CSW Metadata Query

From fmepedia

This workspace demonstrates how to use FME to query a deegree-csw (http://www.deegree.org/) server that provides OGC Catalog Services (http://www.opengeospatial.org/standards/cat), and process the resulting ISO 19115 (http://en.wikipedia.org/wiki/ISO_19115) geospatial metadata (http://en.wikipedia.org/wiki/Geospatial_metadata).

Note that the same technique should work with other OGC Catalog Service providers as well.

Table of contents

1 Service Configuration 2 CSW GetRecords Queries 2.1 PropertyIsLike Filter Operator 2.2 BBOX Filter Operator 3 Workspace Overview 4 Custom Transformers 4.1 CSWPropertyIsLikeFilterOpCreator 4.1.1 Implementation 4.2 CSWBBOXFilterOpCreator 4.2.1 Implementation 4.3 CSWGetRecordsRequestor 4.3.1 Implementation 4.4 MetadataBoundsExtractor 4.4.1 Implementation 4.5 MetadataFIDExtractor 4.5.1 Implementation 4.6 MetadataCRSExtractor 4.6.1 Implementation 4.7 MetadataTitleExtractor 4.7.1 Implementation

Service Configuration

Please see the CSW Metadata Insert example for more information regarding the setup & configuration of a deegree csw service.

CSW GetRecords Queries

The general form of a GetRecords request looks like this:

  <GetRecords>
     <Query typeNames="csw:Record">
        <Constraint version="1.1.0">
           <ogc:Filter>
           </ogc:Filter>
        </Constraint>
     </Query>
  </GetRecords>

Each GetRecords query requires a single filter element that can contain a potentially complex filter expression. Potential filter operations include: PropertyIsEqualTo, PropertyIsNotEqualTo, PropertyIsLessThan, PropertyIsGreaterThan, PropertyIsLessThanOrEqualTo, PropertyIsGreaterThanOrEqualTo, PropertyIsLike, and BBOX. Additionally logical operators such as And, Or, and Not are also supported.

This workspace contains two custom transformers that can generate the XML corresponding to PropertyIsLike, and BBOX filter operators.

PropertyIsLike Filter Operator

The PropertyIsLike operator performs a wildcard match on a specified property. The following parameters can be specified:

• PropertyName: The name of the property
• Literal: The string to match against property values.
• wildChar: A character that is interpreted as 'match multiple' within the match string.
• singleChar: Similar to wildCard, but matches a single character only.
• escapeChar: The character used to escape the wildChar or singleChar if they occur within the match string for purposes other than matching.

The following is the XML representation of a PropertyIsLike operation

   <ogc:PropertyIsLike wildCard="%" singleChar="_" escapeChar="\">
       <ogc:PropertyName>AnyText</ogc:PropertyName>
       <ogc:Literal>%YourLiteral%</ogc:Literal>
   </ogc:PropertyIsLike>

BBOX Filter Operator

The BBOX operator perfroms a spatial bounding box match on records whose bounding box is enclosed by the specified bounding box.

The following is the XML representation of a BBOX operation

   <ogc:BBOX>
       <ogc:PropertyName>apiso:BoundingBox</ogc:PropertyName>
       <gml:Box>
           <gml:coordinates>1,0 19,56</gml:coordinates>
       </gml:Box>
   </ogc:BBOX> 

Workspace Overview

The attached query demo workspace demonstrates how FME can be used to perform a 'PropertyIsLike', and a 'BBOX' query. Each query is constructed, executed, processed to create a single FME feature per metadata record. Where possible, the bounding box of each metadata record is converted into a FME polygon geometry on the feature.

The first query requests all records by using a '%' wildcard on the 'apiso:identifier' property. The bounding boxes of the return records are accumulated, resulting in a single bounding box that corresponds to the bounds of the entire area of query results. This bounding box is then used as the parameter for a bounding box query.

As one would expect, in this particular case the resulting records are identical.

The workspace has been broken in to several component custom transformers to make it easier to understand the workflow & facilitiate reuse.

Note: This workspace implements a small subset of the CSW GetRecord query options, and only extracts a subset of the resulting metadata. As we dig through the details of how the workspace functions, it should become obvious how it could be easily extended as neccesary.

Custom Transformers

CSWPropertyIsLikeFilterOpCreator

This transformer generates the XML for a PropertyIsLike filter operation, and places the result in the specified feature attribute. In addition to the property name, and matching string, the wildcard, singlechar, and escapechar can also be specified. The name of a destination attribute must be specified.

Implementation

The transformer uses a PythonCaller to generate the XML fragment based on the specified parameters.

CSWBBOXFilterOpCreator

This transformer generates the XML for a BBOX filter operation, and places the result in the specified feature attribute. Other than the name of a destination attribute, there are no parameters; the transformer will use the calculated bounding box of the input feature.

Implementation

The transformer uses BoundsExtractor to calculate the input feature's bounding box, and generates the XML fragment using a PythonCaller.

CSWGetRecordsRequestor

This transformer builds the GetRecords request, and then creates features containing each metadata record,

Implementation

MetadataBoundsExtractor

Extracts the geographic extent from the metadata record, and creates a corresponding polygon geometry on the feature.

Implementation

MetadataFIDExtractor

Extracts the id from the metadata and creates a corresponding fme attribute.

Implementation

MetadataCRSExtractor

Extracts the coordinate system from the metadata, and attempts to set the coordinate system on the feature.

Note: This will only work if the metadata record and FME use the same CRS naming convention.

Implementation

MetadataTitleExtractor

Extracts the title property from the metadata and creates a corresponding fme attribute.

Implementation