e2edm impl seadatanet

Views:
 
Category: Entertainment
     
 

Presentation Description

No description available.

Comments

Presentation Transcript

SeaDataNet TTG meeting: 

NODC, Russia SeaDataNet TTG meeting Paris, 18-19 May Overview and potential use of E2EDM technology for SeaDataNet Sergey Belov, Nick Mikhailov

Slide2: 

Scope NODC, Russia E2EDM provides following functionality: Wrapping local data systems Mapping local codes and dictionaries Data discovery, delivery and processing (export and data production from delivered data) Integrated and secured online access to the distributed data E2EDM is integrating operational and delay-mode time scale data (oceanographic and marine meteorological data) from multiple data formats and multiple data providers in different geographic regions.

Slide3: 

NODC, Russia Basis NODC, Russia Concept model Namespace Metadata/data objects specifications Data exchange protocol Software components

Slide4: 

NODC, Russia E2EDM concept model NODC, Russia Providing formalization, identification, description and interpretation for main model objects: Data source Resource User (in particular cases – external application) Model is based on the following structured semantic objects: Element Class - set of elements Record - set of classes These semantic objects defines: Granularity and description for original and transferred data Metadata description Codes and dictionaries unification Data and user policy

Slide5: 

NODC, Russia NODC, Russia E2EDM namespace NODC, Russia Defines metadata and data structures in terms of XML scheme. Within E2EDM consists of two sub-namespaces: global and conceptual (thematic). Global namespace – structures for the model objects Conceptual (thematic domain) namespace – list of thematic elements dealing with grouping, e.g. some discipline and available for discovery and exchange Both designed in XML Schema. Global XML Schema (ISO 19115 + WMO Core Metadata + CDI) Concept XML Schema (DiGIR) XML Schemas are also used for validation and development issues (XML Schema -> UML -> software design)

Slide6: 

NODC, Russia NODC, Russia E2EDM metadata objects specifications NODC, Russia More than 100 elements, 27 classes, 7 metadata records and 4 data records

Slide7: 

NODC, Russia NODC, Russia E2EDM data objects specifications NODC, Russia E2EDM data records, based on NetCDF: E2EDataPoint – for point data E2EDataProfile – for profile data E2EDataGrid – for grids E2EDataObject – object files (http-based and local) Common transport NetCDF construction

Slide8: 

NODC, Russia NODC, Russia E2EDM data objects specifications (II) NODC, Russia Classes and data constructions relationship: <E2EObjectHierarchy> <objectHierarchyLevel>1</objectHierarchyLevel> <objectHierarchyList>objectSystemId, objectHierarchyId, countryId, organizationId, dateTime, Latitude, Longitude, platfType, platformId, platformName</objectHierarchyList> <objectHierarchyId>platformId</objectHierarchyId> <instanceId>platformId</instanceId> </E2EObjectHierarchy> <E2EObjectHierarchy> <objectHierarchyLevel>2</objectHierarchyLevel> <objectHierarchyList>DEPH, TEMP, PSAL</objectHierarchyList> <objectHierarchyId>dateTime, Latitude, Longitude</objectHierarchyId> <instanceId>dateTime</instanceId> </E2EObjectHierarchy>

Slide9: 

NODC, Russia NODC, Russia NODC, Russia E2EDM data exchange protocol NODC, Russia Data exchange protocol is responsible for data requesting and data retrieving. Request message (XML) Response message (XML) Transport data file (NetCDF,v.2.2)

Slide10: 

NODC, Russia E2EDM software components E2EDM Data Provider (DP) – set of services, providing interface between local data systems and distributed system. Must be plugged on the local system. Services are using common library (E2EDM API). DP supports data bases, structured and object data files. E2EDM Integration Server – set of services, providing security issues, resource catalogue maintenance and communication with DP (discovery, requesting and retrieving data)

Slide11: 

NODC, Russia E2EDM Architecture Integration Server layer Communication layer Data Provider layer Local data system layer External layer

Slide12: 

NODC, Russia Integration Server. Features Metadata update & maintenance (automatic) Resource catalogue management Discovery services for data, metadata and common codes Request/response communication service Data sources monitoring Downloading services (for obtaining data files, metadata, resource and instance descriptions synchronization) Export tools (e.g. export in XML from E2EDM resource description into WMO Core Profile, to ASCII) HTTP GET/POST (REST) and Web service interfaces Security service Schedule mechanisms Administration tools (CRM, CMS)

Slide13: 

NODC, Russia Data Provider. Features Data source/resources registry and metadata update Codes and dictionaries mapping Request handling Access to the local data source (DBMS, files) Data extraction based on search criteria Transport data file generation HTTP GET/POST (REST) and Web service interfaces Security service Schedule mechanisms Administration tools (online maintenance for resource and instances)

Slide14: 

NODC, Russia General data exchange scheme User Integration Server Interface layer (HTTP, Web-services) request Data Provider Data Provider Data Provider Request message reply Transport data file Transport data file Response message

Current operational status of E2EDM : 

NODC, Russia Current operational status of E2EDM E2EDM was originated as one of the JCOMM/ETDMP pilot projects in 2003 MetOffice, UK IFREMER, France VLIZ, Belgium NODC, Russia

Slide16: 

NODC, Russia Pilot project data sources The following data sources are involved in the E2EDM prototype Historical marine meteorological data Historical ocean cruise data Real-time GTS ocean (BATHY and TESAC) data Real-time GTS ocean (TESAC/ARGO data) Real-time GTS (SHIP) data Monthly climatic fields of ocean parameters (imageries) Ocean SST satellite data Geographic area – North Atlantic (test-area)

Slide17: 

NODC, Russia Pilot project data sources The following data sources are involved in the E2EDM prototype Historical marine meteorological data Historical ocean cruise data Real-time GTS ocean (BATHY and TESAC) data Real-time GTS ocean (TESAC/ARGO data) Real-time GTS (SHIP) data Monthly climatic fields of ocean parameters (imageries) Ocean SST satellite data Geographic area – North Atlantic (test-area)

Slide18: 

NODC, Russia User data access interface – via Integration Server

Slide19: 

NODC, Russia User Data Access interface (cont.)

Slide20: 

NODC, Russia E2EDM Web site http://data.meteo.ru/e2edm/ E2EDM Integration Server - IODE Project Office (VLIZ) http://e2edm.vliz.be - RIHMI-WDC (mirror) http://data.meteo.ru:8080/iserv/ User data access interface (cont.)

Slide21: 

NODC, Russia E2EDM using for SeaDataNet

Slide22: 

NODC, Russia E2EDM adaptation for SeaDataNet JRA2 - Technical development of the interoperable system: E2EDM covers many of JRA2 tasks, but all actions & decisions should be discussed. E2EDM model deepness is enough for many of the SeaDataNet positions. ( + - there is solution in E2EDM) Discovery services Metadata update & maintenance + Potential decision: CDI adoption. Security services Data access level + Transferred data size level + Delivery services Downloading services + Viewing services Developed user interface, libraries, external tools (based on NetCDF) +

Slide23: 

NODC, Russia Thank you! Questions?

authorStream Live Help