ESSnet on SDMX phase II October 27 - 28, Koln Dario Camol ISTAT - Italian National Institute of Statistics Division of Users’ Needs, Integration and Territory
Dec 23, 2015
ESSnet on SDMX phase II
October 27 - 28, Koln
Dario CamolISTAT - Italian National Institute of StatisticsDivision of Users’ Needs, Integration and Territory
Objectives of ESSnet on SDMX phase II
• Implementation of SDMX at international or national level;
• the further development of the SDMX technical standards used
for data and metadata;
• the further development of the SDMX Content-oriented
Guidelines;
• the further development and use of the SDMX service
infrastructure and IT tools;
• the increase of the SDMX capacity and knowledge.
SISAI ESSnet workshop
October 27 - 28, Koln
General information on ESSnet
Countries: Bulgaria, Italy, Slovak Republic and Sweden.
Coordinator: Italy.
Amount: 595,492 euro (70% contribution from EC).
Starting date: 28.03.2011
Duration: 18 Months.
WPs proposed: 4 Work packages + Management.
ESSnet workshop
October 27 - 28, Koln
Work packages presented
• WP1 - Management of the action (IT)
• WP2 - PC-Axis SDMX integration phase II (SE)
• WP3 - Support of SDMX application for Micro Data handling (SK)
• WP4 - Harmonization of existing SDMX tools (IT,BG)
• WP5 - Capacity building actions (IT)
ESSnet workshop
October 27 - 28, Koln
WP2 – PC-Axis SDMX integration phase II
Integration of the PC-Axis environment with SDMX
ESSnet workshop
October 27 - 28, Koln
The PC-Axis environment
A family of programs:
• PC-Axis/PX-Web
• PX-Edit
• PX-Make
• PX- Map
A network of members:
• 58 International members
• 17 Swedish members
ESSnet workshop
October 27 - 28, Koln
WP2 – PC-Axis SDMX integration phase II
Starting point (ESSnet phase I):
SDMX-RI
SQLDatabase
PC-AXIS Environment
ESSnet workshop
October 27 - 28, Koln
SDMX-RI
PC-AXIS Environment
WP2 – Activities and gantt
Activities:
o Test of the architecture already in place.
o Process description & diffusion of process.
o Further implementation:
• Add attributes at cell level (PX-Web),
• Implementation of a Generic SDMX data file for visualization (PX-
Web).
o Integration of the User Manual of the process with more types of
statistics.
ESSnet workshop
WP2 – Main deliverables and Progress reportESSnet workshop
Deliverables:
Software: a new version of PX-Web (.Net version).
Documentation: a more complete User’s Manual about the architecture.
Workshop: for Pc-Axis community and for other NSIs, in which will be
described the process and tools used (16-18 April 2012, the third day).
Progress report:
Testing the architecture.
October 27 - 28, Koln
WP3 – SDMX for Micro-data handling
Support the description and the export of Micro Data in SDMX format
ESSnet workshop
October 27 - 28, Koln
WP3 – SDMX for Micro-data handling
Starting point (ESSnet phase I): :
QuestionnaireMetadatabase
Questionnairedata
SDMX MetadataEditor E-Collect-X
Questionnaire definitionUser
RespondentUser
ESSnet workshop
October 27 - 28, Koln
WP3 – SDMX for Micro-data handling
QuestionnaireMetadatabase
Questionnairedata
MappingStore
DSD generator
DSD
SDMX-RI
SDMX Data Generator
Data Retriever
ESSnet workshop
SDMX-RI
MappingAssistant
October 27 - 28, Koln
Data retriever
Activities
o Development of “DSD generator”.
o Test of the tool with two pilot projects.
o Enhancement of E-Collect-X application with more complex calculations.
o Analysis of DDI vs SDMX standard.
WP3 – Activities and ganttESSnet workshop
October 27 - 28, Koln
WP3 – Main deliverables and Progress reportESSnet workshop
Deliverables
Software: “DSD generator” application and enhancement of E-Collect-X
Documentation:
• user and system documentation of “DSD generator”
• a report on the results of the pilot projects
• a report on the result of DDI vs SDMX analysis
Progress report
• Development in progress of the “DSD generator”.
• Enhancement in progress of the E-Collect-X functionalities.
• First study of DDI for Micro data handling.
October 27 - 28, Koln
WP4 – Harmonization of existing tools
Provide the necessary instruments to reuse some modules of SDMX-RI
Integration of the “Loader” application into the SDMX-RI framework
ESSnet workshop
October 27 - 28, Koln
Activities:
o Analysis of the source code of the modules: sdmx_model , sdmx_io, DataGenerator and QueryParser. (Italy .NET, Bulgaria Java)
o Realization of step-by-step tutorials on two examples that reuse some of the modules.
o Loader development: merge of two software modules from Istat SDMX framework (http://bms.istat.it/sodidownload) and to be integrated in the SDMX-RI framework. The merge will include:
• interaction with Mapping Store, • rewriting of the code in C#, • use of modules developed by Eurostat in order to guarantee coherence and maintainability.
WP4 – ActivitiesESSnet workshop
October 27 - 28, Koln
WP4 – Gantt and main deliverablesESSnet workshop
Deliverables
Documentation:
• A technical paper on the analysis of the modules of the SDMX-RI
(intermediate deliveries are scheduled according to the timetable
defined by Eurostat for the modification of the modules);
• Step-by-Step tutorials on two examples;
• Documentation about the Loader application
Software: Loader application.
October 27 - 28, Koln
Progress report (Bulgaria):
• Analysis of the documentation on the SDMX-RI.
• Start of the source code analysis about “sdmx_model” and “QueryParser“
modules and releasing of a first draft document.
Progress report (Italy):
• Development in progress of the first example and production of a draft
step-by-step tutorial.
• Start of the development of the second example.
• Release of a draft analysis document of the Loader application.
ESSnet workshop WP4 – Progress report
October 27 - 28, Koln
WP5 – Capacity Building
Increasing of knowledge on SDMX
ESSnet workshop
October 27 - 28, Koln
Activities
o Producing a Handbook on “How to use SDMX” for statisticians
o Workshop on SDMX based on the model of UNESWA (United Nation's Economic and Social Commission for Western Asia's) for IT staff and statisticians
WP5 – Activities and ganttESSnet workshop
October 27 - 28, Koln
WP5 – Main deliverables and Progress reportESSnet workshop
Progress report
• definition of the agenda of the workshop
• proposal for a skeleton of the Handbook
Deliverables
Documentation:
• A handbook on how to use SDMX
• Workshop documentation: agenda, slides, workshop user guide
Workshop: for all the EU countries (16-18 April 2012, the first and
second day)
October 27 - 28, Koln
Next activitiesESSnet workshop
WP2
Start the upgrade of the User’s Manual
WP3
Continue the development of the “DSD generator”
WP4
• Start the development of the first example (BG)
• Start the analysis of the source code of the “QueryParser”
module (IT)
WP5
Start the production of the Handbook
ESSnet workshop ESSNet web site
http://www.essnet-portal.eu/
October 27 - 28, Koln
ESSnet workshop ESSNet web site
October 27 - 28, Koln
ESSnet workshop ESSNet web site
October 27 - 28, Koln
ESSnet on SDMX phase II
October 27 - 28, Koln
Dario CamolISTAT - Italian National Institute of StatisticsDivision of Users’ Needs, Integration and Territory
Thank you…