CountryData SDMX for Development Indicators Metadata in DevInfo: Creation, Mapping and Registration.

CountryDataSDMX for

Development Indicators

Metadata in DevInfo:

Creation, Mapping and Registration

Metadata

• According to the ISO;

“Metadata is data that defines and describes other data.”

• Perhaps, better visualized as layers within a pyramid.

• Information describing the data is more detailed as one moves down from the top of the pyramid.

“Structural” metadata

1. At the top of the pyramid is information essential for understanding the data

• Needs to explain the ‘basics’ of when, where, who and what?

Reference metadata

2. In the middle are explanatory notes and text generally located in the same “publication” provides a good description of the statistics

• definitions, key issues, limitations, etc., that can impact on the use of the data.

Methodological metadata

3. Detailed methodological information disseminated in publications / websites.

• These are potentially the source of the most detailed methodological information available.

• Some statistical agencies publish very detailed concepts, sources and methods for a number of their key statistics.

CountryData Metadata Structure Definition (MSD) background

Developed by UNSD for CountryData Supports exchange of CountryData Indicator

metadata between countries and UNSD Implemented in SDMX 2.0 Design to exchange higher level reference

metadata Latest version (1.0) finalised in Dec 2012

DevInfo (Di) background

Data and metadata dissemination software supported and promoted by UNICEF

DevInfo7 (Di7) launched in Nov 2012 7 out of 11 project countries plan to

share metadata through DevInfo Good support for metadata collation and

exchange.

Mapping to the MSD Metadata mapping from DevInfo to MSD is much simpler than data mapping.

MSD structure is simpler and no part is mandatory.

Expectation that at least “Definition”, “Method of Computation” and “Process of obtaining data” are available.

Open metadata in admin tool…

Set metadata structure…

Edit metadata by indicator…

Export list to excel…

Export all or selection…

Create/ choose excel file…

Open excel file and edit…

Import file into di database…

Select excel file used to edit…

Import excel file used to edit…

New metadata imported…

Once the metadata is entered into the database, then can use “DX Remote Access” to update di7 web-based software in same way as data

Once metadata exists in di7 web then metadata can be mapped and published which conforms with the CountryData MSD.

Like for data, this is all done online through the di7 web-based repository through the administration profile, so let’s begin…

Di Mapping Tool: Introduction

Getting Started…

Scroll down to ‘Registry’ menu

Log onto administrative profile

Prepare the Dbase for mapping

Prepares the SDMX artifacts

If DSD in place, ready to map…

Metadata mapping

To map metadata,

First, map the associated time series through (1st

stage) codelist and (2nd stage) IUS

Once this is complete move to mapping metadata

Metadata mapping

Metadata mapping

MSD Concepts

Definition of the MDG official indicator or background series provided

Describes the basic definition and includes references to standards and classifications and clarification of technical terms included in the definition.

Method of computation Describes the algorithm used in the calculation of the indicator, providing the mathematical formula (if applicable). Identifies all statistics used to derive the indicator such as normalizing and weighting variables (for instance, the population). List different methods used by country or agency to compute the indicator and includes hyperlinks to references to the agency international or national methodology adopted if available.

Process of obtaining data Describes the mechanism for gathering data from countries including: (i) the government counterpart at the country level; (ii) description of the existing process of validation and consultation with countries. Describes the process of adjusting country data to allow international comparability. This includes adjustments such as: to a standard classification, age group or to comply with a specific international or national definition.

Comments and limitations Describes comments and limitations of the indicators including issues such as: comparability, sex disaggregating if applicable, presence of wide confidence intervals (such as for maternal mortality ratios). Provides further details on additional non-official indicators commonly used together with the official MDG indicator.

Expected time of release Provide the expected calendar of release for new data for each indicator, by the specialized agencies.

Sources of discrepancies between global and national figures

Describes the main reasons for discrepancy between data and metadata used for national and global monitoring to improve understanding by users of the differences between country-level data disseminated through the MDGs global database and those available in country MDGs databases.

Treatment of missing values Describes the process and provides the mathematical formula to produce the estimates for the indicator when country data are not available.

Data availability Describes (a) country coverage; (b) universe/population of interest; (c) time lag between reference year and actual production of data series; (d) overview of frequency of data production.

Regional and Global estimates

Provides the mathematical formula and describes the method used for the calculation of the regional/global aggregates from the country values. Specifies what types of weights are used for aggregating country indicator values to regional level.

Map Metadata concepts

Confirm mapping saved

Final Step: Register the mappings

Final Step: Select mappings

Final Step: Generate SDMX-ML

Final Step: Complete

Exercise: Publish metadata Use unstats.un.org/unsd/demodiweb[1-6] Username = [email protected] Password = support@2012

Publish/ register the time series for1. “Maternal mortality ratio (MMR)”

2. “Employment to population ratio”

3. “Share of women in wage employment in the non-agricultural sector”

4. “Infant mortality rate”

5. “Land under forest cover”

MSD Maintenance

• The mapping and registry tool allows users to edit and delete the MSD (has to be packaged with the DSD and uploaded in DevInfo).

• For when the MSD is updated, it is recommended to edit the DSD/MSD rather than delete

• MSD/DSD deletion has the effect of removing all the mappings and subscriptions used for that MSD/DSD

MSD Maintenance…

MSD Header…