Eurostat SDMX Reference Infrastructure: Tools demonstration November 2015 Eurostat Unit B3 – IT and standards for data and metadata exchange Jean-Francois.

1

Eurostat

SDMX Reference Infrastructure:Tools demonstration

November 2015Eurostat Unit B3 – IT and standards for data and metadata exchange

Jean-Francois LEBLANCChristian SEBASTIAN

Eurostat

2

Table of Contents

1. Objectives2. What do we need before the demo3. SDMX RI4. Mapping Assistant

1. First Start2. Category Scheme creation3. Categories creation4. Addition of the NA_MAIN DSD5. Addition of the dataflow definition6. Dataflow categoristaion 7. Connection to the dissemination DB

Eurostat

3

Table of Contents

8. Dataset creation9. Mapping Set creation10. Mapping between the dissemination DB and the DSD11. Transcoding

5. NSI Client1. Welcome screen2. Pivot Table3. Result of an SDMX query

Eurostat

4

1. Objectives

• Launch Mapping Assistant for the first time• Configure mapping store database (MASTORE_DB)• Setup a dissemination tree for National Accounts• Create a mapping between a NA DSD and the

sample disseminiation database• Download a file to PUSH data• Show a web interface PULLing data

Eurostat

5

2. What do we need before the demo

• Install Microsoft SQL Server Express 2014• Create an empty database MASTORE_NA• Create a demo database NA with some sample data

• Install SDMX-RI tools (xcopy ultimate versions)• Mapping Assistant .net 5.4.0• TestClient .net 4.4.1• NSI Web Service .net 4.3.0• NSI Web Client .net 3.4.1• Configured Web Service and Web Client in IIS• Downloaded SDMX-NA package (DSDs, Dataflows, Excel

templates)

Eurostat

6

3. SDMX Reference Infrastructurehttps://webgate.ec.europa.eu/fpfis/mwikis/sdmx/index.php/SDMX_Reference_Infrastructure_SDMX-RI

Data Provider Data Collector

Non-SDMXlocal database

SDMX data set

SDMX Registry

DSD

SDMX-RI

Mapping Assistant

Web Svc

Test Client

Web Client

Eurostat

7

4.1 Mapping Assistant : first start

1 2

3

4

Eurostat

8

4.2 Category Scheme creation

1

2

3

4

No

Eurostat

9

4.3 Category creation

Note:

The Category Scheme and the Catgories below represents the "navigation tree" of the dissemination system. It can be customised as you wish. It will be displayed like you set it up here in the web client later on.

In that example we only create a single Category.

Eurostat

10

4.4 Addition of the NA_MAIN DSD

Note:

Browse to• Desktop

• Workshop• SDMX-NA

• DSDs

And choose• ESTAT+NA_MAIN+1.4

Then wait a few seconds…

Eurostat

11

4.5 Addition of the dataflow definition

Note:

The download contains all National Accounts dataflows, but we only imported the NA_MAIN DSD.

Thus an error may appear for non-NA_MAIN dataflows, which you can ignore.

Browse for:

C:\SDMX Training\Sources\Structure Files

Eurostat

4.6 Dataflow categoristaion

2 possibilites:

Drag & drop

Or

Right-click Attach

1

2OK

12

Eurostat

13

4.7 Connection to the dissemination DB

Settings:

NA-ConnectionSqlServer

localhost\SQLEXPRESSNA√ Enter login/password

Test connection Save

Eurostat

4.8 Dataset Creation

14

1 2

3

4

Eurostat

15

Select table and click OK

Eurostat

16

4.9 Mapping Set creation

Eurostat

17

4.10 Mapping between the dissemination DB and the DSD

Eurostat

18

Dataset DSD Comment

FREQ FREQTIME_FORMAT

Transcode:A A, P1Y

ADJUSTMENT ADJUSTMENT Transcode:NOT_ADJ N

Others 1:1

REF_AREA Constant: AT

COUNTERPART_AREA Constant: W2

INSTR_ASSET Constant: _Z

REF_PERIOD_DETAIL Constant: C

DECIMALS Constant: 2

TABLE_IDENTIFIER Constant: T0103

UNIT_MULT Constant: 6

COMPILING_ORG Constant: AT1

Eurostat

19

4.11 Transcoding

Eurostat

20

Eurostat

21

5.1 NSI Web Client : Welcome screen

Eurostat

22

5.2 Pivot table

Eurostat

23

5.3 Result of an SDMX query