April, 2004 Lars Thygesen International Trade Expert meeting Whats going on at OECD: statistical information management.

April, 2004

Lars Thygesen

International Trade Expert meeting

What’s going on at OECD: statistical information

management

April, 2004 2

Data collection from Member countries

April, 2004 3

Modes of data collection

standard questionnaire “send what you’ve got” web queries from web site

April, 2004 4

Quality

transmit on the day of publication available on web site for download follow specified format correct translation of codes

April, 2004 5

Highlights from a survey

numerous cases of missing data (national accounts)

short and long delays some errors and re-sendings

April, 2004 6

What can be done?

Short term: Remove obstacles? Long term: New methods?

April, 2004 7

What is SDMX?

Statistical Data and Metadata eXchange develop and employ more efficient

business processes for exchange and sharing of statistical information and metadata

Standards

April, 2004 8

And why is OECD interested?

Questionnaires: heavy reporting burden similar questionnaires for other IOs timeliness error prone heavy burden on OECD

April, 2004 9

What we hope to gain

more efficient reporting, i.e. less burden on countries as well as on OECD

automated procedures which are less error prone

more timely reporting and, consequently, dissemination

enhanced coordination with other international organisations

April, 2004 10

Aligned Projects

Exchange of national accounts data between the OECD and Member countries (NAWWE)

Joint UN/OECD Foreign Trade Statistics project (Comtrade)

April, 2004 11

<?xml version="1.0"?><OECD.STAT xmlns:xsd=...>

<Value>AUSTRALIA</Value> </Data> ……

NAWWE:NAWWE: Data FlowData Flow

<?xml version="1.0"?><OECD.STAT xmlns:xsd=...>

<Value>CANADA</Value> </Data> ……

<?xml version="1.0"?><OECD.STAT xmlns:xsd=...>

<Value>AUSTRALIA</Value> </Data> ……

XML Data Files

XML Data Files

ExcelTables

<?xml version="1.0" encoding="UTF-8"?><xs:schema xmlns:xs="http:..XML"...> <xs:element name="Code"> <xs:complexType/> </xs:element>…….

SDMX BasedXML Schemas

Defines Dimensionsand Data Structure

Copied XML Files

<?xml version="1.0"?><OECD.STAT xmlns:xsd=...>

<Value>CANADA</Value> </Data> ……

OECD Web Server

XML Files ValidatedBy Schema

XML Files Copied toServer

Web Application

Navig

ati

on

Con

ten

t

Upload to SNA Databaseor Output toOther Format

Structural XML<?xml version="1.0"?><OECD.STAT xmlns:xsd=...>

<Value>STRUCTURE</Value> </Data> ……

April, 2004 12

OECD’s newStatistical Information System

April, 2004 13

Overall goals

User friendliness– One-stop database– Easy access– Common look and feel of all products

Efficiency– Common tools– Easy access across OECD

Quality– Coherence of concepts & data– Timeliness– Good metadata– Review of processes

Flexibility– Separate storing, process, presentation

April, 2004 14

OECD.Stat

The central repository ("warehouse") where validated statistics and related metadata destined for publication and/or sharing are stored

April, 2004 15

SIS Architecture

Production Storage Dissemination

Data ProductionEnvironments

(incl. StatWorks)

MetaStore

Metadata Production

Environment

XML

User Interfaces

PubStat

Publication ManagementInterface

PublishedOutputs

Work flow

Cubes

Web Services

OECD.Stat Corporate Data Warehouse

XML

April, 2004 16

Metadata principles

All statistical data being shared or disseminated, internally or externally, must have appropriate metadata

Statistical metadata must be consistent All metadata must be created only once

April, 2004 17

QualityReview

Statistics X

Quality problems

Recommen-dations

SISMigration

Plan

April, 2004

The End