STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to...

16
STATUS OF THE SDMX IMPLEMENTATION AT INEGI 7th Meeting of the Expert Group on SDMX 27 October 2014, Seoul, Korea

Transcript of STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to...

Page 1: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

STATUS OF THE SDMX

IMPLEMENTATION AT INEGI

7th Meeting of the Expert Group on SDMX

27 October 2014, Seoul, Korea

Page 2: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

ON PRODUCTION

Page 3: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

INEGI’s site has an SDMX section

which is open to the public Contains: • Descriptions and tutorials to understand the

standard • Links to download SDMX tools from CIRCA • URL building interface for querying the REST

web service • Download of dataflows, DSDs, code

lists • Guides to make use of the web services

• Explanations and examples on how to make graphs to visualize the flows

• Developers section

Page 4: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

SDMX Infrastructure at INEGI

DSW v1.2.7

Produces DSD

Mapping Assistant v2.9.0

Mapping

Dissemination Databases

Queries

SDMX-RI v2.4.4

REST (SDMX 2.1 final)

SDMX-RI v4.0.6

REST (SDMX 2.1 final)

Uses

Produces Produces

Test Production

SDMX Dataflow

XML JSON CSV XML

Uses

SDMX Dataflow

Mapping Assistant v3.1.3

Page 5: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Additional formats supported

• JSON (since 2012)

• JSONP (since 2012)

• CSV (since 2012)

Page 6: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Collection Tools

• Portable versions of Mapping Store and

Mapping Assistant (2.9)

– Generation of CSV based on DSD

– Oriented to collect information from institutions with

limited computational resources

Page 7: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Available SDMX Flows

• Short Term Economic Indicators (STEI)

• Short Term Economic Statistics (STES)

• Quarterly Gross Domestic Product (GDP)

• Goods Commercial Trade of Mexico: – HS2007, years 2010-2011

– HS2012, years 2012-2013

• Millennium Development Goals Indicators (MDG).

• Infra Annual Labor Indicators – Quarterly

– Monthly

Page 8: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

UNDER DEVELOPMENT

Page 9: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Renewing the SDMX Infrastructure

• Adoption of the new Eurostat’s SDMX RI which

implements the CommonAPI

– Testing

– 17x time improvement

Page 10: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

New version of the SDMX Section

• Better look and

responsiveness

• Implementation of new

visualization

components based on

D3 and AngularJs

Page 11: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Domestic exchange

• Pilot test to collect information from a Federal

Department

– Identification of technical capabilities to select

prospective partners

– Planning and agreement building

– Adapting RI components

Page 12: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Collaboration with other Countries

• Collaborating with ILO to review the DSDs – 47 DSD with 90 concepts each

• Joint collaboration with ISTAT for Implementing the CommonAPIs – We have reviewed the actual

implementation, now we are going to start filling the gaps

Page 13: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Updating SDMX Flows • Quarterly GDP

– Adoption of SDMX National Accounts-Data Structure Definition (NA-DSD)

• Commercial Trade of Mexico – Adoption of the DSD from UNSD to provide information to

COMTRADE

• MDG indicators – New DSD with additional Indicators from Mexico

• Labor Statistics – Pilot test of new dataflows for ILO

Page 14: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Conclusions

• SDMX implementation has become a mix of project and continuous process

• New version of SDMX has brought a necessary (r)evolution of technical and conceptual aspects

• The new RI-SDMX with the Common API is elegant but it needs to be complemented with “Custom Data Formats” for CSV and for JSON, in Structures and in Data

• SDMX need to still relevant in the age of the “Data Revolution”

Page 15: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

QUESTIONS?

[email protected]

Page 16: STATUS OF THE SDMX IMPLEMENTATION AT INEGI · INEGI’s site has an SDMX section which is open to the public Contains: • Descriptions and tutorials to understand the standard •

Conociendo México

01 800 111 46 34

www.inegi.org.mx

[email protected]

@inegi_informa INEGI Informa