The Open Data Strategy of Official Statistics in Japan3. The New Open Data Strategy in the New...
Transcript of The Open Data Strategy of Official Statistics in Japan3. The New Open Data Strategy in the New...
The Open Data Strategy of Official Statistics
in Japan
Takao ItouEx‐Director‐General for Policy Planning (Statistical Standards)
Ministry of Internal Affairs and Communications Government of Japan
Session 4 Learning from Good Practices‐Disseminating and Communicating StatisticsInclusive and Sustainable Development in East and North‐East Asia
Strengthening National Capacityto Produce and Use Statistical Information
1. Role of the Director-General for Policy Planning (Statistical Standard
2. Outline of Japanese Official Statistics
3. The New Open Data Strategy in the New Statistics Act (Act No.53 in 2007))
3.1 Fundamental Principles3.1 Fundamental Principles
3.2. More Specific Regulations for the Publication of Statistical Information
in the New Statistics Act
3.3. Other strategies introduced by the New Statistics Act
3.4. My Comments on the Three Strategies
4. Concrete4. Concrete Measures for Improving Statistical Publication Services in JapaMeasures for Improving Statistical Publication Services in Japann
4.1 The Optimization Plan of Operations and Systems for Statistical The Optimization Plan of Operations and Systems for Statistical Work Work
and the Sand the Start of “e-Stat”
4.2. Statistical Survey Operations and the Outline of Inter‐Ministry Information
Systems for Official Statistics (IMISOS)
4.3. Outline of the Portal Site of Official Statistics of 4.3. Outline of the Portal Site of Official Statistics of Japan (Japan (““ee--StatStat””))
4.4. Explanation of the function of 4.4. Explanation of the function of ““ee--StatStat””(examples)(examples)
4..5. Achievements4..5. Achievements
2. Outline
of
Contents
1.政策統括官(統計基準担当)の業務1. Role of the Director-General for Policy Planning (Statistical Standards)
Comprehensive coordination concerning statistics administrationTo plan and design the statistical system, establish statistical standards and coordinate statistical affairs from the viewpoints of systematic development of Japan’s overall official statistics, assurance of trust in statistics, and reduction of burdens on respondents
Comprehensive coordination concerning statistics administrationTo plan and design the statistical system, establish statistical standards and coordinate statistical affairs from the viewpoints of systematic development of Japan’s overall official statistics, assurance of trust in statistics, and reduction of burdens on respondents
Statistics Commission(Cabinet Office)
Statistics Commission(Cabinet Office)
Director-General for Policy Planning (Statistical Standards)
the Ministry of Internal Affairs and Communications
Director-General for Policy Planning (Statistical Standards)
the Ministry of Internal Affairs and Communications◆ Planning, designing and promotion of statistical system・Establishment, revision or abolition of statistics laws and regulations・Preparation of the basic plan for the development of official statistics・To promote the effective use of statistical data; to manage the local government
statistical systems , etc.◆Examining plans and budgets for statistical censuses and surveys・ Examining plans and budgets for statistical censuses and surveys conducted by
each office and ministry
◆ Establishing statistical standards for statistical surveys・ To establish the Japan Standard Industrial Classification, etc.
◆ Cooperation concerning international statistical affairs・ To coordinate international statistical affairs・ Cooperation on the United Nations Statistical Institute for Asia and the
Pacific(SIAP)
Cabinet Office
Cabinet Office
Ministry of Internal Affairs and Communications(Statistics Bureau)
Production of Fundamental Statistics of the state of the Nation
Ministry of Internal Affairs and Communications(Statistics Bureau)
Production of Fundamental Statistics of the state of the Nation
Ministry of
JusticeMinistry of
Justice
Ministry of
Foreign Affairs
Ministry of
Foreign Affairs
Ministry of
FinanceMinistry of
Finance
Ministry of
Education, C
ulture, S
ports, Science
and Technology
Ministry of
Education, C
ulture, S
ports, Science
and Technology
Ministry of H
ealth, Labour and Welfare
Ministry of H
ealth, Labour and Welfare
Ministry of
Agriculture,
Forestry and Fisheries
Ministry of
Agriculture,
Forestry and Fisheries
Ministry of
Economy, Trade
and Industry
Ministry of
Economy, Trade
and Industry
Ministry of Land,
Infrastructure, Transport and Tourism
Ministry of Land,
Infrastructure, Transport and Tourism
Ministry of the
Environment
Ministry of the
Environment
Ministry of
Defense
Ministry of
Defense
3
2. Outline of Japanese Official StatisticsOfficial Statistics Provided by Ministries and Agencies of the Central Government and other public organs including Bank of Japan are divided into the following types
1 Statistics Compiled by Statistical SurveysFundamental Statistics (eg. Population Census )
Important statistics among the statistics that are produced by national governments and designated by the Minister of Internal Affairs and Communications.
51 statistics are designated as Fundamental Statistics as of September 1, 2012.
General Statistics (more than 300)
Statistics other than Fundamental Statistics
In FY2012, more than 220 statistical surveys are scheduled to be undertaken .(monthly, quarterly, annually, biannually, tri‐annually, every five years, and on an ad‐hoc basis)
2. Processed StatisticsStatistics produced by processing survey statistics, administrative statistics and other data.
Fundamental Statistics (5) and Others (eg. SNA )
3. Statistics Compiled by Administrative Data ( more than 300, monthly, quarterly, and on an annual basis)
(eg. Traffic Accident Statistics, Crime Statistics.
These three types are under the jurisdiction of Minster of Ministry of Internal Affairs and Communications (Director‐General for Policy Planning (Statistical Standards)) based on the Statistics Law.The authority of the minister to approve the operation of statistical surveys in type 1 is the strongest one for the coordination of statistical administration in Japan.
Notes1.Some important statistics or important economic data such as “Exchange Rates” are published by non‐governmental public entities. 2.Opinion Polls and other surveys which ask the consciousness of respondents are conducted by Cabinet Office and other ministries and agencies.
3. The New Open Data Strategy in the New Statistics Act (Act No.53 in 2007)
Article 3(1) Official statistics shall be developed systematically through mutual cooperation and the appropriate sharing of roles among administrative organs, etc.
(2) Official statistics shall be produced with appropriate and reasonable methodologies, so as to ensure neutrality and reliability.
(3) Official statistics shall be provided widely for the public so that they are easily accessible for their effective use.
(4) Confidential matters concerning individuals or juridical persons, or other organizations that were used for producing official statistics shall be protected.
NotesBack ground of these principles are the Principles of Official Statistics by the Statistical Commission of UN.
3.1 Fundamental Principles
Publication of Fundamental Statistics, etc. Article 8 (1) The head of an administrative organ shall, when having produced
fundamental statistics, promptly publicize the fundamental statistics and matters specified by the Cabinet Order concerning fundamental statistics through the Internet or through other appropriate methods.
(2) The head of an administrative organ shall, when intending topublicize the fundamental statistics prescribed in the preceding paragraph, specify the date and methods of publication and publicize them through the Internet or through other appropriate methods in advance.
(3) The head of an administrative organ shall preserve informationon fundamental statistics on a long term and systematic basis and take other appropriate measures so that the public may always have easy access to such information.
3.2. More Specific Regulations for the Publication of Statistical Information in theNew Statistics Act
Publication of General Statistics, etc.
Article 23 (1) The head of an administrative organ shall, when having
compiled the results of a general statistical survey, promptly publicize the results of the general statistical survey and matters specified by the Cabinet Order concerning generalstatistical surveys through the Internet or through other appropriate methods; provided, however, that if there are anyspecial circumstances, the whole or a part of them may bewithheld from being publicized.
(2) The provision of Article 8, paragraph (3) shall apply mutatis information concerning the results of general statistical surveys.
Article 3 and 6 (2) of Cabinet Order on Statistics Act (Cabinet Order No.334 in 2008)
Basic Information to be publicized which are necessary for the better understanding and use of statistics
• The matters specified by the Cabinet Order in the first sub‐session of article 8 in the Statistics Act are follows. This provision is applied for both fundamental statistics and general statistics which are compiled by statistical surveys;
1 The title and the purpose of the fundamental statistics.2 The fact that the fundamental statistics are compiled by the fundamental
statistical survey.3 The coverage of the survey4 Matters on which a report is requested and the reference date or period; 5 Individuals/juridical persons/other organizations requested to report; 6 Methods for requesting a report 7 Definition of words used in the statistics or statistical survey8 Other information valuable to the use of the statistics.
3.3. Other strategies introduced by the New Statistics Act
(Secondary Use of Questionnaire Information) Article 32 and 33. (omitted) These provide the use of questionnaire information for statistical
research and preparation of the lists for surveys in order to produce statistics by administrative organs themselves and mutual use among them.
(Production of Statistics, etc. by Entrustment) So-called Order-made Compilation of Statistics Article 34
The head of an administrative organ or an incorporated administrative agency, etc. under Article 25 may conduct the production of statistics, etc. by utilizing questionnaire information pertaining to statistical surveys conducted by himself/ herself in response to request from the public, pursuant to the provision of an Ordinance of the Ministry of Internal Affairs and Communications(MIC), within limits that would not cause any hindrance to the performance of his/her business, when finding that it would contribute to the development of academic researches or in other cases specified by an Ordinance of the MIC.
Notes.1 .Concerning 23 statistical surveys, related administrative agencies have prepared tomeet the request of order‐maide compilation of statistics. A fee is requested.
2. In the past three years, 26 cases concerning 10 statistical surveys have beencompiled. More than half of them were requests for the Population Census.
(Production of Anonymous Data) Article 35
(1) The head of an administrative organ or an incorporated administrative agency, etc.under Article 25 may produce anonymous data by processing questionnaireinformation pertaining to statistical surveys they have conducted. (2) (omitted) Necessary consultation with the Statistics Commission in advance.
(Provision of Anonymous Data) Article 36
The head of an administrative organ or an incorporated administrative agency, etc. under Article 25 may provide anonymous data produced pursuant to the provision of Article 35, paragraph (1) upon a request from the public, pursuant to the provision of an Ordinance of the MIC, when finding that it would contribute to the development of academic researches or in other cases specified by an Ordinance of the MIC.
Notes.1.Contents of Ordinance of the MIC; only for statistical compilation, only for academic research, the publication of the results and appropriate management of the data.
Necessary fees are also required.2.Until the end of March 2012, anonymous data of 6 Fundamental Statistics has been prepared for a certain period of time, and in 60 cases they have been used.
3.4. My Comments on the Three Strategies
The principles concerning dissemination of official statistics described in Article 3 and specific regulations described in Articles 8 and 23 in the Statistics Act of Japanare very important rules concerning the publication of official statistics and theseare common rules for many NSOs/administrative agencies providing official statistics.
2. Concerning the so‐called order‐made compilation of questioner information collected by government statistical surveys and provision of anonymous data,there are of course a few needs . However, there are some problems related to these matters. In Japan, one of the main needs from business sectors is the use of individual data, and such needs interfere with the confidentiality of respondent information.Concerning the provision of anonymous data, its development began from surveys of individuals and households, relatively large scale surveys and the surveys of high interest . However the actual use of such data is not common.Anonymous data of surveys on business sectors are still undeveloped because it is very difficult to keep the confidentiality of business entities.Furthermore these measures are high‐cost and require techniques including ICT. Therefore, I am rather skeptical on these matters from the viewpoints of cost‐effectiveness.For each NSO, it is very important to consider priorities in these matters.
4. Concrete Measures for Improving Statistical Publication Servicesin Japan
4. Concrete4. Concrete Measures for Improving Statistical Publication ServicesMeasures for Improving Statistical Publication Servicesin Japanin Japan
○ In 2003, the Japanese government made a government‐wide strategic plan in order to construct an “e‐government” as a part of administrative reform.
○ In many administrative fields , optimization plans of operations and systemswere established.
○ “The Optimization Plan of Operations and Systems for Statistical Work” was adopted in 2006 for the following purposes.▪ to improve public statistical services▪ to improve convenience and security of responses by survey respondents▪ to reduce public statistical work load▪ to save public statistical expenditure▪ to centralize the statistical information systems
4.1 The Optimization Plan of Operations and Systems for StatisticalThe Optimization Plan of Operations and Systems for StatisticalWork and the Work and the Start of “e‐Stat”
The statistical information systems of different ministries wereThe statistical information systems of different ministries were integrated into the integrated into the
““InterInter‐‐Ministry Information System for Official Statistics (IMISOS)Ministry Information System for Official Statistics (IMISOS)”” in2008.in2008.
Copyright (c) Statistics Bureau, 2011. All rights reserved. 14
PublicationTabulationTabulationField worksPreparation forfield worksPlanning
4.2. Statistical Survey Operations and the Outline of Inter‐Ministry Information System for Official Statistics (IMISOS)
Government Statistics Sharing Center(Application Service Provider: ASP)
Statistical geographic information systemAuthentication system
Regional statistics analysis system
Portal site of G
overnment statistics (
e-Stat)
Statistical table management system
Statistical information database
Standard region code management system
Statistical classification database
Survey item database
Authentication
Portal site of Government online survey(Online survey system)
Enumerator management system
Establishment and enterprise database
利用機関総合窓口(業務ポータルサイト)
※ASP:Enterprises which provide user organizations with business information systems through network.
Operator: Incorporated Administrative Agency “National Statistics Center”
Administrative agencies
(as statistics users)
Population surveyed
Administrative agencies
System
of ministries
and agencies
Portal site of G
overnment statistics
(e-Stat
)
Portal site for user organizations (Portal site for operations)
Survey item database
Standard region code management system
Statistical information database
Statistical table management system
Statistical classification database
Portal site of Government online survey(Online survey system)
Enumerator management system
Establishment and enterprise database
Kasum
igaseki WA
N・
LG W
AN
Statistics users
Internet
Authentication
Subsystems of the Inter-Ministry Information System for Official Statistics are used in each phase of statistical survey operations, namely “planning”, “preparation for field works”, “field works”, “verification”, “tabulation” and “publication”The following chart shows available system applications for each phase.This system is managed by the Bureau of Statistics and operated by the National Statistics Center with the cooperation of
other Ministries and Agencies.
Verification
15
4.3. 1 Outline of the Portal Site of Official Statistics of Japan (“e‐Stat”)
4.3. 1 Outline of the Portal Site of Official Statistics of Japa4.3. 1 Outline of the Portal Site of Official Statistics of Japan (n (““ee‐‐StatStat””))
The “e‐Stat” site provides a “One‐Stop‐Service”
collects and integrates statistical information from the websites of all ministries
provides various statistical services via the Internet
http://www.e‐stat.go.jp/SG1/estat/eStatTopPortalE.do
17
18
4.4. Explanation of the function of “e‐Stat”(Example )4.4. Explanation of the function of 4.4. Explanation of the function of ““ee‐‐StatStat””(Example(Example ))
Search for Statistics e‐Stat saves Excel, CSV or PDF files of statistical tables
Users can search by keyword, theme, and ministries
Users can browse, download, and draw out tables and graphs
Easy Access to Main Statistics Users can gain an understanding of the latest statistical indicators through numbers and graphs
4.4. Explanation of the function of “e‐Stat”(Example )4.4. Explanation of the function of 4.4. Explanation of the function of ““ee‐‐StatStat””(Example(Example ))
Regional Statistics Analysis System Users can browse principal data such as population and the total
land area of each prefecture and municipality in detail
4.4. Explanation of the function of “e‐Stat”(Example )4.4. Explanation of the function of 4.4. Explanation of the function of ““ee‐‐StatStat””(Example(Example ))
Statistical Geographical Information System Users can easily grasp the situation concerning the merging of
municipalities
Emergency measures The e‐Stat system contributed to providing information about
the “ Great East Japan Earthquake”For example, we had posted a map of the flooded area, and population and number of households there
4.4. Explanation of the function of 4.4. Explanation of the function of ““ee‐‐StatStat””(Example(Example) )
4.4. Explanation of the function of “e‐Stat”(examples)4.4. Explanation of the function of 4.4. Explanation of the function of ““ee‐‐StatStat””(examples(examples))
Survey Items Database
records items and questionnaires used in statistical surveys
users can search metadata such as definitions of items
Statistical Classification Management System
Japan Standard Industrial Classification
Japan Standard Occupational Classification
Japan Standard Commodity Classification
Classification of Diseases, Injuries and Causes of Death
Statistical Area Code Management System
manages information concerning changes regarding
municipalities such as mergers, name or boundary changes, and
a Statistical Area Code
possible to grasp these transitions via a timeline
Statistical survey results in e‐Stat The e‐Stat system delivers the data of about 450 statistic
including survey statistics, administrative statistics and
processed statistics, and 870 thousand statistical tables.
Most of the main statistics in Japan have been stored in
IMISOS, and we are making efforts to increase them.
The number of accesses from users to e‐Stat The number of hit have has increased each year.
The number in FY 2011 was more than 57 million.
4.5. Achievements4.5. Achievements4.5. Achievements
Thank you very muchThis presentation was completed with the help of colleages in my office and the Bureau of Statistics. Some of the slides were made based on the materials made by Mr. HirotakaKato and the Statistical Information Systems Division, Statistics Bureau in MIC.