An Introduction to producing Official Statistics

Thursday 26th April 2012

Welcome, aims & key roles

Julie Wilson Deputy Chief Statistician

Office of the Chief Statistician and Performance

Seminar delegates today

• Public Bodies who have been producing Official Statistics for 16 months

• Public Bodies who will become a producer of Official Statistics in June 2012

• Scottish Government statistical and policy staff

Today’s Aims

• Legislation

• Guidance, support and workshop

• Understanding key roles

• Broader Context

• Ministerial Relationship

• Reflections from fellow producer and ASD

• UK Statistics Authority

Background – key legislation • 2007 - Statistics and Registration Services Act

– Defined ‘Official Statistics’ and stated who produces them. Created UK Statistics Authority

– Created ‘Code of Practice for Official Statistics’

• 2008 - Pre-release access to Official Statistics (Scotland) Order

• 2008 - Official Statistics (Scotland) Order

• 2010 - Official Statistics (Scotland) Amendment Order

• 2012 - Official Statistics (Scotland) Amendment Order

Key roles

• Lead official within the producer body responsible for the production of statistical outputs

within their organisation ie operational matters, and for compliance with the Code of Practice and pre-release arrangements.

• Sponsor ASD at SG to provide statistical advice, on code compliance etc.

• Chief Statistician to provide statistical advice on breaches and other

issues (like Chief Statistician’s current role for NRS & ISD)

Communication channel

Producer Body

Ministers Scottish Government - ASD

Scottish Government - Chief Statistician

Key Note Address Key Note Address

Roger HallidayRoger Halliday

Chief StatisticianChief StatisticianScottish GovernmentScottish Government

Thursday 26Thursday 26thth April 2012 April 2012

What makes Official Statistics What makes Official Statistics different to other statistics?different to other statistics?

Used in big decision making and policy Used in big decision making and policy evaluationevaluation

Inform governmentInform government Inform the public about governmentInform the public about government Produced within legislative frameworkProduced within legislative framework Follow international standardsFollow international standards Candidate for National Statistics kite markCandidate for National Statistics kite mark

Key developments in UKKey developments in UK

First Official Statistics CodeFirst Official Statistics Code 1997 elections and development of 1997 elections and development of

“National Statistics”“National Statistics” Run up to Statistics & Registration Service Run up to Statistics & Registration Service

Act 2007Act 2007 Scottish Parliament endorsementScottish Parliament endorsement

Scotland and UK - differencesScotland and UK - differences

Fewer issues of perceived interferenceFewer issues of perceived interference So less emphasis on trust and more on So less emphasis on trust and more on

usefulness/relevance to decision makingusefulness/relevance to decision making Very different approach to pre-release accessVery different approach to pre-release access Reminder that statistics are devolvedReminder that statistics are devolved Not the UK “transparency” agendaNot the UK “transparency” agenda Our own Framework – comments welcome:Our own Framework – comments welcome:http://www.scotland.gov.uk/Topics/Statistics/About/scottishfrhttp://www.scotland.gov.uk/Topics/Statistics/About/scottishframework/frameworkcon#topamework/frameworkcon#top

Role of Chief Statistician and Role of Chief Statistician and Heads of Profession Heads of Profession

The “responsible statistician”The “responsible statistician” Susan Burney covers NHS – National Susan Burney covers NHS – National

Services ScotlandServices Scotland Chief Statistician covers everything else Chief Statistician covers everything else

except NRSexcept NRS Roles set out in FrameworkRoles set out in Framework But some differences for new producers – But some differences for new producers –

to be explained later via guidanceto be explained later via guidance

Role of National StatisticianRole of National Statistician

Head of Government Statistical Service (GSS)Head of Government Statistical Service (GSS)

Indirect role in Scotland but there are times Indirect role in Scotland but there are times when National Statistician is involved (e.g. when National Statistician is involved (e.g. Breaches, Exemptions and the Assessment Breaches, Exemptions and the Assessment process)process)

See National Statistician’s web pages See National Statistician’s web pages http://www.statisticsauthority.gov.uk/national-statihttp://www.statisticsauthority.gov.uk/national-statistician/index.htmlstician/index.html

Focus for New ProducersFocus for New Producers

Understand your interaction with Ministers Understand your interaction with Ministers and policyand policy

Prioritise the key standards nowPrioritise the key standards now Staged approach to other standards is fineStaged approach to other standards is fine Resource issuesResource issues Role of Responsible personRole of Responsible person Tease out roles at the public bodyTease out roles at the public body

ConclusionConclusion

Crucial role of Official Statistics in Crucial role of Official Statistics in informing government and publicinforming government and public

Impact of NPF/SOA – importance of Impact of NPF/SOA – importance of quality statisticsquality statistics

Austerity is a challenge to all producers Austerity is a challenge to all producers (‘New’ and ‘Old’)(‘New’ and ‘Old’)

Steep learning curveSteep learning curve Welcome to the family!Welcome to the family!

Code of Practice for Official Statistics & Guidance

David Campbell

Office of the Chief Statistician and Performance Thursday 26th April 2012

Today’s aims….

• Code

• Guidance

• Breaches

Statistics and Registration Service Act 2007

Overall objective:

To promote and safeguard the quality of official statistics that serve the public good.

Created UK Statistics Authority:

Prepare, adopt and publish a code of practice.

Code of Practice for Official Statistics

• Replaced the National Statistics Code of Practice (the old code)

• Draws on international guidelines• Extensive public consultation (published)

8 Principles with 53 practices

3 Protocols with further 21 practices

Principles and Protocols of the Code of Practice

• Principle 1: Meeting user needs• Principle 2: Impartiality and objectivity• Principle 3: Integrity• Principle 4: Sound methods and assured quality• Principle 5: Confidentiality• Principle 6: Proportionate burden• Principle 7: Resources• Principle 8: Frankness and accessibility• Protocol 1: User engagement• Protocol 2: Release practices• Protocol 3: The use of administrative sources for statistical purposes

Where not to interpret the code too literally:

– Where there is a reference to the National Statistician this should be read as the Chief Statistician (3.5, 5.5, Protocol 2.8)

– Protocol 2.3 on the UK Publication Hub – at Scottish Government we link to our statistics topic pages rather than individual publications. You should think about how you plan to promote your outputs through the Hub. It is important that users go to your website as the prime place to go for your statistics rather than the UK Hub.

• Best practice guide for Official Statistics • Code has been framed to support assessment

of compliance• National Statistics = Code Certified

• Exceptions/Exemptions – UKSA decide if OK• Does not cover Pre-release Access (except

early access for Quality Assurance)• Breadth of Official statistics • UK Statistics Authority considers Official

Statistics to be National Statistics in waiting

Worth noting 1

Worth noting 2

• Focus on what’s relevant today.

• User engagement has a strong focus

• Admin sources and MI recognised as increasingly important issues

• Code will be reviewed and updated

• Code is IMPERATIVE & DYNAMIC….

Code vocabulary….

ENGAGE DOCUMENT PUBLISH

PRESENT ANNOUNCE

RELEASE ISSUE INFORM

PROMOTE PRODUCE

PREPARE REPORT CONSULT

DISSEMINATE PUBLICISE

IDENTIFY

How do we use the Code?

• Refer, assess, interpret

• Satisfy yourself that you are complying

• Refer to your sponsor ASD if in doubt• Note any weakness (and strengths) –

build into your improvement plans

• Code is top tier of the guidance but is not always crystal clear

Guidance

TIER 1 – UK Statistics Authority Code of Practice

TIER 2 – National Statistician’s guidance booklets

TIER 3 – Scottish Government guidance

TIER 4 – Your own guidance?

National Statistician’s guidance booklets

• Quality, Methods and Harmonisation

• Presentation & Publication

• Confidentiality

• Use of Administrative or Management Information

SG guidance - Corporate Policy Statements

As per the Code of Practice, you will find the following on the Statistics pages on SG website:

• SG Revisions Policy• SG Confidentiality Policy

SG Corporate Policy Statement on Quality• SG Quality Assurance guidance• SG Statement of Administrative Sources

• New Producers should think about their own version of these and publish them on their website. Your statistical staff should comply with these policies.

Scottish Government guidance

• On SG Intranet• Detailed and procedural – always evolving• Useful to staff as sets out what to do• Encompass SG/ Devolved Administration considerations

• On SG website• Concise and consolidated version for New Producers

with focus on producing Official Statistics• On internet for bodies to access:http://www.scotland.gov.uk/Topics/Statistics/About/NatStats

SG guidance for Official Statistics Producers

1. Pre-Announcement 2. Release practices 3. Unbiased commentary and presentation 4. Quality Assurance 5. Consultation/engaging with users 6. Management information 7. Other requirements 8. Scrutiny by the UK Statistics Authority 9. Pre-release Access order

Your own Guidance

• Inevitable that you will develop this as your experience of producing Official Statistics grows

• Tailor it to suit your Organisational needs and particular data needs

You could develop your own Example Bank to sit with your guidance…….

……think about what you do when you apply the code to your work….

• Collection of REAL instances of applying Code……CASE LAW?

• Particularly helpful for those grey areas• Helps you share best practice• Helps you understand best practice• Lets you demonstrate best practice• Helps you drive up standards• Efficient!

Breaches

• Alert your own ‘HoP’ and your ASD contact who will alert the SG ASD Senior Statistician & Chief Statistician

• Investigation needed then report breach (if a major breach). Keep records of minor breaches.

• National Statistician involvement• Public acknowledgment on your website and on

UKSA site• NB - Learn from mistakes. Improve procedures.• UK Statistics Authority publicly praised us for our

timely updates to breaches part of our website – helps with integrity and public perception of the statistics

Considerations….

• Official statistics– comply with key parts of Code

• National Statistics– future programme of work for bodies– can you demonstrate Code compliance?

• Breaches – minimise and learn from

PRE-RELEASE PRE-RELEASE ACCESS TO ACCESS TO OFFICIAL OFFICIAL

STATISTICSSTATISTICS

Janette PurbrickJanette PurbrickThursday 26Thursday 26thth April 2012 April 2012

To coverTo cover Legislation – background, scope & purposeLegislation – background, scope & purpose Arrangements across the UKArrangements across the UK When should you give pre-release access?When should you give pre-release access? What should you be doing?What should you be doing? Responsibilities of those receiving pre-release Responsibilities of those receiving pre-release

accessaccess How the UK Government rules affect you How the UK Government rules affect you

Experience to date and issues that have Experience to date and issues that have

arisenarisen ConsiderationsConsiderations Where to go for help Where to go for help

Legislation - BackgroundLegislation - Background New Code of Practice applies to whole of UK New Code of Practice applies to whole of UK

but separate pre-release access but separate pre-release access arrangements in each administrationarrangements in each administration

Pre-Release Access to Official Statistics Pre-Release Access to Official Statistics (Scotland) Order 2008 came into force on 1 (Scotland) Order 2008 came into force on 1 December 2008December 2008

Applies to early access given to Ministers and Applies to early access given to Ministers and others to official statistics in their others to official statistics in their final formfinal form prior to publication.prior to publication.

Timing remains at 5 working days (1 day for Timing remains at 5 working days (1 day for market sensitive statistics)market sensitive statistics)

Procedures and compliance are now stricterProcedures and compliance are now stricter Compliance (for National Statistics) will be Compliance (for National Statistics) will be

assessed by UK Statistics Authorityassessed by UK Statistics Authority

Legislation - scopeLegislation - scope Order applies to all official statisticsOrder applies to all official statistics Order Order does notdoes not apply to early access to apply to early access to

statistics for QA purposes – this is covered statistics for QA purposes – this is covered by the Code of Practiceby the Code of Practice

QA access timing is at the discretion of QA access timing is at the discretion of the responsible statisticianthe responsible statistician

You must be able to evidence that value is You must be able to evidence that value is added by involving colleagues in QAadded by involving colleagues in QA

The QA period The QA period must notmust not be used for be used for preparing ministerial briefing preparing ministerial briefing

Legislation - purposeLegislation - purpose

To increase public trust in official To increase public trust in official statistics through greater clarity and statistics through greater clarity and transparencytransparency

Internationally recognised principle of Internationally recognised principle of equality of access to National Statisticsequality of access to National Statistics

Pre-release access on a “need to know” Pre-release access on a “need to know” basisbasis

Ensures that those who need to Ensures that those who need to comment at the time of release can be comment at the time of release can be properly informed properly informed

Arrangements across the Arrangements across the UKUK

Different arrangements for each Different arrangements for each administrationadministration

UK Government & Northern Ireland – 24 UK Government & Northern Ireland – 24 hours for all official statisticshours for all official statistics

Wales – similar to Scotland – 5 working Wales – similar to Scotland – 5 working daysdays

And now onto the practicalities….And now onto the practicalities….

When should you give pre-release When should you give pre-release access?access?

To ensure Ministers and key officials can To ensure Ministers and key officials can comment on the statistics on an informed basis comment on the statistics on an informed basis at the time of releaseat the time of release

To enable public bodies whose functions are To enable public bodies whose functions are described by the statistics to comment on an described by the statistics to comment on an informed basis informed basis

To allow Communications staff to comment on To allow Communications staff to comment on the statistical news releasethe statistical news release

To ensure related publications or other To ensure related publications or other material being prepared for release at some material being prepared for release at some time (or shortly after) are properly informed by time (or shortly after) are properly informed by the correct figuresthe correct figures

In other exceptional cases where this would In other exceptional cases where this would not damage public trustnot damage public trust

What should you be What should you be doing?doing?

Ensuring key policy and communications contacts Ensuring key policy and communications contacts are aware of new rules are aware of new rules

Ensuring recipients are told why they are given Ensuring recipients are told why they are given access and that they must only use the statistics for access and that they must only use the statistics for this purposethis purpose

Ensuring recipients are aware of their Ensuring recipients are aware of their responsibilities under the pre-release order responsibilities under the pre-release order

Marking all files relating to pre-release statistics as Marking all files relating to pre-release statistics as “ restricted”“ restricted” until the date of release until the date of release

Only sending pre-release statistics to named Only sending pre-release statistics to named individuals, not generic mailboxes. We have some individuals, not generic mailboxes. We have some exceptions in SG:exceptions in SG: Cabinet Secretaries and MinistersCabinet Secretaries and Ministers Directors GeneralDirectors General OCS Forthcoming publicationsOCS Forthcoming publications

What should you be doing? What should you be doing? – cont.– cont.

Ensuring we can justify why access is being Ensuring we can justify why access is being given and keeping a record of all recipients and given and keeping a record of all recipients and reason for accessreason for access

Reporting any wrongful disclosure to your Reporting any wrongful disclosure to your statistical Head of Profession (Breaches)statistical Head of Profession (Breaches)

The UK Statistics Authority may investigate The UK Statistics Authority may investigate possible breachespossible breaches

Responsibilities of those Responsibilities of those receiving pre-release accessreceiving pre-release access Must only use pre-release statistics for the Must only use pre-release statistics for the

purpose for which access grantedpurpose for which access granted Must not use the access for personal or Must not use the access for personal or

political gainpolitical gain Must not pass pre-release statistics on to Must not pass pre-release statistics on to

others or disclose any indication of the content others or disclose any indication of the content Must not use early access for quality Must not use early access for quality

assurance purposes as time to prepare assurance purposes as time to prepare ministerial briefingministerial briefing

Must not save to a shared area Must not save to a shared area

Responsibilities of those Responsibilities of those receiving pre-release access receiving pre-release access

– cont.– cont. Ministerial statements and policy Ministerial statements and policy

briefing on the statistics must retain briefing on the statistics must retain marking marking ““Restricted StatisticsRestricted Statistics” ” until until the time of publicationthe time of publication

Embargoed early access can no longer Embargoed early access can no longer be given to journalistsbe given to journalists

Any accidental or wrongful release must Any accidental or wrongful release must be reported to the responsible be reported to the responsible statisticianstatistician

Non-disclosure agreements (NDA) usefulNon-disclosure agreements (NDA) useful

How UK Government rules How UK Government rules affect usaffect us

Where UK Depts publish devolved statistics it is Where UK Depts publish devolved statistics it is not always clear which pre-release access rules not always clear which pre-release access rules applyapply

Depends on the type of publication. E.g.Depends on the type of publication. E.g. Joint publicationJoint publication - where we publish - where we publish

devolved statistics at the same time as UK Gov devolved statistics at the same time as UK Gov Dept publishes UK-wide statistics - e.g. Dept publishes UK-wide statistics - e.g. Income inequality and poverty statisticsIncome inequality and poverty statistics

Government CompendiaGovernment Compendia – publishing – publishing comparisons across the UK – e.g. General comparisons across the UK – e.g. General Household report on smoking and drinkingHousehold report on smoking and drinking

Where UK Government or a UK-wide body Where UK Government or a UK-wide body publishes a separate country publication publishes a separate country publication on a devolved matteron a devolved matter

Experience to date Experience to date

Some issues that have arisen:Some issues that have arisen: Pre-release access to representative Pre-release access to representative

bodiesbodies Senior Management Team (SMT) Senior Management Team (SMT)

Access to draft pages on your internet Access to draft pages on your internet

editoreditor Issues around access to management Issues around access to management

information information

ConsiderationsConsiderations

SG Pre-release access review in SG Pre-release access review in 2010 concluded that rules were 2010 concluded that rules were working well.working well.

UK Statistics Authority constantly UK Statistics Authority constantly campaign for PRA to be minimised.campaign for PRA to be minimised.

Your duty to uphold rules – minimise Your duty to uphold rules – minimise leaks leaks

For help….For help….

Guidance is available Guidance is available Please continue to contact Please continue to contact

your sponsor ASD for advice. your sponsor ASD for advice. They will pass ‘grey area’ They will pass ‘grey area’ queries to OCSP. queries to OCSP.

The Ministerial relationship with Official Statistics

Mrs Julie Wilson

Deputy Chief Statistician

Who is involved?

• Portfolio Ministers

• Minister for Statistics – Mr Swinney

• Chief Statistician – authorised delegate for Scottish Ministers

Scope

• Portfolio ministers agree which outputs that can be published as Scottish Official Statistics

• Process is via your ASD by ministerial submission – examples available

Major user

• Ministers are a major user of your statistics – not just the published figures but also any internal Management Information.

• Include Ministers in consultations about your statistics.

Forthcoming Publications

• Pre-announcement mechanism

• Ministerial stage (1 week to view)

Pre-release Access

• Ministers may need to comment on your outputs and should be included in the Pre-release access stage if applicable.

• Ministers do not take part in the QA process.

News Releases

• The Code says that policy and/or Ministerial statements about your statistics must be separate to your own statistical new release.

National Statistics Designation

• It is Ministers who put Official Statistics forward for formal assessment and designation by the UKSA.

Where Ministers are not involved

• Ministers have no say in the format, content and timing of your outputs and it would be classed as a breach of the Code if they did try and influence you on these matters. You must produce your statistics in an environment that is free from political interference.

Conclusion

• Ministers are important in Official and National Statistics

• If in doubt about whether you need to involve your Minister at any stage, contact your ASD rep for advice

Statistical Statistical Support for Support for

Public BodiesPublic BodiesChris NewsonChris Newson

Office of the Chief Statistician Office of the Chief Statistician and Performanceand Performance

Scottish GovernmentScottish Government

Presentation OutlinePresentation Outline

Today I will talk to you about:Today I will talk to you about: The role of ASD Support Teams;The role of ASD Support Teams; The ScotStat Public Sector Analysts The ScotStat Public Sector Analysts

Network;Network; Online resources that may be of use; Online resources that may be of use;

andand The support we can provide.The support we can provide.

Time at the end for any questionsTime at the end for any questions

ASD Support TeamsASD Support Teams

It is the role of analytical staff in teams It is the role of analytical staff in teams sponsoring the public body to provide sponsoring the public body to provide support and advice on compliance with support and advice on compliance with the Code of Practice for Official the Code of Practice for Official Statistics, this may cover:Statistics, this may cover: Pre Release AccessPre Release Access Preparing for product assessmentPreparing for product assessment The principals and protocols within the The principals and protocols within the

CodeCode Ministerial correspondenceMinisterial correspondence

ScotStat Public Sector ScotStat Public Sector Analysts NetworkAnalysts Network

Open to anyone from Local Government or Open to anyone from Local Government or other public bodies as well as academicsother public bodies as well as academics

No need to be an analyst by professionNo need to be an analyst by profession About sharing analytical knowledge and About sharing analytical knowledge and

experienceexperience For more information or to join please visitFor more information or to join please visit

www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork Or contact me at:Or contact me at:

Analysts.Network@Scotland.gsi.gov.ukAnalysts.Network@Scotland.gsi.gov.uk 0131 244 04430131 244 0443

Network PurposeNetwork Purpose Develop mutual understanding of statistical needs and Develop mutual understanding of statistical needs and

opportunities between local authorities, public bodies and opportunities between local authorities, public bodies and Scottish Government;Scottish Government;

Consider the best means for Scottish Government to share Consider the best means for Scottish Government to share its analytical resources with other public bodies to build its analytical resources with other public bodies to build analytical capacity more widely; analytical capacity more widely;

Consider issues across public bodies in data collection in Consider issues across public bodies in data collection in order to take a strategic approach to harmonisation and order to take a strategic approach to harmonisation and efficient use of resources; efficient use of resources;

Discuss how Scottish Government statistics are used by Discuss how Scottish Government statistics are used by public bodies and how they might be improved to be of public bodies and how they might be improved to be of more benefit; more benefit;

Increase knowledge and understanding of functional issues Increase knowledge and understanding of functional issues (e.g. Scottish Neighbourhood Statistics, Sample Surveys, (e.g. Scottish Neighbourhood Statistics, Sample Surveys, Official Statistics), cross cutting themes (e.g. equality Official Statistics), cross cutting themes (e.g. equality statistics, geographical statistics) and methodological statistics, geographical statistics) and methodological issues (e.g. measuring change, reporting on targets).issues (e.g. measuring change, reporting on targets).

What the Network doesWhat the Network does The Network’s aims are met through demand-The Network’s aims are met through demand-

led local workshops and short lived working led local workshops and short lived working groups.groups.

Decisions of working groups and workshops are Decisions of working groups and workshops are made by Network members.made by Network members.

Network members contribute to arrangement Network members contribute to arrangement for workshops with support from Scottish for workshops with support from Scottish GovernmentGovernment

Workshops can be tailored to specific needsWorkshops can be tailored to specific needs The Network also aims to keep members The Network also aims to keep members

informed of related work that may be of interest, informed of related work that may be of interest, such as the Local Outcome Indicators Project.such as the Local Outcome Indicators Project.

Analysts Network Analysts Network WorkshopsWorkshops

Can cover any methodological or cross-cutting Can cover any methodological or cross-cutting issue, such as:issue, such as: Presenting dataPresenting data Using administrative sourcesUsing administrative sources Understanding the Scottish Index of Multiple Understanding the Scottish Index of Multiple

Deprivation (SIMD)Deprivation (SIMD) Using Scottish Neighbourhood Statistics (Using Scottish Neighbourhood Statistics (

www.sns.gov.ukwww.sns.gov.uk)) Or many other issues…Or many other issues…

Free to attendFree to attend Held in a variety of locations, provided by Held in a variety of locations, provided by

membersmembers Tend to have 15 to 20 attendees so they can be Tend to have 15 to 20 attendees so they can be

interactive and tailored to specific needs or issuesinteractive and tailored to specific needs or issues

Analysts Network Analysts Network WorkshopsWorkshops

All details of past workshops including All details of past workshops including materials and feedback received are materials and feedback received are available on the network website: available on the network website: www.scotland.gov.uk/analsystnetwork/www.scotland.gov.uk/analsystnetwork/NetworkWorkshopsNetworkWorkshops

Most past workshops can be re-run if Most past workshops can be re-run if there is sufficient demand from there is sufficient demand from Network members.Network members.

There are some suggested workshop There are some suggested workshop topics on the network pagestopics on the network pages

Some of the Past Some of the Past Network WorkshopsNetwork Workshops

Understanding Economic Statistics, EdinburghUnderstanding Economic Statistics, Edinburgh Contribution Analysis, AyrContribution Analysis, Ayr Interpreting the Scottish Index of Multiple Deprivation, Interpreting the Scottish Index of Multiple Deprivation,

Glasgow Caledonian UniversityGlasgow Caledonian University Forecasting and Projections, AberdeenForecasting and Projections, Aberdeen Data Access, Data Sharing and the Data Protection Act, Data Access, Data Sharing and the Data Protection Act,

KirkcaldyKirkcaldy Measuring Change and Monitoring Targets, KirkcaldyMeasuring Change and Monitoring Targets, Kirkcaldy Statistics, OrkneyStatistics, Orkney An Introduction to Understanding Data and Setting An Introduction to Understanding Data and Setting

Targets, EdinburghTargets, Edinburgh Survey Design and Analysis, Edinburgh City CouncilSurvey Design and Analysis, Edinburgh City Council Surveys, FalkirkSurveys, Falkirk Equalities Data Workshop, EdinburghEqualities Data Workshop, Edinburgh Scottish Neighbourhood Statistics, InvernessScottish Neighbourhood Statistics, Inverness

Analysts Network Analysts Network Contact DetailsContact Details

Website:Website:www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork

Email:Email:Analysts.Network@Scotland.gsi.gov.uAnalysts.Network@Scotland.gsi.gov.ukk

Phone:Phone:0131 244 04430131 244 0443

Analytical Guidance Analytical Guidance LibraryLibrary

Created by a short-lived working group of Created by a short-lived working group of the Analysts Networkthe Analysts Network

Electronic library of analytical guidance Electronic library of analytical guidance material material

Covers a magnitude of topic areas:Covers a magnitude of topic areas: Confidence intervalsConfidence intervals EthicsEthics ModellingModelling Statistical Process ControlStatistical Process Control

www.scotland.gov.uk/Topics/Statistics/scotwww.scotland.gov.uk/Topics/Statistics/scotstat/analystsnetwork/AnalyticalGuidanceLstat/analystsnetwork/AnalyticalGuidanceLibraryibrary

Methodology GlossaryMethodology Glossary

Quick reference materials for specific Quick reference materials for specific analytical techniquesanalytical techniques

No previous understanding required, covers No previous understanding required, covers different levels (Tiers 1 and 2)different levels (Tiers 1 and 2)

Tier 1 – Basic introduction to the techniqueTier 1 – Basic introduction to the technique Tier 2 – More detailed how to guide with Tier 2 – More detailed how to guide with

examples.examples.

www.scotland.gov.uk/Topics/Statistics/About/Mwww.scotland.gov.uk/Topics/Statistics/About/Methodology/Glossaryethodology/Glossary

One-to-one and Hands-One-to-one and Hands-on Analytical Supporton Analytical Support

Available from the Office of Available from the Office of the Chief Statistician and the Chief Statistician and

PerformancePerformance

What other support can What other support can we offer?we offer?

Statistical Support for Public Bodies Statistical Support for Public Bodies Branch in the Office of the Chief Branch in the Office of the Chief Statistician and PerformanceStatistician and Performance Methodological QuestionsMethodological Questions Advice or ‘sounding board’ for analytical Advice or ‘sounding board’ for analytical

projectsprojects May be able to be involved in Local projectsMay be able to be involved in Local projects

Christopher.Newson@Scotland.gsi.gov.uChristopher.Newson@Scotland.gsi.gov.ukk

Analysts.Network@Scotland.gsi.gov.ukAnalysts.Network@Scotland.gsi.gov.uk 0131 244 04430131 244 0443

Example IExample I Involvement in a working group looking at data Involvement in a working group looking at data

availability within a Community Planning availability within a Community Planning Partnership (CPP) areaPartnership (CPP) area

Offering critical friend and challenge roleOffering critical friend and challenge role Information on data suitability and availabilityInformation on data suitability and availability Liaise with colleagues in SG on specific topicsLiaise with colleagues in SG on specific topics Helped in the production of a report setting out Helped in the production of a report setting out

the current state of play in the CPP to assist in the current state of play in the CPP to assist in identifying priority areas of concern for the identifying priority areas of concern for the futurefuture

This developed the relationship we have with This developed the relationship we have with the CPP which is beneficial for both partiesthe CPP which is beneficial for both parties

Example IIExample II Methodological advice and assistance on hypothesis Methodological advice and assistance on hypothesis

testingtesting A colleague in Local Government was interested in A colleague in Local Government was interested in

analysing survey results by equalities characteristics and analysing survey results by equalities characteristics and wanted to test for association between variableswanted to test for association between variables

We provided advice on most appropriate test to use for We provided advice on most appropriate test to use for this casethis case

Developed a detailed how to guide that became part of Developed a detailed how to guide that became part of the methodology glossarythe methodology glossary

Provided further assistance to review the approach taken.Provided further assistance to review the approach taken. In the end because of the sample size it was difficult to In the end because of the sample size it was difficult to

use this technique however, we were still able to provide use this technique however, we were still able to provide advice on the analysis and interpretation of the survey advice on the analysis and interpretation of the survey resultsresults

Any Questions?Any Questions?

Check out the Network website:Check out the Network website:www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork

If you think of anything later, feel free to If you think of anything later, feel free to contact us:contact us:

Analysts.Network@Scotland.gsi.gov.ukAnalysts.Network@Scotland.gsi.gov.uk0131 244 04430131 244 0443

eSAY– Learning Disability and Autism Statistics

Reflections from a new producer of Official Statistics

26th April 2012

Presentation Structure

1. Background to eSAY;2. Value of Official Statistics; and3. Advice from our experience.

What is eSAY?

• Learning Disability and autism statistics;• Run by SCLD and funded by Scot. Gov.• eSAY stands for electronic “same as you?”; • Set up to monitor the recommendations

of “The same as you?”• 27,391 adults in 2010;• 6.4 adults per 1,000 pop’n.

Aims and Purpose of eSAY Aims:•To publish an annual statistical report;•To provide electronic information through the eSAY website; and to•Develop a comprehensive national database.Our information is then used to:•Help plan services;•Identify where there is unmet need;•Monitor progress against the recommendations of “The same as you?”

Collection items & data providers Items•Age; •Gender; •Ethnicity; •Accommodation type;•Carers;•Advocacy; •PLP’s; •LAC;•Day centre and day opportunities;•Employment; and •Education.

LA’s on behalf of eSAY collect from: •social care providers; housing; •employment agencies; •advocacy organisations; •colleges and universities and; •social work services.

Methodology

• Guidance;• Data collected and anonymised by LA;• Secure download facility;• Data cleansing;• Report.

Data Users

• Scottish Government;• Local Authorities; • Health care professionals;• General public

Value of Official/ National Statistics

• Continued development of the dataset; • Increases confidence in our method and

outputs;• Develops the profile of the statistics;• Helps us understand our project and

document useful information.

Compliance with the Code

• Principle 1: meeting user need eSAY Evidence: Data Group (regular engagement

for planning); User Survey; timetable for publication published in Guidance; comparative completeness tables.

• Principle 2: Impartiality and objectivity eSAY Evidence: Statistics Release written in a

neural unbiased style. Factual analysis with no assumptions.

Summary of experience/ advice

• Regular contact with SG + UK Statistics Authority;

• Timetable;• Inform stakeholders;• Evidence;• Transparency; and• Enjoy and value the process!

QUESTIONS?

WORKSHOP

To cover

• GUIDANCE FOR PUBLIC BODIES PUBLISHING OFFICIAL STATISTICS IN SCOTLAND

- Key Requirements in more detail

• Other issues/areas of interest

• Coffee

• Producer time

Guidance note 1. - Pre-Announcement

• Official Statistics publications should be pre-announced in 2 stages.

• Planned publications should be announced 12 months ahead, together with the planned month of release.

• The exact date of publication should be announced at least 4 weeks in advance. This is intended to prevent perception of political interference in the timing of release of the data but is also of considerable assistance to users who then know when new figures are due to be published.

• Any change of date must be published in the forthcoming publication schedule together with the reason for the change.

Guidance note 2 - Release practices

• Official Statistics should be published as soon as they are judged ready so that there is no opportunity, or perception of opportunity, for the release to be withheld or delayed for political reasons.

• All official statistics must be published at 9.30am on the day of publication.

• All official statistics should be announced by a statistical press release and this must not include any political commentary.

• Action must be taken to guard against leaks. Leaks include giving an indication of the direction of change e.g. if results were favourable.

• Colleagues granted pre-release must not share the data with anyone else – even members of their own team.

Guidance note 3 - Unbiased commentary and presentation

• The format and presentation of the statistics must be unbiased.

• The statistics must be published separately from any policy or Ministerial statement.

• However, the policy and operational context of the statistics should be explained objectively in the publication – for example by noting any government or performance targets informed by the data. Statements or comments on performance should be issued separately, for example in a ministerial press-release and/or a policy document published at the same time or after the official statistics publication.

Guidance note 4 - Quality Assurance

• You must ensure suitable process for quality checks are in place.

• A clear indication of the quality of the statistics detailing appropriate use and limitations should be provided in the release. A note of any plans to improve quality should also be included.

• Copying of draft statistics to others to assist in quality assurance, whilst to be encouraged, must be managed and records kept e.g. maintain a list of all QA recipients.

• Non-Disclosure Agreements (NDA) can help minimise the chance of leaks

Guidance note 5 - Consultation/engaging with users

• Users should be involved in any plans to change the data collection, methodology or release arrangements.

• You should advise users of the publication plans and the intention to publish the data as official statistics

• Ideally, you should document how user engagement has influenced what you produce.

• Document the uses made of your statistics

Guidance note 6 - Management information

• Where management information is used to produce official statistics, public statements should be based on the published official statistics and not based on any similar, unpublished management information.

• Access should be given to management information and similar data when it is needed for supporting the day to day management/operation of the organisation or decision-making but it should not be used publicly before it has been published as official statistics.

Guidance note 7 - Other requirements

• You should publish on your website, details of your arrangements for ensuring confidentiality of any personal data collected.

• If you have any outputs that are subject to scheduled revisions, you should publish a Revisions Policy explaining how these are managed.

• Publish a Statement of Administrative Sources, which lists any administrative systems which feed into your official statistics.

• Report annually the estimated cost (for example, on business, service providers, or the public) of responding to statistical surveys.

• Strive to develop methods that will reduce the cost to individual organisations or people.

Guidance note 9 - The statutory requirements of the Pre-release order

• Access to official statistics in their final form before they are published is restricted.

• Such access is allowed only for specific purposes set out in the Pre-release Access to Official Statistics (Scotland) Order (although there is scope for exceptions subject to due process)

• The main purpose is to ensure that those who must comment publicly at the time the statistics are produced, do so based on a correct understanding of the statistics.

• Access to draft results can be provided to individuals for the purpose of quality assuring descriptive commentary although the quality assurance of the figures themselves should have been completed much earlier.

• Access can be provided a maximum of 5 working days before publication (24 hours for market sensitive figures). A record must be kept of all those given access and why.

Media & Briefing

• The Press cannot see your statistics before they are published

• Your Statistical news release is written by you then published by you at the same time as your statistics

• Your policy and/or Ministerial colleagues might prepare a news release or a press briefing/conference to come out at the same time as your SNR. They can use the PRA period to prepare the briefing.

• It is fine for you to attend and comment at briefings but you can only comment on the statistics not the policies.

Example of press release with both statistical and policy type

Provisional Sea Fisheries Statistics• Statistical Release

http://www.scotland.gov.uk/News/Releases/2011/03/17094627

• Ministerial Release http://scotland.gov.uk/News/Releases/2011/03/17114100

Document everything!

• A GOOD HABIT– Decision making process and agreed

changes– Interaction with users– Keep register of adhoc requests– Publish where necessary

• Reviewing your documentation helps you improve your statistics and your processes

Early AccessQuality Assurance

Final Form

Legislation Code of Practice

Pre-release access Order

Keep lists of those given access

YES YES

Ministerial Access

NO YES

Risk of leak? YES YES

Non-Disclosure AgreementAs the recipient, please respond to this email indicating in your

response you agree to the following restrictions regarding your early access to the pre-release statistics for the product named:

• The results you will receive will be in their final form and you are receiving access to ensure that those who need to comment at the time of release can do so based on an informed and correct interpretation of the figures.

• Pre-release access is restricted to I day/5 days. You will work with policy advisors or communications briefing must take place within these times.

• You will treat the material and any indication of the results as restricted until public release, which is scheduled for DD/MM/YY.  You will retain any security markings that the product shows. You will not attempt to change the release date.

Non-Disclosure Agreement (Ctd)

• If any accidental release or wrongful release occurs you must let me know as soon as possible so that a breach can be recorded on the Scottish Government website.

• If there are others within your work area who would like to contribute to the quality assurance process please do not forward this email or any data to them – instead forward their contact details to me for consideration. We keep detailed records of who has been given pre-release access and for how long the access lasts. These records are scrutinised by the UK Statistics Authority.

• For more information on your responsibilities when receiving pre-release access to official statistics please see the guidance.

Publication Checklist

Think and plan ahead.

What to do:

• Around 12 months before you publish

• About 2 months ahead

• 1 month before

• 5 days before (PRA period)

Your website

• Dedicated Official Statistics section?

• Explain what OS are, legislation and the date you became OS producer.

• Use this area to pre-announce, publish your statistics, engage with your users

• For examples, see SEPA and Scottish Funding Council websites

The role of the UK Statistics Authority

Neil Jackson

Official Statistics - New Producers’ Seminar

26 April 2012

Coverage of presentation

• Background and organisation of the Authority

• Monitoring function

• Assessment function

• Findings from Assessment

ONS Omnibus, 2007

 

Figures are generally accurate

Figures are produced

without political

interference

Government uses

figures honestly

% % %

Agree 36 20 16 Neither agree

nor disagree 31 23 26

Disagree 33 57 58

Base = 100% 1112 1112 1112

Views about official statistics in general

EU Eurobarometer 2007

Do you trust official statistics?

Tend to Trust Tend not to trust DK

Framework for National Statistics, 2000

• New post - ‘National Statistician’ • New set of rules - ‘Code of Practice’• New quality standard - ‘National Statistics’ • New Watchdog –‘The Statistics Commission’

UK Statistics Authority

• Authority established by the Statistics and Registration Service Act, 2007

• to promote and safeguard the production and publication of official statistics that serve the public good

• A non-ministerial Department – overseen by Parliament, not a Government Minister

• Authority’s responsibilities extend to the whole of the UK - England, Wales, Scotland and Northern Ireland

Monitoring Reviews

• Migration Statistics: The Way Ahead?

• Pre-Release Access to Official Statistics - A Review of the Statutory Arrangements

• Overcoming Barriers to Trust in Crime Statistics - England and Wales

• Strengthening User Engagement

Monitoring Briefs

• Knife crime statistics

• Gender pay gap

• The use made of official statistics

• Findings from Assessment Reports

• Scotland's major population surveys

• Creating official statistics from administrative data

Aims of Assessment

• to determine whether the Code of Practice for Statistics has been complied with

• to communicate to Parliament and the public the extent of compliance with the Code

• to help the producers of official statistics to enhance the quality of the statistical service

Elements of Assessment

• New statutory Code of Practice • Self-evaluation evidence from producer

teams• Views of users, suppliers and other

stakeholders• Review of statistical releases and associated

documentation

Designation

Statistics…

• Meet identified user needs

• Are produced, managed and disseminated to high standards

• Are well explained

Published Assessment Reports as at April 2012

Scotland 38

Wales 16

Northern Ireland 16

UK Government Departments 69

Office for National Statistics 40

Other 19

Total 198

Number of Requirements by Principle and Protocol; first 190 Assessments

Findings from assessment

• Better understand and communicate the use made of official statistics

• Improve the text that accompanies the first release of official statistics

• Improve the documentation of sources and methods

• Make better use of existing administrative data for statistical purposes

• Improve the comparability between some statistics produced by the four administrations

Typical Requirements

• Investigate and document the uses of these statistics and user needs; publish information about users’ experiences of these statistics

• Publish more information about the quality of the statistics, including strengths and limitations

• Improve the commentary in the statistical releases so that it aids user interpretation of the statistics

Impact of assessment

• Enhancing producers’ understanding of the use made of their statistics;

• Improving producers’ engagement with users of statistics outside their own organisations; and

• Improving the quality and accessibility of statistical releases – the ‘shop window’ of the statistical service

Questions?