RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

27
Histpop – The Online Historical Populations Report website and other census resources from the HDS ………………………………………………………. ………………………………............................................................................................ ...... RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE ESDS SOCIAL HISTORY DATA MANAGER UK DATA ARCHIVE UNIVERSITY OF ESSEX ………………………………………... Celebrating the Census, The National Archives 1 OCTOBER 2011

description

……………………………………………………….………………………………. Histpop – The Online Historical Populations Report website and other census resources from the HDS. RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE ESDS SOCIAL HISTORY DATA MANAGER UK DATA ARCHIVE UNIVERSITY OF ESSEX - PowerPoint PPT Presentation

Transcript of RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

Page 1: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

Histpop – The Online Historical Populations Report website and other census resources from the HDS

……………………………………………………….………………………………..................................................................................................

RICHARDDESWARTE………………………………………...

HEAD OF THE HISTORY DATA SERVICEESDS SOCIAL HISTORY DATA MANAGERUK DATA ARCHIVEUNIVERSITY OF ESSEX………………………………………...

Celebrating the Census, The National Archives1 OCTOBER 2011

Page 2: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

OVERVIEW

• UK Data Archive and the History Data Service

• Historical census and population resources: data collections

• Historical census population resources: CHCC & histpop

• Future

Page 3: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

What is the HDS

• Originally founded in 1993 as the History Data Unit

• From April 2008 History Data Service (HDS)

• Small team of historians and IT specialists

• Part of the UK Data Archive, University of Essex

Page 4: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

What we do

HDS collects, preserves and disseminates digital resources that support historical research and teaching.

Page 5: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

What we actually do

• Collect and preserve historical digital resources

• Provide access via a fully searchable and indexed catalogue record to a wide-ranging collection of historical digital resources

• Create thematic special collections, and enrich and enhance selected data collections

• Offer guidance on creating and documenting digital resources from historical sources

• Raise awareness of the value of historical data collections and their potential for secondary use

Page 6: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

HDS collection

Over 650 separate data collectionstranscribed, scanned or compiled from historical sources

Page 7: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Census and population data collections

Over 150 downloadable data collections related to census and population statistics

Including:

• Complete 1881 Census, SN 4177 (HE/FE only)

• Samples and subsets, i.e. SN 1316 National Sample from the 1851 Census Of Great Britain

• County returns, i.e. SN 6683 Warwickshire Census Returns, 1891

• Census enumerators’ returns, i.e. SN 4710 Census Enumerators’ returns for Kingston Upon Thames & SN 5596 Scottish Census Enumerators’ books: Skye, Kimarnock, Rothiemay and Torthorwald, 1861-1901

• Census statistics & aggregated data, i.e. SN 4560 Great Britain Historical Database: Census Data: Parish-level Population Statistics, 1801-1951 & SN 4093 Digest of Welsh Historical Statistics: Population, 1570-1974

Page 8: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Census and population data collections

Page 9: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Census and population data collections (cont.)

• Foreign census and population data from Canada, US, Sri Lanka, i.e. SN 456 Canadian Census and Election Data 1908-1968

• Pre-modern population and demographic data, i.e. SN 4491 Parish Register Aggregate Analyses, 1662-1811, SN 5694 Electronic Edition of Domesday Book & SN 5687 COEL Database: Continental Origins of English Landholders, 1066-1166

• Themed datasets:• Occupations & occupational structure, i.e. SN 5432 1851 Census Principal

Towns Occupational Data

• Emigration, i.e. SN 3580 Database of Irish Historical Statistics : Emigration, 1851-1911

• Religion, i.e. SN 5749 Religious Census of Northamptonshire, 1851 & SN 1660 Segregation and Social Structure in early 20th century Belfast, 1901

• Mortality, i.e. SN 4147 Deaths in Scotland, 1861-1911; by Age, County, Gender and Year

Page 10: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Census and population data collections

Page 11: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

CHCC

• Contemporary and Historical Census Collection (CHCC) was originally a JISC funded project to improve online accessibility to primary census resources.

• Contains: • transcription of the 1881 census enumerators' books – 26 million

individuals• 2% sample of the 1851 census enumerators’ books – 400 000 individuals• Aggregate-level demographic data – the Great Britain Historical Database

& Database of Welsh Historical Statistics

• Provides information about the name, address, relationship to the head of household, marital status, age, occupation, birthplace and disabilities of millions of individuals, as well as a large group of derived demographic variables.

• Download online subsets of enumerators’ books and specific tables from GBHD & DWHS.

• http://hds.essex.ac.uk/history/data/chcc.asp

Page 12: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

CHCC

• Functional but simplistic

• Tabular data only; no images of original documents

• No historical context

• Valuable to expert user but less so for more general user

• Limited to UK HE & FE only

Page 13: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

histpop

• The Online Historical Population Reports Website provides online access to the complete British population reports for Britain and Ireland from 1801 to 1937

• 200,000 pages of census and registration material for the British Isles as well as ancillary documents from The National Archives, critical essays and transcriptions of important legislation

• Provides a wealth of textual and statistical material which offer an in-depth view of the economy, society (through births, deaths and marriages) and medicine during the 19th and early 20th centuries.

• Direct searching of the content and enhanced browsing through the collection by date or geography

• http://www.histpop.org/

Page 14: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

histpop – Features

• Browsing

• Context• Ancillary documents• Academic essays

• Images • Quality• Downloadable PDF or TIFF• Rotate and enlarge

• Downloadable tables – machine readable format

• Citation

• Metadata

Page 15: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

histpop

Page 16: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 17: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 18: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 19: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 20: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 21: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 22: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 23: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 24: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop

Page 25: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Histpop – Users

• Wide-ranging – academic to general public

• 3000 unique users & 50 000 page views per month

• Research – economics, health, local government, PhDs

• Teaching – bespoke historical Census courses, online historical statistics courses

Page 26: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

Future resource – I-CeM

• Integrated Census Microdata (I-CeM) project will bring together more than 200 million individual records from censuses for Great Britain between 1851-1911

• Joint project between the History Dept at Essex and the UK Data Archive – led by Professor Kevin Schürer & Dr Edward Higgs

• Will create largest collection of its kind in world and potentially lead to the creation of a Victorian Panel Survey

• Will combine computerised versions of censuses from that period to create a unique online historical resource full of vast amounts of information on every house, household and individual in the country for that period

• A great UK Data Archive & HDS resource of the future

Page 27: RICHARD DESWARTE ………………………………………... HEAD OF THE HISTORY DATA SERVICE

……………………………………………………………………………………………………………………………….……………………………..

…………………………………………………………………………………………………………………………………………………………..…

UK DATA ARCHIVE

QUESTIONS & FURTHER INFORMATION

ESDS catalogue - http://www.esds.ac.uk/Lucene/Search.aspx

histpop - http://www.histpop.org/

CHCC - http://hds.essex.ac.uk/history/data/chcc.asp

HISTORY DATA SERVICEUK Data ArchiveUniversity of Essex

http://hds.essex.ac.uk/history/

UK DATA ARCHIVEUNIVERSIY OF ESSEXWIVENHOE PARKCOLCHESTERESSEX CO4 3SQ……..……………………………….…..T +44 (0)1206 872001 E [email protected]