The LIBRARY of CONGRESS JISC-CNI Envisioning Future Challenges in Networked Information York,...

The LIBRARY of CONGRESS

JISC-CNI Envisioning Future Challenges

in Networked Information

York, England

July 6, 2006

NDIIPP


NDIIPP: Key Challenges of

Collaboration and Sustainability

Laura E. CampbellAssociate Librarian for Strategic Initiatives

July 6, 2006

3#

NDIIPP


Background• Created by federal legislation (PL 106-554) in

December 2000

• Up to $175 million available with matching

• Guided by National Digital Strategy Advisory Board (NDSAB)

• Preserving Our Digital Heritage national NDIIPP plan approved December 2002

4#

NDIIPP


NDIIPP Vision

To ensure access over time to a rich body of digital content through the establishment of a national network of committed partners.

5#

NDIIPP


Overall NDIIPP Goals• Identify and preserve at-risk digital content

• Develop a national digital collection and preservation strategy

• Support development of improved tools, models, and methods for digital preservation

• Work with industry, concerned federal agencies, libraries, research institutions and not-for-profit entities

6#

Key Challenges:U.S. Context for Digital Preservation• Decentralized activities in many communities

– Government at various levels– Universities– Non-profits– Corporations– Consortial domains (i.e., Earth scientists and

climate data, Biologists and genomic data, etc.)

• Assorted mandates, objectives, approaches

NDIIPP

7#

Answering the Challenges

• LC/NDIIPP to help bring a national focus, encourage collaboration among communities

• LC is providing resources and leadership– Working with other institutions to develop common understanding

• Established ‘Affinity Groups’ based on cross-cutting issues– Selection and Collection

– Rights and Restrictions

– Technical Architecture

– Economic Sustainability

NDIIPP

8#

A Network of PeopleAn Architecture for Preservation

NDIIPP

9#

Working with Other Federal Agencies

• LC/NDIIPP works with the following agencies– National Archives and Records Administration

(responsible for federal records)– National Science Foundation– Government Printing Office– National Library of Medicine– Institute of Museum and Library Services– National Agricultural Library– Department of Commerce/National Institute of Science

and Technology– Office of Science and Technology Policy

NDIIPP

10#

International Context• LC/NDIIPP engaged internationally:

– Founding member of the International Internet Preservation Consortium

– Allied with the Digital Preservation Coalition– Chief Executive of the British Library on

NDIIPP advisory board– Consulted with many national libraries

concerning digital preservation efforts

NDIIPP

11#

NDIIPP


NDIIPP is a Portfolio of Activities

• Four areas of focus– Network of preservation partners– Architectural framework for preservation– Digital preservation research– Intellectual Property

• Two phases of investment – Phase I commenced 2004– Phase II commenced 2006

12#

NDIIPP


A National Content Stewardship Network • 8 Consortial Agreements with 36 Participants• 10 Digital Preservation Grants • 4 AIHT Participants• 2 Technical Archiving and Testing Participants

– Diego Supercomputer Center – Los Alamos National Lab Research Library

• 2 Developers of Preservation Business Models– Portico– LOCKSS/CLOCKSS

• 2 International Partnerships– Representing 12 other national libraries

• 19 Experts on the Section 108 Working Group

13#

NDIIPP


A National Content Stewardship Network • NDIIPP’s Network is comprised of 28 agreements and 67

institutions involved in the beginning stages of building a digital preservation strategy under the NDIIPP program as well as a major initiative to address needed changes to copyright law.

• Reflects distributed approach necessary for preserving the volume and complexity of digital content

14#

NDIIPP


Preserving At-Risk Content• Content Experts providing insight into specific

domain requirements

• Variety of content scope, e.g.– Public television (high-definition digital TV)– Materials relating to southern culture– Government and political web sites– Social science data– Geospatial data– Dot-com era business records

http://digitalpreservation.gov/partners/project.html

15#

NDIIPP


Preservation Research Grants• Joint LC/NSF program funding cutting-edge research • 10 grants across different areas, e.g.

– Large-scale data repositories for oceanographic study data and MODIS satellite images– Video– Engineering and design data– Infrastructure and lifecycle issues, including data provenance and versioning– Incentives for data producers to create archive-ready datasets

– http://www.digitalpreservation.gov/partners/research.html

16#

• Archive Ingest and Handling Test

– Harvard, Stanford, Johns Hopkins & ODU conducted ingest, export, format migration and exchange on a common archive

• Tools and protocols– Los Alamos National Lab Research Library developing tools

and standards to package, disseminate and store e-journal content

• Repository and storage– San Diego Supercomputer Center building and testing utility

and trust in a third-party repository– National Digital Newspaper Program building distributed

content production and validation network and a central repository to preserve digital newspaper content over time

– eDeposit through Copyright acquiring and preserving eJournal content from multiple sources in different formats

Preservation Architecture Projects


NDIIPP

17#

NDIIPP


Preservation Architecture

• Principles: – Support institutional relationships– Separate preservation and access– Construct modularly– Assemble over time, not all at once– Upgrade parts without disruption of the whole– Use broadly adoptable standards and protocols

18#

NDIIPP


Section 108 Study Group• Working group sponsored by NDIIPP with Copyright Office

– 19 copyright experts – half from libraries, archives; half from various content industries

• Mission: – re-examine copyright exceptions applicable to libraries and

archives in light of digital technologies– findings and recommendations on revising law – ensure appropriate balance among copyright interests and

needs of libraries and archives in manner that best serves the national interest

• Submit report to Librarian of Congress by late 2006

• Roundtables on preservation and eligibility held March 2006; written comments due April 17, 2006

19#

NDIIPP


Partnership Outcomes• Identify and preserve significant at-risk content• Leverage resources and experience through

collaboration• Learn how to build and sustain a national digital

stewardship network• Construct a technical infrastructure to support

interoperability and preservation services• Explore public policy issues• Provide basis for 2010 report to Congress

http://digitalpreservation.gov/partners/project.html

20#

NDIIPP


• Expanding partnerships to commercial content and technology companies– Preserving Creative America

• Encouraging development of repositories for state and local “at-risk” content

• Additional funding of NSF/LC Grants

• Additional business models

• Technical infrastructure projects to expand and sustain a preservation network

Phase Two Investments

21#

NDIIPP


Preserving Creative America• Engage the commercial sector• Goals

– Preserve at-risk digital cultural heritage collections• Recorded sound; moving image; interactive/electronic

games; still images– Encourage agreement on preservation standards & best

practices– Support demonstration projects with new tools & services

– Establish Public-Private partnership models

22#

NDIIPP


• LC exploring how best to include the States within the scope of NDIIPP

• Focusing on significant and at-risk state government digital information, broadly defined

• Special attention on multi-state repositories• Received 9 responses June 15, 2006• Funds awarded in September 2006

NDIIPP and the States

23#

NDIIPP


• Establish a network of shareable storage– Support preservation strategies such as content

exchange, syndicated storage and risk assessment

• Develop services to support preservation functions such as– Data replication– Risk assessment– Data integrity assurance – Content validation– Content exchange

• 25 Proposals received June 1, 2006

Technical Infrastructure Projects

24#

Digital Universe

25#

NDIIPP


www.digitalpreservation.gov

The LIBRARY of CONGRESS JISC-CNI Envisioning Future Challenges in Networked Information York,...

Documents

Transcript of The LIBRARY of CONGRESS JISC-CNI Envisioning Future Challenges in Networked Information York,...