Batch Loading Workflows

Batch Loading Workflows for DSpace

Maureen P. Walsh, The Ohio State University LibrariesSPARC O A M ti DS U G M h 14 2012

June 30, 2008 ALA Annual: ALCTS AS Technology Committee / LITA Digital Library Technologies IG

SPARC Open Access Meeting: DSpace User Group March 14, 2012

Batch Loading Workflows

Batch Loading Workflows

• Background / Context• Metadata Services and Archiving Optionsg p

• Metadata Repurposing Overview• MARC Metadata• Embedded Image Metadata

P i d T M d• Printed Text Metadata

Batch Loading Workflows

The Ohio State University’s Institutional Repository

Knowledge Bank Mission:to collect preserve and…to collect, preserve, and distribute the digitally

formatted intellectual output f th U i itof the University…

Batch Loading Workflows

67 Communities67 Communities47,369 Items

97 641 C t t Fil97,641 Content Files

Batch Loading Workflows

Knowledge Bank Archived Items

Batch Loading Workflows

KB Metadata Application Profile• Core set of metadata elements and

Dublin Core Metadata Element Set mappings tomappings to• improve retrieval accuracy and

resource discovery• facilitate multi-institutional

i t bilit d lit t linteroperability and quality control• comply with the Open Archives

Initiative Protocol for Metadata Harvestingg

• enable collection migration, import & export between the Knowledge Bank and other systems as necessary

Batch Loading Workflows

KB Collection Core Element Set

Batch Loading Workflows

Individual Item Submission

Batch Loading Workflows

Customized Input Forms (Display)

Batch Loading Workflows

Customized Input Forms (XML)

Batch Loading Workflows

Customized Input Forms (Display)

Batch Loading Workflows

Customized Input Forms (XML)

Batch Loading Workflows

Customized Input Templates (Display)

Batch Loading Workflows

Customized Input Templates (Dublin Core)

Batch Loading Workflows

Importing Items in Batch

Batch Loading Workflows

Batch Loading – DSpace Simple Archive Format

Batch Loading Workflows

Batch Loading – Metadata CSV

Batch Loading Workflows

Batch Loading – Dublin Core

DSpace Dublin Core XML DSpace Item Record

Batch Loading Workflows

Building the Simple Archive Format

• Simple Archive Formathttps://wiki.duraspace.org/display/DSDOC18/Importing+and+Exporting+Items+via+Simple+Archive+Format

• Custom Perl Scripts• Examplesphttp://hdl.handle.net/1811/46845

• Stand-alone Java ToolStand alone Java Tool• Simple Archive Format Packagerhttps://wiki.duraspace.org/display/DSPACE/Simple+Archive+Format+Packager

Batch Loading Workflows

Repurposing MARC Metadata

Batch Loading Workflows

Repurposing MARC Metadata

Dublin Core IR

MARC - Catalog

Dublin Core - IR

Batch Loading Workflows

Repurposing MARC Metadata

• XSLT Workflow

• Export Tab Delimited Records Workflow

Batch Loading Workflows

XSLT Workflow

Batch Loading Workflows

XSLT Workflow

[Truncated] XSLT[Truncated] XSLT

MarcEdit by Terry ReeseFull example available at:http://hdl.handle.net/1811/47564

Batch Loading Workflows

Export Tab Delimited Records Workflow

MarcEdit by Terry Reese

Batch Loading Workflows

MarcEdit CSV Export

Batch Loading Workflows

Batch Load CSV

Batch Loading Workflows

Repurposing Embedded Image Metadata

Batch Loading Workflows

Embedded Metadata Workflow

Adobe Photoshop

Batch Loading Workflows

Extracting Metadata with ExifTool

Adobe Photoshop

Batch Loading Workflows

ExifTool CSV Export

Batch Loading Workflows

Batch Load CSV

Batch Loading Workflows

Batch Loading Workflows

Repurposing PrintedText Metadata

Batch Loading Workflows

Delimited Text Workflow

Batch Loading Workflows

Delimited Text Workflow

Batch Loading Workflows

Delimited Result

Batch Loading Workflows

Thank You

Maureen P. WalshMetadata Librarian / Assistant ProfessorThe Ohio State University Librarieswalsh.260@osu.edu