KE EMu Peabody Museum of Natural History atthe The four YPM buildings Peabody (YPM) Environmental...
-
Upload
derrick-purkiss -
Category
Documents
-
view
220 -
download
3
Transcript of KE EMu Peabody Museum of Natural History atthe The four YPM buildings Peabody (YPM) Environmental...
KE EMu
Peabody Museum of Natural History
at the
The four YPM buildings
Peabody(YPM)
EnvironmentalScience Center
(ESC)
Geology / Geophysics(KGL)
175 Whitney(Anthropology)
Confluence of YPM, KGL, ESC
KGL YPM
ESC
Peabody CollectionsCounts & Functional Cataloguing Unit
• Anthropology 325,000 Lot• Botany 350,000 Individual• Entomology 1,000,000 Individual• Invertebrate Paleontology 300,000 Lot• Invertebrate Zoology 300,000 Lot• Mineralogy 35,000 Individual• Paleobotany 150,000 Individual• Scientific Instruments 2,000 Individual• Vertebrate Paleontology 125,000 Individual• Vertebrate Zoology 185,000 Lot / Individual
2.7 million functional units => ~11 million items
Peabody CollectionsFunctional Units Databased
• Anthropology 325,000 90 %• Botany 350,000 1 %• Entomology 1,000,000 1 %• Invertebrate Paleontology 300,000 55 %• Invertebrate Zoology 300,000 20 %• Mineralogy 35,000 85 %• Paleobotany 150,000 60 %• Scientific Instruments 2,000 100 %• Vertebrate Paleontology 125,000 60 %• Vertebrate Zoology 185,000 95 %
930,000 of 2.7 million => 35 % overall
VZKristof Zyskowski (Vert. Zool. - ESC)
Greg Watkins-Colwell(Vert. Zool. - ESC)
HSIShae Trewin
(Scientific Instruments – KGL )
VPMary Ann Turner
(Vert. Paleo. – KGL / YPM)
ANTMaureen DaRos
(Anthro. - YPM / 175 Whitney)
EMu Planning
2002 Collections Computerization Committee deliberations
2003 Q2 on-site demonstrations from CM vendors
2003 Q3+ talk with existing clients of CM vendors
EMu Planning
2002 Collections Computerization Committee deliberations
2003 Q2 on-site demonstrations from CM vendors
2003 Q3+ talk with existing clients of CM vendors
Lots of other folks…
Classic Argus
Argus Module EMu Module
Object CatalogueObject ConservationObject Internal MovementsLexicon TaxonomyActivity Accession LotsActivity LoansSite Collecting EventsSite SiteConstituent PartiesPublication Bibliography
Old to the New
Single CMS shared by all Departments for about a decade - YPM staff cohabiting
internally and realizing commonalities
- streamlined system administration- ease strain of future migration path
Prior Argus Experience
EMu Implementation
01/2004 Data mapping starts, contract refinement02/2004 Major data parsing & cleaning starts in Argus07/2004 Contracts signed, Vancouver starts08/2004 Servers configured, YPM-test environment running09/2004 Begin iterative screen design & tests with tiny datasets10/2004 Draft YPM-live environment added to server10/2004 One week of KE training for collections staff11/2004 Staff working with draft YPM-live environment02/2005 Larry to Vancouver to work with Negar03/2005 YPM-live screen design & data mappings stabilizing04/2005 Last uploads to Argus, prep for final data migration05/2005 Final data migration, all curatorial disciplines
1.5 years total
EMu Implementation
01/2004 Data mapping starts, contract refinement02/2004 Major data parsing & cleaning starts in Argus07/2004 Contracts signed, Vancouver starts08/2004 Servers configured, YPM-test environment running09/2004 Begin iterative screen design & tests with tiny
datasets10/2004 Draft YPM-live environment added to server10/2004 One week of KE training for collections staff11/2004 Staff working with draft YPM-live environment02/2005 Larry to Vancouver to work with Negar03/2005 YPM-live screen design & data mappings stabilizing04/2005 Last uploads to Argus, prep for final data migration05/2005 Final data migration, all curatorial disciplines
Local Emu web site
EMu training session
19 trainees
Even with best intentions the ‘EMu Big Picture’ can remain a bit fuzzy…
Clarity…
Ian TurnbullNegar Samenirad
EMu Implementation
01/2004 Data mapping starts, contract refinement02/2004 Major data parsing & cleaning starts in Argus07/2004 Contracts signed, Vancouver starts08/2004 Servers configured, YPM-test environment running09/2004 Begin iterative screen design & tests with tiny datasets10/2004 Draft YPM-live environment added to server10/2004 One week of KE training for collections staff11/2004 Staff working with draft YPM-live environment02/2005 Larry to Vancouver to work with Negar03/2005 YPM-live screen design & data mappings stabilizing04/2005 Last uploads to Argus, prep for final data migration05/2005 Final data migration, all curatorial disciplines
06/2005 Safe to jump into the water…
EMu Users Group
a.k.a. Weekly Therapy
- started meetings at go-live- topic du jour as a kick off- then open season on issues - driven by users' experiences
Specimens
Some Miscellaneous Statistics
• 1,200,000 Argus records => 2,100,000 EMu records
• 3 days for Argus server to spit out the final migration files
• 12 days for EMu server to ingest the final migration files
• held a final migration “race” between the KE & YPM servers
• lost few weeks to Vancouver server hiccups, office move, etc.
operating in Emu - IZ Chomping at the bit…
Invertebrate Zoology
Lourdes Rojas
Eric Lazo-Wasem
Dan Drew
operating in Emu - IZpartitioning backlogged multi-species samples…
operating in Emu - IZ
Site record for lot
operating in Emu - IZ
Site record for lot RTF label
operating in Emu - IZ
Site record for lot RTF label
Datamax I-4406 (thermal)
operating in Emu - IZ
Site record for lot RTF label
Datamax I-4406 (thermal) …label(s) into jar
Excerpts from YPM Modules
Catalogue - adjustments for speed
Taxonomy - Lexicon tab
Catalogue ANT
Catalogue HSI
Catalogue IZ
DET – IZ4
Cloned the grid elements for:"Current" Identification
"Filed Asth" Identificationinto additional, separate fields
Yowza ! An identification updater is coming to EMu !
Tax – higher
Tax - lex
Tax – lex expand1
Tax – lex expand2
Tax – lex expand2
- levels of children to display is regulated by a registry entry- assigning the parent sets the full path back up the tree- optional viewing mechanism grafted onto the base module
PRINCIPLE #1 = LEAVE EXTANT MODULE INTACT !
taxontree1
taxontree2
taxontree2
Other external resources?Drag and drop reparenting?Alternate classifications?Autopopulating Luts fields?
Backend Script Tinkering
= Creative Destruction
JPEG 2000 and EMu - protem freeware fix
Admin Module - the proverbial black box
http://www.jpeg.org/jpeg2000
non-proprietary standardmathematically losslesslossy (much smaller files)"perceptually" losslessdesktop sofwtare emerging
http://www.fnordware.com/j2k
JP2 spicebush
JP2 spicebush with J2K
JP2 spicebush with J2K and tail target
JP2 spicebush tails with file sizes
1.54 mB 15 kB
JP2 spicebush tails with moral
lossless JP2 => circa 30-40% original TIFF size
lossy JP2 => go to circa 1%-5%, depending on purpose
Reed Beaman1, Nico Cellinese1, Bryan Heidorn2, Ashley Green1, Youjun Guo1,
Michael Donoghue1, Barbara Thiers3,Heather Rolan3 & Melissa Tulig3
1Peabody Museum of Natural History, Yale University
2Graduate School of Library and Information Science, University of Illinois at Urbana-Champaign
1The New York Botanical Garden
Funded by the US National Science Foundation
Digital Darkroom
• TTI 30 x 40 inch vacuum easel copy stand
• UV free, minimal IR lighting
• Hardware colorimetric calibration
• Apple G5 workstation• 3.2 Tbytes RAID storage
and tape library backup• Pipeline to image
processing web services
Lynn Jones (Botany)
261 kb 1,302 kb
5,166 kb 62,640 kb
JP2 - withoutoops… no thumbnail
JP2 - coding
find imagedir –name *.jp2 –mtime -2 –print
loop on the matches and test to see which recently loaded JP2 files are missing a thumbnail JPG, or which JP2 files have been modified more recently than their existing thumbnail JPG ; then build filenames for any qualifying target JPGs ; execute script several times per hour from cron
jasper –f match –F tempfile
convert tempfile –resize 90x90 target
JP2 - without
JP2 - with
JP2 – size matters
a hefty TIFF… or a ballet of tiny JP2s ?
Ask your EMu server what it might prefer
Scripting a data load
Scripting a data load
Save to simple text format
Scripting a data load
Save to simple text format
Script to convertto Texpress input
Scripting a data load
Save to simple text format
Script to convertfor Texpress
Texpress 'fidsbrief'
Scripting a data load
Save to simple text format
Script to convertfor Texpress
Texpress 'fidsbrief'
Texpress grammar file
Scripting a data load
Save to simple text format
Script to convertfor Texpress
Texpress 'fidsbrief'
Texpress grammar file
Admin
Send output to location of your choice (e.g., Admin Results window)
Admin
Send output to location of your choice (e.g., Admin Results window)
texload -ch -ddatafile -ggrammarfile ecataloguetexload -as -ddatafile -ggrammarfile ecatalogue
Local catalog service
Ornis
Paleoportal
Cope and labels
Cope MacClintock (Inv. Paleo.)
Cope chopping
another Happy Camper
finis