Introduction to Collections as Data Follow along: https ... · Collections as data stewards are...
Transcript of Introduction to Collections as Data Follow along: https ... · Collections as data stewards are...
![Page 1: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/1.jpg)
Introduction to Collections as Data
Follow along: https://tinyurl.com/whseumv
Joe Carrano, Alex McGee, Greta Suiter, Chris Tanguay, Rachel Van Unen
![Page 2: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/2.jpg)
AGENDA9:00 – 9:15 Group Norms and Intros
9:15 – 10:15 Collections as Data Introduction
10:15 – 10:45 Project Percolator
10:45 – 11:00 Break
11:00 – 12:00 Case Studies
12:00 – 1:00 Lunch
1:00 – 2:00 Overview of Collections as Data Tools
2:00 – 2:45 Collaboration and Assumptions
2:45 – 3:00 Wrap Up
![Page 3: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/3.jpg)
Group norms / ROPES
RespectOpen mind, opportunityParticipate / passEmpathy, Education, EscucharSafe space
![Page 4: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/4.jpg)
Introductions
● Introduce yourself to someone you’ve never met before
● Name, affiliation, reason for attending
● As a pair, find another pair, and introduce your partner
![Page 5: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/5.jpg)
Collections as DataIntroduction
![Page 6: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/6.jpg)
![Page 7: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/7.jpg)
Definition
![Page 8: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/8.jpg)
● Ordered information● Stored digitally● Inherently amenable to
computation- Elizabeth Russey Roke,bloggERS! July 16, 2019
![Page 9: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/9.jpg)
Evolution of Digital Access
Early initiatives focused on digital surrogates
Special Collections and Archives, Cal Poly
![Page 10: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/10.jpg)
Evolution of Digital Access
Collections as data approach provides access beyond just the object itself, e.g. OCR text downloads
Special Collections and Archives, Cal Poly
![Page 11: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/11.jpg)
“To see collections as data begins with reframing all digital objects as data.”
- Thomas Padilla,“On a Collections as Data Imperative”
![Page 12: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/12.jpg)
Collections as Data Myths
● I need to be a programmer / have access to a programmer’s time○ False! Although public APIs are great!
■ New York Public Library■ Library of Congress
● My project needs to have a very broad scope to reach as many people as possible○ False! Don’t try to be all things to all people
![Page 13: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/13.jpg)
Collections as Data Myths (continued)
● My colleagues are so busy, I need to do this project on my own○ False! Involving an appropriately sized group of various
stakeholders will lead to better results
![Page 14: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/14.jpg)
“Digital tools we build and provide are likely to reflect and perpetuate stereotypes, biases, and inequalities”
- Chris Bourg,OLA Super Conference, January 2015
![Page 15: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/15.jpg)
The Collections as Data Project
![Page 16: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/16.jpg)
Always Already Computational: Collections as Data focused on current and potential approaches to developing cultural heritage collections that support computationally-driven research and teaching.
![Page 17: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/17.jpg)
“Collections as Data: Part to Whole aims to foster the development of broadly viable models that support implementation and use of collections as data.”
![Page 18: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/18.jpg)
Principles
![Page 19: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/19.jpg)
Santa Barbara Statement on Collections as DataVersion 2
Written by the Always Already Computational: Collections as Data project team
![Page 20: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/20.jpg)
Collections as data development aims to encourage computational use of digitized and born digital collections.
![Page 21: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/21.jpg)
Collections as data stewards are guided by ongoing ethical commitments.
Collection stewards aim to respect the rights and needs of the content creators, those represented in collections, and the communities that use them.
![Page 22: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/22.jpg)
Collections as data stewards aim to lower barriers to use.
A range of accessible instructional materials and documentation should be developed to support data use.
![Page 23: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/23.jpg)
Collections as data designed for everyone serve no one.
Specific needs inform collections as data development.
![Page 24: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/24.jpg)
Shared documentation helps others find a path to doing the work.
➔ Document!➔ Document!➔ Document!
![Page 25: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/25.jpg)
Collections as Data should be made openly accessible by default, except in cases where ethical or legal obligations preclude it.
![Page 26: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/26.jpg)
Collections as data development values interoperability.
![Page 27: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/27.jpg)
Collections as data stewards work transparently in order to develop trustworthy, long-lived collections.
![Page 28: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/28.jpg)
Data as well as the data that describe those data are considered in scope.
➔ images ➔ metadata➔ finding aids or other description➔ data resulting from analysis of those data
![Page 29: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/29.jpg)
The development of collections as data is an ongoing process and does not necessarily conclude with a final version.
![Page 30: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/30.jpg)
Who is using collections as data?
![Page 31: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/31.jpg)
Humanists
Distant reading
Text and Data mining
Network graphs
Spatial analysis, GIS, mapping
Spatial analysis, GIS, mapping
Timelines
N-gram
Basically any sort of data viz!
![Page 32: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/32.jpg)
Science Community
![Page 33: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/33.jpg)
Data Journalists
![Page 34: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/34.jpg)
Civic data users
Community members
City planners
Open data advocates
Nonprofit and research professionals
![Page 35: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/35.jpg)
Social Scientists
![Page 36: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/36.jpg)
Computer ScientistsNatural Language Processing
Name Entity Recognition
Sentiment analysis
Machine learning, Computer vision
Computational Archival Science is an example of a crossover between GLAM/comp sci
![Page 37: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/37.jpg)
Teachers and Students
Need easy intro datasets for students, low barrier methods that aren’t programming heavy
Create workshops and classes for students to learn new methods
Miriam Posner’s intro to DH class website is a great example
![Page 39: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/39.jpg)
Cultural Heritage Professionals
Archivists
Metadata experts
Data Librarians
Subject specialists
Repository administrator
Library administrators
Library developers
Outreach staff
![Page 40: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/40.jpg)
50 things you can do
Within the next 1-6 months, what can you do within your own workplace to realistically and relatively easily improve/ move forward collections as data work?
![Page 41: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/41.jpg)
50 things themes
● Generate institutional support/interest○ ex. #10, 14, 15, 16, 17, 18, 19, 20, 23, 24, 29, 30, 31, 38, 40, 41, 45
● Lay groundwork for future projects○ ex. #1, 2, 4, 5, 6, 7, 9, 11, 12, 13, 25, 27, 29, 32, 33, 34, 36, 37, 42, 47, 48
● Scope potential projects○ ex. #43, 44, 46
![Page 42: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/42.jpg)
Ways to access collections as data
![Page 43: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/43.jpg)
Finding data
Data download – csv, xml, json, database, image files, etc
API calls, OAI-PMH for metadata
FOIA, lawsuit
Web scraping
Jupyter notebooks
Digitization/reformatting
Getting Data
![Page 44: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/44.jpg)
Once you have the data you often have to edit or enhance it to suit your needs
![Page 45: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/45.jpg)
Project Percolator
What data set makes a good collections as data project? Where do I start?
![Page 46: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/46.jpg)
Learning Goals
● Discuss the application of Collections as Data principles in relation to example data sets.
● Practice analyzing and evaluating example data sets to better recognize potential projects in the future.
![Page 47: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/47.jpg)
Project Percolator
● Intro - 5 mins● In groups of 2-3 choose a data set
and discuss below Qs - 10 mins● What format is data in?● What are opportunities?● What are challenges?
● Find another pair/group and share data set and at least one opportunity or challenge - 10 mins
● Group share - 5 mins
![Page 48: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/48.jpg)
BREAK!
![Page 49: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/49.jpg)
Collections as DataCase Studies
![Page 50: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/50.jpg)
A Matchbook Map
Case study from the University of Utah J. Willard Marriott Library Special Collections
ArcGIS in action!
![Page 51: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/51.jpg)
Harold Stanley Sanders Matchbook Collection
➔ Series from the Harold Stanley Sanders collection➔ Documents businesses in Utah➔ Comprises 4 of 134 boxes in the collection➔ 678 matchbooks
![Page 52: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/52.jpg)
The Data
![Page 53: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/53.jpg)
The Data
➔ Additional metadata by Rachel Wittmann➔ Shared on GitHub➔ CSV and TXT files➔ Open for reuse
https://github.com/marriott-library/collections-as-data/tree/master/matchbooks
![Page 54: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/54.jpg)
The Data
https://github.com/marriott-library/collections-as-data/tree/master/matchbooks
![Page 56: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/56.jpg)
Library of Colors A case study from the Library of Congress LC Labs Innovator
in Residence, Jer Thorp
![Page 57: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/57.jpg)
Analyzing permanent collection data
at the National Gallery of Art in DC
“The National Gallery of Art
will be the first American art
museum to invite teams of
data scientists and art
historians to analyze,
contextualize, and visualize
its permanent collection
data.”
![Page 58: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/58.jpg)
6 Teams given NGA full permanent collection data
Team 1 - InceptionV3 neural network
Team 2 - Spatial data w/in paintings + w/in museum
Team 3 - Reflect vs. attract America
Team 4 - Diversity on display
Team 5 - Intention in acquisition
Team 6 - Focus on women donors
![Page 59: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/59.jpg)
Team 1 - Pittsburgh - Neural network - clustering images by visual similarity
![Page 60: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/60.jpg)
Team 3 - George Mason University
![Page 61: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/61.jpg)
Team 4 - Diversity on display (or is it?) - calls for data curation along w/ art curation
![Page 62: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/62.jpg)
Team 5 - undergrads from multiple institutions - Intention in acquisition
![Page 63: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/63.jpg)
Team 6 - NGA - Women as donors
![Page 64: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/64.jpg)
Takeaways from NGA datathon
● What do we want from the data?○ How do we form questions to ask of the data?○ What is the data telling us?
● What do we want from the project?○ Who shares information about the project?○ How are audiences engaged in the project?○ Scale of project?
![Page 65: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/65.jpg)
Eastern Apps: Visualizing Historic Prison Data
![Page 66: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/66.jpg)
Women Men
![Page 67: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/67.jpg)
![Page 68: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/68.jpg)
![Page 69: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/69.jpg)
MIT Indie Tarot Collection
![Page 70: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/70.jpg)
Every 3 minutes/Texas Runaway Ads Twitter Bots
● @Every3Minutes● @TxRunawayAds
![Page 71: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/71.jpg)
Every 3 minutes
● Twitter bot created by historian, W. Caleb McDaniel● Tweets every 3 minutes that an enslaved person was sold,
in relation to statistics compiled by historian Herbert Gutman
● Now includes data/images from cultural heritage collections
● More info
![Page 72: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/72.jpg)
Texas Runaway Ads
● Twitter bot created by students in historian, W. Caleb McDaniel’s digital humanities course
● Tweets text and image twice a day of runaway slave ad from Portal for Texas History
● More info
![Page 73: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/73.jpg)
LUNCH!
![Page 74: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/74.jpg)
Collections as DataTools
Photo by Ashim D’Silva on Unsplash
![Page 75: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/75.jpg)
Library as laboratory
2020 IAP library offerings - focus on making
● Basics of Copyrights, Data, and Software Intellectual Property
● Data Management for Postdocs and Research Scientists
● Data Visualization: Introduction to Tools and Principles
● GIS Level 1: Introduction to GIS & Mapping
● Introduction to Cleaning and Prepping Data with OpenRefine
● Introduction to R Graphics with ggplot2
● Introduction to Web Scraping with Python
● Lockedletter Book Making
● Make an Online Map: Introduction to Carto
● Software Carpentries: Introduction to Unix Shell, Python, and Git
![Page 76: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/76.jpg)
The Wikimedia universe
![Page 77: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/77.jpg)
77
Wikipedia Written sum of human knowledge
Wikidata Structured data, semantic representation
Commons Multimedia formats
slides borrowed from Andrew Lih, @fuzheado, from LD4 2019 keynote
![Page 78: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/78.jpg)
![Page 79: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/79.jpg)
What is Wikidata?
● www.wikidata.org
● A website that anyone can edit
● That uses software called Wikibase (an extension to MediaWiki)
● To create a repository of linked open data
![Page 80: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/80.jpg)
●Wikidata is comprised of items
● Items have properties
●Properties have values
item property value
Noam Chomsky Instance of Human
Q9049 P31 Q5
item property value
Massachusetts Institute of Technology
Founded by William Barton Rogers
Q49108 P112 Q2341286
![Page 81: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/81.jpg)
Benefit: re-using, re-mixing and re-imagining that human
knowledge in new innovative ways
81
slides borrowed from Andrew Lih, @fuzheado, from LD4 2019 keynote
![Page 82: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/82.jpg)
What’s in Wikidata?
● 75,322,058 data items○ One item for every topic that is in Wikipedia○ There can also be items for topics that are not yet in Wikipedia
■ Places ■ People■ Paintings & artworks ■ Scientific articles…
● Items are multilingual
![Page 83: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/83.jpg)
You can ask Wikidata things with SPARQL
Q1368825
query.wikidata.org
![Page 84: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/84.jpg)
Let’s Query!
SELECT ?person ?personLabel ?birthplaceLabel ?coordinates ?birthdateWHERE { ?person wdt:P485 wd:Q6784299 . = person with archives at MIT Libraries ?person wdt:P21 wd:Q6581072 . = person with sex or gender female ?person wdt:P19 ?birthplace . = person with place of birth anywhere ?birthplace wdt:P625 ?coordinates . = place of birth with coordinate location anywhere ?person wdt:P569 ?birthdate = person with date of birth any date of birth SERVICE wikibase:label { bd:serviceParam wikibase:language "en".} }
Ewan McAndrew Wikidata Sparql Query Tutorial - YouTube
![Page 85: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/85.jpg)
![Page 86: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/86.jpg)
![Page 87: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/87.jpg)
![Page 88: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/88.jpg)
Use OpenRefine to see what is already in Wikidata
Detailed instructions “Using OpenRefine to Reconcile Name Entities”By Karen H. on The Metro Fellowship website
![Page 90: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/90.jpg)
Resources
OpenRefine tutorial: Getting Started with OpenRefine
British Library data sets: Downloads
![Page 91: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/91.jpg)
Facet data to find possible duplication
![Page 92: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/92.jpg)
Normalize your terms
![Page 93: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/93.jpg)
General Refine Expression Language (GREL) example
![Page 96: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/96.jpg)
Archives Unleashed
Data analysis of web archives
![Page 97: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/97.jpg)
Archives Unleashed Cloud
Archives Unleashed Cloud allows for importing data from Archive-it and is currently free for Archive-It Users.
● How to set it up with your account ● Allows you to create derivative sets of data to
analyze
![Page 98: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/98.jpg)
Archives Unleashed Jupyter Notebooks
● Jupyter notebooks walk you through code snippets and how to run larger programs
● How to install and set up● Let’s try an example
![Page 99: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/99.jpg)
Questions?Other tools that you love/work with/want to share with others?
Suggested tools:
● Timeline JS● Drupal Views● Internet Archive● StoryMaps
![Page 100: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/100.jpg)
Collaboration and Assumptions
![Page 101: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/101.jpg)
Definitions
Assumption: a thing that is accepted as true or as certain to happen, without proof.
Bias: prejudice in favor of or against one thing, person, or group compared with another, usually in a way considered to be unfair.
Implicit bias refers to the attitudes or stereotypes that affect our understanding, actions, and decisions in an unconscious manner.
![Page 102: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/102.jpg)
Thinking things through...
● How many people will be involved in this project and what will their roles be?
● What assumptions are you making about the project?
● What potential biases are there in these assumptions?
![Page 103: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/103.jpg)
Assumption Junction - 15 mins
Go back to your data set and project percolator partner(s). Keeping in mind the format of the data, and what the opportunities and challenges are, spend 15 minutes discussing the following questions:
● What does the ideal team look like to complete this project? What can you do? What expertise do you need from others?
● How will you recruit and build your team?● What does the complete project look like? What tools might you use?● When you think about the opportunities and challenges for your
project what assumptions are you making?
![Page 104: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/104.jpg)
Share out: What assumptions and/or biases did you talk about? Best practices for overcoming them?
Group google doc here:
https://tinyurl.com/r6t4345
![Page 105: Introduction to Collections as Data Follow along: https ... · Collections as data stewards are guided by ongoing ethical commitments. Collection stewards aim to respect the rights](https://reader034.fdocuments.net/reader034/viewer/2022051310/5ffe3533c61a81050924f79a/html5/thumbnails/105.jpg)
Thank you!Joe Carrano | [email protected]
Alex McGee | [email protected]
Greta Suiter | @gkur | [email protected]
Chris Tanguay | [email protected]
Rachel Van Unen | [email protected]