Post on 04-Aug-2015
Tracing the afterlife of iconic photographs using IPTC
Martijn Kleppe@martijnkleppe
Slide on slideshare: bit.ly/dh2015kleppe
Nick Ut, 1972
Charlie Cole, Newsweek, 1989
Icons
Composition
Archetype
Often Published
Variations
Emotions
Meaning clear
Symbolic Meaning
Meaning changes
5
Icons
Composition
Archetype
Often Published
Variations
Emotions
Meaning clear
Symbolic Meaning
Meaning changes
METHOD
7
International Press Telecommunications Council
METHOD
9
International Press Telecommunications Council
METHOD
10
• Dataset of ~ 5.000 photographs
• 400 Dutch History textbooks
• 1970 - 2000
• Analyzed on 41 variables
Fotostation Pro
1912
1918
RESULTS
DISCUSSION
13
• Metadata in IPTC helps to find reuse of materials
• BUT: Still manual process
http:
//ha
nnes
sth.
tum
blr.c
om/p
ost/
7631
4269
980
HELP IS UNDER WAY!
14
IMAGE RECOGNITION
15
• Track-down copyright protected images• Assess impact scholarly images online
(Kousha 2010)• Find patterns in large image databases
(Losh 2014, Manovich 2009)• Analyse reuse cultural & heritage material
(Terras 2013)• Similar images within closed dataset
(Reside 2014; Resig 2014)
TO BE CONTINUED
16
• Researcher-in-residence
• PhoCon: Photos in and out Context
• Deep learning techniques in computer vision and natural language processing
17
See you in Krakow!
https
://e
n.w
ikip
edia
.org
/wik
i/Fi
le:K
rak%
C3%
B3w
_-_S
ukie
nnic
e_01
_cro
pped
.jpg
References• Brandhorst, H.: “The Iconography of the Pleasures and Problems of Drink: Thoughts on the Opportunities and Challenges for Access and
Collaboration in the Digital Age”. In: Visual Resources, 28(4), 384-390 (2012).• Finnegan, C.A.: “What is this a picture of? Some Thoughts on Images and Archives”, In: Rethoric & Public Affairs 9, 116 – 123 (2006).• Grijsen, C.: “In perspectief: behoud en beheer van born-digital fotoarchieven” (In perspective: conservation and management of born-digital
photo archives). In: Fotografisch Geheugen 75, 24 – 26. (2012).• Hariman, R. & Lucaites, J.L.: No Caption Needed: Iconic Photographs, Public Culture, and Liberal Dmeocracy (2007),• Kleppe, M.: Canonieke Icoonfoto’s. De rol van (pers)foto’s in de Nederlandse geschiedschrijving (Canonical Iconic Photographs: The role of (press)
photos in Dutch Historiography). Eburon, Delft (2013a).• Kleppe, M.: Foto’s in Nederlandse Geschiedenisschoolboeken (FiNGS) (Photos in Dutch History textbooks)
http://www.persistent-identifier.nl/?identifier=urn:nbn:nl:ui:13-l37n-bi (2013b).• Kleppe, M.: “Wat is het onderwerp op een foto? De kansen en problemen bij het opzetten van een eigen fotodatabase” (What is the subject of a
picture? The opportunities and difficulties in setting up their own photo database). In: Tijdschrift voor Mediageschiedenis 2 93 – 107 (2012).• Kroes, R.: Photographic memories: Private pictures, public images, and American history. Dartmouth College, Hanover (2007).• Kousha, Kayvan, Mike Thelwall, and Somayeh Rezaie. “Can the impact of scholarly images be assessed online? An exploratory study using image
identificationtechnology.” Journal of the American Society for Information Science and Technology 61.9: 1734-1744 (2010).• Losh, Elizabeth: “Visualizing Global News”. Digital Humanities 2014 http://dharchive.org/paper/DH2014/Paper-869.xml. • Manovich, Lev. “Cultural analytics: Visualing cultural patterns in the era of more media.” Domus (923) (2009).• Oomen, Johan. & Brugman, Hennie: “Thesauri gekoppeld” (Thesauri Linked), In: Digitale Bibliotheek 2 (5) 18- 21 (2010)• Paul, Gerhard, Das Jahrhundert der Bilder. 1949 bis heute (Göttingen 2008).• Reser, G., & Bauman, J.: “The Past, Present, and Future of Embedded Metadata for the Long-Term Maintenance of and Access to Digital Image
Files”. In: International Journal of Digital Library Systems (IJDLS), 3(1), 53-64 (2012).• Resig, J. (2014). “Using Computer Vision to Increase the Research Potential of Photo Archives.” Journal of Digital Humanities, 3(2).
http://journalofdigitalhumanities.org/3-2/using-computer-vision-to-increase-the-research-potential-of-photo-archives-by-john-resig/• Resode, D. (2014): ‘Using Computer Vision to Improve Image Metadata’. Digital Humanities 2014. http://
dharchive.org/paper/DH2014/Paper-294.xml (2014)• Rose, G.: Visual Methodologies – An Introduction to the interpretation of Visual Materials. Sage Publications, London (2007).• Smeulders, Arnold W. M. e.a., “Content-Based Image Retrieval at the End of the Early Years”, IEEE Transactions on Pattern Analysis and Machine
Intelligence 22, 1349 – 1380 (2000).• Terras, M. M., and I. Kirton. “Where do images of art go once they go online? A Reverse Image Lookup study to assess the dissemination of
digitized cultural heritage.” Selected papers from Museums and the Web North America, 237 – 248 (2013).• Wallace, D.: “Words as Keys to the Image Bank” In: Bailey, C.: Revisualizing Visual Culture (2010).• Wu, Zhong, et al. “Bundling features for large scale partial-duplicate web image search.” Computer Vision and Pattern Recognition, 2009. CVPR
2009. IEEE Conference on. IEEE, (2009).15-04-2023 Key concepts and perspectives of digital scholarschip 18
Questions?Martijn Kleppe
kleppe@eshcc.eur.nlwww.martijnkleppe.nl
@martijnkleppe Slides on Slideshare: bit.ly/dh2015kleppe
Interested in Audiovisual material &
Digital Humanities? Join our SIG!
https://avindhsig.wordpress.com