Tracing the afterlife of iconic photographs using IPTC

Martijn Kleppe@martijnkleppe

Slide on slideshare: bit.ly/dh2015kleppe

Nick Ut, 1972

Charlie Cole, Newsweek, 1989

Icons

Composition

Archetype

Often Published

Variations

Emotions

Meaning clear

Symbolic Meaning

Meaning changes

5

Icons

Composition

Archetype

Often Published

Variations

Emotions

Meaning clear

Symbolic Meaning

Meaning changes

METHOD

7

International Press Telecommunications Council

METHOD

9

International Press Telecommunications Council

METHOD

10

• Dataset of ~ 5.000 photographs

• 400 Dutch History textbooks

• 1970 - 2000

• Analyzed on 41 variables

Fotostation Pro

1912

1918

RESULTS

DISCUSSION

13

• Metadata in IPTC helps to find reuse of materials

• BUT: Still manual process

http:

//ha

nnes

sth.

tum

blr.c

om/p

ost/

7631

4269

980

HELP IS UNDER WAY!

14

IMAGE RECOGNITION

15

• Track-down copyright protected images• Assess impact scholarly images online

(Kousha 2010)• Find patterns in large image databases

(Losh 2014, Manovich 2009)• Analyse reuse cultural & heritage material

(Terras 2013)• Similar images within closed dataset

(Reside 2014; Resig 2014)

TO BE CONTINUED

16

• Researcher-in-residence

• PhoCon: Photos in and out Context

• Deep learning techniques in computer vision and natural language processing

17

See you in Krakow!

https

://e

n.w

ikip

edia

.org

/wik

i/Fi

le:K

rak%

C3%

B3w

_-_S

ukie

nnic

e_01

_cro

pped

.jpg

References• Brandhorst, H.: “The Iconography of the Pleasures and Problems of Drink: Thoughts on the Opportunities and Challenges for Access and

Collaboration in the Digital Age”. In: Visual Resources, 28(4), 384-390 (2012).• Finnegan, C.A.: “What is this a picture of? Some Thoughts on Images and Archives”, In: Rethoric & Public Affairs 9, 116 – 123 (2006).• Grijsen, C.: “In perspectief: behoud en beheer van born-digital fotoarchieven” (In perspective: conservation and management of born-digital

photo archives). In: Fotografisch Geheugen 75, 24 – 26. (2012).• Hariman, R. & Lucaites, J.L.: No Caption Needed: Iconic Photographs, Public Culture, and Liberal Dmeocracy (2007),• Kleppe, M.: Canonieke Icoonfoto’s. De rol van (pers)foto’s in de Nederlandse geschiedschrijving (Canonical Iconic Photographs: The role of (press)

photos in Dutch Historiography). Eburon, Delft (2013a).• Kleppe, M.: Foto’s in Nederlandse Geschiedenisschoolboeken (FiNGS) (Photos in Dutch History textbooks)

http://www.persistent-identifier.nl/?identifier=urn:nbn:nl:ui:13-l37n-bi (2013b).• Kleppe, M.: “Wat is het onderwerp op een foto? De kansen en problemen bij het opzetten van een eigen fotodatabase” (What is the subject of a

picture? The opportunities and difficulties in setting up their own photo database). In: Tijdschrift voor Mediageschiedenis 2 93 – 107 (2012).• Kroes, R.: Photographic memories: Private pictures, public images, and American history. Dartmouth College, Hanover (2007).• Kousha, Kayvan, Mike Thelwall, and Somayeh Rezaie. “Can the impact of scholarly images be assessed online? An exploratory study using image

identificationtechnology.” Journal of the American Society for Information Science and Technology 61.9: 1734-1744 (2010).• Losh, Elizabeth: “Visualizing Global News”. Digital Humanities 2014 http://dharchive.org/paper/DH2014/Paper-869.xml. • Manovich, Lev. “Cultural analytics: Visualing cultural patterns in the era of more media.” Domus (923) (2009).• Oomen, Johan. & Brugman, Hennie: “Thesauri gekoppeld” (Thesauri Linked), In: Digitale Bibliotheek 2 (5) 18- 21 (2010)• Paul, Gerhard, Das Jahrhundert der Bilder. 1949 bis heute (Göttingen 2008).• Reser, G., & Bauman, J.: “The Past, Present, and Future of Embedded Metadata for the Long-Term Maintenance of and Access to Digital Image

Files”. In: International Journal of Digital Library Systems (IJDLS), 3(1), 53-64 (2012).• Resig, J. (2014). “Using Computer Vision to Increase the Research Potential of Photo Archives.” Journal of Digital Humanities, 3(2).

http://journalofdigitalhumanities.org/3-2/using-computer-vision-to-increase-the-research-potential-of-photo-archives-by-john-resig/• Resode, D. (2014): ‘Using Computer Vision to Improve Image Metadata’. Digital Humanities 2014. http://

dharchive.org/paper/DH2014/Paper-294.xml (2014)• Rose, G.: Visual Methodologies – An Introduction to the interpretation of Visual Materials. Sage Publications, London (2007).• Smeulders, Arnold W. M. e.a., “Content-Based Image Retrieval at the End of the Early Years”, IEEE Transactions on Pattern Analysis and Machine

Intelligence 22, 1349 – 1380 (2000).• Terras, M. M., and I. Kirton. “Where do images of art go once they go online? A Reverse Image Lookup study to assess the dissemination of

digitized cultural heritage.” Selected papers from Museums and the Web North America, 237 – 248 (2013).• Wallace, D.: “Words as Keys to the Image Bank” In: Bailey, C.: Revisualizing Visual Culture (2010).• Wu, Zhong, et al. “Bundling features for large scale partial-duplicate web image search.” Computer Vision and Pattern Recognition, 2009. CVPR

2009. IEEE Conference on. IEEE, (2009).15-04-2023 Key concepts and perspectives of digital scholarschip 18

Questions?Martijn Kleppe

kleppe@eshcc.eur.nlwww.martijnkleppe.nl

@martijnkleppe Slides on Slideshare: bit.ly/dh2015kleppe

Interested in Audiovisual material &

Digital Humanities? Join our SIG!

https://avindhsig.wordpress.com