At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam....

23
At td P ti Automated Preservation: The Case of Digital Raw Photographs Stephan Bauer, Christoph Becker ICADL 2011 Beijing

Transcript of At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam....

Page 1: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

A t t d P tiAutomated Preservation:The Case of Digital Raw Photographs

Stephan Bauer, Christoph BeckerICADL 2011Beijingj g

Page 2: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Joseph Nicéphore Niépce

Page 3: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

stallio (flickr)

Page 4: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Why RAW

digital negativedigital negative

most authentic version of the image

no lossy compression as in jpeg

new tools may create better interpretationsy p

not an image: uninterpolated sensor data

Page 5: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Developing a raw file

Demosaiquing

White balance adjustmentWhite balance adjustment

Colorimetric interpretationColorimetric interpretation

iTone mapping

Image enhancements

Page 6: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

interpretation

Page 7: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW
Page 8: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Adobe

ron

vert

er

dcraw

e D

NG

CAdo

b

Applepp

Page 9: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

validate

migrate

Page 10: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Evaluation framework

numerous proprietary raw formats – high risknumerous proprietary raw formats high risk

normalization to standardized format desirable

How to evaluate and validate?

preservation planningpreservation planningsystematic evaluation method and tool

controlled experimentationcontrolled experimentation

automated measurements

Page 11: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

migrate

comparison

comparison

comparison

comparison

Page 12: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Automated Measurements

traditional quality assurance methods traditional quality assurance methods are error based

common tools not reliablecommon tools not reliable

requirementsperception based

respecting ICC-profiles

meaningful for color images

Page 13: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

equal MSE

https://ece.uwaterloo.ca/~z70wang/research/ssim/#MAD

Page 14: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Significant Properties - Content

relative AESSIM

SSIM Hue

relative MSE

SSIM Saturation

Page 15: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Significant Properties - Context

Exif (exposure)IPTC

Exif (technical)Dublin Core

MetadataExif (location)Private Tags

XMPExif (generated)(g )

Page 16: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Contribution

image comparison metrics implementedimage comparison metrics implementedusing Java Advanced Imaging API

metadata e ification sing E ifToolmetadata verification using ExifTool

comparing Adobe DNGConverter and digiKamp g g

migrate and validate a representative selection

Page 17: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Results – CRW

RAW DNG by digikam

raw data are identicalraw data are identicalincorrect color matrix generated

Page 18: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Results – CRW

RAWRAW

DNG by digiKam

Page 19: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Results – CR2

RAW DNG RAW DNG by

ADC

two embedded color matrices

Page 20: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Results – CR2

RAW

DNG by ADC

Page 21: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Conclusion

demonstrated fully automated QAi t t f th t t l l l th dusing state of the art perceptual level method

well suited to falsify: find bad conversionsyet not suited to fully verify conversions

SSIM allows meaningful measurements

Page 22: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

Outlook

implement workflows using tavernaimplement workflows using taverna

run large scale tests

correlation of SSIM and manual evaluation

use more tools for QAQ

expand approach to different types of content

Page 23: At td Automated PtiPreservationbecker/slides/20111026-ICADL... · 2011. 11. 28. · DNG by digiKam. Results – CR2 RAW DNG by ADC two embedded color matrices. Results – CR2 RAW

??Automated Preservation: The Case of Digital Raw PhotographsStephan Bauer, Christoph Becker, ICADL 2011

www.ifs.tuwien.ac.at/~becker