Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital...

41
Interactive Digital Photomontage Aseem Agarwala 1 Mira Dontcheva 1 Maneesh Agrawala 2 Steven Drucker 2 Alex Colburn 2 Brian Curless 1 David Salesin 1,2 Michael Cohen 2 1 University of Washington 2 Microsoft Research Presented by: Gagan Bansal 1

Transcript of Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital...

Page 1: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage

Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2 Brian Curless1 David Salesin1,2 Michael Cohen2

1University of Washington 2Microsoft Research

Presented by: Gagan Bansal1

Page 2: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Photomontage : What does it mean

Combining parts of a set of photographs into a single composite picture ---(of course with minimum visible artifacts !!!!)

2Interactive Digital Photomontage

Presented by : Gagan Bansal

Page 3: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

3

Page 4: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

4

Page 5: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

5

Page 6: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

6

Page 7: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

7

Page 8: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Issues Involved

• How to select the seams where to cut the images so that they merge as seamlessly as possible in the composite image ?

• How to minimize the remaining artifacts in the composite image?

Interactive Digital Photomontage Presented by : Gagan Bansal

8

Page 9: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

9

Page 10: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Overview of the Approach

• Choosing seams– Use Graph Cut

• Minimizing the remaining artifacts– Gradient domain fusion based on Poisson equation

Interactive Digital Photomontage Presented by : Gagan Bansal

10

Page 11: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Image Objectives

• Designated Color• Minimum or maximum luminance• Minimum or maximum Contrast• Minimum or maximum likelihood• Eraser• Minimum or maximum difference• Designated Image

Interactive Digital Photomontage Presented by : Gagan Bansal

11

Page 12: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Seam Objectives

• Colors – match colors• Colors and gradients• Colors and edges – prefer seams that lie

along edges

Seam objectives are global

Interactive Digital Photomontage Presented by : Gagan Bansal

12

Page 13: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Graph Cut

Interactive Digital Photomontage Presented by : Gagan Bansal

13

Page 14: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Graph Cut

• Data Penalty– Designated Color – Euclidean distance of color to

be assigned from color in source image– Designated Image - 0 if same label– Eraser – Euclidean distance of source from current

composite ( ? )

Interactive Digital Photomontage Presented by : Gagan Bansal

14

Page 15: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Graph Cut

Interactive Digital Photomontage Presented by : Gagan Bansal

15

Page 16: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Gradient Domain Fusion

• Use labels on composite to determine the source gradient field.

• Same as in Perez et al.• Add a constraint – user chooses a pixel whose

color constrained to color in source image

Interactive Digital Photomontage Presented by : Gagan Bansal

16

Page 17: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Applications

• Selective Composites

Interactive Digital Photomontage Presented by : Gagan Bansal

17

Page 18: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Applications

• Selective Composites• Extended depth of field

Interactive Digital Photomontage Presented by : Gagan Bansal

18

Page 19: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

19

Page 20: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

20

Page 21: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

21

Page 22: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

22

Page 23: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Result – used maximum local contrast

Interactive Digital Photomontage Presented by : Gagan Bansal

23

Page 24: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Applications

• Selective Composites• Extended depth of field• Relighting

Interactive Digital Photomontage Presented by : Gagan Bansal

24

Page 25: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

25

Page 26: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

26

Page 27: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

27

Page 28: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

28

Page 29: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Result – using max or min luminance

Interactive Digital Photomontage Presented by : Gagan Bansal

29

Page 30: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Applications

• Selective Composites• Extended depth of field• Relighting• Stroboscopic visualization of movement

Interactive Digital Photomontage Presented by : Gagan Bansal

30

Page 31: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Applications

• Selective Composites• Extended depth of field• Relighting• Stroboscopic visualization of movement• Time lapse mosaics

Interactive Digital Photomontage Presented by : Gagan Bansal

31

Page 32: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Applications

• Selective Composites• Extended depth of field• Relighting• Stroboscopic visualization of movement• Time lapse mosaics• Panoramic stitching

Interactive Digital Photomontage Presented by : Gagan Bansal

32

Page 33: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

33

Page 34: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

34

Page 35: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

35

Page 36: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

36

Page 37: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Result

Interactive Digital Photomontage Presented by : Gagan Bansal

37

Page 38: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Applications

• Selective Composites• Extended depth of field• Relighting• Stroboscopic visualization of movement• Time lapse mosaics• Panoramic stitching• Clean plate production

Interactive Digital Photomontage Presented by : Gagan Bansal

38

Page 39: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

39

Page 40: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Interactive Digital Photomontage Presented by : Gagan Bansal

40

Page 41: Interactive Digital Photomontagemisha/Fall07/Notes/Agarwala04.pdf · Interactive Digital Photomontage Aseem Agarwala1 Mira Dontcheva1 Maneesh Agrawala2 Steven Drucker2 Alex Colburn2

Result – using max or min likelihood

Interactive Digital Photomontage Presented by : Gagan Bansal

41