International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston,...

28
International Journal of Computer Vision, 321-331 (1988 o 1987 KIuwer Academic Publishers, Boston, Manufactured The Netherlands Snakes: Active Contour Models Active Contour Models Speak by Lingfeng Mo

Transcript of International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston,...

Page 1: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Active Contour Models

Speak by

Lingfeng Mo

Page 2: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Snakes( energy-minimizing systems): 1. is an energy-minimizing spline guided by external

constraint forces and influenced by image forces that pull it toward features such as lines and edges.

2. Snakes are active contour models: they lock onto nearby edges, localizing them accurately.

3. The way the contours slither while minimizing their energy, hence the name.

Introduction

Page 3: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

What can snakes do?

1. Former: detection of edges, lines, and subjective contours; motion tracking; and stereo matching.

2. Now: interactive interpretation, in which user-imposed constraint forces guide the snake near features of interest.

Page 4: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Energy minimizing model

Former: have a rich history but regarded as autonomous

Now: developed interactive techniques for guidding them

Page 5: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Main Work: finding salient image contours-edges, lines, and subjective contours-as well as tracking thosecontours during motion and matching them in stereopsis.

Traditional way: detect edges and linking them

Now: use high level computation, and high-level mechanisms can interact with the contour model by pushing it toward an appropriate local minimum.

Page 6: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Fig.1 Lower-left: original wood pgotograph from Brodatz.Others: Three different local minima for the active contour model.

Page 7: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

How good can snakes do?

1. Can not finding entire salient image contours but rely on other mechanisms to place them near the desired contour.

2. Once snakes were placed close to an intended contour, its energy minimization will take care of the rest of the way.

Page 8: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Some terms:

1. Internal spline forces: impose a piecewise smoothness constraint.

2. Image forces: push the snake toward salient image features, such as lines, edges, and subjective contours.

3. External constraint forces: putting the snake near the desired local minimum. Can be user interface, automatic attentional mechanisms or high-level interpretations.

Page 9: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Representing the position of a snake parametricallyby v(s) = (x(s), y(s)), we can write its energyfunctional as

Page 10: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

2.1 Internal Energy

The internal spline energy can be written

Page 11: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Snake Pit: Specify the particular image feature in a certain picture.

Page 12: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Image Forces

1. Line Functioan

2. Edge Function

3. Termination Funciont

Page 13: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Line Function

PS: Used in Fig. 2

Page 14: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Edge Function

snake is attracted to contours with large image gradients.

Page 15: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Page 16: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Add his energy term to snake means that it is attracted to zero-crossings but still constrained by its own smoothness.

Scale Space Continuation

How to deal with a picture with very blurry energy functional and reduce the blurring?

Page 17: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Page 18: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Termination Function

Use the curvature of level lines in a slightly smoothed mage to find terminations of line segments and corners.

Page 19: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Combining E-edge and E-term, can creat a snake that is attracted to edges or terminations.

Page 20: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

snakes are constantly minimizing their energy, they can exhibit hysteresis when shown moving stimuli. Figure 6 shows a snake tracking a movingsubjective contour.

Page 21: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Page 22: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

StereoSnakes can also be applied to the problem of stereo

matching. In stereo, if two contours correspond,then the disparity should vary slowly along the contour

unless the contour rapidly recedes in depth.

Page 23: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Psychophysical evidence [4] of a disparity gradient limit in human stereopsis.

human visual system do not change too rapidly with space. This disparities constraint can be expressed in an additional energy functional for a stereo snake:

Page 24: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Page 25: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Motion

Shows the “Lock on” function of the snakes

Page 26: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Page 27: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Pros:1. Prove that snakes is useful for interactive speciticationof image contours. 2. Scale-space continuation greatly enlarge the capture region

around features of interest.3. The snake model provides a unified treatmentto a collection of visual problems that have beentreated differently in the past. 4. The snake provides a number of widely separated local minima

to further levels of processing. Instead of committing irrevocably to a single interpretation, snakes can change their interpretation based on additional evidence from higher levels of processing.

1.

Page 28: International Journal of Computer Vision, 321-331 (1988) o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands Snakes: Active Contour.

International Journal of Computer Vision, 321-331 (1988)o 1987 KIuwer Academic Publishers, Boston, Manufactured in The Netherlands

Snakes: Active Contour Models

Cons:

1. Lack of some background about the research in the past in detail

2. Omit the important function step for introducing the function.

3. Many grammar mistakes are not hard to find. Such as the adjective and noun. Sometimes made me confused.