ANSIG An Analytic Signature for Permutation Invariant 2D Shape Representation

30
ANSIG An Analytic Signature for Permutation Invariant 2D Shape Representation José Jerónimo Moreira Rodrigues

description

ANSIG  An Analytic Signature for Permutation Invariant 2D Shape Representation. José Jerónimo Moreira Rodrigues. Outline. Motivation: shape representation Permutation invariance : ANSIG Dealing with geometric transformations Experiments Conclusion Real-life demonstration. - PowerPoint PPT Presentation

Transcript of ANSIG An Analytic Signature for Permutation Invariant 2D Shape Representation

Page 1: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIG An Analytic Signature forPermutation Invariant 2D Shape Representation

José Jerónimo Moreira Rodrigues

Page 2: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIG

Outline

Motivation: shape representation

Permutation invariance: ANSIG

Dealing with geometric transformations

Experiments

Conclusion

Real-life demonstration

Page 3: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation ANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Motivation

The

Permutation

Problem

Page 4: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation ANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Shape diversity

Page 5: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation ANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

When the labels are known: Kendall’s shape

‘Shape’ is the geometrical information that remains

when location/scale/rotation effects are removed.

Limitation:

points must have labels, i.e.,

vectors must be ordered, i.e.,

correspondences must be known

Page 6: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation ANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Without labels: the permutation problem

permutation matrix

Page 7: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation ANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Our approach:seek permutation invariant representations

Page 8: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

Motivation

ANSIGANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

ANSIG

Page 9: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

Motivation

ANSIGANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

The analytic signature (ANSIG) of a shape

Page 10: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

Motivation

ANSIGANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Maximal invariance of ANSIG

same signature equal shapes

same signature equal shapes

Page 11: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

Motivation

ANSIGANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Maximal invariance of ANSIG

Consider , such that

Since , their first nth order derivatives are equal:

Page 12: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

Motivation

ANSIGANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Maximal invariance of ANSIG

This set of equalities implies that - Newton’s identities

The derivatives are the moments of the zeros of the polynomials

Page 13: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

Motivation

ANSIGANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Storing ANSIGs

The ANSIG maps to an analytic function

How to store an ANSIG?

Page 14: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

Motivation

ANSIGANSIG Geometric

transformations Experiments Conclusion Real-life demonstration

Storing ANSIGs

2) Approximated by uniform sampling:

1) Cauchy representation formula:

512

Page 15: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Geometrictransformations

Page 16: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

(Maximal) Invariance to translation and scale

Remove mean and normalize scale:

Page 17: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Sampling density

Page 18: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Shape rotation: circular-shift of ANSIG

Rotation

Page 19: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Efficient computation of rotation

Solution: maximum of correlation. Using FFTs,

“time” domain frequency domain

Optimization problem:

Page 20: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Shape-based classificationSHAPE TOCLASSIFY

SHAPE 3

SHAPE 2

SHAPE 1

MÁX

Similarity

Similarity

Similarity

SHAPE

2

DAT

ABA

SE

Page 21: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Experiments

Jeras
Experiments or results?
Page 22: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

MPEG7 database (216 shapes)

Page 23: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Automatic trademark retrieval

Page 24: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Robustness to model violation

Page 25: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Object recognition

Page 26: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Conclusion

Page 27: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Summary and conclusion

ANSIG: novel 2D-shape representation- Maximally invariant to permutation (and scale, translation)- Deals with rotations and very different number of points- Robust to noise and model violations

Relevant for several applications

Development of software packages for demonstration

Publications:- IEEE CVPR 2008- IEEE ICIP 2008- Submitted to IEEE Transactions on PAMI

Page 28: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Future developments

Different sampling schemes

More than one ANSIG per shape class

Incomplete shapes, i.e., shape parts

Analytic functions for 3D shape representation

Page 29: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Real-lifedemonstration

Jeras
Experiments or results?
Page 30: ANSIG    An  Analytic Signature  for Permutation Invariant 2D Shape Representation

ANSIGMotivation Geometric

transformations Experiments Conclusion Real-life demonstrationANSIG

Shape-based image classfication

Shap

eda

taba

se

Pre-processing: morphological filter operations, segmentation, etc.

Image acquisition

system

Shape-based classification