Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs ›...

56
Möbius Transformations For Global Intrinsic Symmetry Analysis Vladimir G. Kim Yaron Lipman Xiaobai Chen Thomas Funkhouser Princeton University Symposium On Geometry Processing 2010

Transcript of Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs ›...

Page 1: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Möbius Transformations For

Global Intrinsic Symmetry Analysis

Vladimir G. KimYaron LipmanXiaobai Chen

Thomas Funkhouser

Princeton University

Symposium On Geometry Processing 2010

Page 2: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Goal

Find a map from surface onto itself that preserves geodesic distances

Page 3: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous Work

Extrinsic Symmetry

Intrinsic Symmetry

Symmetry Axis

Laplace-Beltrami Operator

Gromov-Hausdorff Distance

Inter-Surface Correspondence

Möbius Voting

Podolak et al., 2006

Mitra et al., 2006

Page 4: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous Work

Xu et al., 2009

Extrinsic Symmetry

Intrinsic Symmetry

Symmetry Axis

Laplace-Beltrami Operator

Gromov-Hausdorff Distance

Inter-Surface Correspondence

Möbius Voting

Page 5: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous Work

Ovsjanikov et al. '08

Extrinsic Symmetry

Intrinsic Symmetry

Symmetry Axis

Laplace-Beltrami Operator

Gromov-Hausdorff Distance

Inter-Surface Correspondence

Möbius Voting

Page 6: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous Work

Raviv et al. '10

Gromov-Hausdorff Distance

Inter-Surface Correspondence

Möbius Voting

Page 7: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous Work

Extrinsic Symmetry

Intrinsic Symmetry

Symmetry Axis

Laplace-Beltrami Operator

Gromov-Hausdorff Distance

Inter-Surface Correspondence

Möbius Voting

Page 8: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous WorkMöbius Voting

Look for an isometry

Conformal

Area-preserving

Conformal Maps

Mid-edge flattening

Möbius Transformation

Defined by 3 correspondences

Page 9: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous WorkMöbius Voting

Look for an isometry

Conformal

Area-preserving

Conformal Maps

Mid-edge flattening

Möbius Transformation

Defined by 3 correspondences

Complex Plane

Page 10: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous WorkMöbius Voting

z

m(p)

p

m(z)

Look for an isometry

Conformal

Area-preserving

Conformal Maps

Mid-edge flattening

Möbius Transformation

Defined by 3 correspondences

Page 11: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Previous WorkMöbius Voting

Look for an isometry

Conformal

Area-preserving

Conformal Maps

Mid-edge flattening

Möbius Transformation

Defined by 3 correspondences

m(p1)

p1

m(z1)m(z2)

z2

z1

z3

m(z3)

unique m

p2

p3

m(p2)

m(p3)

Page 12: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Our Approach

Look for an Anti-Möbius Transformation that makes intrinsic symmetry extrinsic on complex plane

Page 13: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pipeline

Generating Set S1

Correspondence Set S2

Complex Plane

Best Anti-Möbius

Transformation

Final

Correspondences

Page 14: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pipeline

Generating Set S1

Correspondence Set S2

Best Anti-Möbius

Transformation

Page 15: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Finding a Symmetric Point Set

Generating Set S1

Correspondence Set S2

Page 16: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Goal: need a set containing potential correspondences and stationary points

Approach: use critical points of symmetry invariant function

Finding a Symmetric Point Set

e.g. Find a set invariant under :

Page 17: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Finding a Symmetric Point SetExample Symmetry Invariant Function

Average Geodesic Distance

Page 18: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Finding a Symmetric Point SetExample Symmetry Invariant Function

Average Geodesic Distance

Robust to noise and outliers

Only few extrema

Generating Set for Anti-Möbius Transformations

Local Extrema

Page 19: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Symmetry:

Finding a Symmetric Point SetTheory

Page 20: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Symmetry:

Symmetry Invariant Function:

Finding a Symmetric Point SetTheory

Page 21: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Symmetry:

Symmetry Invariant Function:

Prop. 7.1:

Finding a Symmetric Point SetTheory

Page 22: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Symmetry:

Symmetry Invariant Function:

Prop. 7.1:Look for critical points

Finding a Symmetric Point SetTheory

Page 23: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Symmetry:

Symmetry Invariant Function:

Prop. 7.1:Look for critical points

Theorem 7.6:

If is bilateral reflective, the gradient of is parallel to the curve of stationary points of

Finding a Symmetric Point SetTheory

Page 24: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Symmetry:

Symmetry Invariant Function:

Prop. 7.1:Look for critical points

Theorem 7.6:

If is bilateral reflective, the gradient of is parallel to the curve of stationary points of

At least 2 stationary points will have

Finding a Symmetric Point SetTheory

Page 25: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Symmetry:

Symmetry Invariant Function:

Prop. 7.1:Look for critical points

Theorem 7.6:

If is bilateral reflective, the gradient of is parallel to the curve of stationary points of

At least 2 stationary points will have

For any other symmetry if there is a stationary point it would be a critical point of

Finding a Symmetric Point SetTheory

Page 26: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pipeline

Generating Set S1

Correspondence Set S2

Complex Plane

Best Anti-Möbius

Transformation

Final

Correspondences

Page 27: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pipeline

Best Anti-Möbius

Transformation

Page 28: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Searching for the Best Anti-Möbius Transformation

Goal: find a conformal map

that is as isometric as possible

Approach: use small

symmetry invariant set to

explore conformal mappings

Symmetry Invariant

Point Set from AGD

(21 points)

Page 29: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Searching for the Best Anti-Möbius Transformation

Explore all 3-plets:

Explore all 4-plets: Symmetry Invariant

Point Set from AGD

(21 points)

Page 30: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Searching for the Best Anti-Möbius Transformation

Explore all 3-plets:

Explore all 4-plets: Symmetry Invariant

Point Set from AGD

(21 points)

Page 31: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Best Anti-Mobius Transformation

Bad m

Green Edges:

Mutually Closest Neighbors

under a conformal map defined by m

Good m

Page 32: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Best Anti-Mobius Transformation

Bad m

Alignment Score:

How well does the map preserve area?

Good m

60% mutually closest 17% mutually closest

Page 33: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pruning

Ignore a-priory bad mappings

Different AGD values

Too close correspondences

Different geodesic distances

Bad correspondence

Page 34: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pruning

Ignore a-priory bad mappings

Different AGD values

Too close correspondences

Different geodesic distances

Bad correspondence

Page 35: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pruning

Ignore a-priory bad mappings

Different AGD values

Too close correspondences

Different geodesic distances

Bad Triplet

Page 36: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pipeline

Final

Correspondences

Page 37: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Final Correspondences

Goal: Given sparse correspondences: find a correspondence q for every p

Approach: For any p, find q so that their geodesic distances to sparse set are same

p

pi qi

Similar to:

“Efficient computation of isometry-invariant distances between surfaces”. Bronstein et al. 2006

q

Page 38: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Pipeline

Generating Set S1

Correspondence Set S2

Conformal Space

Best Anti-Möbius

Transformation

Final

Correspondences

Page 39: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Results Benchmark

Goal: quantitatively evaluate performance of our method on 366 models

Scape:

71 Models

Non-Rigid World:

75 Models

SHREC, Watertight’07:

220 models

Page 40: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Results Benchmark

Ground Truth

Geodesic Error

Correspondence Rate

Mesh Rate

Results

Page 41: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Results Benchmark

Ground Truth

Geodesic Error

Correspondence Rate

Mesh Rate

Results

Page 42: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Results Benchmark

Ground Truth

Geodesic Error

Correspondence Rate

Mesh Rate

Results

Geodesic Error for strue

Page 43: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Results Benchmark

Ground Truth

Geodesic Error

Correspondence Rate

Mesh Rate

Results

Geodesic Error for strue

Page 44: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Results Benchmark

Ground Truth

Geodesic Error

Correspondence Rate

Mesh Rate

Results

Correspondence Rate > 75%

Geodesic Error for strue

Page 45: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

ResultsBenchmark

Page 46: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

ResultsScape

Page 47: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

ResultsWatertight'07, Non-rigid world

Page 48: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Comparison

Page 49: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Rotational Symmetry

Page 50: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Large-scale outliers

Best Mobius Second Best Mobius

Page 51: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Conclusion

Anti-Mobius Transformations can be used for analysis of intrinsic symmetries

Method succeeded on 75% of 366 meshes

Our method improves speed and performance significantly over Möbius Voting

Page 52: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Limitations

General partial intrinsic symmetries

Alignment error for a conformal map is global

Symmetry-invariant sets

Robustness to noise

Various functions (other than AGD)

Page 53: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Acknowledgements Funding

NSF (IIS-0612231, CNS-0831374, CCF-0702672, and CCF-0937139)

NSERC Graduate Scholarship (PGS-M, PGS-D)

Google

Rothschild Foundation

Data Daniela Giorgi and AIM@SHAPE (Watertight’07)

Drago Arguelov and Stanford University (SCAPE)

Project TOSCA (Non-Rigid World)

Page 54: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Online

• More data and results:

http://www.cs.princeton.edu/~vk/IntrinsicSymmetry/

Page 55: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Finding a Symmetric Point Set

Minimal Geodesic Distance

S1

Page 56: Möbius Transformations For Global Intrinsic Symmetry Analysisshape.cs.princeton.edu › vkcorrs › talks › 10_SGP_MobiusSymmetry.pdf · Global Intrinsic Symmetry Analysis Vladimir

Finding a Symmetric Point Set

Minimal Geodesic Distance

Can apply iteratively to construct set of arbitrary size

Less robust

Correspondence Set

S1