Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et...

50
Mesh Denoising via L 0 Minimization Lei He Scott Schaefer Texas A&M University

Transcript of Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et...

Page 1: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Mesh Denoising via L0 Minimization

Lei He Scott Schaefer

Texas A&M University

Page 2: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Surface Denoising

Page 3: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Related Work

[Desbrun et al. 1999] [Vollmer et al. 1999] [Nealen et al. 2006] [Kim et al. 2005]

[Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt et al. 2004] [Tasdizen et al. 2002]

[Yagou et al. 2002] [Fleishman et al. 2003] [Jones et al. 2003] [Zheng et al. 2012]

Page 4: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Related Work

[Desbrun et al. 1999] [Vollmer et al. 1999] [Nealen et al. 2006] [Kim et al. 2005]

[Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt et al. 2004] [Tasdizen et al. 2002]

[Yagou et al. 2002] [Fleishman et al. 2003] [Jones et al. 2003] [Zheng et al. 2012]

Page 5: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Related Work

[Desbrun et al. 1999] [Vollmer et al. 1999] [Nealen et al. 2006] [Kim et al. 2005]

[Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt et al. 2004] [Tasdizen et al. 2002]

[Yagou et al. 2002] [Fleishman et al. 2003] [Jones et al. 2003] [Zheng et al. 2012]

Page 6: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Motivation

[Xu et al. 2011]

Page 7: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Norm

Page 8: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Images

[Xu et al. 2011]

Page 9: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Images

auxiliary variables

[Xu et al. 2011]

> 1, for L=0,1,2,…

Page 10: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Images

• Fix , update locally

• Fix , update globally

• Increment

[Xu et al. 2011]

Page 11: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Images

[Xu et al. 2011]

Page 12: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Images

piecewise constant images! [Xu et al. 2011]

Page 13: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Images

[Xu et al. 2011]

Page 14: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Surfaces

?

Page 15: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Surfaces

Page 16: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

L0 Minimization for Surfaces

• Properties of

• a discrete linear operator

• measure planarity

Page 17: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

Page 18: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

A

Page 19: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

• Vertex-based cotangent operator

Page 20: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

• Vertex-based cotangent operator

Page 21: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

• Vertex-based cotangent operator

[Pinkall and Polthier 1993]

Page 22: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

input surface vertex-based

cotangent operator

cotangent

edge operator

area-based

edge operator

Page 23: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

Page 24: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

• Edge-based cotangent operator

Page 25: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

• Edge-based cotangent operator

[Bergou et al. 2006]

Page 26: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

input surface vertex-based

cotangent operator

cotangent

edge operator

area-based

edge operator

Page 27: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

Page 28: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

Page 29: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

Page 30: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

Page 31: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

Page 32: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

• When are planar,

Page 33: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Discrete Differential Operator

input surface vertex-based

cotangent operator

cotangent

edge operator

area-based

edge operator

Page 34: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Regularization

ground truth noisy input without

regularization

With

regularization

Page 35: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Regularization

Page 36: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Regularization

Page 37: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Regularization

ground truth noisy input without

regularization

with

regularization

Page 38: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Optimization

> 1, for L=0,1,2,…

Page 39: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Optimization

> 1, for L=0,1,2,…

Page 40: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Parameters

input mesh

increase

Page 41: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Parameters

ground truth noisy input

decrease

Page 42: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Results

[Desbrun et al. 1999] [Vollmer et al. 1999] [Nealen et al. 2006] [Kim et al. 2005]

[Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt et al. 2004] [Tasdizen et al. 2002]

[Yagou et al. 2002] [Fleishman et al. 2003] [Jones et al. 2003] [Zheng et al. 2012]

Page 43: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Results

[Desbrun et al. 1999] [Vollmer et al. 1999] [Nealen et al. 2006] [Kim et al. 2005]

[Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt et al. 2004] [Tasdizen et al. 2002]

[Yagou et al. 2002] [Fleishman et al. 2003] [Jones et al. 2003] [Zheng et al. 2012]

PMC

BNF BF MF

Page 44: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Results

noisy input BF PMC MF BNF our result

Page 45: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Results

noisy input BF PMC MF BNF our result

Page 46: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Results

noisy input BF PMC MF BNF our result

Page 47: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Results

noisy input BF PMC MF BNF our result

Page 48: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Results

noisy input BF PMC MF BNF our result

Page 49: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

Results

noisy input our result

Page 50: Mesh Denoising via L0 MinimizationRelated Work [Vollmer et al. 1999] [Desbrun et al. 1999] [Kim et al. 2005] [Nealen et al. 2006] [Clarenz et al. 2000] [Bajaj and Xu 2003] [Hildebrandt

A failure case

ground truth our result noisy input