Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group...

31
Texture Synthesis Texture Synthesis over over Arbitrary Manifold Arbitrary Manifold Surfaces Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University

  • date post

    21-Dec-2015

  • Category

    Documents

  • view

    240

  • download

    0

TAGS:

Transcript of Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group...

Page 1: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Texture Synthesis Texture Synthesis overover

Arbitrary Manifold SurfacesArbitrary Manifold Surfaces

Li-Yi Wei Marc Levoy

Computer Graphics GroupStanford University

Page 2: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

IntroductionIntroduction

+

Synthesize a surface texture by coloring mesh vertices

Input Texture Input Mesh Result

Page 3: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Desirable PropertiesDesirable Properties

• Share advantages of 2D algorithm [SIGGRAPH 2000]

– Quality– Efficient– General– Easy to use

• Minimum distortion

• Minimum discontinuity

Page 4: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Previous WorkPrevious Work

• Texture Mapping– Global [Catmull’74, Bier’86, Levy’98]– Local

• Triangle tiles [Neyret’99]

• Lapped textures [Praun’00]

Page 5: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Previous WorkPrevious Work

• 3D Texture synthesis– procedural [Perlin’85, Turk’91, Witkin’91]– from example

• surface texture [Gagalowicz’86, Turk’01, Ying’01]

• volume texture [Heeger’95, Ghazanfarpour ’96]

Page 6: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Previous WorkPrevious Work

• 2D Texture from Example– pyramid matching [Heeger’95, Simoncelli’98]– block shuffling [De Bonet’97, Xu’00]– Markov Random Field [Popat’93]– neighborhood search [Efros’99, Wei’00]

Page 7: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Texture Synthesis byTexture Synthesis byNeighborhood SearchNeighborhood Search

noise

Input pyramid

noise

Output pyramid

Search

Copy

Page 8: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Surface Texture Synthesis bySurface Texture Synthesis byNeighborhood SearchNeighborhood Search

Input pyramid Output pyramid

Search

Page 9: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Differences betweenDifferences betweenImages and MeshesImages and Meshes

Our Solutionimageimage meshmesh

Synthesis Order

Pixels/Vertices

Local Orientation(Vector field)

?

?

mesh re-tiling[Turk’92]

user-specifiedrelaxationrandom

randomscanline

u

v

grid

Neighborhood flattening/resampling

normal

? ?tangent bitangent

Page 10: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

ProcessProcess

1. Build image/mesh pyramids

2. Assign texture orientation

3. Generate texture

Page 11: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Image & Mesh PyramidsImage & Mesh Pyramids

Mesh Retiling [Turk’92]

Page 12: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Retiling DensityRetiling Density

24576 vertices 73728 vertices

Page 13: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Texture OrientationTexture Orientation

• Methods for orienting textures – user-specified– random (for isotropic textures)– smooth or symmetric (for anisotropic textures)

• by relaxation

Page 14: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

4-way symmetric texture 4-way symmetric vector field

Texture OrientationTexture Orientation

Page 15: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Texture Orientation by Texture Orientation by RelaxationRelaxation

• Minimize an error function– similar to [Hertzmann’00, Pedersen’95]

Page 16: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

SynthesisSynthesis

Page 17: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Synthesis : 2 Lowest LevelsSynthesis : 2 Lowest Levels

Page 18: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Synthesis : Lowest LevelSynthesis : Lowest Level

Random copy

Page 19: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Synthesis Pass1 : Synthesis Pass1 : ExtrapolationExtrapolation

Search

Copy

Shooting normal

Page 20: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Synthesis Pass2 :Synthesis Pass2 :Full NeighborhoodFull Neighborhood

Search

Copy

Page 21: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Neighborhood ComparisonNeighborhood Comparison

compare ?

Page 22: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Mesh NeighborhoodMesh Neighborhood

Resample

Compare

Resampled Grid

2D Patch

3D Patch

Flatten (Maillot’93)

Page 23: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Accelerating Accelerating Neighborhood SearchNeighborhood Search

• Tree-structured Vector Quantization [Wei’00]

Page 24: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Multiresolution SynthesisMultiresolution Synthesis

Page 25: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Results:Results:Random OrientationRandom Orientation

Page 26: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Results:Results:Other OrientationsOther Orientations

Random User-specified Relaxation

2-way symmetry

4-way symmetry

Page 27: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

ResultsResults

smooth 4-way symmetry random

Page 28: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

ResultsResults

Surface displacement

smooth 2-way symmetry 2-way symmetry

Page 29: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Summary of DifferencesSummary of Differences

Turk’s approach Our approach

Vector field

Traversal order

Neighborhood

Mesh hierarchy

smooth random, symmetric

sweeping random

surface marching flattening/resampling

explicit parent/child shooting normal

Page 30: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

Future WorkFuture Work

• Texture transfer between models

• Texturing animated models

• Mesh signal processing

Page 31: Texture Synthesis over Arbitrary Manifold Surfaces Li-Yi Wei Marc Levoy Computer Graphics Group Stanford University.

More InformationMore Information

http://graphics.stanford.edu/projects/texture/


arXiv:0912.1177v2 [math.NA] 12 Aug 2010where is an arbitrary discrete differential -form [3,5,11] defined on a discrete manifold, and is a discrete vector field living on this manifold.

arXiv:0912.1177v2 [math.NA] 12 Aug 2010where is an arbitrary discrete differential -form [3,5,11] defined on a discrete manifold, and is a discrete vector field living on this manifold.

Light field photography and videography Marc Levoy Computer Science Department Stanford University.

Light field photography and videography Marc Levoy Computer Science Department Stanford University.

Power divider ( Arbitrary Termination Impedance, Arbitrary Power Division )

Power divider ( Arbitrary Termination Impedance, Arbitrary Power Division )

Structured Light principles Figure from M. Levoy, Stanford Computer Graphics Lab.

Structured Light principles Figure from M. Levoy, Stanford Computer Graphics Lab.

Light field photography and microscopy Marc Levoy Computer Science Department Stanford University.

Light field photography and microscopy Marc Levoy Computer Science Department Stanford University.

Sensors & noise by Marc Levoy - Computer graphics · Sensors & noise CS 448A, Winter 2010 Marc Levoy Computer Science Department Stanford University

Sensors & noise by Marc Levoy - Computer graphics · Sensors & noise CS 448A, Winter 2010 Marc Levoy Computer Science Department Stanford University

CHESS 2: Castling and Forking…and a Stalemate A Levoy Power Point.

CHESS 2: Castling and Forking…and a Stalemate A Levoy Power Point.

60009 Intake Manifold Exhaust Manifold Emission Control System

60009 Intake Manifold Exhaust Manifold Emission Control System

Efficient Similarity Search : Arbitrary Similarity Measures, Arbitrary Composition

Efficient Similarity Search : Arbitrary Similarity Measures, Arbitrary Composition

Arbitrary Democracy

Arbitrary Democracy

et al. pl(X) Pl(X) - maths.ed.ac.ukv1ranick/papers/milin.pdf · 254 LAZAR MILIN formula for an arbitrary combinatorial manifold. The 'non-combinatorial part' of the formula requires

et al. pl(X) Pl(X) - maths.ed.ac.ukv1ranick/papers/milin.pdf · 254 LAZAR MILIN formula for an arbitrary combinatorial manifold. The 'non-combinatorial part' of the formula requires

TRB for AF: The Idea arbitrary failureslorenzo/corsi/cs380d/past/08S/notes/week7.pdf · arbitrary failures Crash Arbitrary failures with message authentication Arbitrary (Byzantine)

TRB for AF: The Idea arbitrary failureslorenzo/corsi/cs380d/past/08S/notes/week7.pdf · arbitrary failures Crash Arbitrary failures with message authentication Arbitrary (Byzantine)

Marc Levoy Using Plane + Parallax to Calibrate Dense Camera Arrays Vaibhav Vaish, Bennett Wilburn, Neel Joshi, Marc Levoy Computer Science Department.

Marc Levoy Using Plane + Parallax to Calibrate Dense Camera Arrays Vaibhav Vaish, Bennett Wilburn, Neel Joshi, Marc Levoy Computer Science Department.

, tome 53 (1981), p. 53-78. - Yale Universitytd252/858/Gromov-PolyGrowth.pdf · 2008. 1. 25. · Geometric corollary. An expanding self-map of an arbitrary compact manifold is tope-logically

, tome 53 (1981), p. 53-78. - Yale Universitytd252/858/Gromov-PolyGrowth.pdf · 2008. 1. 25. · Geometric corollary. An expanding self-map of an arbitrary compact manifold is tope-logically

Light Þelds and plenoptic cameras - graphics.stanford.edu · flipbook animation (QuickTime VR) [Chen 1995] rebinning the rays to create new views [Levoy 1996]! 2010 Marc Levoy Outline

Light Þelds and plenoptic cameras - graphics.stanford.edu · flipbook animation (QuickTime VR) [Chen 1995] rebinning the rays to create new views [Levoy 1996]! 2010 Marc Levoy Outline

SURGERY ON COMPACT MANIFOLDSv1ranick/books/scm.pdf2. a surgery obstruction theory for manifolds with arbitrary fundamental group, including the exact sequence for the set of manifold

SURGERY ON COMPACT MANIFOLDSv1ranick/books/scm.pdf2. a surgery obstruction theory for manifolds with arbitrary fundamental group, including the exact sequence for the set of manifold

BASED ON THE MULTIPLANE TECHNIQUE Marc Levoy · BASED ON THE MULTIPLANE TECHNIQUE Marc Levoy Program of Computer Graphics ... wherein the lines of the drawing appear to dis-

BASED ON THE MULTIPLANE TECHNIQUE Marc Levoy · BASED ON THE MULTIPLANE TECHNIQUE Marc Levoy Program of Computer Graphics ... wherein the lines of the drawing appear to dis-

Marc Levoy Graphics research and courses at Stanford .

Marc Levoy Graphics research and courses at Stanford .

This is a Mr. Levoy PowerPoint

This is a Mr. Levoy PowerPoint

This is a Mr. Levoy PowerPoint The United States Court System.

This is a Mr. Levoy PowerPoint The United States Court System.