Slide 1

An Application of Lie theory to Computer Graphics Applied Topology 25 th July. 2013. Bdlewo Shizuo KAJI Yamaguchi University JST/CREST Slide 2 Blend Shape - a problem in CG Mathematical setup Our solution Outline Slide 3 Blend Shape Slide 4 Statue of MoaiJapanese ex-prime minister Mori Slide 5 Blend Shape The problem Problem: From (two or more) input images, generate interpolated images input: A, B => (1-t)A + tB: output Input Output t=0.5 Slide 6 Michael Jackson Black or White Movie: Terminator 2 Forest Gump Creating new industrial design Video compression, High framerate TV Adobe Photoshop/After effects Puppet Warp Where is it used ? Igarashi et al. 2005 Beier and Neely 1992 Slide 7 Construct a series of homeos indexed by t R f t : R 2 R 2 t R Blend Shape basic idea input: A, B => (1-t)A + tB: output It usually requires additional input which should be given manually. (ex. the arrows in the picture) It usually requires additional input which should be given manually. (ex. the arrows in the picture) Slide 8 Weakness of classical method desirable Slide 9 What is an appropriate setup for this problem ? Slide 10 Simplicial complex In CG, the most basic representation of geometric object is (triangulated) polyhedron, i.e., simplicial complex 2D 3D3D 3D3D Slide 11 Simplicial complex More precisely, Abstract simplicial complex (= set of tetrahedra) Piecewise Linear (PL) embedding (= vertex positions in R n ) Slide 12 Instead of considering objects themselves, Consider embeddings from a (reference) simplicial complex And find a suitable path in the space of embeddings Paraphrase of blend shape fAfA fAfA fBfB fBfB f A/2+B/2 Slide 13 Our algorithm Based on Joint works with K. Anjyo, S. Hirose, H. Ochiai and K. Anjyo, S. Hirose, Y. Mizoguchi, S.Sakata Slide 14 Our strategy is divided into three steps 1.Express input shapes by PL-maps from a reference simplicial complex For each t R; 2.Construct interpolated affine maps independently for each simplex 3.Assemble those maps into a global PL-immersion Workflow Problem From given input shapes, generate interpolated shapes input: A, B => (1-t)A + tB: output Slide 15 1. Isomorphic subdivision Fact: Homeo PL-isomorphic (dimension 3) There are algorithms to give an explicit isomorphism. But none of them is perfect. This is still an open problem in computational geometry. Sub problem Given homeomorphic simplicial complexes, subdivided them to make combinatorially isomorphic We simply rely on existing methods here 1-to-1 Slide 16 fAfA fAfA fBfB fBfB H 1/2 HtHt HtHt Assume we have PL-embeddings f A, f B of a reference simplicial complex to the shapes to be blended. We want to find a homotopy H t connecting f A and f B. Assume we have PL-embeddings f A, f B of a reference simplicial complex to the shapes to be blended. We want to find a homotopy H t connecting f A and f B. Slide 17 Sub problem For each simplex, construct a time varying series of interpolated affine maps, which preserve geometry locally. First, we consider simplex-wisely 2. Local construction Slide 18 More precisely, 2. Local construction Sub problem Given two affine maps X and Y, generate a blended affine map A t := (1-t)X + tY The first guess for the answer would be simply the linear combination of X and Y, but it produces bad results. undesirable desirable Slide 19 The second guess would be using Lie correspondence 2. Local construction The above map is almost bijective and its continuous inverse can be computed. Lie algebra Lie group But the problem is the group of affine transformations is not compact. Based on the Cartan decomposition, we have the following surjection, which meets our need. Slide 20 Now we can blend affine maps linearly in the parameter space Key points: is not surjective There is an explicit and fast computation algorithm for , The blended map has geometric meaning: for example, the interpolated map stays as close as Euclidean motion (In the sense of Frobenius norm) 2. Local construction Nice both geometrically and computationally ! Slide 21 Sub problem Assemble the locally constructed affine maps into a global PL-map 3. Patching local maps Local to Global It is done by finding the minimum of a certain energy functional on the space of PL-immersions. Slide 22 The energy functional Key points: * It measures the difference between the PL-map and the locally constructed maps up to PL-conformal equivalence * The minimizer is unique (modulo linear conformal equivalence) and varies smoothly with regard to t Invariant under conformal transformation Users can easily direct the result by adding some terms to it : the simplex-wisely blended affine map Slide 23 Visual consequence Left and center: user defined constraints Right: effect of PL-conformal invariance Left and center: user defined constraints Right: effect of PL-conformal invariance Energy w/o invariance Energy w/ invariance Trajectory of a point Is specified by user Slide 24 Applications input: A, B, C, D => sA + tB + uC + vD + : output Our algorithm directly generalizes to more than two inputs Furthermore, nice properties of our linear parametrization of the affine transformation group allow various applications shape deformer (addition/scalar product) Inverse kinematics (calculus/differential equation) Motion analysis/compression using PCA/ICA (linear algebra) Slide 25 Demo Three shapes are blended according to weights. Weights are specified by user through the ball controller Slide 26 Target shape (dino) is deformed according to users operation on the yellow cage. Demo Slide 27 Shapes are deformed according to user manipulated handles (invisible) Demo Slide 28 There will be a conference on Math for CG in October Google MEIS2013 for detail Advertisement