A Multi-Resolution Dynamic Model for Face Aging...

8
A Multi-Resolution Dynamic Model for Face Aging Simulation Jinli Suo GUCAS [email protected] Feng Min Songchun Zhu Lotus Hill Institute fmin.lhi,[email protected] Shiguang Shan Xilin Chen GUCAS sgshan,[email protected] Abstract In this paper we present a dynamic model for simulating face aging process. We adopt a high resolution grammat- ical face model[1] and augment it with age and hair fea- tures. This model represents all face images by a multi-layer And-Or graph and integrates three most prominent aspects related to aging changes: global appearance changes in hair style and shape, deformations and aging effects of fa- cial components, and wrinkles appearance at various facial zones. Then face aging is modeled as a dynamic Markov process on this graph representation which is learned from a large dataset. Given an input image, we firstly compute the graph representation, and then sample the graph struc- tures over various age groups according to the learned dy- namic model. Finally we generate new face images with the sampled graphs. Our approach has three novel aspects: (1) the aging model is learned from a dataset of 50,000 adult faces at different ages; (2) we explicitly model the uncer- tainty in face aging and can sample multiple plausible aged faces for an input image; and (3) we conduct a simple hu- man experiment to validate the simulated aging process. 1. Introduction Face aging is an interesting and challenging problem in computer vision. Aging can cause significant alterations in face appearance, and deteriorate the performance of face recognition systems. Modeling face aging can help build more robust face recognition systems in a variety of real world applications, such as person identification based on old ID photos, recognition of fugitives, looking for miss- ing children, and entertainment. Compared with other face modeling tasks, modeling face aging has some unique chal- lenges. (i) There are large shape and texture variations over long term period, say 20-50 years. (ii) The perceived face age often depends on global non-facial factors, such as hair color and style, the degree of boldness of the forehead, and cultural and ethnic groups. (iii) It is very difficult to have face images of the same person over a long time period. Human face aging has attracted research in computer vi- sion, psychology, and computer graphics. Previous work on face aging can be divided into two categories: child growth and adult aging. For child growth, shape change of face profile is the most prominent factor. Most researchers adopted coor- dinate transformation on a set of landmark points[ 3, 6] or a parametric approach[ 2, 13] to simulate age related shape changes. For example, Ramanathan and Challeppa[ 4] use parameters from anthropometric studies[ 22, 23] to de- fine the deformation of facial landmarks in child growth. They also studied face verification problem across age progression[ 5]. For adult aging, both texture and shape change. In computer vision, most aging approaches are based on image examples, rather than physics. Burt[ 8, 9] studied two factors affecting age perception of adult faces – shape and color. From the average face image at different ages they extract average aging patterns and propose an ag- ing approach. Several other approaches performed texture transferring from senior faces to young faces[ 10, 11, 12]. Some vision approaches have also been proposed for the age estimation[15, 16, 20, 21]. Some recent work adopted PCA approach to build a statistical model for the aging sim- ulation, which includes[ 7, 26, 27]. In computer graphics, people mostly used physical model to simulate the changes in face aging. For example, Wu [ 16, 17] used a skin model to simulate the wrinkles on face as age increases. Berg [ 19] simulated the aging process of orbicularies muscles. Other similar work include [ 14] and [18]. The biggest disadvan- tage of these physical models is their complexity, which makes it difficult to generate photo-realistic aging effects. In summary, the example based models are often limited by the small dataset, and the physical models are usually too complex to render realistic aged faces. Therefore, it is necessary to have a more sophisticated model to account for all factors involved in face aging, as well as a quantitative study on the intrinsic variabilities in face aging. Motivated by these problems, we make the following contributions in this paper. (1) We adopt a high resolution grammatical face model[1] to account for the large variations of the facial structures (different types of eyes, noses, mouths etc.), and 1

Transcript of A Multi-Resolution Dynamic Model for Face Aging...

Page 1: A Multi-Resolution Dynamic Model for Face Aging Simulationsczhu/papers/Conf_2007/aging_cvpr07.pdfFace aging is an interesting and challenging problem in computer vision. Aging can

A Multi-Resolution Dynamic Model for Face Aging Simulation

Jinli SuoGUCAS

[email protected]

Feng Min Songchun ZhuLotus Hill Institute

fmin.lhi,[email protected]

Shiguang Shan Xilin ChenGUCAS

sgshan,[email protected]

Abstract

In this paper we present a dynamic model for simulatingface aging process. We adopt a high resolution grammat-ical face model[1] and augment it with age and hair fea-tures. This model represents all face images by a multi-layerAnd-Or graph and integrates three most prominent aspectsrelated to aging changes: global appearance changes inhair style and shape, deformations and aging effects of fa-cial components, and wrinkles appearance at various facialzones. Then face aging is modeled as a dynamic Markovprocess on this graph representation which is learned froma large dataset. Given an input image, we firstly computethe graph representation, and then sample the graph struc-tures over various age groups according to the learned dy-namic model. Finally we generate new face images with thesampled graphs. Our approach has three novel aspects: (1)the aging model is learned from a dataset of 50,000 adultfaces at different ages; (2) we explicitly model the uncer-tainty in face aging and can sample multiple plausible agedfaces for an input image; and (3) we conduct a simple hu-man experiment to validate the simulated aging process.

1. Introduction

Face aging is an interesting and challenging problem incomputer vision. Aging can cause significant alterations inface appearance, and deteriorate the performance of facerecognition systems. Modeling face aging can help buildmore robust face recognition systems in a variety of realworld applications, such as person identification based onold ID photos, recognition of fugitives, looking for miss-ing children, and entertainment. Compared with other facemodeling tasks, modeling face aging has some unique chal-lenges. (i) There are large shape and texture variations overlong term period, say 20-50 years. (ii) The perceived faceage often depends on global non-facial factors, such as haircolor and style, the degree of boldness of the forehead, andcultural and ethnic groups. (iii) It is very difficult to haveface images of the same person over a long time period.

Human face aging has attracted research in computer vi-

sion, psychology, and computer graphics. Previous work onface aging can be divided into two categories: child growthand adult aging.

For child growth, shape change of face profile is themost prominent factor. Most researchers adopted coor-dinate transformation on a set of landmark points[3, 6]or a parametric approach[2, 13] to simulate age relatedshape changes. For example, Ramanathan and Challeppa[4]use parameters from anthropometric studies[22, 23] to de-fine the deformation of facial landmarks in child growth.They also studied face verification problem across ageprogression[5]. For adult aging, both texture and shapechange. In computer vision, most aging approaches arebased on image examples, rather than physics. Burt[8, 9]studied two factors affecting age perception of adult faces –shape and color. From the average face image at differentages they extract average aging patterns and propose an ag-ing approach. Several other approaches performed texturetransferring from senior faces to young faces[10, 11, 12].Some vision approaches have also been proposed for theage estimation[15, 16, 20, 21]. Some recent work adoptedPCA approach to build a statistical model for the aging sim-ulation, which includes[7, 26, 27]. In computer graphics,people mostly used physical model to simulate the changesin face aging. For example, Wu [16, 17] used a skin modelto simulate the wrinkles on face as age increases. Berg [19]simulated the aging process of orbicularies muscles. Othersimilar work include [14] and [18]. The biggest disadvan-tage of these physical models is their complexity, whichmakes it difficult to generate photo-realistic aging effects.

In summary, the example based models are often limitedby the small dataset, and the physical models are usuallytoo complex to render realistic aged faces. Therefore, it isnecessary to have a more sophisticated model to account forall factors involved in face aging, as well as a quantitativestudy on the intrinsic variabilities in face aging.

Motivated by these problems, we make the followingcontributions in this paper.

(1) We adopt a high resolution grammatical facemodel[1] to account for the large variations of the facialstructures (different types of eyes, noses, mouths etc.), and

1

Page 2: A Multi-Resolution Dynamic Model for Face Aging Simulationsczhu/papers/Conf_2007/aging_cvpr07.pdfFace aging is an interesting and challenging problem in computer vision. Aging can

Face_k

Wrinkle_1

MouthEye_R

Forehead Pigment

Brow_R

Laugh_L EC_R

Nose

Hair ∆fc,t

∆cmp,t

∆wk,t

∆hair,t

Glabella

t

Eye_L Brow_L

...

EC_LLaugh_R

t

Icmp,t

Ifc,t

Face

Wrinkle

Face_1 ...

... ... ...... ... ... ...

... ... ... ... ... ...

Head

Iwk,t

Figure 1. A high resolution face image It at age group t is represented in three resolutions – Ifc,t,Icmp,t and Iwk,t (left) All face imagesat an age group are represented collectively a hierarchic And-Or graph GAO

t (middle). The And nodes (in solid ellipses) in the graphGAO

t represent coarse-to-fine decomposition of a face image into its parts and components. The Or-nodes (in dashed ellipses) representalternative configurations. By choosing the Or-nodes, we obtain an And-graph Gt for a specific face instance. On the right side are theircorresponding dictionaries Δrc,t,Δcmp,t and Δwk,t.

augment it with age and hair features. This generativemodel represents all face images by a multi-layer And-Orgraph and integrates three most prominent aspects relatedto aging changes: global appearance changes in hair styleand shape, deformations and aging effects of facial compo-nents, and wrinkle appearance in various facial zones.

(2) We adopt a dynamic Markov (motion) process onthis graph representation for face aging. Given an input im-age, we first infer the graph representation, and then samplethe graph structures over various age groups following thelearned dynamic model. The sampled graphs then generatenew images as plausible aged faces. We generate more sam-ple faces for longer period to account for the uncertainty.

(3) We train the generative model and the dynamicsbased on a large dataset of 50,000 face images which aremanually divided into different age groups and annotatedinto hairs and facial components. Thus the model is learnedacross many individuals over ages, because it is hard to getphotos of the same person over long period.

(4) We conduct a simple human experiment to validatethe simulated aging process.

The paper is organized in the following way. In Section 2we formulate the layered face model and the dynamic mod-els. Section 3 discusses the algorithms. Section 4 presentsthe experiments and some quantitative study. We concludethe paper discussion in Section 5.

2. Representation and formulation

In this section, we formulate the multi-resolution facerepresentation and the dynamic model.

2.1. Multiscale graph for face modeling

We extend a multi-resolution grammatical model for facerepresentation[1]. As Fig.1 illustrates, a face image It at agegroup t is represented in three resolutions, from coarse-to-fine,

It = (Ifc,t, Icmp,t, Iwk,t).

Ifc,t is the whole face image for general shape, hair style,skin color etc. Icmp,t refines the facial components (eyes,eyebrows, nose, mouth etc.). Iwk,t further refines the wrin-kles, skin marks, and pigments in different zones of the face.

Page 3: A Multi-Resolution Dynamic Model for Face Aging Simulationsczhu/papers/Conf_2007/aging_cvpr07.pdfFace aging is an interesting and challenging problem in computer vision. Aging can

All faces in age group t are collectively represented by anAnd-Or graph GAO

t (see the middle column of Fig.1) wherean And-node (in solid ellipse) represents the decompositionand an Or-node (in dashed ellipse) represents the alterna-tives, for example, different eye shapes.

A dictionary Δt for each age group t is shown on theright side for various components over the three scales.

Δt = {{Δhair,t, Δfc,t}, Δcmp,t, Δwk,t} (1)

where both Δhair,t and Δfc,t belong to the first resolution.This dictionary is learned from a large dataset for each in-dividual age group separately. In latter sections, we use i asthe index for the three resolutions.

After choosing the alternatives at the Or-nodes, the And-Or graph GAO

t becomes an And-graph Gt as a specific faceinstance. Gt in turn generates image It.

GtΔt=⇒ It (2)

We denote the set of faces produced by GAOt as

Σt = {Gt : Gt ⊂ GAO} (3)

Σt is a very large set of face images at age group t to accountfor the variabilities and composition. It is much larger thanthe training set.

The And-Or graph is a generative model that accountsfor a large variety of faces.

In summary, the face representation is

Gt = (w1,t, w2,t, w3,t). (4)

where wi,t are the hidden variables controlling the gener-ation of It at different resolution layers. It can be furtherdecomposed as

wi,t = {li,t, T geoi,t , T pht

i,t } (5)

where li,t is a switch variable for the alternatives in the Or-nodes. T geo

i,k and T phti,k are the variables accounting for the

photometric and geometric attributes of the components inthe synthesized images.

We briefly present the image generation model in Eq.(6)for all the 3 scales according to the work in [1].

Ii,t = Jreci,t (wi,t; Δi,t) + Ires

i,t , i = 1, 2, 3. (6)

where Iresi,t is a residual image at time t with resolution i,

which follows a Gaussian distribution.The probabilistic model of the whole face can be written

as

p(It|Gt; Θimg,t) =3∏

i=1

p(Ii,t|wi,t; Δi,t) (7)

20-30

Eye Mouth HairForehead

Wrinkles

30-40

40-50

50-60

60-80

Empty

Figure 2. Examples of the facial components and hairs from thedictionaries of different age groups.

2.2. Modeling aging procedure as a Markov Chain

Markov Chain on graphs. As is known the future appear-ance of a subject depends only on the current appearance,therefore, face aging procedure can be modeled as a MarkovChain on Graph.

Fig.3 is an illustration of our dynamic model for graphmotion[25]. I1 is an input young face image and G1 is itsgraph representation. I2 to I5 are four synthesized agedimages in four consecutive age groups generated by G 2 toG5. {G1, G2, ..., G5} is a graph chain describing face agingprocedure.

There are two types of variations in the motion ofMarkov chain:

1) Continuous Variation. Some variations in the graphmotion will only change the attributes(skin color, hair color,

Page 4: A Multi-Resolution Dynamic Model for Face Aging Simulationsczhu/papers/Conf_2007/aging_cvpr07.pdfFace aging is an interesting and challenging problem in computer vision. Aging can

Example

Aging Image

Graphs

Time Axis

Markov

Graph Chain 1 2 3 4 5

Input

Image I1

Syn Image

I2

Syn Image

I3

Syn Image

I4

Syn Image

I5

Өimg,t

Өdyn

G1

Fc1

le re ns

Fc H

lb rbwk m

G2

Fc1

Fc H

wk1

gl ll rl fh lc rc

le re ns lb rbwk m

pg

G3

Fc1

Fc H

le re ns lb rbwk m

gl ll rl fh lc rc pg

wk1

G5

Fc1

Fc H

le re ns lb rbwk m

gl ll rl fh lc rc pg

wk1

G4

Fc1

Fc H

le re ns lb rbwk m

gl ll rl fh lc rc pg

wk1

Figure 3. An aging process can be modeled by a Markov Chain on the And graphs Gt. The first row is a sequence of face images at differentages, the leftmost one is the input image, and the other four are synthesized aged images. The second row is the graph representations ofthe image sequence. Third row is the corresponding And-graphs Gt, which form a Markov Chain. Θimg,t is the parameters for generatingthe images from Gt and Θdyn the parameters for aging progression.

wrinkle length etc.) of some Leaf-nodes. We represent themwith the transition probability of T geo

i,t and T phti,t .

2) Abrupt Variation. Some variations in the graph motionwill change the topology of the graph. For example, newnode inserted(wrinkles appear etc.) or the change of thealternatives in the Or-node(hair style changes etc.). We usethe transition probabilities of li,t to represent this variation.

For simplicity we assume that l, T geoi,t and T pht

i,t are in-dependent with each other. The dynamic model for graphmotion is as follows:

p(Gt|Gt−1; Θdyn) = (8)3∏

i=1

p(li,t|li,t−1) ·3∏

i=1

p(T geoi,t |T geo

i,t−1) ·3∏

i=1

p(T phti,t |T pht

i,t−1)

where, Θdyn is the parameters accounting for aforemen-tioned two types of variations in the motion of the graphchain and is learned from the training data. The continuousvariation transition model can be represented as follows forall the three resolutions.

p(T geoi,t |T geo

i,t−1) ∝ exp(−Dgeo(T geoi,t , T geo

i,t−1)) (9)

p(T phti,t |T pht

i,t−1) ∝ exp(−Dpht(T phti,t , T pht

i,t−1)) (10)

whereDgeo andDpht are the predefined geometric and pho-tometric distance.

We denote by I[1, τ ] and G[1, τ ] the image and graphsequences respectively for a period [1, τ ]. Therefore, ouroverall probabilistic model is a joint probability

p(I[1, τ ], G[1, τ ]; Θ) (11)

=τ∏

t=1

p(It|Gt; Θimg,t) · p(G1) ·τ∏

t=2

p(Gt|Gt−1; Θdyn)

Here Θ = {Θimg,t, Θdyn} is the parameter that drives theoverall probabilistic model. p(It|Gt; Θimg,t) is the imagemodel, which generates an image from a graph G t withΘimg,t being the parameters (including the dictionaries atdifferent layers). p(Gt|Gt−1; Θdyn) is the dynamic modelfor the motion of graphs at different ages with Θdyn beingthe motion (aging) parameters.

2.3. Face Aging Simulation

According to the multilayer representation, we simulateface aging at 3 layers separately. Facial component agingand wrinkle addition are the key points of our work.

Page 5: A Multi-Resolution Dynamic Model for Face Aging Simulationsczhu/papers/Conf_2007/aging_cvpr07.pdfFace aging is an interesting and challenging problem in computer vision. Aging can

To overcome the difficulty of collecting the photos ofa person at different age groups, we collect a set of facecomponents of different types for each age group. Foreach sample in Δi,t we label the contour shape as dis-played in Fig.4 (b). Then for each component image pair[Δi,t(j), Δi,t−1(k)] within two consecutive age groups inthe dictionary, we define a geometric distance Dgeo

t (j, k)and a photometric distance Dpht

t (j, k) to measure the simi-larity between them. Fig.4(a) gives an example of the train-ing set and the matches.

(1) Global Appearance AgingFor the whole face aging, we just select an aged image

with proper face type from Δfc,t, and use simple mergetechnique to reflect the change of face shape, skin colordarkening and drops of muscles. Shape context warpingis adopted to warp proper hair style from Δhair,t−1(j) toΔhair,t−1(k). Artifacts along the edges are blurred. There-fore, the transition probability is defined as

p(l1,t|l1,t−1) (12)

= p(lfc1,t = j′|lfc

1,t−1 = k′) · p(lhair1,t = j|lhair

1,t = k)

∝ exp(−(Dgeohair(j, k) + Dpht

fc (j′, k′) + Dgeofc (j′, k′)))

(2) Face Component AgingIn the image model at this layer, l2,t is the switch vari-

able for the alternatives of the face components at aget, the abrupt variation takes place when the switch vari-able changes value by jumping from Δ2,t−1(k) to Δ2,t(j).Therefore, the transition dynamics can be written as fol-lows:

p(l2,t = j|l2,t−1 = k)∝ exp(−(Dgeot (j, k) + Dpht

t (j, k))) (13)

j = 1, 2, ..., Nt, k = 1, 2, ..., Nt−1

Nt and Nt−1 are the numbers of components in Δcmp,t andΔcmp,t−1 respectively.

By sampling from the dynamic model at this layer, wecan get w2,t, and the aged component image I2,t can besynthesized by Eq.6. An example of eye aging is displayedin Fig.4 (c).

(3) Wrinkles AdditionFor wrinkle addition, we decompose face into 8 zones, as

is shown in Fig.5 (a), and add wrinkles for each zone sep-arately. Collecting the wrinkle images of a person across asequence of age groups is impractical. Therefore, we collecta large number of face images at different age groups, anduse the statistical data instead. In our approach, we modelthe number of wrinkles with Poisson distribution.

p(Nt = k) =exp(−λt)(λt)k

k!(14)

where Nt is the number of wrinkles at age group t, λt is theparameter for the distribution, which can be learned from

Age0 Age1 Age2

…… …… ……

0

Figure 4. (a) give sample set of eye at three age range. The arrowsbetween the matches between eyes at two sequent age, and thethickness of the arrows indicate the probabilities of eye aging.(b)is the labeled landmarks of two eye match (c) is one aging resultof a young eye.

20_30 30_40 40-50 50_60 60_800

1

2

3

4

5

6

7

0

Age Group

Wri

nkle

Curv

e N

um

ber

mean

variance

(a) (b)

Figure 5. Facial zones and statistic of forehead wrinkle number

the training data as below. Fig.6(a) displays several exam-ples of the training data.

λt =1

Mt

Mt∑

i=1

N it (15)

where Mt is the number of training images at age group tand N i

t is the wrinkle number of the ith sample at age groupt.

It should be noted that the geometric variable T geo3,t here

describes the geometry of the wrinkle curves, including thenumber, positions, orientations, and scales. The wrinklenumber can be sampled from Eq.14. The other variablescan be sampled from the corresponding prior distributions.Fig.6(b) is a sequence of wrinkle group generated by T geo

3,t .The transition probability of the switch variable l3,t is

similar to the other parts. However, because only the wrin-kle texture is selected across age groups, the transition onlyhas the photometric distance while the geometric change is

Page 6: A Multi-Resolution Dynamic Model for Face Aging Simulationsczhu/papers/Conf_2007/aging_cvpr07.pdfFace aging is an interesting and challenging problem in computer vision. Aging can

(b)

WrinkleTexture

Curve Group

Render Result

(c)

30-40 40-50 50-60 60-80

(a)

Figure 6. (a) is some curve groups(in forehead zone) labeledfrom training data and (b) shows some synthesized wrinkle curvegroups. (c) is one example of wrinkle addition process.

already incorporated in p(T geo3,t |T geo

3,t−1).

p(l3,t = j|l3,t−1 = k) ∝ exp(−Dphtt (j, k)) (16)

Given the wrinkle groups, the realistic images, withwrinkle added, can be synthesized according to Eq.6 usingthe wrinkle texture examples and the process is shown inFig.6(c).

3. Computing and Simulation

3.1. Flow of Algorithm

Step 1) Compare with the input image I1, and build theinitial graph G1 at start age point.

G1 = argmax p(I1|Gt; Θimg,t)

Step 2) For t = 2, 3, ..., τ

1. Sample the graph Gt from three items in Eq.9Gt ∼ p(Gt|Gt−1; Θdyn)

2. Synthesize the aged image It from learned pa-rameter Θimg,t and Gt.It = Jrec(Gt; Δt)

3.2. Variabilities of aging results

The motion of Markov chain is probabilistic. G t andIt are sampled from the generative models. Similar to theBrownian motion, the longer the time period, the highervariance is observed in the sample results. This is illus-trated in our experimental result shown in Fig.7. For eachinput face, we can sample a number of plausible aged facesover time. We sample more images as time goes by.

......

...

...

......

Time Axis

Figure 7. The uncertainty of aging result increases with time.

4. Experiment

4.1. Data collection

There are two sources of aging database in our experi-ment. One is the FG-Net aging database[24]. The other isthe database we collected ourselves. Our database includes50,000 mid-resolution images of subjects at different agegroups.

The landmarks accounting for the profile and the wrin-kles are manually labeled by the artists. According to theselabeled data we get the statistic of shape parameters andwrinkle groups, from which we get the aging pattern andsynthesize the final aged image. Some face aging resultsare displayed in Fig.9.

4.2. Two Quantitative studies

To verify the validity of our model and aging approach,we conducted two experiments here. We divide ages into 5age groups:20-30, 30-40, 40-50, 50-60 and 60-80. We se-lect 20 young faces aged 20-30, for each one, 4 aged imagesbelong to four groups above 30 respectively are synthesized.Twenty testees are asked to evaluate the aging results.

In the First Experiment. We present the testees with twoimage set A and B. Set A includes the 80 synthesized im-ages and Set B includes the same number of real images.Both set A and B have 20 images in each age group above30. Then the testees are asked to estimate the age groupof the faces in Set A and Set B separately. The estimationresults are displayed in Fig.8.

The experimental results show that our model and statis-

Page 7: A Multi-Resolution Dynamic Model for Face Aging Simulationsczhu/papers/Conf_2007/aging_cvpr07.pdfFace aging is an interesting and challenging problem in computer vision. Aging can

52.5

58.555.0

72.0

57.2554.0

61.0

78.5

��

��

��

��

��

��

��

�����

��������

����������� ������ ������

��������

�� �����

����� ����� ����

Figure 8. Age estimation of synthesized images and real images.

tical data contain most of the age related variations at eachage point, and the aging results are consistent with the hu-man perception in a large extent.

In the second Experiment, we give the testees two imagesets A and B. Set A contains 50 face images aged between20 and 30, including the 20 young faces we aged. Set B con-tains the 80 synthesized images. For each face in B we askthem to match its young face in A, the rate of right matchingis shown in Table 1.

Table 1. Correct matching rate of the synthesized face images.

Age Group 30-40 40-50 50-60 60-80Correct Matching(%) 100 83.21 75.58 50.71

The experimental result shows that our approach is sub-ject specific, it retains the identity information of the youngimage. But the recognition rate decrease with age increase,it indicates that simulating face aging effects would becomemore challenging with the time range increases.

5. Discussion

There are a few important factors that we have learned inthis study. (i) A large training set is the key. Currently ourannotated dataset is limited to Asian faces, but we are ex-tending this to other ethnic groups. (ii) Global appearance,such as hair color and hair style has large influence on pho-torealism and age perception. This is an important factorcontributing to our success. (iii) 3D head and muscle mod-els will be important to model the deformation for seniorfaces (60-80 years old). This part is beyond our 2D model.But it is still possible to overcome this problem by collect-ing senior face images. (iv) More experiments are needed toquantify the variance in face aging and to validate the agingmodel.

6. Acknowledgement

This work is done at the Lotus Hill Institute and is sup-ported by the National Science Foundation China Contact

No. 60672162.The data used in this paper were provided by the Lotus

Hill Annotation project[28] , which was supported partiallyby a subaward from the W.M. Keck fundation, a microsoftgift, and a 863 grant NSFC 2006AA01Z121.

References

[1] Z. J. Xu, H. Chen, S. C. Zhu, ”A high resolution gram-matical model for face representation and sketching”.CVPR,2005. 1, 2, 3

[2] A. Lanitis, C. J. Taylor, and T. F. Cootes, ”Towardautomatic simulation of aging effects on face images”,IEEE Trans. on PAMI, vol.24, n.4, p.442-455, 2002. 1

[3] J. B. Pittenger and R. E. Shaw, ”Aging facesas viscal-elastic events: implications for a theoryof nonrigid shape perception”, Journal of Exper-imental Psychology:Human Perception and Perfor-mance.1(4):374C382, 1975. 1

[4] N. Ramanathan, R. Chellappa, ”Modeling age pro-gression in young faces”, CVPR,2006. 1

[5] N. Ramanathan and R. Chellappa, ”Face verificationacross age progression”, CVPR,2005 1

[6] L. S. Mark, J. T. Todd and R. E. Shaw, ”Perception: ageometric analysis of how different styles of changesare distinguished”, Journal of Experimental Psychol-ogy Perception and Performance, 7:855-868,1981. 1

[7] M. Gandhi, ”A method for automatic synthesis ofaged human facial images”, Master’s thesis, McGillUniversity,2004. 1

[8] D. M. Burt and D. I. Perrett, ”Perception of age inadult caucasian male faces computer graphic manip-ulation of shape and color information”, Proc. RoyalSoc. London, vol.259,1995. 1

[9] D. A. Rowland and D. I. Perrett, ”Manipulating facialappearance through shape and color”, IEEE Trans.Computer Graphics and Applications,1995. 1

[10] B. P. Tiddeman, D. M. Burt and D. I. Perrett, ”Proto-typing and transforming facial textures for perceptionresearch”, IEEE Trans. Computer Graphics and Ap-plications,2001. 1

[11] B. P. Tiddeman, M. Stirrat, and D. I. Perrett, ”Towardsrealism in facial prototyping: results of a waveletMRF method”, Proc. Theory and Practice of Com-puter Graphics,2006 1

[12] Y. Shan and Z. Y. Zhang, ”Image based surface detailtransfer”, IEEE Trans. CVPR,2001. 1

[13] F. R. Leta et al., ”Manipulating facial appearancethrough age parameters”, SIGGRAPH,1996. 1

[14] A. Golovinskiy et al., ”A statistical model for syn-thesis of detailed facial geometry”, ACM Trans. onGraphics,2006. 1

[15] L. S. Mark et al., ”Wrinkling and head shape as co-ordinated sources of age level information”, JournalPerception Psychophysics,27(2):117-124,1980. 1

Page 8: A Multi-Resolution Dynamic Model for Face Aging Simulationsczhu/papers/Conf_2007/aging_cvpr07.pdfFace aging is an interesting and challenging problem in computer vision. Aging can

20-30 30-40 40-50 50-60 60-80

Figure 9. Some more aging result. The leftmost column is the original images of the subjects. The 2nd to 5th row are synthesized agedimages at 4 age groups respectively.

[16] Y. Wu, P. Beylot, and N. M. Thalmann, ”Skin AgingEstimation by Facial Simulation”, Proc. of the Com-puter Animation,1999. 1

[17] Y. Wu, N. M. Thalmann, and D. Thalmann, ”A Dy-namic Wrinkle Model in Facial Animation and SkinAging”, Journal of Visualization and Computer Ani-mation, 1995, 6:195-205,1995. 1

[18] L. Boissieux et al., ”Simulation of skin aging andwrinkles with cosmetics insight”, Computer Anima-tion and Simulation,2000. 1

[19] A. C. Berg, ”Aging of Orbicularis Muscle in VirtualHuman Faces”, International Conference on Informa-tion Visualization,2003. 1

[20] Y. H. Kwon and N. da Vitoria Lobo, ”Age classifica-tion from facial images”. Computer Vision and ImageUnderstanding,1999. 1

[21] A. Lanitis, C. Dragonova and C. Christondoulou,”Comparing Different Classifiers for Automatic AgeEstimation”. IEEE Trans. on Systems, Man and Cy-bernetics,2004. 1

[22] L. G. Farkas, Anthropometry of the Head and Face,Raven Press, New York, 1994. 1

[23] L. G. Farkas and I. R. Munro. Anthropometric FacialProportions in Medicine, Charles C. Thomas, Spring-field, Illinois, USA,1987. 1

[24] ”Face and Gesture Recognition”, Net-work: FG-NET aging database. [online]Available:(http://sting.cycollege.ac.cy/ alani-tis/fgnetaging/). 6

[25] Y.Z. Wang and S.C. Zhu. ”Modeling complex mo-tion by tracking and editing hidden Markov graphs”,CVPR,2004. 3

[26] J.Y.Wang, Y.Shang etc. ”Age simulation for facerecognitions”, ICPR,2006. 1

[27] Hill CM, Solomon CJ, Gibson SJ. ”Aging the humanface-A statistically rigorous approach”, ICDP,2005. 1

[28] Z.Y.Yao, X.Yang, S.C.Zhu. ”Introduction to aLarge-Scale General Purpose Ground Truth Database:Methodology, Annotation Tool and Benchmarks”,EMMCVPR,2007. 7