Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on...

16
A Proposal of Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision Thang CAO 1 , Y oukinobu HOSHINO 2 1 The University of Electro-Communication Tokyo, Japan 2 Kochi University of T echnology Kochi, Japan First International Symposium on Affective Enginee ring ISAE2013, Kitakyushu, Japan March 6 - 8, 2013 Image Source: Internet

Transcript of Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on...

Page 1: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 1/16

A Proposal of Kansei Evaluation for Traditional Vietnamese Aodai Clothes

based on Computer Vision

Thang CAO1, Youkinobu HOSHINO2

1

The University of Electro-CommunicationTokyo, Japan2Kochi University of Technology

Kochi, Japan

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Image Source: Internet

Page 2: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 2/16

Objectives

• Kansei Evaluation based on Computer Vision for a traditional

Vietnamese women’s cloth named Ao dai

• Image features for outside environment images and Aodai images

are described by Color Coherence Vector 

• Learning algorithms are used to learn Kansei relations among

outside environment images and Kansei words for Aodai.

• The system can recommends which Ao dai is suitable for a woman

on an occasion based on own characters and physical conditions

with the environment about any cases

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Image Source: Internet

Page 3: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 3/16

 Aodai - Introduction

• Early versions of Vietnamese Aodai appeared from 17th century

• Design of  Aodai has also been changed with the country history

• The most popular style is –  A long dress that fits tightly around the women's upper torso

 – Split into two flaps from waist to bottom over wide trousers

 – Emphasizes women's bust and curves

• Hue colors and decorating characters depend on her age andoutgoing environments

 – Young girls dressed in pure white

 – Office women in delicate pastels with slight decoration

 – Middle-aged married women in strong, rich colors and decoration

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Image Source: Internet

Page 4: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 4/16

 Aodai - Introduction

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Image Source: InternetSource: Wikipedia

Page 5: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 5/16

 Aodai in Daily Life

Image Source: Internet

Page 6: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 6/16

Choosing an Aodai for an Occasion

• Some questions a woman may ask herself when choosinga cloth – Outgoing environment:

•  Activity purpose: office conference, outing, showing, ceremony, etc.

• Who she will meet: students, office people, business man, or leisure people?

• How about surrounding people: young, middle-aged, old, or mixture of them?

• Meeting place: school campus, garden or park, offices or hotel?

 – Own emotion she wants to show to the others• Character looks: vivid, sweet, gently, soft, joyful, dull, etc.

• Human status: aristocratic, popular, serious, striking, condescending 

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Page 7: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 7/16

Classifier Learning

Algorithm

Images of Meeting Places

(CCV Histograms)

Suitable

Kansei Words

Describing the places

Words describe Outside

Environment

Inputs

Outputs

Self-Organizing Map

CCV Histograms of  Aodai 

and their Kansei Words

Output Map

Inputs

Outputs

Learning for Outside Environment

Learning for Aodai Images

Outputs

Classifier Learning

Algorithm

Images of Meeting Places

(CCV Histograms)

Kansei Words forPlaces and Aodai

Words describe Outside

Environment

Inputs

Self-Organizing Map

Images of Suitable

 Aodai 

Output Map

Decision Making Process

System for Aodai’s Recommendation

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Page 8: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 8/16

Selecting Kansei Words for Aodai

• From common adjectives often used to say about clothand emotion, we

 – collect 34 words

 – clarify them into 3 groups:

• Elegance

•  Active/Energetic

• Inactive Groups

Elegance Group

Sober Naive

Elegance

Mild

Cute

Simple

Dreamy

Sweet

Active/Energetic Group

JoyfulRefreshing

Warm

Young & Fresh

Lively

 Ambition

Inactive Group

 AwkwardMonotonous

Calm & Quiet

Heavy

Restful/quiet

Examples

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Page 9: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 9/16

Estimating Images of Aodai with

Kansei Words

255,0),(:  y x I 

i y x I  y xcard hi ),(),(

Histogram Intensity

Color coherence vector defined as the degree to which pixels of that color 

are members of large similarly-colored regions

ii

   ,

Illustration of CCV regions

Page 10: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 10/16

Training Data Preparation

• Training data for the system consists of 

 – images of meeting places

 –  Ao dai clothes

 – Corresponding described Kansei word

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Page 11: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 11/16

Survey Program

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Page 12: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 12/16

Modeling by NN and SOM

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

SOMTraining data(CCV histograms)

SOM map

showing similar 

 Aodai

 Neural

 Networks

Training data

(CCV histograms)

Degree of  Kansei

words

Page 13: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 13/16

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Modeling by NN and SOM

By SOM

By NN

Page 14: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 14/16

 A SOM Output Map of Aodai Images

Page 15: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 15/16

Discussion

• This research proposes a Kansei Evaluation System for traditionalVietnamese Aodai.

• The system can advise which Aodai clothes a woman should wear in an occasion

 – Inputs of the system are descriptions of outing environments with thewearer’s characters and feelings

 – Outputs are list of suitable clothes that fit her feelings with emotions of outside people in that occasion.

• Future Topics

 – Investigating other image representation methods – Integrating conspicuity factors (harmony, discriminability and visibility)

 – Extending Aodai images with outgoing scene backgrounds

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Page 16: Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

7/29/2019 Kansei Evaluation for Traditional Vietnamese Aodai Clothes based on Computer Vision, Presentation on ISAE2013

http://slidepdf.com/reader/full/kansei-evaluation-for-traditional-vietnamese-aodai-clothes-based-on-computer 16/16

References

First International Symposium on Affective Engineering ISAE2013, Kitakyushu, Japan March 6 - 8, 2013

Thang CAO and Youkinobu HOSHINO (2013) A Proposal of Kansei Evaluation

for Traditional Vietnamese Aodai Clothes based on Computer Vision,

Proceedings of 1st International Symposium on Affective Engineering (ISAE2013):Pages 31-36