Face Recognition through Deep Neural Network -...

25
Face Recognition through Deep Neural Network Yang Song

Transcript of Face Recognition through Deep Neural Network -...

Page 1: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FaceRecognitionthroughDeepNeuralNetwork

YangSong

Page 2: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FaceRecognition,IdentificationandVerification

ImplementationofVGG16

Dataaugmentation

Page 3: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FaceID

Page 4: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FaceIdentification:

Trainingset

QueryImage

FaceIdentification FaceID:TaylorSwift

Page 5: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FaceVerification:

TrainingsetQueryImages

FaceVerification Whethertheyarethesameperson?

Page 6: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FaceRecognition=FaceIdentification+FaceVerification

A facerecognitionsystem isa computerapplication capableof identifying or verifying apersonfroma digitalimage ora videoframe froma video source.Oneofthewaystodothisisbycomparingselected facialfeatures fromtheimageandaface database.

Page 7: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

TraditionalMethod

FaceDetectionFeatureExtractionGivenImage

e.g.,Physicalfeatures:therelativeposition,size,shapeofeyes,nose,jawandetcsSkincolor;SIFTorHOGfeatures

Classifier/Model output

FaceIdentification/Verification

e.g.,SVMorabayse modele.g.,Landmarkdetection

Page 8: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

Limitations?Intherealapplication,therearelargevariationwithfacepose,background,illuminationandocclusion.Itishardtodesignafeatureextractionmethodtoberobustanddiscriminative.

Whyourhumanbraincanfigureitout?

Page 9: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FaceDetection FeatureExtraction&FaceIdentification/VerificationGivenImage

output

ACNNNetwork

Page 10: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

VGGFaceNetwork

Page 11: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FeatureMapSize

W

W

K

K

W=224K=3n_input =3N_output =64

Padding Stride Size Depth

SAME 1

SAME 2

VALID 1

VALID 2

Page 12: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FeatureMapSize

W

W

K

K

W=224K=3n_input =3N_output =64

Padding Stride Size Depth

SAME 1 224*224 64

SAME 2 112*112 64

VALID 1 222*222 64

VALID 2 111*111 64

Page 13: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FeatureMapSize

W

W

K

K

W=224K=5n_input =3N_output =64

Padding Stride Size Depth

SAME 1 64

SAME 2 64

VALID 1 64

VALID 2 64

Page 14: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

FeatureMapSize

W

W

K

K

W=224K=5n_input =3N_output =64

Padding Stride Size Depth

SAME 1 224*224 64

SAME 2 112*112 64

VALID 1 220*220 64

VALID 2 110*110 64

If”VALID”,W_out =ceil((W– K+1)/S)If“SAME”,W_out =ceil(W/S)

Page 15: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,
Page 16: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

VGG16Tensorflow Implementationhttps://www.cs.toronto.edu/~frossard/vgg16/vgg16.py

Page 17: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

VGG16Tensorflow Implementationhttps://www.cs.toronto.edu/~frossard/vgg16/vgg16.py

Page 18: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

Another lightweight implementation of VGG16

TF-Slim is a lightweight library for defining, training and evaluating complex models in TensorFlow.

Page 19: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

Another lightweight implementation of VGG16

TF-Slim is a lightweight library for defining, training and evaluating complex models in TensorFlow.

Page 20: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,
Page 21: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

Or

Page 22: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

VGG16 byTF-Slim

Page 23: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

DataAugmentation

Avoidoverfitting!IncreaseDatasetTranslation-robusttotinyshiftRotation-robusttoposevariationCompression-berobusttopoorresolution

Translation Flipping

Rotation RandomCropping

Compression

Page 24: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,

tf.random_croptf.image.resize_image_with_crop_or_padtf.image.random_flip_left_right

Page 25: Face Recognition through Deep Neural Network - UTKweb.eecs.utk.edu/~hqi/deeplearning/lecture08-cnn-vggface.pdf · Face Recognition through Deep Neural Network Yang Song. Face Recognition,