Markus Paasovaara: Face recognition
-
Upload
futurice -
Category
Technology
-
view
164 -
download
2
Transcript of Markus Paasovaara: Face recognition
![Page 1: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/1.jpg)
Face
recognition_
The state of the art
and how we applied it
at Finnair
![Page 2: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/2.jpg)
![Page 3: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/3.jpg)
• Face Detection & Tracking
• Head pose and eye-gaze estimation
• Emotion recognition
• 2D & 3D Face recognition
• Face Morphing
All with real-time performance!
Background & State of the Art_
![Page 4: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/4.jpg)
3D Face Recognition_
Source: Ayonix.com
From face landmarks
into a 3D model and
feature vector
Terminology:
• Match Rate
• False Negative
• False Positive
![Page 5: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/5.jpg)
• Security & Surveillance
• AI & Robotics
• Consumer behavior
• Smart Shopping
• Convenience
Business Cases_
![Page 6: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/6.jpg)
Domain specific
problem: Human-made
Identification_+ Interaction with another human is
natural
+ Reacting to extraordinary situations is
much easier.
- We are vulnerable to tiredness and
biases.
![Page 7: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/7.jpg)
Fixed camera
Identification_
+ Precise, no biases or overload
+ Works 24/7
- Lacks human interaction, no room for
improvising
![Page 8: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/8.jpg)
What has been figured
TECH
SOFTWARE
HARDWARE
Current State
Analysis_
![Page 9: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/9.jpg)
Walk in experience
What did we do differently?
![Page 10: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/10.jpg)
strength in pattern-based classification with
strength in making choices
O U R A P P R O A C H
0 1
![Page 11: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/11.jpg)
An invisiblewalk-paced identification
focusing on human interaction & convenience
S E R V I C E V I S I O N
![Page 12: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/12.jpg)
Registration
App_
Premium Passengers of Finnair will
register themselves at home using the
Android App deployed to their phones.
First digital touchpoint
![Page 13: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/13.jpg)
Arrive to the airport_
Embedded into the normal UX of the
passenger.
![Page 14: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/14.jpg)
Check in desk 206
interface_
The “Hands in the pocket” experience
for the platinum and gold passengers
of Finnair at the priority check in desk
Second digital touchpoint
![Page 15: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/15.jpg)
Technical Architecture
OVERVIEW
• PoC system architecture is separated into two clients and one backend server
• Android application is used to register new people to the system
• Airport Client Application is used for detecting faces from camera stream and sending those for recognition.
Recognize
Backend
Processes the recognitions and
stores the data
Android
Airport Client Application
• Detects faces in camera stream
• Sends facial images for recognition
• Visualizes results
• Gathers feedback from the agent
Register
![Page 16: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/16.jpg)
How did we do?
R E S U L T S
0 2
![Page 17: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/17.jpg)
Passenger Feedback
“It's amazing that new
technologies are being
sought and tested actively”
4.6/5Overall experience rating
4.75/5Ease of use of the App
4.1/5Not worried about privacy
![Page 18: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/18.jpg)
01_Check in
attendants
"The app is easy to use,
fast and reliable. Would like
to use it in the future,
especially if it is integrated
to our systems.”
- Tiia, Check in agent
![Page 19: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/19.jpg)
Publicity Overview
Our proof of concept has been featured in
various travel and aviation magazines
worldwide.
Big national and international media outlets
have featured the Proof of Concept such as
AP, HS and SVD.
Ten interview requests including big
technology and aviation magazines, including
PTW, ATW and ZD NET.
![Page 20: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/20.jpg)
One more little thing..
03
![Page 21: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/21.jpg)
Privacy_
• GRPD: Penalties up to 4% Revenue / 20MEur
• Scope: “Personal data is any information relating to an
individual, whether it relates to his or her private, professional
or public life. It can be anything from a name, a home address,
a photo, an email address, bank details, posts on social
networking websites, medical information, or a computer’s IP
address.“ Source: European Commission press release
• Privacy by design, Consent, Encryption,
Pseudonymisation, Right to be forgotten, …
![Page 22: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/22.jpg)
What we learnt
04
![Page 23: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/23.jpg)
Control the illumination
(as much as you can)
Study your
environment and users
Triggers can help to
achieve “real-time”
![Page 24: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/24.jpg)
Control the number &
quality of the images
in the database
• Registration
• Self-adjusting
![Page 25: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/25.jpg)
Test the algorithm
Test the code
Test the UX!!
![Page 26: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/26.jpg)
Key Insights_
•We can do this in real time, in real world environment
•You can use an app for sourcing the images, but free form facial image sourcing does not work.
•Equal illumination on both side of the face is crucial
•Minimum 3 photos with the illumination variation in the database is a requirement
•Privacy is your major concern, not your customers
•We need to compromise from zero UI approach
• If you are wearing glasses, we have a problem
![Page 27: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/27.jpg)
Privacy_
Who cares?
• Data controller, Data processor
• System developers?
• End users, You and me?
How to “protect” yourself and your client?
• Privacy by Design
• Know the rules
• Know what you’re doing
• Don’t store ANY data you don’t need
![Page 28: Markus Paasovaara: Face recognition](https://reader034.fdocuments.net/reader034/viewer/2022051521/5a64db8b7f8b9a4d0b8b4b4b/html5/thumbnails/28.jpg)
Thank You!