Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... ·...

48
Anil K. Jain Michigan State University http://biometrics.cse.msu.edu October 15, 2012 Biometrics Technology for Human Recognition

Transcript of Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... ·...

Page 1: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Anil K. Jain

Michigan State University

http://biometrics.cse.msu.edu

October 15, 2012

Biometrics Technology for Human Recognition

Page 2: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Foreigners Arriving at Incheon

Page 3: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

G20 Seoul Summit 2010

Face recognition system at the COEX entrance

Page 4: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Security Concerns

We now live in a society where people

cannot be trusted based on credentials

• Something you have: ID card, passport

• Something you know: PIN, password

Page 5: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

• Two of the Sept. 11 attackers used stolen Saudi Arabian passports

• Spanish police arrested seven men, connected to al Qaeda, tasked with stealing 40 passports per month (Dec 2, 2010)

Fake Passports

http://press.homeoffce.gov.uk/press-releases/passport-warning?version=1

http://www.pbs.org/wgbh/pages/frontline/shows/trail/etc/fake.html

http://www.lonelyplanet.com/thorntree/thread.jspa?threadID=2071874

Page 6: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Most common passwords: 123456, password Hacker-resistant passwords?

Too Many Passwords!

Page 7: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Two-Factor Authentication

http://www.bankinfosecurity.com/chase-hit-in-atm-skimming-attacks-a-4663 http://www.statisticbrain.com/credit-card-fraud-statistics/

• Card + 4-digit PIN

• “skimming” attacks,

“shoulder surfing”

• ~10% of Americans victims

of credit card fraud

Page 8: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Phishing Attack

~5 million U. S. citizens are victims

Page 9: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Outline

• Recognition by body traits

• Biometric System

• Applications

• Challenges

Page 10: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Biometric Recognition

Recognition by body traits (Who you are)

Page 11: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Uniqueness

Identical twins

Page 12: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Persistence Sharbat Gula in 1985 & 2002; Steve McCurry, National Geographic

Published in the June 1985 issue (~12 years old) 17 years later in the April 2002 issue

Page 13: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Rejected Biometric Traits

Page 14: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Why Biometrics?

• Cannot be stolen or forged

• Discourages fraud

• Enhances security

• Audit trail

• User convenience

Palmvein system at Bradesco bank, Brazil

Page 15: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

H.T. F. Rhodes, Alphonse Bertillon: Father of Scientific Detection, Harrap, 1956

British Parliament required that repeat offenders be identified

Habitual Criminal Act (1869)

Alphonse Bertillon

Page 16: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Cumins and Midlo, Finger Prints, Palms and Soles, Dover, 1961

Friction Ridge Patterns

Page 17: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Fingerprints

Page 18: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Biometric Recognition System

Verification (1:1 Matching)

Page 19: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Fingerprint Matching

Match score =38 on a scale of 0-999

Page 20: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

US-VISIT United States Visitor and Immigrant Status Indicator Technology

Page 21: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

UAE Iris Border Crossing System

Page 22: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Time and Attendance

Page 23: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Cash Register Login

Meijer supermarket, Okemos, Michigan

Page 24: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Disney Parks

200K visitors per day, 365 days per year

Page 25: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

De-duplication (1:N Matching) Prevent a person from obtaining multiple ID documents

Page 26: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Accuracy

Scale

Usability

Unusable

Hard to Use

Easy to Use

Transparent to User

101

103

105

107

90%

99%

99.99%

99.999%

Next Generation Biometric Systems

For 1: N matching (N ~ 1 billion), 1:1 matching accuracy must be very high

Page 27: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

“Issue a unique identification number (UID) to Indian

residents that can be verified and authenticated in an

online, cost-effective manner, and that is robust to

eliminate duplicate and fake identities.”

600 million numbers to be issued in 4 years

Large Scale Identification

Name

Parents

Gender

DoB

PoB

Address

1568 3647 4958 Basic demographic data and

biometrics stored centrally

UID = 1568 3647 4958

10 fingerprints, 2 iris & face image

Central UID database

Page 28: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

http://uidai.gov.in/

Page 29: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Biometric Capture

Page 30: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Image Quality

Page 31: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Fusion of Iris and Fingerprints

FPIR: Likelihood that a person’s biometrics is seen as a duplicate

FNIR: Likelihood that system is unable to identify a duplicate enrollment

Page 32: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Securing Mobile Devices • No. of mobile devices will exceed world’s population by 2012

• By 2015, consumers will buy $1.3 trillion worth of goods with mobile devices; 1.5% of the transactions will be fraudulent

http://www.homelandsecuritynewswire.com/srbiometrics20120228-smartphone-biometric-security-market-set-to-grow-fivefold-in-three-years http://techcrunch.com/2012/02/14/the-number-of-mobile-devices-will-exceed-worlds-population-by-2012-other-shocking-figures/ http://www.businessweek.com/articles/2012-10-04/mobile-payments-a-new-frontier-for-criminals

Voice, face, fingerprint, iris Apple buys AuthenTec for $356 million

(July 2012)

Page 33: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Challenges

• Intra-class and inter-class variations

• Fingerprint matching

• Touchless sensors

• Latent fingerprint matching

• Face recognition

• Age invariant face recognition

• Heterogeneous face recognition

• Unconstrained face recognition

• Fake & altered biometric traits

• Soft biometrics

Page 34: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Intra-Class & Inter-Class Variations

Large inter-class similarity Large intra-class variability

Page 35: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

3D Touchless Sensor

Virtual “rolled” image

TBS Touchless 3D image

Ink on paper

Page 36: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Rolled Fingerprint Matching

True accept rate of 99.4% @ false accept rate of 0.01%

Page 37: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Latent Fingerprint Matching

C. Wilson et al., “Fingerprint Vendor Technology Evaluation 2003: Summary of Results and Analysis Report”, NISTIR 7123, 2004

M. Indovina et al., “Evaluation of Latent Fingerprint Technologies: Extended Feature Sets [Evaluation #2]”, NISTIR 7859, 2012 Rank-1 identification rate of only 68%

Page 38: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Latent Fingerprint Enhancement

* Latent G063 from NIST SD27; 27,258 reference prints from NIST 14 & 27 ; Neurotechnology VeriFinger SDK 4.2

Latent

Enhanced Latent

Mated Rolled

Mated Rolled

# Matched Minutiae = 13

Matching Score = 38

# Matched Minutiae = 2

Match Score = 3

Page 39: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Age Invariant Matching

• Learn invariant features

• Synthesize appearances to offset facial variations

Page 40: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Heterogeneous Face Recognition

Large intra-class variability due to change in modality

Page 41: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Video Surveillance

1 million CCTV cameras in London & 4 million in U.K.; average

Briton is seen by 300 cameras/day; 3 million cameras in S. Korea

Page 42: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Unconstrained Face Recognition

Page 43: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Dummy finger from a lifted impression

Attacks on Biometric Systems

Fake eyeball

Face disguise

Page 44: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Fingerprint Alteration

Mutilated fingertips

Altered fingerprint

Pre-altered fingerprint

Page 45: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Privacy Concerns

Will biometric be used to track people?

Page 46: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Provide some information about an individual, but

lack the distinctiveness and permanence

Ethnicity, Skin Color, Hair color

Periocular

Height

Weight

Soft Biometrics

Birthmark Tattoos

Page 47: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Tattoo Caught in Surveillance Image

Detroit police linked at least six armed robberies at an ATM after matching a tipster’s description of the suspect’s distinctive tattoos

www.DetroitisScrap.com/2009/09/567/

Page 48: Technology for Human Recognition - Biometricsbiometrics.cse.msu.edu/Presentations/AnilJain... · Palmvein system at Bradesco bank, Brazil H.T. F. Rhodes, Alphonse Bertillon: Father

Summary

• Biometric recognition is indispensable in efforts

to enhance security and eliminate fraud

• Fingerprint matching has been successfully used

in forensics for over 100 years

• New deployments for civil registration, border

crossing, financial transactions

• Market for mobile devices is emerging

• Seamless integration, recognition under non-

ideal conditions, user privacy, system integrity