EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the...

31
EE 7740 Fingerprint Recognition

Transcript of EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the...

Page 1: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

EE 7740

Fingerprint Recognition

Page 2: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 2

Biometrics

Biometric recognition refers to the use of distinctive characteristics (biometric identifiers) for automatically recognition individuals.

These characteristics may be Physiological (e.g., fingerprints, face, retina, iris) Behavioral (e.g., gait, signature, keystroke)

Biometric identifiers are actually a combination of physiological and behavioral characteristics, and they should not be exclusively identified into either class. (For example, speech is determined partly by the physiology and partly by the way a person speaks.)

Page 3: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 3

Biometrics

Page 4: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 4

Biometrics

Page 5: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 5

Biometrics

Page 6: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 6

Fingerprint

Human fingerprints have been discovered on a large number of archeological artifacts and historical items.

Page 7: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 7

Fingerprint

In 1684, an English plant morphologist published the first scientific paper reporting his systematic study on the ridge and pore structure in fingerprints.

Page 8: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 8

Fingerprint

Page 9: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 9

Fingerprint A fingerprint image may be classified as

Offline: Inked impression of the fingertip on a paper is scanned

Live-scan: Optical sensor, capacitive sensors, ultrasound sensors, …

Critical parameter are:Resolution, area, contrast, noise, geometric accuracy.

Page 10: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 10

Fingerprint The fingerprint pattern exhibits different types of features. At the global level, the ridge line flow has one the following patterns.

Singular points are sort of control points around which a ridge line is “wrapped”.

There are two types of singular points: loop and delta.

However, these singular points are not sufficient for accurate matching.

Page 11: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 11

Fingerprint At the local level, there different local ridge characteristics. The two most prominent ridge characteristics, called minutiae, are:

Ridge termination Ridge bifurcation

At the very-fine level, intra-ridge details (sweat pores) can be detected. They are very distinctive; however, very high-resolution images are required.

Bifurcation

Termination

Page 12: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 12

Example Matching is not easy due to: displacement, rotation,

partial overlap, nonlinear distortion, changing skin condition, noise, feature extraction errors, etc.

Page 13: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 13

Example There are many “ambiguous” fingerprints, whose

exclusive membership cannot be reliably stated even by human experts.

Page 14: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 14

Fingerprint Recognition Approaches

Correlation-based matching: Intensity based correlation between the fingerprint images are computed.

Minutiae-based matching: Minutiae are extracted from two fingerprints and stored as sets of points in the 2D plane. Matching is done based on minutiae pairings.

Ridge feature-based matching: Local orientation and frequency of ridges, ridge shape, texture, etc are used for matching.

Page 15: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 15

Orientation Image

Orientation image shows the local orientation of ridges. The length of each element is proportional to its reliability.

Page 16: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 16

Singularity and Core Detection Poincare index

Page 17: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 17

Singularity and Core Detection Poincare index

Page 18: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 18

Singularity and Core Detection

Page 19: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 19

Singularity and Core Detection

Page 20: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 20

Singularity and Core Detection

Page 21: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 21

Singularity and Core Detection

The straight lines normal to the ridges identify the “core”. (Use Hough transform to determine its coordinate.) The core is used as a registration point for fingerprints.

Page 22: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 22

Minutiae Detection Binarize the image (using global thresholding, local

thresholding, etc.) Apply thinning (by, for example, using morphological

operations) to get the skeleton image. Analyze the neighborhood of each pixel in the

skeleton image.

Page 23: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 23

Minutiae Detection Minutia detection may be followed by post-processing

to remove false minutiae structures.

Page 24: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 24

Fingerprint Matching

Page 25: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 25

Fingerprint Matching

Page 26: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 26

Fingerprint Matching

Page 27: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 27

Fingerprint Matching

Page 28: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 28

Fingerprint Matching

Page 29: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 29

Pre-alignment

• Computational complexity of previous approach might be high.• It is a good idea to roughly align fingerprints:

• Find the core• Find the average ridge orientation on the left and right sides of core• Rotate fingerprint around the core such that the difference between the left and the ridge orientations are minimum.

Page 30: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 30

Performance

• Comparison• Fingerprints [FVC 2002]

• False reject rate: 0.2%• False accept rate: 0.2%

• Face [FRVT 2002]• False reject rate: 10%• False accept rate: 1%

• Voice [NIST 2000]• False reject rate: 10-20%• False accept rate: 2-5%

Page 31: EE 7740 Fingerprint Recognition. Bahadir K. Gunturk2 Biometrics Biometric recognition refers to the use of distinctive characteristics (biometric identifiers)

Bahadir K. Gunturk 31

Performance

• How to improve• Fingerprint enhancement• Estimating deformations• Multiple matchers & combine results• Multimodel biometrics