Finger detection evaluation system
description
Transcript of Finger detection evaluation system
![Page 1: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/1.jpg)
1
Finger detection evaluation system
Su-ting, Chuang
![Page 2: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/2.jpg)
2
OutlineIntroductionRelated workHardware configurationFinger Detection systemOptimal parameter estimation frameworkConclusion
![Page 3: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/3.jpg)
3
OutlineIntroductionRelated workHardware configurationFinger Detection systemOptimal parameter estimation frameworkConclusion
![Page 4: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/4.jpg)
4
IntroductionMotivation
Evaluate components in finger detection systems
Verify and improve performance of finger detection systems
MethodDevelop an optimal parameter estimation
frameworkUse most prevalent finger detection system as
testbed Touchlib
![Page 5: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/5.jpg)
5
OutlineIntroductionRelated workHardware configurationFinger Detection systemOptimal parameter estimation frameworkConclusion
![Page 6: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/6.jpg)
6
Related WorkFTIR (Frustrated Total Internal Reflection)
J. Y. Han, “Low-cost multi-touch sensing through frustrated total internal reflection," in Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST '05). New York, NY, USA: ACM Press, 2005, pp. 115-118.
![Page 7: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/7.jpg)
7
Related WorkDI (Diffused Illumination)
J. Rekimoto and N. Matsushita, “Perceptual surfaces: Towards a human and object sensitive interactive display," Workshop on Perceptural User Interfaces (PUI'97), 1997.
![Page 8: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/8.jpg)
8
Related WorkTouchLib
A multi-touch development kit
Finger detection processing flow chartBackgroundSubtraction
SimpleHighpass ScaleMono Threshold
![Page 9: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/9.jpg)
9
OutlineIntroductionRelated workHardware configurationFinger Detection systemOptimal parameter estimation frameworkConclusion
![Page 10: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/10.jpg)
10
Hardware configurationTable setup
![Page 11: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/11.jpg)
11
Hardware configurationOrder of diffuser layer and touch-glass layer
Diffuser layer
IR illuminatorIR camera
spot
IR illuminatorIR camera
Touch-glass layer
IR camera
spot
IR camera
![Page 12: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/12.jpg)
12
Hardware configurationProblem:
IR rays will be reflected by the touch-glass and resulting hot spot regions in camera views
Solution:Use other cameras to recover the regions
which are sheltered by IR spots
![Page 13: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/13.jpg)
13
OutlineIntroductionRelated workHardware configurationFinger Detection systemOptimal parameter estimation frameworkConclusion
![Page 14: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/14.jpg)
14
Detection system
IR cam
Pre-processing
Imageprocessin
g
FingerAnalyzing
DataAssociatio
n
DataTransmissio
n
IR cam GPU
CPU
![Page 15: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/15.jpg)
15
Detection systemPre-processing
ImageFusion(Blend)
IR Camera
IR camera
Undistortion
Undistortion
HomoWarp
HomoWarp
![Page 16: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/16.jpg)
16
Pre-processingUndistortion
Undistort foreground objectsWarp
Unify finger size among different position of table
Image fusionMask hot spots and recover them from the
other camera imageFinger at border won’t be discard
![Page 17: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/17.jpg)
17
Pre-processingAdvantage of implementing on GPU
Increase performance High frame rate
Preserve CPU for application computation Enable detection system and interactive application
on the same computer Reduce unsynchronized problem among different
computers
![Page 18: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/18.jpg)
18
Detection systemImage processing
BackgroundSubtraction Normalization Simple
HighpassMono Threshold
![Page 19: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/19.jpg)
19
Image processingNormalization
Motivation Eliminate influence due to non-uniform lighting
condition Various finger touch response
Hard to decide a good thresholdMethod
Model distribution of IR illumination Use specific material to simulate foreground Calculate each pixel’s dynamic range
Stretch dynamic range to 0-255
![Page 20: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/20.jpg)
20
Finger AnalyzingConnected componentfinger size evaluation
![Page 21: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/21.jpg)
21
Data associationFingertip matching
Matching fingertips among framesUsing bipartite algorithm
Fingertip trackingSmooth detected results and fix lost resultsUsing Kalman filter
![Page 22: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/22.jpg)
22
OutlineIntroductionRelated workHardware configurationDetection systemOptimal parameter estimation frameworkConclusion
![Page 23: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/23.jpg)
23
Optimal parameters estimation frameworkMotivation
Find optimal parameters for finger detection system
![Page 24: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/24.jpg)
24
Optimal parameters estimation frameworkProcedure
Define parameters for finger detection systemCollect samples
Various finger size Various hand gesture
Search optimal parameters Verify performance of all possible parameter
combinations
![Page 25: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/25.jpg)
25
Optimal parameters estimation frameworkCollect samples
Task Soft /Hard touch Vertical/Oblique touch Various fingers
Sample set Each task has 2x2x5 samples
Sample collection Step-by-step instruction Straightforward UI design
Finger touch position
5timer
Instructions….
![Page 26: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/26.jpg)
26
Optimal parameters estimation frameworkSearch optimal parameters
Exhaustive search Test various parameter combination in each set
Step Each parameter combination
Detect finger touch Verify detection result
Calculate error rate
![Page 27: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/27.jpg)
27
Optimal parameters estimation frameworkDetection systemframe
Optimal parameter finder
Parameter Set
Detection Result
GroundTruth
OptimalParameter Set
VerifyNext Parameter Set
Generator
DetectionResult
GroundTruth
Error Rate
Parameter Set
Sampleset
![Page 28: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/28.jpg)
28
OutlineIntroductionRelated workHardware configurationDetection systemOptimal parameter estimation frameworkConclusion
![Page 29: Finger detection evaluation system](https://reader035.fdocuments.net/reader035/viewer/2022062500/568151d6550346895dc010b0/html5/thumbnails/29.jpg)
29
Thanks for your attention