Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion...
-
Upload
juliana-mccormick -
Category
Documents
-
view
213 -
download
0
Transcript of Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion...
![Page 1: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/1.jpg)
Finger Detection for Multi-Touch Tabletop Display System
多重觸控桌面顯示系統之手指偵測
Su-ting, Chuang2010/8/2
![Page 2: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/2.jpg)
2
OutlineIntroductionRelated WorkSystem and MethodExperimentConclusion & Future Work
![Page 3: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/3.jpg)
3
OutlineIntroductionRelated WorkSystem and MethodExperimentsConclusion & Future Work
![Page 4: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/4.jpg)
4
Introduction
![Page 5: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/5.jpg)
5
OutlineIntroductionRelated WorkSystem and MethodExperimentsConclusion & Future Work
![Page 6: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/6.jpg)
6
Related WorkFTIR (Frustrated Total Internal Reflection)
J. Y. Han, “Low-cost multi-touch sensing through frustrated total internal reflection," in Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST '05). New York, NY, USA: ACM Press, 2005, pp. 115-118.
![Page 7: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/7.jpg)
7
Related WorkDI (Diffused Illumination)
J. Rekimoto and N. Matsushita, “Perceptual surfaces: Towards a human and object sensitive interactive display," Workshop on Perceptural User Interfaces (PUI'97), 1997.
![Page 8: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/8.jpg)
8
Related WorkTouchLib
A multi-touch development kit
Finger detection processing flow chart
BackgroundSubtraction
SimpleHighpass Scale Threshold
![Page 9: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/9.jpg)
9
OutlineIntroductionRelated WorkSystem and MethodExperimentsConclusion & Future Work
![Page 10: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/10.jpg)
10
Hardware Configuration
(2) IR Camera
(3) IR Illuminator
(1) Peripheral Projector
![Page 11: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/11.jpg)
11
Hardware ConfigurationOrder of diffuser layer and touch-glass layer
Diffuser layer
IR illuminatorIR camera
spot
IR illuminator
IR camera
Touch-glass layer
IR camera
spot
IR camera
2
1
4 3
![Page 12: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/12.jpg)
12
Hardware ConfigurationProblem:
IR rays will be reflected by the touch-glass and resulting hot spot regions in camera views
Solution:Use other cameras to recover the regions
which are sheltered by IR spots
![Page 13: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/13.jpg)
13
Software ArchitectureDetection system
Image StitchingFinger DetectionFinger Tracking
Parameter determination
ImageStiching
FingerDetection
Finger Tracking
![Page 14: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/14.jpg)
14
Software ArchitectureDirectShow
Filter-based framework GShow
GPU-accelerated framework
![Page 15: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/15.jpg)
15
Image Stitching
ImageBlending
IR Camera
IR camera
Undistortion
Undistortion
HomoWarp
HomoWarp
![Page 16: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/16.jpg)
16
Image StitchingHomoWarp
Goal Unify finger size among different position of table
![Page 17: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/17.jpg)
17
Image StitchingHomoWarp
Method Calculate homography in advance
5 2
16
2 5
43
1
4
3
6
VSLH VS
RH
2
5
![Page 18: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/18.jpg)
18
Image StitchingHomoWarp
Warp image from each camera to virtual space
VSLH
VSRH
![Page 19: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/19.jpg)
19
Image StitchingImage Blending
![Page 20: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/20.jpg)
20
Parameter DeterminationRequirements of ideal finger detection
systemSensitive Noise-free
Evaluation of parametersData Collection
Depict traceMeasurement
Minimize miss and false alarm
Miss
False Alarm
![Page 21: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/21.jpg)
21
Parameter DeterminationIdeal finger detection
Only one fingertip landing on traceContinuity among frames
![Page 22: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/22.jpg)
22
Parameter Determination
![Page 23: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/23.jpg)
23
Parameter Determination
Parameters Determinator
Parameter Combination
Detection Result
Applicable set of Parameters
TestSet
Touch Data
Ground Truth
(Trace)
Detection System
![Page 24: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/24.jpg)
24
OutlineIntroductionRelated WorkSystem and MethodExperimentsConclusion & Future Work
![Page 25: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/25.jpg)
25
ExperimentsPerformance evaluation
![Page 26: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/26.jpg)
26
ExperimentsParameter determination
Decide parameters in our systemAdopt sampling-based parameter search
technique
Normalization Difference of Gaussian
Background Subtraction Binary Finger
Analysis
Subtract value
Smoothkernel Threshold Finger
Size
![Page 27: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/27.jpg)
27
ExperimentsParameter determination
Exhaustive search Parameter combination
5 (step) *5 (step) *5 (step) *5 (step) = 625 Applicable parameter num
16/625 = 2.56%
Subtract value
Smooth kernel Threshold Finger size
Low bound 0 5 10 10
Step 5 5 5 10
High bound 15 17 30 50
![Page 28: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/28.jpg)
28
ExperimentsParameter determination
Particle filtering
Sampling
Measure
1 1( | )t tP X Z
1( | )t tP X Z
( | )t tP X Z
![Page 29: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/29.jpg)
29
Experiments
![Page 30: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/30.jpg)
30
Experiments
![Page 31: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/31.jpg)
31
OutlineIntroductionRelated WorkSystem and MethodExperimentsConclusion & Future Work
![Page 32: Su-ting, Chuang 2010/8/2. Outline Introduction Related Work System and Method Experiment Conclusion & Future Work 2.](https://reader037.fdocuments.net/reader037/viewer/2022110321/56649ce25503460f949ad287/html5/thumbnails/32.jpg)
32