Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case:...
-
Upload
cleopatra-porter -
Category
Documents
-
view
217 -
download
0
Transcript of Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case:...
![Page 1: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/1.jpg)
Workshop - November 2011 - Toulouse
(SoC toolKit for critical Embedded sysTems)
Thales Use Case:
Pedestrian tracking with smart cameras
SoCKET Collaborative Project
Paul [email protected]
23/11/2011 1
![Page 2: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/2.jpg)
IntroductionThales interest on the project.
SOCKET Global Flow
Thales Use case description: Application description. Create Classifiers. C application. Architecture description.
2Workshop - November 2011
![Page 3: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/3.jpg)
Thales Interest
Thales Research has several interests on the project: Interaction between control and dataflow. Predictability real time comportment. Reduce the programming/re-programming cost. Verification.
3Workshop - November 2011
![Page 4: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/4.jpg)
SoCKET Flow
Global SoC Req.
SoCArchitecture
Functional validation
SW Performance Validation
C/C++/ASM
Functionality
Timing +Functionalit
y
Instruction Set
Simulator
System Requirements
PlatformAssembly
MetricsHLS
SystemProperties
Hardwareproperties
Softwareproperties
TLMLT
TLMAT
Software
Software
Co-simulation/Co-emulation
Silicon SoftwareExecution
HLS
Trafficgenerator
Metrics
IP-XactSoC
Headersgeneration
RTL SoftwareR
eq
uir
em
en
ts t
raceab
ilit
y
4
![Page 5: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/5.jpg)
Thales use case – ContextContext
Safety of critical infrastructures containing image processing Detection of intrusions pedestrians
Description Environment multi-camera (basic scenario using 2 cameras) having a specific
visual field
Centralized process of the video stream coming from a reduced number of camera in an System on Chip embedded system
5Workshop - November 2011
![Page 6: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/6.jpg)
Use case TRT – Description App.Pedestrians detection
Algorithm of classification [Viola&Jones]
Two steps: Off-line: training by an image database On-line: detection by using the training results
Pedestrians tracking in an multi-camera environmentUse of the visual covering of the cameras in order to
carry out the trackingUtilization of descriptors of forms and/or colors in order
to improve the tracking and to manage occlusions
6Workshop - November 2011
![Page 7: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/7.jpg)
Thales use case – Appl. descriptionSome examples [Viola&Jones ICCV ’03]
Database
7Workshop - November 2011
![Page 8: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/8.jpg)
Thales use case – App. descriptionProcedure
The training is carried out on a workstation The SoC applies the classifiers and the tracking
algorithm on multi-camera Synoptic Application
CameraIntegralImage
Tiler
Features
ClassifiersCascade
Bounding BoxDescriptor
DescriptorTable
ManageDescriptors
Trackingresult
SoC
IO Frontend processing Backend processing
Host
8Workshop - November 2011
![Page 9: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/9.jpg)
Thales use case – App. DescriptionSchematic view of the pedestrian detection
9Workshop - November 2011
![Page 10: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/10.jpg)
To create the classifiersFrom scratch:
A huge database is needed: Minimum 10 000 positive and negative images to have good
classifiers.
A good workstation and Time: Take about 30 minutes on 8 cores Xeon 2.4GHz and 12Gb
RAM. 2 Weeks on Dual core and 2Gb RAM.
From existing classifiers:Convert to the Thales classifiers by XML parsing.
10Workshop - November 2011
![Page 11: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/11.jpg)
C ApplicationClassifiers (off-line) C Code (on-line)
Result
11Workshop - November 2011
![Page 12: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/12.jpg)
Thales use Case – ArchitectureHost Architecture details
12Workshop - November 2011
![Page 13: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/13.jpg)
Thales use Case – ArchitectureAccelerator details (Engine)
13Workshop - November 2011
![Page 14: Workshop - November 2011 - Toulouse (SoC toolKit for critical Embedded sysTems) Thales Use Case: Pedestrian tracking with smart cameras SoCKET Collaborative.](https://reader036.fdocuments.net/reader036/viewer/2022062805/5697bfc31a28abf838ca558a/html5/thumbnails/14.jpg)
23/11/2011
Questions?
14Workshop - November 2011