1
XIMEA Hyperspectral (HSI) Cameras xiSpec
VISION 2014, Stuttgart 4.11.2014 Max Larin, [email protected]
2 06.11.2014
Seeing the invisible – Miniature HSI Cameras Max Larin, XIMEA CEO
Hyperspectral Imaging (HSI)
XIMEA, Max Larin
3 06.11.2014 XIMEA, Max Larin
About
a recognized innovator in machine vision and scientific imaging markets.
In cooperation with
a world-leading research center in nano-electronics
Belgium
Hyperspectral Imaging (HSI) cameras
4 06.11.2014 XIMEA, Max Larin
What is HSI?
• It is a combination of
• Spectroscopy
• Imaging
• Spectrum at each pixel
• Spectral irradiance of a scene
• Datacube I(x,y,λ)
Hyperspectral Imaging (HSI) cameras
5 06.11.2014
Applications
• Medical Imaging
• Microscopy and Endoscopy
• Precision Agriculture
• Remote Sensing
• Mineralogy
• Environmental Monitoring
• Life science instrumentation
• Optical sorting
• Food inspection
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
6 06.11.2014
HSI – seeing the invisible
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
Image courtesy of Perception Park GmbH
Monochrome Color Chemical Color
7 06.11.2014
Scanning HSI technique
• Line scanning
• Point scanning
• Wavelength scanning
High number of bands
Time sequential
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
8 06.11.2014
Snapshot HSI technique
• Split into multiple 2D elements
• Recombine with software
Simultaneous acquisition
A few spectral bands
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
9 06.11.2014
State of the art HSI methods
• 4 basic methods
• Wavelength scan (A..D)
• Spatial scan (E)
• Time scan (F)
• “Compromise” (G)
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
10 06.11.2014
Major obstacles for massive deployment of HSI
• State of the art HSI systems are:
• Handicraft manufactured
• Fragile
• Expensive
• Bulky
• Non customizable
• Slow
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
11 06.11.2014
Revolutionary approach – make bandbass filters right on the sensor
What is needed?
• Fabry-Pérot interferometric filter on top of each pixel
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
12 06.11.2014
imec Hyperspectral Sensors
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
13 06.11.2014
HSI sensor types
Hyperspectral Imaging (HSI) cameras
Snapshot Mosaic Snapshot Tiled
‘wedge’ design High number of bands
Time sequential
‘per-pixel’ design
Simultaneous acquisition
A few spectral bands
‘area’ design
Simultaneous acquisition
Low spatial resolution
Linescan
XIMEA, Max Larin
14 06.11.2014
Linescan 600…1000nm
• High resolution, fast and flexible
• 100+ spectral bands
• 600-1000nm, 4nm incremental steps
• FWHM 10…15nm
• Spatial resolution 2048 x (100+ each band x 8 pixels)
• up to 1360 lines/sec
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
15 06.11.2014
Snapshot Mosaic 4x4, 470...630nm
• Extremely compact and robust
• Spectral resolution: 4x4 mosaic, 16 bands
• 470-630nm, 11nm incremental steps
• FWHM 10…15nm
• Spatial resolution per band: 512 x 272, up to 2mpix with interpolation
• up to 170 data-cubes/sec
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
16 06.11.2014
Snapshot Tiled, 32 bands, 600...1000nm
• User friendly, requires optical duplicator
• Spectral resolution: 32 bands
• 600-1000nm, 12nm incremental steps
• FWHM 10…15nm
• Spatial resolution per band: 256 x 256
• up to 170 data-cubes/sec
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
17 06.11.2014
Available cameras and new developments
Type Model Spectral
range [nm] Bands
Scans/sec max
Availability
Linescan VNIR
MQ022HG-IM-LS100-600-1000 600…1000 100+
1360 lines/s
Now
Linescan VNIR
MQ022HG-IM-LS150-470-900 470…900 150+
1360 lines/s
In development
Snapshot Mosaic VIS
MQ022HG-IM-SSM4X4-470-630 470…630 16
170 cubes/s
Now
Snapshot Mosaic VNIR
MQ022HG-IM-SSM5X5-600-1000 600…1000 25
170 cubes/s
Call
Snapshot Mosaic VNIR
MQ022HG-IM-SSM4X4-600-900 600…900 16
170 cubes/s
In development
Snapshot Tiled VNIR
MQ022HG-IM-ST32-600-1000 600…1000 32
170 cubes/s
Now
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
18 06.11.2014
xiSpec and xiQ USB3 Vision camera family
• World smallest USB3 Vision camera
• Compact: 26x26x26mm
• Low power consumption: 1.8W
• Lightweight: 27g
• Single PC board
• USB3 Vision Standard compliant
• Board level: 25x25x14mm, 7g
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
19 06.11.2014
Extremely Compatible
Support for major operating systems:
• Windows
• Linux
• Mac-OS
Support for major architectures:
• Intel x86/x64
• ARM
• Embedded platforms
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
20 06.11.2014
HSI ecosystem
Is it enough to have just a HSI camera?
• There are 216 = 65,536 shades per pixel on 16 bit B/W image
• There are 224 = 16,777,216 colors per pixel on 24 bit RGB image
• There are 21,024 = 179,769,313,486,...,624,224,137,216 (309 digits) spectrums per pixel in 128 band 8 bit/sample HS data-cube
Smart HSI software is needed to reduce amount of data
• Reduce dimensionality of the data
• Provide easy to understand data for traditional machine vision workflows
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
21 06.11.2014
HSI data processing workflow
• Data acquisition
• Spectra selection
• Extract method
• Validate
• Deploy
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
22 06.11.2014
HSI Software partners
perception park, Graz, Austria
www.perception-park.com
• Chemical Color Imaging
• Integrates with existing image processing systems
• Short development time
Hyperspectral Imaging (HSI) cameras
XIMEA, Max Larin
NICTA, Canberra, Australia
www.scyllarus.com
• powerful, full featured hyperspectral imaging engine
• automatic recovery of scene illuminant
• available for license as C++ API, standalone application and Matlab toolbox
23
Perception Studio XIMEA, Max Larin 06.11.2014
24
Scyven from Scyllarus XIMEA, Max Larin 06.11.2014
25 06.11.2014
XIMEA, Max Larin
MEL: ( 03 ) 9480 4999SYD: ( 02 ) 9705 [email protected]
Distributed by
Top Related