Download - XIMEA Hyperspectral (HSI) Cameras xiSpec...6 06.11.2014 HSI – seeing the invisible Hyperspectral Imaging (HSI) cameras XIMEA, Max Larin Image courtesy of Perception Park GmbH Monochrome

1

XIMEA Hyperspectral (HSI) Cameras xiSpec

VISION 2014, Stuttgart 4.11.2014 Max Larin, [email protected]

2 06.11.2014

Seeing the invisible – Miniature HSI Cameras Max Larin, XIMEA CEO

Hyperspectral Imaging (HSI)

XIMEA, Max Larin

3 06.11.2014 XIMEA, Max Larin

About

a recognized innovator in machine vision and scientific imaging markets.

In cooperation with

a world-leading research center in nano-electronics

Belgium

Hyperspectral Imaging (HSI) cameras

4 06.11.2014 XIMEA, Max Larin

What is HSI?

• It is a combination of

• Spectroscopy

• Imaging

• Spectrum at each pixel

• Spectral irradiance of a scene

• Datacube I(x,y,λ)


5 06.11.2014

Applications

• Medical Imaging

• Microscopy and Endoscopy

• Precision Agriculture

• Remote Sensing

• Mineralogy

• Environmental Monitoring

• Life science instrumentation

• Optical sorting

• Food inspection


XIMEA, Max Larin

6 06.11.2014

HSI – seeing the invisible


XIMEA, Max Larin

Image courtesy of Perception Park GmbH

Monochrome Color Chemical Color

7 06.11.2014

Scanning HSI technique

• Line scanning

• Point scanning

• Wavelength scanning

High number of bands

Time sequential


XIMEA, Max Larin

8 06.11.2014

Snapshot HSI technique

• Split into multiple 2D elements

• Recombine with software

Simultaneous acquisition

A few spectral bands


XIMEA, Max Larin

9 06.11.2014

State of the art HSI methods

• 4 basic methods

• Wavelength scan (A..D)

• Spatial scan (E)

• Time scan (F)

• “Compromise” (G)


XIMEA, Max Larin

10 06.11.2014

Major obstacles for massive deployment of HSI

• State of the art HSI systems are:

• Handicraft manufactured

• Fragile

• Expensive

• Bulky

• Non customizable

• Slow


XIMEA, Max Larin

11 06.11.2014

Revolutionary approach – make bandbass filters right on the sensor

What is needed?

• Fabry-Pérot interferometric filter on top of each pixel


XIMEA, Max Larin

12 06.11.2014

imec Hyperspectral Sensors


XIMEA, Max Larin

13 06.11.2014

HSI sensor types


Snapshot Mosaic Snapshot Tiled

‘wedge’ design High number of bands

Time sequential

‘per-pixel’ design


A few spectral bands

‘area’ design


Low spatial resolution

Linescan

XIMEA, Max Larin

14 06.11.2014

Linescan 600…1000nm

• High resolution, fast and flexible

• 100+ spectral bands

• 600-1000nm, 4nm incremental steps

• FWHM 10…15nm

• Spatial resolution 2048 x (100+ each band x 8 pixels)

• up to 1360 lines/sec


XIMEA, Max Larin

15 06.11.2014

Snapshot Mosaic 4x4, 470...630nm

• Extremely compact and robust

• Spectral resolution: 4x4 mosaic, 16 bands


• FWHM 10…15nm

• Spatial resolution per band: 512 x 272, up to 2mpix with interpolation

• up to 170 data-cubes/sec


XIMEA, Max Larin

16 06.11.2014

Snapshot Tiled, 32 bands, 600...1000nm

• User friendly, requires optical duplicator

• Spectral resolution: 32 bands


• FWHM 10…15nm

• Spatial resolution per band: 256 x 256

• up to 170 data-cubes/sec


XIMEA, Max Larin

17 06.11.2014

Available cameras and new developments

Type Model Spectral

range [nm] Bands

Scans/sec max

Availability

Linescan VNIR

MQ022HG-IM-LS100-600-1000 600…1000 100+

1360 lines/s

Now

Linescan VNIR

MQ022HG-IM-LS150-470-900 470…900 150+

1360 lines/s

In development

Snapshot Mosaic VIS

MQ022HG-IM-SSM4X4-470-630 470…630 16

170 cubes/s

Now

Snapshot Mosaic VNIR

MQ022HG-IM-SSM5X5-600-1000 600…1000 25

170 cubes/s

Call

Snapshot Mosaic VNIR

MQ022HG-IM-SSM4X4-600-900 600…900 16

170 cubes/s

In development

Snapshot Tiled VNIR

MQ022HG-IM-ST32-600-1000 600…1000 32

170 cubes/s

Now


XIMEA, Max Larin

18 06.11.2014

xiSpec and xiQ USB3 Vision camera family

• World smallest USB3 Vision camera

• Compact: 26x26x26mm

• Low power consumption: 1.8W

• Lightweight: 27g

• Single PC board

• USB3 Vision Standard compliant

• Board level: 25x25x14mm, 7g


XIMEA, Max Larin

19 06.11.2014

Extremely Compatible

Support for major operating systems:

• Windows

• Linux

• Mac-OS

Support for major architectures:

• Intel x86/x64

• ARM

• Embedded platforms


XIMEA, Max Larin

20 06.11.2014

HSI ecosystem

Is it enough to have just a HSI camera?

• There are 216 = 65,536 shades per pixel on 16 bit B/W image

• There are 224 = 16,777,216 colors per pixel on 24 bit RGB image

• There are 21,024 = 179,769,313,486,...,624,224,137,216 (309 digits) spectrums per pixel in 128 band 8 bit/sample HS data-cube

Smart HSI software is needed to reduce amount of data

• Reduce dimensionality of the data

• Provide easy to understand data for traditional machine vision workflows


XIMEA, Max Larin

21 06.11.2014

HSI data processing workflow

• Data acquisition

• Spectra selection

• Extract method

• Validate

• Deploy


XIMEA, Max Larin

22 06.11.2014

HSI Software partners

perception park, Graz, Austria

www.perception-park.com

• Chemical Color Imaging

• Integrates with existing image processing systems

• Short development time


XIMEA, Max Larin

NICTA, Canberra, Australia

www.scyllarus.com

• powerful, full featured hyperspectral imaging engine

• automatic recovery of scene illuminant

• available for license as C++ API, standalone application and Matlab toolbox

http://www.perception-park.com/

http://www.perception-park.com/

http://www.scyllarus.com/

23

Perception Studio XIMEA, Max Larin 06.11.2014

24

Scyven from Scyllarus XIMEA, Max Larin 06.11.2014

25 06.11.2014

XIMEA, Max Larin

MEL: ( 03 ) 9480 4999SYD: ( 02 ) 9705 [email protected]

Distributed by