Download - Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Transcript
Page 1: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

SpectroNet Collaboration Forum 2015

Miniaturized hyperspectral imaging cameras

Fraunhofer IOSB KCM

XIMEA GmbH , Jürgen Hillmann17.03.20151

Page 2: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Hyper spectral imaging (HSI)

XIMEA GmbH , Jürgen Hillmann2

Miniaturized hyperspectral imaging cameras

17.03.2015

Page 3: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

XIMEA GmbH , Jürgen Hillmann3

HSI sensor types from imec

Linescan Snapshot Mosaic Snapshot Tiled

Miniaturized hyperspectral imaging cameras

17.03.2015

‘per-pixel’ design4x4: 470 – 630 nm5x5: 600 – 1000 nm

‘area’ design32 bands600 – 1000 nm

filter layouts

‘wedge’ design100 bands600 - 1000 nm

Page 4: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

XIMEA GmbH , Jürgen Hillmann4

Snapshot Mosaic (imec)

XIMEA camera MQ022HG-IM-SM4X4-470-620

Key specificationSpectral resolution: 4x4 mosaic = 16 bands in 465-630nmFWHM: ~ 15nmSpatial resolution: from 512x272 (per band)Speed: up to 170 data-cubes / s (full sensor frame)

Miniaturized hyperspectral imaging cameras

17.03.2015

Page 5: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

XIMEA GmbH , Jürgen Hillmann5

Snapshot Mosaic (imec)

Miniaturized hyperspectral imaging cameras

17.03.2015

XIMEA camera MQ022HG-IM-SM5X5-600-1000

Key specificationSpectral resolution: 5x5 mosaic = 25 bands in 600-975nmFWHM: ~ 16nmSpatial resolution: from 409x217 (per band)Speed: up to 170 data-cubes / s (full sensor frame)

Page 6: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Fabry-Perot interference filter

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann6

17.03.2015

Transmitted wavelength: 𝑘𝜆=2𝑛𝐿cos𝜃

A filter designed for a specific wavelength 𝜆 will also transmit severalother wavelengths, e.g. 𝜆/2 and the wavelength of the second order harmonics (on snapshot mosaic sensors).

The sensor is designed to work in a specific spectral range (active range).

Wavelength ranges outside of the active range must be cut off by bandpass filters.

Page 7: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Bandpass filters (SM 5x5)

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann7

17.03.2015

Bands with first order response at 840 – 1000 nm have a second order responseat 600-675 nm.

Band pass filters to retain second order peaks: 600-875 nm or 675-975 nmBand pass filter for the full active range: 600-975 nm

Page 8: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Calibration data

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann8

17.03.2015

Each sensor is calibrated individually!

The complete calibration data is delivered (and stored to the XIMEA cameras).

Page 9: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

XIMEA GmbH , Jürgen Hillmann9

HSI – industrial applications

• Medical Imaging

• Microscopy and Endoscopy

• Precision Agriculture

• Remote Sensing

• Mineralogy

• Environmental Monitoring

• Life science instrumentation

• Optical sorting

• Food inspection

Miniaturized hyperspectral imaging cameras

17.03.2015

Page 10: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Waste sorting white plastics

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann10

17.03.2015

5x5 snapshot mosaic, halogen lamp illumination, filter set 675 – 975 nm

Color imageCamera MQ022CG-CMCMOSIS CMV2000

NIR (intensity) HSI separated

Page 11: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Food / organic sorting green leafs

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann11

17.03.2015

5x5 snapshot mosaic, halogen lamp illumination, filter set 675 – 975 nm

Color imageCamera MQ022CG-CMCMOSIS CMV2000

NIR (intensity) HSI separated

Page 12: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Food / organic sorting green leafs

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann12

17.03.2015

5x5 snapshot mosaic, halogen lamp illumination, filter set 675 – 975 nm

NIR (intensity) HSI separated

Page 13: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Miniaturization

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann13

17.03.2015

Miniaturizedhyperspectral

imaging cameras

Page 14: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Software environments

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann14

17.03.2015

Support for Windows

Linux

Mac-OS

Compatible with USB3-Vision

GenICam GenTL

XIMEA API / SDK

Running on Intel x86 / x64

ARM (Cortex A9 +)

embedded platforms

Page 15: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

HSI software partners

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann15

17.03.2015

perception park, Graz, Austria

www.perception-park.com • Chemical Color Imaging

• integrates with existing image processing systems

• short development time

NICTA, Canberra, Australia

www.scyllarus.com • powerful, full featured hyperspectral imaging engine

• automatic recovery of scene illuminant

• available for license as C++ API, standalone application and

Matlab toolbox

Page 16: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Supported software libraries

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann16

17.03.2015

Extremely compatible

compatible with more than 30 popular machine vision libraries…

Page 17: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Yes, we can …

Miniaturized hyperspectral imaging cameras

XIMEA GmbH , Jürgen Hillmann17

17.03.2015

4x4 snapshot mosaic, halogen lamp illumination, filter set 450 – 650 nm

… compare apples with pears !

Page 18: Miniaturized hyperspectral imaging cameras · HSI –industrial applications •Medical Imaging •Microscopy and Endoscopy •Precision Agriculture •Remote Sensing •Mineralogy

Thank you for your attention

XIMEA GmbH , Jürgen Hillmann18

Miniaturized hyperspectral imaging cameras

17.03.2015