XIMEA Hyperspectral (HSI) Cameras xiSpec ... 6 06.11.2014 HSI...

download XIMEA Hyperspectral (HSI) Cameras xiSpec ... 6 06.11.2014 HSI ¢â‚¬â€œ seeing the invisible Hyperspectral

of 25

  • date post

    16-Aug-2020
  • Category

    Documents

  • view

    3
  • download

    0

Embed Size (px)

Transcript of XIMEA Hyperspectral (HSI) Cameras xiSpec ... 6 06.11.2014 HSI...

  • 1

    XIMEA Hyperspectral (HSI) Cameras xiSpec

    VISION 2014, Stuttgart 4.11.2014 Max Larin, max.larin@ximea.com

  • 2 06.11.2014

    Seeing the invisible – Miniature HSI Cameras Max Larin, XIMEA CEO

    Hyperspectral Imaging (HSI)

    XIMEA, Max Larin

  • 3 06.11.2014 XIMEA, Max Larin

    About

    a recognized innovator in machine vision and scientific imaging markets.

    In cooperation with

    a world-leading research center in nano-electronics

    Belgium

    Hyperspectral Imaging (HSI) cameras

  • 4 06.11.2014 XIMEA, Max Larin

    What is HSI?

    • It is a combination of • Spectroscopy • Imaging

    • Spectrum at each pixel • Spectral irradiance of a scene • Datacube I(x,y,λ)

    Hyperspectral Imaging (HSI) cameras

  • 5 06.11.2014

    Applications

    • Medical Imaging • Microscopy and Endoscopy • Precision Agriculture • Remote Sensing • Mineralogy • Environmental Monitoring • Life science instrumentation • Optical sorting • Food inspection

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 6 06.11.2014

    HSI – seeing the invisible

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

    Image courtesy of Perception Park GmbH

    Monochrome Color Chemical Color

  • 7 06.11.2014

    Scanning HSI technique

    • Line scanning • Point scanning • Wavelength scanning

     High number of bands

     Time sequential

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 8 06.11.2014

    Snapshot HSI technique

    • Split into multiple 2D elements • Recombine with software

     Simultaneous acquisition

     A few spectral bands

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 9 06.11.2014

    State of the art HSI methods

    • 4 basic methods • Wavelength scan (A..D) • Spatial scan (E) • Time scan (F) • “Compromise” (G)

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 10 06.11.2014

    Major obstacles for massive deployment of HSI

    • State of the art HSI systems are: • Handicraft manufactured • Fragile • Expensive • Bulky • Non customizable • Slow

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 11 06.11.2014

    Revolutionary approach – make bandbass filters right on the sensor

    What is needed?

    • Fabry-Pérot interferometric filter on top of each pixel

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 12 06.11.2014

    imec Hyperspectral Sensors

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 13 06.11.2014

    HSI sensor types

    Hyperspectral Imaging (HSI) cameras

    Snapshot Mosaic Snapshot Tiled

    ‘wedge’ design  High number of bands

     Time sequential

    ‘per-pixel’ design

     Simultaneous acquisition

     A few spectral bands

    ‘area’ design

     Simultaneous acquisition

     Low spatial resolution

    Linescan

    XIMEA, Max Larin

  • 14 06.11.2014

    Linescan 600…1000nm

    • High resolution, fast and flexible • 100+ spectral bands • 600-1000nm, 4nm incremental steps • FWHM 10…15nm • Spatial resolution 2048 x (100+ each band x 8 pixels) • up to 1360 lines/sec

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 15 06.11.2014

    Snapshot Mosaic 4x4, 470...630nm

    • Extremely compact and robust • Spectral resolution: 4x4 mosaic, 16 bands • 470-630nm, 11nm incremental steps • FWHM 10…15nm • Spatial resolution per band: 512 x 272, up to 2mpix with interpolation

    • up to 170 data-cubes/sec

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 16 06.11.2014

    Snapshot Tiled, 32 bands, 600...1000nm

    • User friendly, requires optical duplicator • Spectral resolution: 32 bands • 600-1000nm, 12nm incremental steps • FWHM 10…15nm • Spatial resolution per band: 256 x 256 • up to 170 data-cubes/sec

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 17 06.11.2014

    Available cameras and new developments

    Type Model Spectral

    range [nm] Bands

    Scans/sec max

    Availability

    Linescan VNIR

    MQ022HG-IM- LS100-600-1000 600…1000 100+

    1360 lines/s

     Now

    Linescan VNIR

    MQ022HG-IM- LS150-470-900 470…900 150+

    1360 lines/s

    In development

    Snapshot Mosaic VIS

    MQ022HG-IM- SSM4X4-470-630 470…630 16

    170 cubes/s

     Now

    Snapshot Mosaic VNIR

    MQ022HG-IM- SSM5X5-600-1000 600…1000 25

    170 cubes/s

     Call

    Snapshot Mosaic VNIR

    MQ022HG-IM- SSM4X4-600-900 600…900 16

    170 cubes/s

    In development

    Snapshot Tiled VNIR

    MQ022HG-IM- ST32-600-1000 600…1000 32

    170 cubes/s

     Now

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 18 06.11.2014

    xiSpec and xiQ USB3 Vision camera family

    • World smallest USB3 Vision camera • Compact: 26x26x26mm • Low power consumption: 1.8W • Lightweight: 27g • Single PC board • USB3 Vision Standard compliant

    • Board level: 25x25x14mm, 7g

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 19 06.11.2014

    Extremely Compatible

    Support for major operating systems:

    • Windows • Linux • Mac-OS Support for major architectures:

    • Intel x86/x64 • ARM • Embedded platforms

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 20 06.11.2014

    HSI ecosystem

    Is it enough to have just a HSI camera?

    • There are 216 = 65,536 shades per pixel on 16 bit B/W image • There are 224 = 16,777,216 colors per pixel on 24 bit RGB image • There are 21,024 = 179,769,313,486,...,624,224,137,216 (309 digits) spectrums per pixel in 128 band 8 bit/sample HS data-cube

    Smart HSI software is needed to reduce amount of data

    • Reduce dimensionality of the data • Provide easy to understand data for traditional machine vision workflows

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 21 06.11.2014

    HSI data processing workflow

    • Data acquisition

    • Spectra selection

    • Extract method

    • Validate

    • Deploy

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

  • 22 06.11.2014

    HSI Software partners

    perception park, Graz, Austria

    www.perception-park.com

    • Chemical Color Imaging • Integrates with existing image processing systems • Short development time

    Hyperspectral Imaging (HSI) cameras

    XIMEA, Max Larin

    NICTA, Canberra, Australia

    www.scyllarus.com

    • powerful, full featured hyperspectral imaging engine • automatic recovery of scene illuminant • available for license as C++ API, standalone application

    and Matlab toolbox

    http://www.perception-park.com/ http://www.perception-park.com/ http://www.scyllarus.com/

  • 23

    Perception Studio XIMEA, Max Larin 06.11.2014

  • 24

    Scyven from Scyllarus XIMEA, Max Larin 06.11.2014

  • 25 06.11.2014

    XIMEA, Max Larin

    MEL: ( 03 ) 9480 4999 SYD: ( 02 ) 9705 8059 sales@scitech.com.au www.scitech.com.au

    Distributed by

    XIMEA Hyperspectral (HSI) Cameras�xiSpec� Seeing the invisible – Miniature HSI Cameras��������Max Larin, XIMEA CEO�� About What is HSI? Applications HSI – seeing the invisible Scanning HSI technique Snapshot HSI technique State of the art HSI methods Major obstacles for massive deployment of HSI Revolutionary approach – make bandbass filters right on the sensor imec Hyperspectral Sensors HSI sensor types Linescan 600…1000nm Snapshot Mosaic 4x4, 470...630nm Snapshot Tiled, 32 bands, 600...1000nm Available cameras and new developments xiSpec and xiQ USB3 Vision camera family Extremely Compatible HSI ecosystem HSI data processing workflow HSI Software partners Slide Number 23 Slide Number 24 QUESTIONS?