NI Vision Platform - TUL
Transcript of NI Vision Platform - TUL
ni.com
NI Vision Platform
Radim ŠTEFAN www.ni.com/vision
2 ni.com
National Instruments – Our Stability
• Revenue: $1.15B in 2012
• Innovation: 18% re-invested to R&D
• Global Operations: Approximately
7,100 employees; operations in more
than 40 countries
• Broad customer base: More than
35,000 companies served annually
• Diversity: No industry >15% of
revenue
• Culture: Ranked among top 25
companies to work for worldwide by
the Great Places to Work Institute
‘12 ’86 ’88 ‘90 ’92 ’94 96 ’98 ’00 ’02 ’04 ’06 ’08 ’10 ‘12
3 ni.com
National Instruments—What We Do
NI combines graphical programming software with modular
hardware, leveraging the latest technologies.
Low-Cost Modular Measurement
and Control Hardware
Productive Software
Development Tools
Highly Integrated
Systems Platforms
4 ni.com
Graphical System Design
A Platform-Based Approach for Measurement and Control
5 ni.com
User Community
9,000+ Certified Users
700+ Alliance Partners
60+ Registered User Groups
LabVIEW Tools Network
1,000,000+ Add-Ons Downloaded
26+ Certified Add-Ons
100+ Available Add-Ons
The LabVIEW Ecosystem
Partners and Solutions
700+ Alliance Partners
8 ni.com
10 ni.com
Parallel Digital
Camera Link USB 2.0
FireWire
IP Cameras
PCI
Analog
GigE Vision
‘96 ‘00 ‘02 ‘04 ‘06 ‘08 ‘10
PCIe
‘98
PXI PXIe
Compact Vision System
Smart Cameras
Embedded Vision Systems
CompactRIO
17 Years of Vision at National Instruments
USB 3.0
‘12
14 ni.com
NI Vision Platform
16 ni.com
NI Vision Platform - Hardware
17 ni.com
NI Vision Acquisition Software
NI Vision Builder for Automated Inspection
Configurable environment to create, benchmark, and deploy vision inspections
NI Vision Development Module Programming tools for LabVIEW,
LabWindows/CVI, MS Visual Studio
Camera Standards
Parallel Digital
Camera Link (Channel Link)
NI Smart Cameras
Consumer Ports
Gigabit Ethernet (GigE Vision)
FireWire
(IEEE 1394) USB Ethernet
(IP cameras)
Hardware Abstraction
19 ni.com
Buses
Parallel digital
Sensors
• Line-scan
• Area scan
• Thermal/infrared
• Near infrared (NIR)
• Lasers
• Proximity sensors
• 3D laser triangulation sensors
• Contact Image Sensors (CIS)
• Etc.
Camera Sensor & Camera Bus Support
20 ni.com
Industry Involvement
• AIA Board Member since 2004
• VDMA member
• Technical Committees
• Camera Link
• GigE Vision
• Gen<i>Cam
• Camera Link HS
• USB3
21 ni.com
Interface Comparison
5 m
4.5 m
100 m
8 m
10 m
Cable lengths
Multi camera
Cable costs
“RealTime“ „Plug & play“
40
64
100
350
850
Bandwidth Max in MB/s
USB 2.0 Not Industrial
Dying Technology
A harmonious coexistence of interfaces :)
22 ni.com
USB3 Vision
• USB3 Vision standardization effort started 2010.
• Version 1.0 standard released in 2013
• NI chairs the USB3 Vision standardization
committee.
• Standard based on USB 3.0 specifications
(SuperSpeed) and Gen<I>Cam.
• NI-IMAQdx includes native driver for USB3 Vision
camera on Windows.
23 ni.com
• 11 models
• Rugged (IP67) and small
• Integrated camera and processor
• CCD sensors (VGA to 5 MP resolution)
• Monochrome or Color
• Up to 1.6 GHz processor
• Isolated digital I/O
• Direct drive lighting
• Wide range of connectivity options
• EtherNet/IP, Modbus TCP/Serial , RS232, TCP/IP
Smart Cameras
24 ni.com
Compact Vision System
• Rugged, passively cooled
• Small form factor
• 1.66 GHz Atom processor
• 2 independent GigE Vision ports • Power over Ethernet (PoE) compliant
• 1 GigE port for network connectivity
• 2 USB ports for external data storage
• Built-in VGA port for display
• Selectable RS232/RS485 serial port
• FPGA-based industrial I/O • 8 Bidirectional TTL (2 MHz)
• 8 Opto-Isolated Inputs (~200 kHz)
• 8 Opto-Isolated Outputs (~2 kHz)
• 1 Quadrature Encoder Input (5 MHz)
25 ni.com
Embedded Vision Systems
• Stand-alone real-time machine vision
• Multi-camera support
(GigE Vision, IEEE 1394, Camera Link)
• Industrial, fanless design
• Solid-state drive
• Dual-core processor
• Reconfigurable digital I/O (TTL, isolated)
• Industrial communications options
• Built-in video output
26 ni.com
PC-Based Solutions
• Real-time or Windows (32-bit & 64-bit) systems
• PCI, PCI Express, PXI, PXI Express frame grabbers
(cameras can also connect directly to PCs)
• Support for wide range of camera types: Parallel digital, IEEE 1394, CameraLink, GigE Vision, USB, IP
• PXI and PCs provide highest performance
(ex. multicore)
27 ni.com
Integration with automation devices
Control Network
Vision Network
GigE Vision Camera Network
Enterprise
Network
Real-Time
Vision System
Smart Cameras
Servers and workstations
PAC PLC
Robotics System
Operator Interface
HMI
Vision System
EtherNet Serial Digital I/O
TCP/IP
RS232 Serial
TTL
Opto-isolated
Other
IEEE 1588
Network-Shared
variables
• Communicate inspection results to PLCs, HMIs, and
other automation devices with digital I/O, serial, and
Ethernet protocols.
31 ni.com
NI Vision Platform - Software
32 ni.com
Two Ways to Create Vision Applications
• Configuration Software • Programming Libraries
33 ni.com
NI Vision Capabilities
Enhance
• Calibrate image
• Filter noise
• Remove distortion
Check
• Measure intensity
• Count particles
• Match colors
Locate
• Match patterns
• Match geometry
• Detect edges
Identify
• Read text (OCR)
• Read 1D barcodes
• Read 2D codes
• Classify shapes
Measure
• Detect edges
• Measure distance
• Calculate geometry
37 ni.com
Pyramid Matching
Template Search Image
0
1
2
Level
Pyramid level is same for the template and search image during matching.
Match Direction
38 ni.com
Pyramid Matching – Initial Matching
Template Search Image
0
1
2
Level
All the pixel positions in higher pyramid are
inspected for possible matches
39 ni.com
Pyramid Matching – Refine Matching
Template Search Image
0
1
2
Level
Only Initial matches are inspected in
Lower pyramids.
Neighborhood Search Area
40 ni.com
Pyramid Matching – Refine Matching
Template Search Image
0
1
2
Level
Matches are qualified based on score
on every pyramid level
Low Score
41 ni.com
Vision Development Module: Object Tracking
• Track objects regardless of blur, noise and partial occlusion
• Invariance to gradual changes in geometric transformations such as shifting, rotation, or scaling
• Track objects in gray-scale and color images
• Multiple Object Tracking
42 ni.com
Preprocessing
:
Multiline
Detection
Segmentation:
Local
Threshold,
Color Threshold
Noise Filtering Character
separation
Rotation
detection
Space
Identification
Vision Development Module: OCR
43 ni.com
• New 3D Stereo Vision Features in
Vision Development Module
• Calibrate cameras to analyze left
and right images
• Generate depth and disparity
maps (3D images)
• Suited for advanced inspection
and vision guided robotics
applications
Left Image Right Image
Combined Image for Depth Information
Defective
Chocolate
3D Binocular Stereo Vision
46 ni.com
LabVIEW FPGA VHDL
LabVIEW FPGA - Abstraction to the Pin
47 ni.com
FPGAs
• Latency
• Jitter
• Compute power
• Pipelining
• Security
• Weight / Power / Heat
• Complexity
• Raw Clock Rates
• Limited Floating Point support
49 ni.com
FPGA Image Processing
• High-speed control
• Image pre-processing
Optical Coherence
Tomography Web & Surface
Inspection
Laser Alignment
& Tracking High-Speed
Sorting
50 ni.com
Pixel Processing Example - Threshold
Threshold
51 ni.com
• Laser alignment/steering
– Beam profile/position measurements
– Low latency control output
• High-speed sorting
– Segmentation
– Measure parameters of contaminant
– Trigger rejection valves
• In Air Sorting
– Image and inspect falling product
– Low jitter requirement for decision
making and IO
High-Speed Control
52 ni.com
Shack-Hartmann wavefront sensor
Image Detector Lenslets
Wavefront
Adaptive Optics
53 ni.com
• Optical Coherence Tomography
(OCT)
– Data scaling
– FFT
– Logarithmic LUT
– Image display (host)
• Web and surface inspection
– Flat field correction
– Thresholding
– Particle analysis
Image Pre-processing
ni.com
•
V rámci konference se budeme zabývat nejnovějšími technologickými trendy, produkty a
řešeními z oblastí:
• Software a sběr dat
• Automatizované měření a testování
• Průmyslové a embedded technologie
• Řešení pro vzdělávání a výzkum
Buďte naším přednášejícím!
Přihlaste svůj nejinovativnější projekt do soutěže NIDays Graphical System Design Case Study Contest –
soutěže technických článků, které ukazují nejinovativnější použití virtuální instrumentace a grafického
návrhu systémů.
Můžete vyhrát hodnotné ceny:
• Výherce z oblasti střední a východní Evropy – Jedna vstupenka na NIWeek 2014, který se
bude konat ve městě Austin v Texasu v srpnu 2014, včetně letenky a ubytování. (NI provede
rezervaci letů i ubytování.)
• Výherce z České republiky - LEGO® MINDSTORMS® EV3®
Více informací: czech.ni.com/nidays
Zveme Vás na NIDays 2013
největší konferenci National Instruments
v České republice, 7. 11. 2013
Více informací: czech.ni.com/nidays