Value of 3D in Moments of Visual Dominanceon-demand.gputechconf.com/gtc/2016/presentation/s...Value...
Transcript of Value of 3D in Moments of Visual Dominanceon-demand.gputechconf.com/gtc/2016/presentation/s...Value...
1
Value of 3D in Moments of Visual Dominance
Tom Curtin, Director of Business Development, DTI
NVIDIA GTC16 April 6, 2016
Value of 3D Situational Awareness
The basis for real-time decision making
Command and Control Human in the Loop—In Harm’s Way
Human in the Loop—Out of Harm’s Way
Safety and Security Seeing and identifying threats
Situational Awareness Perceive
Comprehend Project Decide
Act
12.5 Seconds
See an Object .1 .1 Identify as Aircraft 1.0 1.1 Collision Course! 5.0 6.1 Decide on Evasive Maneuver 4.0 10.1 Take Action .4 10.5
Aircraft Responds to Action 2.0 12.5
US Naval Aviation Safety Center
Time to Respond
Total Time
Situational Awareness Visually Dominant Activity
50% of sensory neurons
engaged in vision
Visual Dominance: The Colavita Effect
When presented with multiple sensory stimuli – the brain favors vision.
Can 3D Save Lives? NASA thinks so.
Greater Situational Awareness De-cluttered data enhances comprehension
Monoscopic Depth Cues Motion Parallax
Perspective
Relative Size
Familiar Size
Occlusion
Shading
Texture Gradient Elevation
2D Displays Provide Incomplete Information
Stereoscopic Cues/Binocular Vision Retinal disparity Accommodation
Convergence
Improved perception of relative position in space (most precise cue) The shape and volume of objects
Segregation in complex scenes (foliage) Camouflaged objects Surface perception
Scientific Method
The Science of 3D
The Science of 3D
The Science of 3D
{"45752bf": [3958177, 40.63490, -73.77839, 210, 0, 16, 9525, 1502, "A388", "D-AIMA", 1410887030, "FRA", "JFK", "LH400", 1, 0, "DLH400", 0], "4580277": [10661764, 42.33331, -71.18330, 210, 3700, 211, 16449, 5798, "E145", "N272SK", 1410887030, "CMH", "BOS", "DL6409", 0, 0, "CHQ6409", 0], "45751fb": [3754505, 40.64450, -73.80389, 177, 0, 31, 25459, 1502, "B77W", "F-GSQJ", 1410887030, "CDG", "JFK", "AF12", 1, 0, "AFR12", 0], "458129e": [11230230, 40.43010, -73.68960, 205, 5124, 195, 25140, 8444, "E135", "N831AE", 1410887030, "YUL", "JFK", "AA3509", 0, 0, "ENY3509", 0], "458255d": [11152660, 40.09310, -75.81680, 235, 30554, 393, 10000, 8444, "CRJ7", "N755EV", 1410887030, "HPN", "ATL", "DL4965", 0, 0, "ASQ4965", 0], "4581a8d": [10671875, 40.43330, -73.66670, 142, 8100, 266, 0, 5798, "E145", "N282SK", 1410887030, "ROC", "JFK", "DL6140", 0, 0, "CHQ6140", 0], "4582b01": [0, 42.36671, -70.73330, 99, 7200, 281, 0, 5798, "B737", "", 1410887030, "BOS", "BNA", "WN2692", 0, 0, "SWA2692", 0], "4582569": [11019070, 40.62840, -73.78250, 210, 0, 18, 29009, 1502, "A320", "N623VA", 1410887030, "JFK", "LAX", "VX411", 1, 0, "VRD411", 0], "458225b": [11108477, 40.60710, -76.99729, 280, 29119, 387, 4375, 8444, "B737", "N711HK", 1410887030, "", "", "", 0, 0, "", 0], "457f5ea": [10803610, 38.84790, -76.58079, 38, 36018, 482, 29703, 8444, "A320", "N411UA", 1410887030, "FLL", "EWR", "UA231", 0, 0, "UAL231", 0], "4581286": [10855637, 38.83171, -77.27000, 118, 5919, 236, 26215, 8444, "CRJ2", "N463AW", 1410887030, "CVG", "DCA", "US4072", 0, 0, "AWI4072", 0], "4582209": [11053733, 40.24501, -76.90039, 251, 25994, 391, 5429, 8444, "CRJ7", "N658CA", 1410887030, "JFK", "PIT", "G76187", 0, 0, "GJS6187", 0], "4581fa1": [10765018, 41.41520, -76.19610, 107, 25477, 477, 0, 8444, "CRJ7", "N374CA", 1410887030, "PIT", "JFK", "DL6296", 0, 0, "GJS6296", 0], "457f2d7": [10764337, 40.60670, -74.02690, 36, 3746, 185, 12401, 8444, "A320", "N373NW", 1410887030, "MSP", "LGA", "DL1496", 0, 0, "DAL1496", 0], "4582186": [10512780, 40.49061, -76.11229, 243, 28897, 347, 9846, 8444, "E145", "N12564", 1410887030, "EWR", "CMH", "UA4335", 0, 0, "ASQ4335", 0], "457edfd": [10976599, 38.66770, -77.39929, 82, 16304, 459, 9047, 8444, "MD82", "N582AA", 1410887030, "DFW", "BWI", "AA1368", 0, 0, "AAL1368", 0], "4574bed": [4921469, 40.64420, -73.75579, 30, 0, 39, 4400, 1502, "A333", "HB-JHD", 1410887030, "ZRH", "JFK", "LX16", 1, 0, "SWR16", 0], "4580d8f": [11218034, 43.94620, -78.63849, 278, 37986, 389, 8720, 8444, "B738", "N819SY", 1410887030, "", "", "", 0, 0, "", 0], "45805df": [10536665, 44.33330, -77.20000, 76, 35000, 490, 0, 5798, "E145", "N14923", 1410887030, "ORD", "YUL", "UA4520", 0, 0, "ASQ4520", 0], "45822dd": [10763486, 37.88880, -77.95640, 220, 33067, 395, 8468, 8444, "B733", "N372SW", 1410887030, "", "", "", 0, 0, "", 0], "458040e": [11258368, 40.57740, -75.02219, 128, 9900, 312, 12614, 584, "B738", "N859NN", 1410887030, "ORD", "LGA", "AA380", 0, 0, "AAL380", 0], "4581568": [10829108, 44.06670, -73.36670, 355, 24900, 421, 0, 5798, "CRJ2", "N437AW", 1410887030, "PHL", "YUL", "US3912", 0, 0, "AWI3912", 0], "457020c": [7735545, 43.67060, -79.83570, 226, 4750, 263, 1877, 850, "B77L", "AP-BGY", 1410887030, "LHE", "YYZ", "PK789", 0, 0, "PIA789", 0], "4581cd4": [11300779, 39.73330, -74.56669, 234, 2000, 193, 0, 5798, "", "N900FB", 1410887030, "EWR", "", "", 0, 0, "N900FB", 0], "4580f87": [11104926, 46.78331, -79.26669, 14, 31000, 460, 22391, 5798, "B77L", "N708DN", 1410887030, "DTW", "PVG", "DL583", 0, 0, "DAL583", 0], "45755f5": [4456572, 42.01200, -71.29519, 199, 34475, 452, 1890, 1389, "B772", "OE-LPC", 1410887030, "VIE", "JFK", "OS87", 0, 0, "AUA87", 0], "457d087": [10490240, 42.76671, -71.38329, 305, 19300, 344, 0, 5798, "E170", "N103SY", 1410887030, "BOS", "ORD", "UA5204", 0, 0, "SKW5204", 0], "4581810": [11028726, 39.22931, -76.13840, 41, 27020, 475, 9536, 8444, "A320", "N633AW", 1410887030, "CLT", "EWR", "US1936", 0, 0, "AWE1936", 0], "4580d17": [11178781, 46.44860, -68.12260, 30, 32975, 511, 0, 6271, "B772", "N78013", 1410887030, "EWR", "PEK", "UA89", 0, 0, "UAL89", 0], "45810e6": [10682089, 39.77770, -75.93989, 234, 15163, 284, 4929, 8444, "B737", "N292WN", 1410887030, "", "", "", 0, 0, "", 0], "457d344": [12590837, 43.78331, -79.75000, 144, 8900, 310, 0, 5798, "A320", "C-FLSU", 1410887030, "YEG", "YYZ", "AC1156", 0, 0, "ACA1156", 0], "4580b79": [10687484, 41.33800, -72.58749, 61, 23024, 441, 8706, 8444, "E190", "N298JB", 1410887030, "CLT", "BOS", "B61246", 0, 0, "JBU1246", 0], "45757b6": [10576499, 40.60000, -73.76670, 37, 400, 157, 0, 5798, "B763", "N189DN", 1410887030, "AMS", "JFK", "DL49", 0, 0, "DAL49", 0], "4582bde": [0, 38.10000, -75.58330, 0, 7600, 92, 0, 5798, "", "", 1410887030, "", "", "", 0, 0, "N16283", 0], "4582789": [0, 42.75000, -70.76669, 65, 1500, 148, 0, 5798, "PC12", "", 1410887030, "BED", "PSM", "", 0, 0, "CNS8", 0], "457d26f": [11051982, 42.36480, -71.01459, 58, 0, 0, 8192, 645, "A320", "N656JB", 1410887030, "MCO", "BOS", "B6152", 1, 0, "JBU152", 0], "4581219": [0, 43.00000, -75.16670, 106, 11000, 208, 0, 5798, "COL4", "", 1410887030, "YOO", "ALB", "", 0, 0, "N7790J", 0], "458289d": [10616892, 40.71280, -74.30360, 221, 4225, 135, 13136, 8444, "M20T", "N228RM", 1410887030, "TEB", "IAG", "", 0, 0, "N228RM", 0], "4582906": [10526664, 44.73111, -78.92769, 244, 33567, 305, 4208, 8444, "E145", "N13958", 1410887030, "YOW", "ORD", "UA4108", 0, 0, "UAL4108", 0], "4581603": [11235952, 39.62781, -76.13739, 230, 17268, 331, 4869, 8444, "A319", "N837AW", 1410887030, "BOS", "DCA", "US2113", 0, 0, "AWE2113", 0], "45822c5": [10728634, 39.04851, -77.47210, 24, 5507, 192, 8454, 8444, "DH8D", "N338NG", 1410887030, "EWR", "PIT", "UA4903", 0, 0, "RPA4903", 0], "45804c0": [11315604, 37.74131, -79.32660, 225, 31988, 395, 8528, 8444, "MD88", "N915DL", 1410887030, "PWM", "
FINDINGS: 3D is Superior in Many Important Use Cases 77% -- increased spatial understanding of complex scenes
67% -- definite benefit for spatial manipulations of real or virtual objects
65% -- superior for finding, identifying, and classifying objects
70% -- definite benefit in medical applications
65% -- clearly superior for telerobotic surgery
3D vs 2D Displays 162 Studies/184 Experiments
Visual Dominance: Intense Focus
Air Traffic Controllers Pilots
Manned and UAV Drivers
Surgeons Researchers Luggage Screeners
Luggage Screening Front Line of Security
Federal Courthouse Visitors
Military Bases
Gov. Parcel Screening
All Other ScreeningApplications
County Courthouse Visitors
Commercial ParcelScreening
Airline Passengers
1.5 Billion Screenings in US per year
770 million
Luggage Screening Troubling signs for aviation safety. Christopher Elliott, Special for USA TODAY 10:58 a.m. EDT April 4, 2016
An internal report last year revealed that inspectors posing as passengers successfully smuggled weapons past TSA agents in 67 out of 70 tests.
A second round of testing later in the year showed little improvement..
3D Luggage Screening
• Greater Accuracy in Detecting Contraband • Fewer Passenger Delays • Fewer Searches (due to increased accuracy) • Less Operator Fatigue • Increased Efficiency (TSA workforce multiplier) • May replace current 2-D scanners worldwide • Public Buildings, Schools and Industry
3-D X-Ray Luggage Scanner
User Experience Requirements
• Image quality with stereo depth cues • Maintain stereo during head movement
• Full resolution and brightness
Glasses-Free 3D for Serious Use Cases
Improved Situational Awareness Improved Command and Control
Improved Monitoring, Safety and Security
If we can do better; we must do better.
Glasses-Free 3D for Serious Use Cases
Thank you
Contact:
Arnold Lagergren CEO, DTI
585 436 3530 [email protected]
Tom Curtin
Director of Business Development, DTI 585-329-5580 [email protected]