Visual thinking colin_ware_lectures_2013_11_objects and object-based displays
-
Upload
elsa-von-licy -
Category
Technology
-
view
117 -
download
2
Transcript of Visual thinking colin_ware_lectures_2013_11_objects and object-based displays
![Page 1: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/1.jpg)
Perceiving and Representing Structured Information
using Objects
![Page 2: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/2.jpg)
![Page 3: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/3.jpg)
Organization
Image based theories Structural 3D theories Object perception: Object displays
![Page 4: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/4.jpg)
Image Based vs Structure Theories
Template theories based on 2D image processing
In structural theories we extract the structure of a scene in terms of 3D primitives
![Page 5: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/5.jpg)
Template theories
A template with simple morphing operations
![Page 6: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/6.jpg)
Objects as patterns of (2D) patterns
![Page 7: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/7.jpg)
![Page 8: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/8.jpg)
![Page 9: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/9.jpg)
![Page 10: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/10.jpg)
Scenes (gist in 100 msec)
Torralba and Oliva Patterns of patterns
![Page 11: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/11.jpg)
Properties of Image Recognition
Remarkable image recognition memory Up to 5 images for second in object
identification Applications in image searching interfaces RSVP Rapid serial visual presentation
![Page 12: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/12.jpg)
Perception of object structure
![Page 13: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/13.jpg)
Geon Theory
![Page 14: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/14.jpg)
Geon Theory
3D Primitives “Geons”Structural skeleton
Shape from shading is also primitive
![Page 15: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/15.jpg)
How Does the Brain Find Geons?
a
Contourgenerator
![Page 16: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/16.jpg)
![Page 17: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/17.jpg)
Canonical Views
To make things clear both component parts and the critical joints must be clear
![Page 18: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/18.jpg)
Processing stages for recognition
![Page 19: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/19.jpg)
The Geon Diagram Pourang Irani
3D shape primitives for architecture - entities and relationships
Surface texture and color for attributes
![Page 20: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/20.jpg)
Pattern finding& Recognition
13% errors: 4.3 secsub-structure
26% errors 7.1 secsub-structure
42% memoryerrors
22% memoryerrors
![Page 21: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/21.jpg)
Semantics
On top of - relies on Underneath – support, foundation Inside – containment (private code) Attachment points (external interfaces; part_of
relationships) more than topology mid Upper Lower
![Page 22: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/22.jpg)
Natural semanticsInstances Dependency
Strength of Relationship Multiplicity
![Page 23: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/23.jpg)
![Page 24: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/24.jpg)
![Page 25: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/25.jpg)
The Object Display (Wickens)
Use complex objects to fuse variables Map entities to object parts Map structure to object structure Can be pictorial (simplified) – an engine +
fuel tank Map attributes to object attributes
- color, size, motion etc.
![Page 26: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/26.jpg)
Object Display
100 L
45 L
Solids: 23%
45 deg 0.2/1.0
Vol : 45 LTemp: 45 degFlow: 20%Solids: 23%
![Page 27: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/27.jpg)
Approx 1/3 errors with anesthiologists Dr George Blike
![Page 28: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/28.jpg)
A medical ventilator
Such displays Must be custom
![Page 29: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/29.jpg)
Chart Junk (ducks) Tufteor Effective Communication
1990 2000 2010 1990 2000 2010
![Page 30: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/30.jpg)
A Duck? (Tufte)
![Page 31: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/31.jpg)
![Page 32: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/32.jpg)
The concrete/abstraction tradeoff Object displays may lead to lower errors Lend themselves to overly literal interpretation.
They are not general purpose. Object displays must be custom designed
More abstract representations leave more room for interpretation (better support the creative process)
![Page 33: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/33.jpg)
2 ½ D design
Use 3D objects to represent entities Layout to make structure clear in 2D.
-Connections, basic shapes
Use canonical views
![Page 34: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/34.jpg)
Holding attention-Object scene conflict
Used in advertising
![Page 35: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/35.jpg)
Emotional and motivational effects
![Page 36: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/36.jpg)
There is a great future in 3D object icons and object structures
It is happening anyway, but nice to know that it is not always “chart junk”.
Conclusion
![Page 37: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/37.jpg)
Conclusions
Visual space is non-homogenous The plane orthogonal to the line of sight
and the forward direction are very different.
A 21/2D design attitude recognizes the cost of actions.
![Page 38: Visual thinking colin_ware_lectures_2013_11_objects and object-based displays](https://reader033.fdocuments.net/reader033/viewer/2022060200/5598719e1a28ab9b2e8b456d/html5/thumbnails/38.jpg)
3D versus 2D
34% memoryerrors
20% memoryerrors
21% errors 5.1 secsub-structure
11.4% errors 3.7 secsub-structure