Information Representation Need to break representations into component forms, for analysis and for...

53
Information Representation • Need to break representations into component forms, for analysis and for design • Establish a common language for discussion • Few frameworks available

TAGS:

Transcript of Information Representation Need to break representations into component forms, for analysis and for...

Page 1: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Information Representation

• Need to break representations into component forms, for analysis and for design

• Establish a common language for discussion

• Few frameworks available

Page 2: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Wood’s levels of Representation

• Workspace

• Views

• Graphic Forms

• Graphic Fragments

• The Graphic Atom

Page 3: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Workspace

• A coordinated set of view and the global relationships between them.

• Design decisions: salience of process views, organisation and arrangement of process views, positioning of viewports, size and background

• overall display issues, navigation

Page 4: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Prototype Hercules Display

Page 5: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Process Views

• Graphic Forms joined with a common context

• Design Issues are: salience and arrangement of graphic forms, organisation, grouping, backgrounds

Valve 1 Valve 2

Page 6: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Graphic Forms• A more meaningful unit

• shows changes and anomolies

• Design issues are how to convey context, and salience

Page 7: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Graphic Fragments

• Words, numbers, bars, scale, labels

• Design decisions: position, content of numbers, words, relation to near fragments, (proportion, salience)

temperature

Page 8: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Graphic Atom

• Smallest unit

• a letter, digit, line, colour block

• Design decisions: colour, size, shape, length, thickness, angle, etc.

A

3

Page 9: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Forms of Reference

• 3 kinds

• Propositional

• Iconic

• Analogical

• Describe how the visual token relates between the user and the world

Page 10: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Propositional Form

• Token tells the observer about the world• Relation between the token and the world is

arbitrary• Typically words, numbers, some graphics• Relies on stored knowledge such as language,

numbers• Gives current state but little more

Observer Token World“tells” arbitrary

Page 11: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Iconic Reference

• Relies on observer experience with the world

• depends on quality of visual form to look like the world

• should evoke recognition

• typical “icons”

Observer Token Worldrecognizes looks like

Page 12: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Analogical Reference

• May or may not look like world

• Typically graphs on contextual backgrounds

Observer Token WorldProcesses constraint

captures natural constraint

Page 13: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Examples

• Stop lightpropositional

Page 14: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Airline departure and arrival signs

iconic

Page 15: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Stop Sign

STOP propositional

Page 16: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Stove Labels

“REAR”

“FRONT”

propositional

iconic

Page 17: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Can you have too many icons?

• Early trend of using icons as “user-friendly”

• A good idea taken too far?

• Examples:

• Iconization of non-visual things

• (is that still iconic reference?)

• Poorly drawn or obscure icons

• Aiding with words an indicator

Page 18: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Mixed Forms of Reference

• Windows Recycle Bin– Recycle Bin iconic– darkens/lightens propositional– fills/empties propositional

Page 19: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Map

• Words propositional

• Symbols propositional

• landmark images iconic

• spacing and scale analogical

Page 20: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.
Page 21: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Final Notes

• Propositional and Iconic usually give 1 piece of information

• Analogical usually gives many pieces

• Representation is not right or wrong but changes the work of the observer

Page 22: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Work involved in processing representations

• Analogical perceptual

• Propositional memory

• Iconic recognition memory

• (Propositional and Iconic both rely to some degree on knowledge in the head. Analogical leaves knowledge in the world.)

Page 23: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Graphic FormsAnalog vs. Digital

• DIGITAL:– uses propositional reference– set of numerical strings that describe the

referent e.g. 100.91– observer reads the information

Page 24: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Digital Forms

• only current state is available

• very difficult to display history of the referent

• past or future states must be – remembered– calculated

• Memory and mental workload for user

Page 25: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Analog

• Uses analogical reference

• data is represented by a relationship between visual tokens on the screen

• representation is not as direct as digital

• requires the interpretation of a position in space

Page 26: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Analog

• Relationship is typically between an indicator and a reference scale

• Reference scale = Frame of reference.

Page 27: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Frames of Reference

1-dimensional frame of reference

indicator

scale

2-dimensional frame of reference

scales

indicator

Page 28: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Main Differences (A/D forms)

• 1. Generality vs. Precision– digital is precise and explicit– analog is more general, harder to extract precise

values

• 2. Parallel vs. Serial Display– digital tells you 1 piece of data (serial)– analog permits parallel data display and

integration with other data

Page 29: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Main Differences (A/D forms)

• 3. Context– analog shows current value against the

complete set of values that the referent can take– digital just shows the current value

Max value

Min value

Current value

Distance to max value

Distance to min value

Page 30: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

In terms of Workload

• Analog is generally easier because it is processed perceptually

• Digital requires mental comparisons and memory

• The Principle of the Primacy of Perception: Whenever you can offload a mental task to a perceptual task you take advantage of human capabilities and make work easier.

Page 31: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Using Digital Forms

• Digital Forms typically consist of two parts– 1. An identifier or label

• tells you what the referent is

– 2. A dynamic description of the referent• the value

• The visual form is typically a string of alphanumeric characters but could be icons.

Page 32: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Design Issues with Digital Forms

• 1. Precision– how much precision (# of significant digits)

should you have– 100.2379 vs. 100

Page 33: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Design Issues with Digital Forms

• 2. Context– how will you show context?

• When the referent hits its max value?

• When the referent hits its min value?

• On/off a desired value?

– People often change colour (propositional ref)

Page 34: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Design Issues with Digital Forms

• 3. How will you handle change and rate of change information? Change over time? Direction of change?

• 4. Digital is best choice when precise reading is required

• 5. Digital makes the most efficient use of screen space.

• 6. Digital forms are overused.

Page 35: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Showing Context with Digital Forms

123.45 Change the colour of the numbers for meaning e.g. red for alarms

150.55

123.45 Arrows to show rate and direction of change

123.45 Ratios to show performance relative to a target value

123.45

123.45C Units also add context.

Page 36: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Design Issues with Analog Forms

• 1. You need to show all the values that the referent could take– maximum– minimum– offscale– failed sensor

Page 37: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Design Issues with Analog Forms

• 2. Put the value in the context of reference values

• 3. Design multiple elements– indicator– scale– labels

Page 38: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Possible Reference Values

• 1. Value vs. its past values– changes over time, rate of change

• 2. Value vs. its future values– predicted values

• 3. Value vs its target value (or range)– setpoints

Page 39: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Possible Reference Values

• 4. Value vs. its alarm limits– is it approaching a dangerous value?

• 5. Value vs. its max/min values

• 6. Value vs. decision points that affect operation.– Eg. Automatic system activations.

Page 40: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Graphical Techniques

• “Trend plot”– plot variable against time – gives current value (x), history, rate of change

(dx/dt), rate of rate of change (d2x/dt2)

x

time

Page 41: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Graphical Techniques

• “Trend plot”– shade regions to show target values or alarm

limits

x

time

Alarm region

Target region

Page 42: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Graphical Techniques

• “Trend plot”– “marker bars” on the scale– improved salience by adding indicator

x

time

Alarm region

Target region

Page 43: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Hercules display

• Mostly analog forms

• Polar star - several scales put together

• Trends - used a combination of analog and digital forms to get context and precision.

Page 44: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Polar Star Display

scale

Current value

High limit

Low limit

Page 45: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Other Analog Forms

• Combined with digital

Page 46: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Stacked Bar Graphs

- multiple analog forms

v1

v2

v3

v4

Height=v1+v2+v3+v4

Page 47: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

“Icons” that are Analog

Icon “fills” with water to show level

Page 48: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

More analog forms

Degree of rotation shows degree valve is open.

Page 49: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Air Traffic Control Display

Page 50: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.
Page 51: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

www.smartmoney.com/marketmap

Page 52: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Design ExerciseYou have been hired as an interface designer to work for Mrs. Field’s cookies.

Mrs. Fields needs to know when the oven isn’t working correctly. Sometimes it overheats and sometimes the burners break and don’t come on. Sometimes it heats up too slowly and the first few batches of cookies are ruined, being either burned or not baked through. Mrs. Fields wants to monitor her oven performance so that she can replace the burners before they break by knowing when they are not heating up properly anymore. In general, the oven thermometer has a range of 0 to 500 degrees F. Because of the different kinds of cookies, the oven is set to a new temperature with each new batch. Mrs. Fields needs to set her oven temperature to within 25 degrees. The cookie temperature can only range 25 degrees higher or lower from the setpoint temperature before the cookies are ruined.

•  Design a display for the cookie oven. Identify the appropriate frame of reference, boundary conditions, reference values, and make decisions about what events to highlight.

Page 53: Information Representation Need to break representations into component forms, for analysis and for design Establish a common language for discussion Few.

Topics Summary

• Cognitive Ergonomics– Salience

– Alarms

• Memory & Attention• Display Representations

– Information Representation (decomposition)

– Forms of Reference (propositional, iconic, analogical)

– Analog vs. digital


Learning Deep Representations for Visual Recognitionkaiminghe.com/cvpr18tutorial/cvpr2018_tutorial_kaiminghe.pdf · 2018. 6. 25. · Learning Deep Representations for Visual Recognition

Learning Deep Representations for Visual Recognitionkaiminghe.com/cvpr18tutorial/cvpr2018_tutorial_kaiminghe.pdf · 2018. 6. 25. · Learning Deep Representations for Visual Recognition

Chapter 2 Representations for Classical Planning

Chapter 2 Representations for Classical Planning

Green’s function representations for seismic interferometry

Green’s function representations for seismic interferometry

Qualitative representations for recognition

Qualitative representations for recognition

Fundamental Parametric Geometry Representations for ...

Fundamental Parametric Geometry Representations for ...

National Representations · National representations in Brussels: open for corporate lobbyists Executive summary Permanent representations – the primary link between member states

National Representations · National representations in Brussels: open for corporate lobbyists Executive summary Permanent representations – the primary link between member states

Written Representations - AICPA · Written Representations 607 AU-CSection580 Written Representations Source:SASNo.122. Effective for audits of financial statements for periods ending

Written Representations - AICPA · Written Representations 607 AU-CSection580 Written Representations Source:SASNo.122. Effective for audits of financial statements for periods ending

Learning Representations for Relation Classificationcs224d.stanford.edu › reports › ZhongVictor.pdfrecurrent model, with the addition of learned representations for the sampled

Learning Representations for Relation Classificationcs224d.stanford.edu › reports › ZhongVictor.pdfrecurrent model, with the addition of learned representations for the sampled

SphereNet: Learning Spherical Representations for ...

SphereNet: Learning Spherical Representations for ...

Evolving Static Representations for Task Transferjmlr.csail.mit.edu/papers/volume11/verbancsics10a/verbancsics10a.pdf · EVOLVING STATIC REPRESENTATIONS FOR TASK TRANSFER learning

Evolving Static Representations for Task Transferjmlr.csail.mit.edu/papers/volume11/verbancsics10a/verbancsics10a.pdf · EVOLVING STATIC REPRESENTATIONS FOR TASK TRANSFER learning

Learning representations for counterfactual inferencepeople.csail.mit.edu/dsontag/papers/ShalitJohanssonSontag16_slides.pdf · Learning representations for counterfactual inference

Learning representations for counterfactual inferencepeople.csail.mit.edu/dsontag/papers/ShalitJohanssonSontag16_slides.pdf · Learning representations for counterfactual inference

Backpropagated Gradient Representations for Anomaly … › papers › eccv_2020 › papers_ECCV › papers › 123660205.pdfBackpropagated Gradient Representations for Anomaly Detection

Backpropagated Gradient Representations for Anomaly … › papers › eccv_2020 › papers_ECCV › papers › 123660205.pdfBackpropagated Gradient Representations for Anomaly Detection

Learning Domain Invariant Representations for ...

Learning Domain Invariant Representations for ...

Connecting the Dots: Learning Representations for Active …openaccess.thecvf.com/content_CVPR_2019/papers/Riegler_Connect… · Connecting the Dots: Learning Representations for

Connecting the Dots: Learning Representations for Active …openaccess.thecvf.com/content_CVPR_2019/papers/Riegler_Connect… · Connecting the Dots: Learning Representations for

Dual Representations for Dynamic Programming

Dual Representations for Dynamic Programming

Representations for KBS: Uncertainty & Decision Support

Representations for KBS: Uncertainty & Decision Support

Coordinate Transformations & Representations for Rotations ...

Coordinate Transformations & Representations for Rotations ...

Learning Representations by Humans, for Humans · learning representations by humans, for humans, in which we learn representations of inputs (‘advice’) that are effective for

Learning Representations by Humans, for Humans · learning representations by humans, for humans, in which we learn representations of inputs (‘advice’) that are effective for

Learning Robust Representations for Computer Visionopenaccess.thecvf.com/content_ICCV_2017_workshops/... · Learning Robust Representations for Computer Vision Peng Zheng University

Learning Robust Representations for Computer Visionopenaccess.thecvf.com/content_ICCV_2017_workshops/... · Learning Robust Representations for Computer Vision Peng Zheng University

On the binary expansions of algebraic numbers · analysis—notably the theory of representations of integers as sums of two squares—to establish quadratic irrationality for z.

On the binary expansions of algebraic numbers · analysis—notably the theory of representations of integers as sums of two squares—to establish quadratic irrationality for z.