Visual thinking colin_ware_lectures_2013_4_patterns

73
Representing Data using Static and Moving Patterns Colin Ware UNH

description

 

Transcript of Visual thinking colin_ware_lectures_2013_4_patterns

Page 1: Visual thinking colin_ware_lectures_2013_4_patterns

Representing Data using Static and Moving

Patterns

Colin Ware

UNH

Page 2: Visual thinking colin_ware_lectures_2013_4_patterns

Introduction Finding patterns is key to information visualization. Expert knowledge is about understanding patterns (Flynn effect) Example Queries: We think by making pattern queries on the

world Patterns showing groups? Patterns showing structure? When are patterns similar? How should we organize information on the screen?

What makes a pattern distinct?

Page 3: Visual thinking colin_ware_lectures_2013_4_patterns
Page 4: Visual thinking colin_ware_lectures_2013_4_patterns

The dimensions of space

Page 5: Visual thinking colin_ware_lectures_2013_4_patterns

The “What” Channel

Objects, any location

Simple features specific locations

Patterns of patterns

Page 6: Visual thinking colin_ware_lectures_2013_4_patterns

Patterns

Feature heirarchy (learned) Contours and Regions (formed on the fly)

Page 7: Visual thinking colin_ware_lectures_2013_4_patterns

V1 processing

Ware:Vislab:CCOM

Page 8: Visual thinking colin_ware_lectures_2013_4_patterns

Texture segmentation (regions)

Page 9: Visual thinking colin_ware_lectures_2013_4_patterns

Textures and low level features

Page 10: Visual thinking colin_ware_lectures_2013_4_patterns

Interference based on spatialfrequency

Page 11: Visual thinking colin_ware_lectures_2013_4_patterns

Low level tuning based on feature maps

Page 12: Visual thinking colin_ware_lectures_2013_4_patterns

A diagram with same principle

Page 13: Visual thinking colin_ware_lectures_2013_4_patterns

Field, Hayes and Hess

Contour finding mechanisms

Page 14: Visual thinking colin_ware_lectures_2013_4_patterns

Results

rt = -4.970 + 1.390spl + 0.01699con + 0.654cr + 0.295br

spl: Shortest path lengthcon: continuitycr: crossingsbr: branches

1 crossing adds .65 sec100 deg. adds 1.7 sec

1 crossing == 38 deg.

Page 15: Visual thinking colin_ware_lectures_2013_4_patterns

Connectedness

Connectedness assumed in Continuity

a b

c d

Page 16: Visual thinking colin_ware_lectures_2013_4_patterns

Continuity

Visual entities tend to be smooth and continuous

a

a b c

Page 17: Visual thinking colin_ware_lectures_2013_4_patterns

Continuity in Diagrams

Connections using smooth lines

a

a b

Page 18: Visual thinking colin_ware_lectures_2013_4_patterns

Ware:Vislab:CCOM

LOC – generalized contour finding

The mechanisms of line and contour

Page 19: Visual thinking colin_ware_lectures_2013_4_patterns

Closure

Closed contours to show set relationship

a

AB

C

D

Page 20: Visual thinking colin_ware_lectures_2013_4_patterns

Extending the Euler diagram

Page 21: Visual thinking colin_ware_lectures_2013_4_patterns

Collins bubble sets

Page 22: Visual thinking colin_ware_lectures_2013_4_patterns

More Contours

Direct application to vector field display

a

a

b

Page 23: Visual thinking colin_ware_lectures_2013_4_patterns

How to add VS?

TerminationsSome End-Stopped neurons respond only with terminations in the receptive field.

Asymmetry along path

Halle’s “little stroaks” 1868

Page 24: Visual thinking colin_ware_lectures_2013_4_patterns

Modeling V1 and aboveDan Pineo

Page 25: Visual thinking colin_ware_lectures_2013_4_patterns

Vector Field Visualization

Laidlaw

Page 26: Visual thinking colin_ware_lectures_2013_4_patterns

Perceptually optimize forSome sub-set of task

requirements

An optimization process (NSF ITR)

Identify a visualizationMethod and a paramaterization

Streaklets:A generalizedFlow vis technique

Characterize solutions

Define task requirementsAdvection path perceptio

Magnitude perceptionDirection perception

Human In the Loop

Actual solutionsGuidelinesAlgorithmsTheory

Page 27: Visual thinking colin_ware_lectures_2013_4_patterns

Key idea

Almost all solutions can be described as being composed of “streaklets”

Mag color Mag luminance Mag size (length, width) Mag spacing Orient orient Direction arrow head Direction shape Direction lum change Direction transparency

Page 28: Visual thinking colin_ware_lectures_2013_4_patterns

Task: optimize streaklets. (How?) 1) Streaklet design optimized according to

theory – head to tail, direction cues Modified Jobard and Lefer (Pete Mitchell) 2) Human in the loop optimization

Genetic algorithms (NO) Domain experts with a lot of sliders Designers with a lot of sliders

Page 29: Visual thinking colin_ware_lectures_2013_4_patterns
Page 30: Visual thinking colin_ware_lectures_2013_4_patterns
Page 31: Visual thinking colin_ware_lectures_2013_4_patterns
Page 32: Visual thinking colin_ware_lectures_2013_4_patterns

Possibilities for Evaluation

Direction Magnitude Advection Global pattern Local pattern Nodal points

Page 33: Visual thinking colin_ware_lectures_2013_4_patterns

Back to the feature hierarchy

Page 34: Visual thinking colin_ware_lectures_2013_4_patterns
Page 35: Visual thinking colin_ware_lectures_2013_4_patterns

Scatter plots: comparing variables

Page 36: Visual thinking colin_ware_lectures_2013_4_patterns

Parallel coords vsGeneralized draftsmans plot

Page 37: Visual thinking colin_ware_lectures_2013_4_patterns

Parallel coord vs gen draftsmans Parallel

Each line is a data Dimension

Gen drafts All pairwise

scatterplots. Results suggest

Gen drafts is best Clusters & correlations

Holten and van Wijk

Page 38: Visual thinking colin_ware_lectures_2013_4_patterns

Symmetry

Symmetry create visual whole

Prefer Symmetry

Page 39: Visual thinking colin_ware_lectures_2013_4_patterns

Symmetry (cont.) Using symmetry to show Similarities

between time series data

Page 40: Visual thinking colin_ware_lectures_2013_4_patterns

Bivariate maps (texture + color)

Page 41: Visual thinking colin_ware_lectures_2013_4_patterns

3 Channels: Color, Texture, Motion

Page 42: Visual thinking colin_ware_lectures_2013_4_patterns

Compare to this!!

Page 43: Visual thinking colin_ware_lectures_2013_4_patterns

Scribble exercise

Page 44: Visual thinking colin_ware_lectures_2013_4_patterns

Ware:Vislab:CCOM

The Magic of Line and Contour: Chameleon lines

Saul Steinberg Santiago Coltrava

Page 45: Visual thinking colin_ware_lectures_2013_4_patterns

Ware:Vislab:CCOM

Page 46: Visual thinking colin_ware_lectures_2013_4_patterns

Patterns in Diagrams Patterns applied

a

ab

cd

Page 47: Visual thinking colin_ware_lectures_2013_4_patterns

Visual Grammar of diagrams Entitiesrepresented byDiscrete objectsAttributes: ShapeColorsTextures

Relationshipsrepresented byConnecting linesor nesting regions

Page 48: Visual thinking colin_ware_lectures_2013_4_patterns

Semantics of structure

Page 49: Visual thinking colin_ware_lectures_2013_4_patterns
Page 50: Visual thinking colin_ware_lectures_2013_4_patterns

Treemaps and hierarchies Treemaps use areas (size) SP tree Graph Trees use connectivity (structure)

a

a

b

c

d e

f

g

h

i

a b c

d e

f g h

i

a b

www.smartmoney.com

Page 51: Visual thinking colin_ware_lectures_2013_4_patterns

Top down – Bottom up Tunable attention to patterns Contours and regions + Some are automatic Basic to constructive thinking

Page 52: Visual thinking colin_ware_lectures_2013_4_patterns

Part II: Patterns in Motion

How can we use motion as a display technique?

Gestalt principle of common fate

Page 53: Visual thinking colin_ware_lectures_2013_4_patterns

Motion as a visual attribute (Common fate)

correlation between points: frequency, phase or amplitude Result: phase is most noticeable

Page 54: Visual thinking colin_ware_lectures_2013_4_patterns

Motion is Highly Contextual Group moving objects in hierarchical

fashion.

a

a b

Page 55: Visual thinking colin_ware_lectures_2013_4_patterns

Using Causality to display causality

Michotte’s claim: direct perception of causality

Page 56: Visual thinking colin_ware_lectures_2013_4_patterns

A causal graph

Page 57: Visual thinking colin_ware_lectures_2013_4_patterns

Michotte’s Causality Perception

a

100 200

50%

100%

Time (msec.)

Direct LaunchingDelayed launchingNo causality

Page 58: Visual thinking colin_ware_lectures_2013_4_patterns

Visual Causal Vectors

a

Page 59: Visual thinking colin_ware_lectures_2013_4_patterns

Experiment

Evaluate VCVs Symmetry about time of contact.

Page 60: Visual thinking colin_ware_lectures_2013_4_patterns

Results

aa

Some relationshipCausal relationship

0.0-0.5-1.0 0.5 1.0

Time relative to contact (seconds)

No relationship

p3p1

p2

Per

ceiv

ed e

ffec

t

Page 61: Visual thinking colin_ware_lectures_2013_4_patterns

Motion Patterns that attract attention (Lyn Bartram)

Motion is a good attention getter in periphery

The optimal pattern may be things that emerge, as opposed to simply move.

We may be able to perceive large field patterns better when they are expressed through motion (untested)

Page 62: Visual thinking colin_ware_lectures_2013_4_patterns

Anthropomorphic Form from motion

Pattern of moving dots (captured from actor body) – Johansson.

Attach meaning to movements (Heider and Semmel)

a

a b

Page 63: Visual thinking colin_ware_lectures_2013_4_patterns

Conclusion

Gestalt Laws are useful as design guidelines.

Patterns should be present in luminance Patterns should be the appropriate size Motion is under-researched, but evidence

suggest its power. Simple motion coding can be used to

express communication, causality, urgency, happiness? (Braitenberg)

Page 64: Visual thinking colin_ware_lectures_2013_4_patterns
Page 65: Visual thinking colin_ware_lectures_2013_4_patterns

Algorithms

Optimizing trace density (poisson disk) Flexible methods for rendering (enhanced

particle systems).

Page 66: Visual thinking colin_ware_lectures_2013_4_patterns
Page 67: Visual thinking colin_ware_lectures_2013_4_patterns

Figures and Grounds (cont.) Rubin’s Vase

Competing recognition processes

Page 68: Visual thinking colin_ware_lectures_2013_4_patterns

Show particle solutions

Problem: how do we create an optimal solution out of all of these possibilities?

Standard solution: do studies and measure the effect of different parameters.

Problem: Too many alternatives.

Page 69: Visual thinking colin_ware_lectures_2013_4_patterns

Closure (cont.)

Segmenting screen Creating frame of reference Position of objects judged based on enclosing

frame.

Page 70: Visual thinking colin_ware_lectures_2013_4_patterns

Laciness (Cavanaugh)

Layered data: be careful with composites of textures

a

ab

c d

Page 71: Visual thinking colin_ware_lectures_2013_4_patterns

Transparency

Continuity is important in transparency x < y < z or x > y > z y < z < w or y > z > w

a

ab

x

y z

w

Page 72: Visual thinking colin_ware_lectures_2013_4_patterns
Page 73: Visual thinking colin_ware_lectures_2013_4_patterns

Limitation due to Frame Rate

Can only show motions that are limited by the Frame Rate.

We can increase by using additional symbols.

a

b

c

a