Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007...

72
Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 [email protected] www.win.tue.nl/~apretori/

Transcript of Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007...

Page 1: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Visualizing State Transition Graphs

Hannes PretoriusVisualization Group, TU/e

17 October [email protected]

www.win.tue.nl/~apretori/

Page 2: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Introduction

Page 3: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 4: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 5: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 6: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 7: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 8: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 9: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 10: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 11: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 12: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 13: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 14: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 15: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 16: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 17: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

State transition graph

Graph G = (V, E) where:• Node s in V is a possible system state• Directed edge t = (s, s’) in E is a

transition from source state s to target state s’

Page 18: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Research question

“How can visualization be used to gaininsight into state transition graphs?”

Page 19: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Research question

“How can visualization be used to gaininsight into state transition graphs?”

• What is insight?– Symmetries, patterns…

• What about size?– System behavior is often complex

• Typical users?– Small number of expert users

Page 20: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 21: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Related work

Van Ham et al., TVCG, 2002.

Page 22: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Van Ham et al., TVCG, 2002.

Page 23: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Approach

Page 24: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 25: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 26: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Handle_posFront_wheel_po

sBack_wheel_po

sSeat_pos

= up= out= in= down

Page 27: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Handle_posFront_wheel_po

sBack_wheel_po

sSeat_pos

= down= in= out= up

Page 28: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

State transition graph

Graph G = (V, E) where:• Node s in V is a possible system state• Directed edge t = (s, s’) in E is a

transition from source state s to target state s’

Page 29: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

State transition graph

Graph G = (V, E) where:• Node s in V is a possible system state• Directed edge t = (s, s’) in E is a

transition from source state s to target state s’

Every node s in V has:

• n associated attributes ai

• ai has domain Ai = {ai,1, …, ai,ki}

Page 30: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Projection

Pretorius and Van Wijk, IV, 2005.

Page 31: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 32: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 33: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 34: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 35: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 36: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Projection

• Multivariate data:– Select interesting subset– Show low-dimensional projection

Pretorius and Van Wijk, IV, 2005.

Page 37: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Projection

• Multivariate data:– Select interesting subset– Show low-dimensional projection

• Suggestive behavioral patterns• Meaning of positions projected to not

clear• Select subset based on domain

knowledgePretorius and Van Wijk, IV, 2005.

Page 38: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Clustering

Pretorius and Van Wijk, InfoVis, 2006.

Page 39: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 40: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 41: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 42: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

All states

Handle_pos

Seat_pos

Page 43: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 44: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 45: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 46: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 47: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 48: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 49: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 50: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 51: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 52: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Clustering

• Choose subsets based on domain knowledge

• Position clusters linearly• Show additional information on top of

this:– Clustering hierarchy– Arcs representing transitions– Bar tree representing size of clusters

Pretorius and Van Wijk, InfoVis, 2006.

Page 53: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Clustering

• Reduce complexity– Location has meaning

• Patterns:– Attribute values– Behavior– Cluster sizes

• Different types of analysis:– Explorative (e.g. different perspectives)– Specific (e.g. deadlock analysis)

Pretorius and Van Wijk, InfoVis, 2006.

Page 54: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Custom diagrams

Pretorius and Van Wijk, CG&A, 2007.Mathijssen and Pretorius, LNCS, 2007.

Page 55: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Pretorius and Van Wijk, CG&A, 2007.Mathijssen and Pretorius, LNCS, 2007.

Page 56: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Pretorius and Van Wijk, CG&A, 2007.Mathijssen and Pretorius, LNCS, 2007.

Page 57: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Custom diagrams

• Support diagramming in general way:– Edit diagrams– Link with attributes

• Capture conceptualization of problem

Pretorius and Van Wijk, CG&A, 2007.Mathijssen and Pretorius, LNCS, 2007.

Page 58: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Custom diagrams

• Support diagramming in general way:– Edit diagrams– Link with attributes

• Capture conceptualization of problem• Semantics clear and intuitive• Analysis and communication• Flexible Pretorius and Van Wijk, CG&A, 2007.

Mathijssen and Pretorius, LNCS, 2007.

Page 59: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Wafer stepper Paint factory Petri nets

Page 60: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Trace visualization

Submitted, PacificVis, 2008.

Page 61: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 62: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 63: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Time

Att

ribu

tes

1 k

1n

1

2

Page 64: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Time

Att

ribu

tes

1 k

1n

Page 65: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori
Page 66: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

3

Page 67: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Submitted, PacificVis, 2008.

Page 68: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Trace visualization

• Traces:– Curb size and complexity– Users intuitively relate to time

Submitted, PacificVis, 2008.

Page 69: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Trace visualization

• Traces:– Curb size and complexity– Users intuitively relate to time

• Three views:1. Diagram: easier to interpret2. Time series: general trends3. Transition graph: generalized behavior

Submitted, PacificVis, 2008.

Page 70: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Conclusion

• Visualization of state transition graphs• Prototyping• Focus on state attributes

– Clear semantics

• Explorative analysis: – E.g. different perspectives

• Focused analysis:– E.g. deadlock, steam flow

Page 71: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Questions

www.win.tue.nl/~apretori/

Page 72: Visualizing State Transition Graphs Hannes Pretorius Visualization Group, TU/e 17 October 2007 a.j.pretorius@tue.nl apretori

Projection (cont.)