Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks ›...

36
Developing Visual Analytics Applications: Lessons Learned from the Trenches John Stasko & Carsten Görg Information Interfaces Research Group School of Interactive Computing Georgia Institute of Technology Dec. 3, 2009

Transcript of Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks ›...

Page 1: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Developing Visual Analytics Applications: Lessons Learned from the Trenches

John Stasko & Carsten Görg

Information Interfaces Research Group

School of Interactive Computing

Georgia Institute of Technology

Dec. 3, 2009

Page 2: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Jigsaw

• Visualization for Investigative Analysis and Sense-making across Document Collections

“Putting the pieces together”

2

Page 3: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

3

Blogs

DBs

Documents/case reports

Page 4: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Example Documents

4

Page 5: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Our Focus

• Entities within the documents

– Person, place, organization, phone number, date, license plate, etc.

• Thesis: A bigger story or insight from the documents will involve a set of interconnected entities working in coordination

• (We use entity identification software from others)

5

Page 6: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Connections

• Entities relate/connect to each other to make a larger “story”

• Connection definition:

– Two entities are connected if they appear in a document together

– The more documents they appear in together, the stronger the connection

6

Page 7: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Jigsaw

• Multiple visualizations (views) of documents, entities, & their connections

• Views are highly interactive and coordinated

• User actions generate eventsthat are transmitted to and (possibly) reflected in other views

7

Page 8: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

System Views

8

Page 9: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

The Need for Pixels

9

Page 10: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Even More!

10

Page 11: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Even More!

11

Page 12: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Demo Data

• NSF awards from 2000-now (abstract & key meta-data)

• Big thanks to Remco Chang & UNCC folks

• Demo focus: CSE awards (12,243)

12

Page 13: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

13

Page 14: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

14

Page 15: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

15

Demo

Page 16: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

What We’re Working On

• Jigsaw is heavy on the user-directed visual exploration, but light on the automated computational analysis

16

Page 17: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Recommend Related Entities

17

Page 18: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Adding Computational Analysis

• Document themes & clustering

18

Page 19: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

19

Page 20: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Adding Computational Analysis

• Document themes & clustering

• Document similarity

20

Page 21: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

21

Similarity

Most similar

Page 22: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Adding Computational Analysis

• Document themes & clustering

• Document similarity

• Document summarization

22

Page 23: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

23

Earthquake hits Pacific island of Vanuatu.

Page 24: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Adding Computational Analysis

• Document themes & clustering

• Document similarity

• Document summarization

• Sentiment analysis

24

Page 25: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

25

Most positive

Most negative

Page 26: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Lessons Learned

• A quick recap of some things we’ve learned from working with partners from

– Homeland security

– Law enforcement

– Intelligence analysis

– Investigative reporting

– Business intelligence

and from our experience developing systems like Jigsaw

26

Page 27: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Focus on the user’s task & goals

27

Page 28: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

But in many instances, you don’t know the questions

28

Page 29: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

As the data scales up, we still want interactive visualization

29

Page 30: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Online algorithms are better than offline algorithms

– Real-time is great

30

Page 31: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

For real systems, pragmatics matter

– “Common” programming languages

– Others must be able to access your code

– Documentation, tutorials, …

– “Good” is usually good enough, especially at first (great would be wonderful)

31

Page 32: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

You don’t get training data

32

Page 33: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Real data doesn’t necessarily have nice clusters

33

Page 34: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Evaluation doesn’t necessarily have a good quantitative measure

34

Page 35: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

35

Fundamentalalgorithmicresearch

Application-drivenproblems

Page 36: Developing Visual Analytics Applications: Lessons Learned ... › gvu › ii › talks › fodava-09dec.pdf · Developing Visual Analytics Applications: Lessons Learned from the Trenches

Acknowledgments

• Work conducted as part of the Southeastern Regional Visualization and Analytics Center, supported by DHS and NVAC and the new DHS Center of Excellence in Command, Control & Interoperability (VACCINE Center)

• Supported by NSF IIS-0414667, CCF-0808863 (FODAVA lead), NSF IIS-0915788

36