Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata •...
Transcript of Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata •...
![Page 1: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/1.jpg)
Uncertainty Visualization InfoVis ~ Winter 2008 ~ Torre Zuk
![Page 2: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/2.jpg)
What Uncertainty?• Uncertainty in measurements or data from
precision– E.g. 50 kg +/- 0.5kg
• Uncertainty in measurements or data from temporal changes– E.g. Shares of RIMM 120.12
• Uncertainty in confidence– E.g. What should I have for lunch?
• …
![Page 3: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/3.jpg)
Uncertainty Typology
source independenceInterrelatednessamount of judgment includedSubjectivityassessment of info sourceCredibilitytemporal gaps from info collectionCurrency/Timingconduit through which info passedLineageextent to which info components agreeConsistencyextent to which info is comprehensiveCompletenessexactness of measurementPrecisiondifference between observation & realityAccuracy/Error
Thomson et al. A typology for visualizing uncertainty. In Proc. SPIE & IS&T Conf. Electronic Imaging, Vol. 5669: Visualization and Data Analysis 2005, pages 146–157, 2005
![Page 4: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/4.jpg)
Uncertainty Visualizations
• Visualizing Data Uncertainty
![Page 5: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/5.jpg)
Uncertainty Visualizations
• Visualizing Uncertainty for Tasks/Decisions
National Oceanic and Atmospheric Administration National Weather Service
![Page 6: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/6.jpg)
Visualizing Uncertainty
• Uncertainty is relevant to comprehension and decision-making but may be left out
• Interpretation may be difficult enough without extra cognitive load
What are the best ways to integrate uncertainty into visualizations?
![Page 7: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/7.jpg)
Uncertainty as Metadata
• Example A • Example B
• same base data• variation in metadata
![Page 8: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/8.jpg)
Metadata and Representations
• Example A [Nirvana] • Example B [Paul Anka]
• Variables [Krygier 1994]: loudness, pitch, register, timbre, duration, rate of change, order, attack/decay
• audience• …
![Page 9: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/9.jpg)
Uncertainty Visualization Pipeline
A. T. Pang, C. M. Wittenbrink, and S. K. Lodha, “Approaches to uncertainty visualization,” The Visual Computer 13(8), pp. 370–390, 1997
![Page 10: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/10.jpg)
Analysis of Uncertainty Visualization
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic approach – Semiotic: icon, index, symbol– Perceptual & cognitive theory (InfoVis)– Human factors and task constraints
![Page 11: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/11.jpg)
Analysis for Order
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic approach– Semiotic: icon, index, symbol– Perceptual & cognitive theory (InfoVis)– Human factors and task constraints
![Page 12: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/12.jpg)
Approaches to uncertainty visualization [Pang et al. 1996]
Categorizations• datum values
– scalar, vector, tensor, multivariate• location of the datum
– 0D, 1D, 2D, 3D, time, …• visualization axes mapping
– experiential or abstract• extent of both location and value
– discrete or continuous
![Page 13: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/13.jpg)
Approaches to uncertainty visualization [Pang et al. 1996]
• Uncertainty encoding– add glyphs– add geometry– modify geometry– modify attributes – animation – sonification– psychovisual
![Page 14: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/14.jpg)
Representations for Uncertainty
• Vector fields
C. M. Wittenbrink, A. T. Pang, and S. K. Lodha, “Glyphs for visualizing uncertainty in vector fields,”IEEE TVCG 2(3), pp. 266–279, 1996.
![Page 15: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/15.jpg)
Representations for Uncertainty
Zuk et al., Visualizing temporal uncertainty in 3D virtual reconstructions. VAST 2005.
• Temporal uncertainty in Archaeology
![Page 16: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/16.jpg)
Analysis for Fun & Profit
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic– Semiotic– Perceptual & Cognitive Theory (InfoVis)– Human factors and task constraints
![Page 17: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/17.jpg)
Representations for Uncertainty• MacEachren’s Focus Variables [1992]
– edge crispness (blur)– fill crispness (blur)– resolution– fog (transparency)
• MacEachren’s Clarity Variables (revision) [1995]– crispness– resolution– transparency
![Page 18: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/18.jpg)
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
![Page 19: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/19.jpg)
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
![Page 20: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/20.jpg)
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
![Page 21: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/21.jpg)
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
![Page 22: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/22.jpg)
Representations for Uncertainty
• MacEachren’s Clarity Variables [1995]– crispness– resolution– transparency
• Why these variables?– Icon, index, symbol
![Page 23: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/23.jpg)
Representations for Uncertainty
• Virtual reconstructions
T. Strothotte, M. Puhle, M. Masuch, B. Freudenberg, S. Kreiker, and B. Ludowici, “Visualizing Uncertainty in Virtual Reconstructions,” in Proceedings of Electronic Imaging & the Visual Arts, EVA Europe ’99, VASARI, GFaI, (Berlin), 1999.
![Page 24: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/24.jpg)
• Molecular positional uncertainty
P. Rheingans and S. Joshi. Visualization of molecules with positional uncertainty. Data Visualization ’99, pages 299–306. Springer-Verlag Wien, 1999.
Representations for Uncertainty
![Page 25: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/25.jpg)
Analysis for Design
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic– Semiotic– Perceptual & cognitive theory (InfoVis)– Human factors and task constraints
![Page 26: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/26.jpg)
Heuristic Evaluation• Evaluated 8 existing uncertainty visualizations • Amalgamated infovis theory to develop 12 general
heuristics
Zuk and Carpendale, Theoretical Analysis of Uncertainty Visualizations. SPIE VDA 2005.
![Page 27: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/27.jpg)
Local contrast affects color & gray perception
![Page 28: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/28.jpg)
Color perception varies with size of colored item
![Page 29: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/29.jpg)
BertinQuantitative assessment requires position or size variation
Bertin & WarePreattentive benefits increase with field of viewWareConsider people with color blindnessWareLocal contrast affects color & gray perceptionWare & BertinColor perception varies with size of colored itemBertin & WareDon’t expect a reading order from colorTufte & WareIntegrate text wherever relevantWareConsider Gestalt LawsTufteRemove the extraneous (ink)Tufte & WareProvide multiple levels of detailTuftePut the most data in the least spaceTufte & BertinPreserve data to graphic dimensionalityBertin & WareEnsure visual variable has sufficient lengthSourceHeuristic
Heuristic Evaluation
![Page 30: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/30.jpg)
Representations for Uncertainty
• Medical segmented surfaces
G. Grigoryan and P. Rheingans, “Point-based probabilistic surfaces to show surface uncertainty,” IEEE TVCG 10(5), pp. 564–573, 2004..
![Page 31: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/31.jpg)
Representations for Uncertainty
• Procedural rendering
Andrej Cedilnik and Penny Rheingans. Procedural rendering of uncertainty information.In T. Ertl, B. Hamann, and A. Varshney, editors, Proceedings Visualization 2000..
![Page 32: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/32.jpg)
Analysis for Cognitive Support
• Any visual cue may be used to represent uncertainty, but which are best?
– Taxonomic– Semiotic– Perceptual & cognitive theory (InfoVis)– Human factors and task constraints
![Page 33: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/33.jpg)
• Experiment – Reasoning under uncertainty
Cognition and Uncertainty
![Page 34: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/34.jpg)
y = 0.07x + 0.21R2 = 0.6662
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 3 4 5 6 7 8 9 10
outliers
• Experiment I – Observations by Person I
![Page 35: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/35.jpg)
y = 0.07x + 0.2101R2 = 0.6667
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 3 4 5 6 7 8 9 10
oversampling
• Experiment I – Observations by Person II
![Page 36: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/36.jpg)
• From only the options below person II (data above) is most likely: HCI student InfoVis student non-technical InfoVis student Graphics student
y = 0.07x + 0.2101R2 = 0.6667
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
1 2 3 4 5 6 7 8 9 10
B C
Judgment Question
![Page 37: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/37.jpg)
Types of Heuristics and Biases
• Associations– affect, availability, recency bias, …
• Ignorance of Rules– representativeness, statistics, ...
• Application of Rules– automation bias, adjustment and anchoring, …
![Page 38: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/38.jpg)
Visualizing Reasoning under Uncertainty• People have reasoning heuristics and biases
[Tversky and Kahneman]
• Supporting the decision may be as important as seeing the data uncertainty
Zuk and Carpendale, Vis. Uncertainty in Reasoning, Smart Graphics 2007.
![Page 39: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/39.jpg)
Task & Cognitive Constraints:Supporting Evidence-based Diagnosis
© 2007 W21C
Collaboration with W. Ghali and B. Baylis, UofC Medicine
• Uncertainty in test data, test implications, strategies, diagnosis, …
![Page 40: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/40.jpg)
Supporting Evidence-based Diagnosis
Bayes Theorem
A Bab
( | ) ( )( | )( | ) ( ) ( | ) ( )
P B A P AP A BP B A P A P B A P A
=+ ¬ ¬
![Page 41: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/41.jpg)
Supporting Evidence-based DiagnosisObservational Study
• Understand the problem domain• Assess existing support at W21C
© 2007 C. Tang
![Page 42: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/42.jpg)
Supporting Evidence-based DiagnosisAnalysis & Design
• Task model with uncertainty
• Design recommendations for new support• Participatory design
![Page 43: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/43.jpg)
Supporting Evidence-based DiagnosisTest Results: multiple representations
)()|()()|()()|()|(
DPDTPDPDTPDPDTPTDP
¬¬+=
++
++
![Page 44: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/44.jpg)
![Page 45: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/45.jpg)
GeneralizationsDirectives for Uncertainty Visualization
1. Provide support for cognitive task simplification.2. Support emphasis and de-emphasis of uncertainty
information.3. Support viewing of uncertainty as metadata and as
separate data.4. Allow the user to select realizations of interest.5. Mitigate cognitive heuristics and biases with reasoning
support.6. Provide interaction to assist knowledge creation.7. Assess the implications of incorrectly interpreting the
uncertainty.
Zuk, Visualizing Uncertainty, PhD Thesis. 2008.
![Page 46: Uncertainty Visualization - InnoVis · uncertainty into visualizations? Uncertainty as Metadata • Example A • Example B • same base data • variation in metadata. Metadata](https://reader034.fdocuments.net/reader034/viewer/2022052408/5f0e755c7e708231d43f5878/html5/thumbnails/46.jpg)
Acknowledgements