The Perceptual Proxies of Visual...
Transcript of The Perceptual Proxies of Visual...
![Page 1: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/1.jpg)
The Perceptual Proxies of Visual Comparison
Presented by: Youssef Sherif
1
![Page 2: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/2.jpg)
Visual comparison
2
Bigger Mean? Bigger Range?
![Page 3: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/3.jpg)
A bit of History
Examine the precision of comparison tasks with different arrangements
Max Correlation Max Delta
3
![Page 4: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/4.jpg)
Arrangements
4
![Page 5: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/5.jpg)
Dimensions
● 2 comparison tasks● 3 marks● 5 arrangements
5
![Page 6: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/6.jpg)
6
![Page 7: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/7.jpg)
2 more tasks to experiment with
● Max Mean● Max Range
7
![Page 8: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/8.jpg)
2 more tasks to experiment with
● Max Mean● Max Range
8
![Page 9: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/9.jpg)
How to increase difficulty?
Staircase procedure
Which set in each pair has a bigger mean?
Easy Hard
9
![Page 10: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/10.jpg)
10
![Page 11: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/11.jpg)
11
![Page 12: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/12.jpg)
What is visually compared?
12
What steps do our brain do in order to reach for a conclusion?
![Page 13: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/13.jpg)
What is visually compared?
13
![Page 14: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/14.jpg)
What is visually compared?
14
![Page 15: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/15.jpg)
Proxies for scatter plots
15
Bounding Box Prediction Ellipse
What does your brain do to know the correlation between two factors in a scatterplot?
![Page 16: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/16.jpg)
Proxies for bar charts
● Different from scatterplot● Allows for different tasks like comparing mean and
comparing range instead of only one task ● Different tasks map to different proxies
16
![Page 17: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/17.jpg)
Proxy bots
● Not computer vision systems● Only know how to do one thing● Simple algorithms
17
![Page 18: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/18.jpg)
What do these proxy bots do?
18
![Page 19: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/19.jpg)
Example: Top-Item proxy bot
19
![Page 20: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/20.jpg)
Example: Range proxy bot
20
![Page 21: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/21.jpg)
Example: Convex hull proxy bot
21
![Page 22: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/22.jpg)
Example: Convex hull proxy bot
22
![Page 23: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/23.jpg)
Example: Convex hull proxy bot
23
![Page 24: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/24.jpg)
Example: Convex hull proxy bot
24
Which have a centroid farther to the right?
![Page 25: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/25.jpg)
Convex hull proxy bot
25
Which have a larger area?
![Page 26: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/26.jpg)
Focal proxies
26
![Page 27: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/27.jpg)
Global proxies
27
![Page 28: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/28.jpg)
What to do with the proxy bots?We need to answer two questions
1. Which proxies are accurate for each task (useful)?2. Which proxies are used by humans for each task (used)?
28
![Page 29: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/29.jpg)
29
![Page 30: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/30.jpg)
Results● Global visual features are better candidates for the MAXMEAN comparisons● Focal visual features are better candidates for MAXRANGE compar-isons.● People tend to make decisions consistent with using the most useful visual
features
30
![Page 31: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/31.jpg)
Strengths● Novel idea which is to build proxy bots and use these bots to understand what
humans do to for specific visualization tasks● Provided clear examples of what proxy bots are and clear examples of tasks
and arrangements● Were generous to provide a video for their paper● Did not shy away from mentioning their failed attempts in proving a correlation
of two tasks● Used visualizations in their paper to make it easier for readers to comprehend● Clearly mentioned their limitations and caveats in the paper
31
![Page 32: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/32.jpg)
Weaknesses● Were discouraged of establishing a correlation between arrangements with
tasks after conducting two extra tasks only● Did not show clearly on which basis did they categorize proxy bots into two
categories (item based and set-based)● Looks like they had 2 unrelated contributions
32
![Page 33: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/33.jpg)
Future work● How can different datasets affect what proxy the user uses● Example: “In a visualization with two charts with one large item outlier, the
single item outlier might capture attention provoke a focal comparison.”
33
![Page 34: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/34.jpg)
References● https://vimeo.com/371939151● https://vimeo.com/360050277
34
![Page 35: The Perceptual Proxies of Visual Comparisontmm/courses/547-19/slides/youssef-percepproxies.pdfPresented by: Youssef Sherif 1. Visual comparison 2 Bigger Mean? Bigger Range? A bit of](https://reader033.fdocuments.net/reader033/viewer/2022043017/5f39744feb636f08056034c7/html5/thumbnails/35.jpg)
Thank you
35