Social Street View: Blending Immersive Street Views with Geo-tagged Social Media
-
Upload
ruofei-du -
Category
Technology
-
view
1.747 -
download
0
Transcript of Social Street View: Blending Immersive Street Views with Geo-tagged Social Media
![Page 1: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/1.jpg)
Social Street View: Blending Immersive Street Views with Geo-tagged Social Media
Ruofei Du and Amitabh VarshneyThe Augmentarium| UMIACS | University of Maryland, College Park
{ruofei, varshney} @ cs.umd.eduwww.SocialStreetView.com
![Page 2: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/2.jpg)
image courtesy: plannedparenthood.org
IntroductionSocial Media
![Page 3: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/3.jpg)
image courtesy: adweek.com
IntroductionSocial Media - Interactivity
![Page 4: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/4.jpg)
image courtesy: forbes.com
IntroductionSocial Media - Versatility
![Page 5: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/5.jpg)
image courtesy: huffingtonpost.com
IntroductionSocial Media - Social Relevance
![Page 6: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/6.jpg)
![Page 7: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/7.jpg)
EXIF
image courtesy: B&T Magazine
![Page 8: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/8.jpg)
IntroductionMeta data - Time of Creation
image courtesy: Brian Clegg
![Page 9: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/9.jpg)
IntroductionMeta data - Location of Creation
image courtesy: squarespace.com
![Page 10: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/10.jpg)
IntroductionMeta data - Camera Parameters
image courtesy: naldzgraphics.net
![Page 11: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/11.jpg)
image courtesy:
instagram.com,
facebook.com,
twitter.com
Related WorkLinear narrative visualization
![Page 12: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/12.jpg)
image courtesy:
pinterest.com
Related Work2D layout
![Page 13: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/13.jpg)
Related WorkNatural Immersive Virtual Reality?
image courtesy: drivenhealthy.com
![Page 14: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/14.jpg)
Related WorkKarnath et al. and Loomis et al.
![Page 15: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/15.jpg)
Related WorkKarnath et al. and Loomis et al.
![Page 16: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/16.jpg)
Related WorkKarnath et al. and Loomis et al.
![Page 17: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/17.jpg)
Related WorkVisualization of Geo-tagged Information
![Page 18: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/18.jpg)
Related WorkVisualization of Geo-tagged Information
![Page 19: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/19.jpg)
Related WorkVisualization of Geo-tagged Information
![Page 20: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/20.jpg)
Related WorkVisualization of Geo-tagged Information
![Page 21: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/21.jpg)
Related WorkVisualization of Geo-tagged Information
![Page 22: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/22.jpg)
image courtesy: panoramio.com
Related WorkPanoramio - Photos of the WorldCuenca and Manchón, 2005 - Now
![Page 23: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/23.jpg)
image courtesy: twitterstand.umiacs.umd.edu
Related WorkTwitterStand: News in TweetsSankaranarayanan et al. SIGGIS 2009
![Page 24: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/24.jpg)
image courtesy: flickr.com
Related WorkFlickr - World MapSerdyukov et al. SIGIR 2009
![Page 25: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/25.jpg)
image courtesy: photostand.umiacs.umd.edu
Related WorkPhotoStand for News PhotosSamet et al. VLDB 2013
![Page 26: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/26.jpg)
Related WorkVisualization of Geo-tagged Information (cont.)
![Page 27: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/27.jpg)
Related WorkVisualization of Geo-tagged Information (cont.)
![Page 28: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/28.jpg)
Related WorkVisualization of Geo-tagged Information (cont.)
![Page 29: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/29.jpg)
Related WorkVisualization of Geo-tagged Information (cont.)
![Page 30: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/30.jpg)
Related WorkVisualization of Geo-tagged Information (cont.)
![Page 31: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/31.jpg)
Related WorkVisualization of Geo-tagged Information (cont.)
![Page 32: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/32.jpg)
Our Approach?
![Page 33: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/33.jpg)
Social Street View
![Page 34: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/34.jpg)
Social Street View
![Page 35: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/35.jpg)
DemonstrationThe Augmentarium, UMIACS6000 x 3000 pixels
![Page 36: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/36.jpg)
![Page 37: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/37.jpg)
Conception, architecting & implementation
Social Street View
A mixed reality system that can depict geo-tagged social media in immersive 3D web environments
![Page 38: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/38.jpg)
Blending multiple modalities of
Street View + Social Media
Depth maps, normal maps, and road orientationGPS coordinates and time creation
![Page 39: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/39.jpg)
Enhancing visual augmentation
Maximal Poisson-disk sampling
Evaluated by image saliency metrics
![Page 40: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/40.jpg)
Achieving cross-platform compatibility by
WebGL + Three.js
smartphones, tablets, desktop, high-resolution large-area wide field of view tiled display walls, as well as head-mounted displays.
![Page 41: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/41.jpg)
Technical Challenges?
![Page 42: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/42.jpg)
System Overview
![Page 43: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/43.jpg)
ArchitectureSocial Street View System Flowchart
![Page 44: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/44.jpg)
image courtesy: Google
![Page 45: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/45.jpg)
Street View Cars - Cameras, Lasers and GPSImage courtesy from Google Street View
image courtesy: Google
![Page 46: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/46.jpg)
image courtesy: Google
![Page 47: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/47.jpg)
Tiles of Panoramic ImagesImage courtesy from Google Street View
image courtesy: Google
![Page 48: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/48.jpg)
![Page 49: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/49.jpg)
Panorama
![Page 50: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/50.jpg)
![Page 51: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/51.jpg)
Depth MapDecoded from Google Maps API v3 and GSVPanoDepth.js
![Page 52: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/52.jpg)
![Page 53: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/53.jpg)
Normal MapDecoded from Google Maps API v3
![Page 54: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/54.jpg)
![Page 55: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/55.jpg)
Road OrientationsDecoded from Google Maps API v3
![Page 56: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/56.jpg)
image courtesy: Instagram
![Page 57: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/57.jpg)
Multi-level Strategy for Streaming Social MediaImage courtesy from Instagram users in public domains
image courtesy: Instagram
![Page 58: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/58.jpg)
SQL DatabaseIndexed by B+ Treelogarithmic insertion & query
![Page 59: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/59.jpg)
Bipartite GraphG = V(V, S, E)
![Page 60: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/60.jpg)
Haversine FormulaAndrew, 1805
![Page 61: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/61.jpg)
Interface
![Page 62: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/62.jpg)
![Page 63: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/63.jpg)
BaselineRandom Uniform Sampling
![Page 64: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/64.jpg)
Without uniform samplingAccumulation
![Page 65: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/65.jpg)
BaselineRandom Uniform Sampling
![Page 66: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/66.jpg)
Not preferredOverlays high saliency regions
![Page 67: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/67.jpg)
Add depth mapRemove sky and ground (most)
![Page 68: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/68.jpg)
Add depth mapRemove sky and ground (most)
![Page 69: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/69.jpg)
Can we ensure each image
aligns with the building geometries?
![Page 70: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/70.jpg)
Add normal mapRemove all ground, align images
![Page 71: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/71.jpg)
![Page 72: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/72.jpg)
Can we reduce visual clutter and occlusion?
![Page 73: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/73.jpg)
Maximal Poisson-disk Sampling Gamito et al. Remove visual clutter and occlusion
![Page 74: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/74.jpg)
Dart-throwing Algorithm PixelPie by Ip et al. using vertex and fragment shaders
image courtesy:
PeterPan23@Wikipedia
![Page 75: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/75.jpg)
Pixel-Pie Algorithm Remove when occlusion occurs
![Page 76: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/76.jpg)
Project Social Media PicturesBy Maximal Poisson-disc Sampling
![Page 77: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/77.jpg)
Sampling ComparisonRemove visual clutter and occlusion
![Page 78: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/78.jpg)
Scenic LandscapesUsing orientation of the road
![Page 79: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/79.jpg)
Scenic LandscapesUsing orientation of the road
![Page 80: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/80.jpg)
Scenic LandscapesUsing orientation of the road
![Page 81: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/81.jpg)
![Page 82: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/82.jpg)
Experiment100 panoramas, 80,000+ social media
![Page 83: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/83.jpg)
ExperimentNvidia Quadro K6000
![Page 84: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/84.jpg)
ExperimentConditions of panoramic images
Immersive high-resolution screens
Common Consumer-level Displays
![Page 85: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/85.jpg)
Initialization TimePanorama takes a while to load
![Page 86: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/86.jpg)
After Prefetching¾ - ⅘ time reduced
![Page 87: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/87.jpg)
Rendering TimeAlmost 58~60 FPS
![Page 88: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/88.jpg)
Saliency MapHou et al. TPAMI 2011
![Page 89: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/89.jpg)
Social Media Coverage100 panoramas for each algorithm
![Page 90: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/90.jpg)
Social Media Coverage100 panoramas for each algorithm
![Page 91: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/91.jpg)
Social Media Coverage100 panoramas for each algorithm
![Page 92: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/92.jpg)
Potential Applications?
![Page 93: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/93.jpg)
![Page 94: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/94.jpg)
Stuck in traffic on our way to Cabo with this awesome view#roadtrip #cabo #view #mexico
Daniela on InstagramJuly 12, 2014
![Page 95: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/95.jpg)
![Page 96: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/96.jpg)
![Page 97: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/97.jpg)
Business AdvertisingMuseum, restaurant, real-estate ...
![Page 98: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/98.jpg)
... dinner started off with amazing oysters paired with my favorite Ruinart blanc de blancs champagne
By frankiextah on Instagram
![Page 99: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/99.jpg)
Business AdvertisingMuseum, restaurant ...
![Page 100: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/100.jpg)
Learning CultureTaierzhuang, Chinese Spring Festivals
![Page 101: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/101.jpg)
Crowd-sourced Tourism
![Page 102: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/102.jpg)
Crowd-sourced Tourism
![Page 103: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/103.jpg)
What if …Temporal information is used for filtering and rendering?
image courtesy: mindtheproduct.com
![Page 104: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/104.jpg)
Visual EnhancementSpatio-Temporal Augmented Reality
image courtesy: webneel.com
![Page 105: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/105.jpg)
![Page 106: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/106.jpg)
Seasonal EffectWinter
![Page 107: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/107.jpg)
Seasonal EffectWinter
![Page 108: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/108.jpg)
Seasonal EffectSpring
![Page 109: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/109.jpg)
Seasonal EffectAutumn in Paris
![Page 110: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/110.jpg)
Failure CasesA Square in London
![Page 111: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/111.jpg)
Future WorkDigital City by 3D Reconstruction, Depth Fusion and Augmented Reality
image courtesy: wallpapervortex.com
![Page 112: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/112.jpg)
Future WorkIncorperate with Open3D in Web3D 2016?
image courtesy: Lu et al.
![Page 114: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/114.jpg)
AcknowledgementAugmentarium Lab | GVIL | UMIACS
![Page 115: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/115.jpg)
AcknowledgementNSF | Nvidia | MPower | UMIACS
![Page 116: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/116.jpg)
Video FieldsWeb3D Sunday 9:20 - 9:40 AM
![Page 117: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/117.jpg)
Social Street Viewwww.SocialStreetView.com
Thank you! Any questions or comments are welcome!
Ruofei Du and Amitabh VarshneyAugmentarium Lab | GVIL | UMIACS
Web3D 2016
![Page 118: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/118.jpg)
Social Street View
Backup Slides
![Page 119: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/119.jpg)
Future WorkSaliency
- Low-level image saliency for layout- Real-time or post-processed saliency
maps
![Page 120: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/120.jpg)
Future WorkUser Study
- High-resolution large-area screens - Head-mounted displays
![Page 121: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/121.jpg)
Future Work3D Reconstruction and AR
- Real-time geometric fusion- HoloLens
![Page 122: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/122.jpg)
Future Work3D Reconstruction and AR
- What is the (experimentally-justifiable) motivation for putting generic images into scenes?
- What is the relevance of which photos are displayed? And how this affects the worth?
- Whether it is possible to try and improve this relevance using vision techniques?
![Page 123: Social Street View: Blending Immersive Street Views with Geo-tagged Social Media](https://reader034.fdocuments.net/reader034/viewer/2022050613/5aac34727f8b9adb278b4cdf/html5/thumbnails/123.jpg)
What is ignored in current social media sites?