Internet-scale Imagery for Graphics and Vision
description
Transcript of Internet-scale Imagery for Graphics and Vision
![Page 1: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/1.jpg)
Internet-scale Imagery for Graphics and Vision
James Hayscs129 Computational Photography
Brown University, Spring 2011
![Page 2: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/2.jpg)
Big issues
• What is out there on the Internet? How do we get it? What can we do with it?
• How do we compute distances between images?
![Page 3: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/3.jpg)
The Internet as a Data Source
• Social Networking Sites (e.g. Facebook, MySpace)
• Image Search Engines (e.g. Google, Bing)• Photo Sharing Sites (e.g. Flickr, Picasa,
Panoramio, photo.net, dpchallenge.com)• Computer Vision Databases (e.g. CalTech 256,
PASCAL VOC, LabelMe, Tiny Images, image-net.org, ESP game, Squigl, Matchin)
![Page 4: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/4.jpg)
How Big is Flickr?
• As of 2010• Total content:– 5 billion photographs – 100+ million geotagged images
• Public content:– about 1/3rd of images
![Page 5: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/5.jpg)
How Annotated is Flickr? (tag search)
• Party – 7,355,998• Paris – 4,139,927• Chair – 232,885• Violin – 55,015• Trashcan – 9,818
![Page 6: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/6.jpg)
Trashcan Results
• http://www.flickr.com/search/?q=trashcan+NOT+party&m=tags&z=t&page=5
![Page 7: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/7.jpg)
Different ways to leverage Internet Data
• Aggregate Statistics (e.g. Photo collection priors, Image sequence geolocation)
• Text keywords, other metadata (e.g. Phototourism, Photo Clip Art, sketch2photo)
• Visual similarity (e.g. Tiny Images, Scene Completion, im2gps, cg2real, DB photo enhancement, Virtual Photoreal Space, Total Recall)– Scene level similarity– Instance level similarity
![Page 8: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/8.jpg)
Statistics from Large Photo Collections
![Page 9: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/9.jpg)
Priors for Large Photo Collections and What They Reveal about Cameras.
Sujit Kuthirummal, Aseem Agarwala, Dan B Goldman, and Shree K. Nayar
ECCV 2008
![Page 10: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/10.jpg)
im2gps Geographic Photo Density
![Page 11: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/11.jpg)
Image Sequence Geolocation with Human Travel Priors
• Kalogerakis, Vesselova, Hays, Efros, Hertzmann.Image Sequence Geolocation with Human Travel Priors. ICCV 2009
![Page 12: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/12.jpg)
Internet Imagery from metadata search
![Page 13: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/13.jpg)
Building Rome in a Day
Sameer Agarwal, University of WashingtonYasutaka Furukawa, University of Washington
Noah Snavely, Cornell UniversityIan Simon, University of WashingtonSteve Seitz, University of WashingtonRichard Szeliski, Microsoft Research
![Page 14: Internet-scale Imagery for Graphics and Vision](https://reader036.fdocuments.net/reader036/viewer/2022062501/56816032550346895dcf50f3/html5/thumbnails/14.jpg)
Sketch2photo