Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data...

11
Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly, URCV Johannes Schönberger, ETHZ

Transcript of Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data...

Page 1: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

Large-scale3DModelingfromCrowdsourcedData

Jan-MichaelFrahm,UNCEnriqueDunn,SIT

MarcPollefeys,ETHZ,MicrosoftJaredHeinly,URCV

JohannesSchönberger,ETHZ

Page 2: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

ResourcesJohannesL.Schönberger

Page 3: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

DataAssociation

• StreamingConnectedComponentDiscoveryhttps://github.com/jheinly/streaming_connected_component_discovery

• COLMAP (OpenSource,Freeware)https://colmap.github.io/

3Large-scale3DModelingfromCrowdsourcedData

Page 4: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

IncrementalSfM

• Bundler (OpenSource,Freeware)http://www.cs.cornell.edu/~snavely/bundler/

• VisualSfM (ClosedSource,Freeware)http://ccwu.me/vsfm/

• COLMAP (OpenSource,Freeware)https://colmap.github.io/

4Large-scale3DModelingfromCrowdsourcedData

Page 5: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

GlobalSfM

• Theia(OpenSource,Freeware)http://www.theia-sfm.org/

• OpenMVG (OpenSource,Freeware)https://github.com/openMVG/openMVG

5Large-scale3DModelingfromCrowdsourcedData

Page 6: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

Bundleadjustment

• CeresSolver(OpenSource,Freeware)http://ceres-solver.org/

• PBA (OpenSource,Freeware)https://grail.cs.washington.edu/projects/mcba/

• SSBA (OpenSource,Freeware)https://github.com/chzach/SSBA

6Large-scale3DModelingfromCrowdsourcedData

Page 7: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

Multi-ViewStereoandFusion• COLMAP (OpenSource,Freeware)https://colmap.github.io/

• CMVS/PMVS(OpenSource,Freeware)https://www.di.ens.fr/cmvshttps://www.di.ens.fr/pmvs

• CMP-MVS(ClosedSource,Freeware)http://ptak.felk.cvut.cz/sfmservice/websfm.pl?menu=cmpmvs

• Gipuma (OpenSource,Freeware)https://hithub.com/kysucix/gipuma

• OpenMVS (OpenSource,Freeware)https://github.com/cdcseacave/openmvs

7Large-scale3DModelingfromCrowdsourcedData

Page 8: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

Benchmarks

• “TanksandTemples:BenchmarkingLarge-ScaleSceneReconstruction”A.Knapitsch,J.Park,Q.Zhou,V.Koltun.SIGGRAPH2017.https://www.tanksandtemples.org/• “AMulti-ViewStereoBenchmarkwithHigh-ResolutionImagesandMulti-CameraVideos”T.Schöps,J.L.Schönberger,S.Galliani,T.Sattler,K.Schindler,M.Pollefeys,A.Geiger.CVPR2017.http://www.eth3d.net/• “ExperimentalComparisonofOpenSourceVision-BasedStateEstimationAlgorithms”Quattrini etal.ISER2016.

8Large-scale3DModelingfromCrowdsourcedData

Page 9: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

References• S.Agarwal,N.Snavely,S.M.Seitz,andR.Szeliski,“Bundleadjustmentinthelarge.”ECCV2010

• S.Agarwal,Y.Furukawa,N.Snavely,I.Simon,B.Curless,S.M.Seitz,andR.Szeliski.“BuildingRomeinaDay.”Comm.ACM,2011

• J.-M.Frahm,P.Fite-Georgel,D.Gallup,T.Johnson,R.Raguram,C.Wu,Y.-H.Jen,E.Dunn,B.Clipp,S.Lazebnik,andM.Pollefeys.“BuildingRomeonacloudlessday.”ECCV2010

• J.-M.Frahm,M.Pollefeys,S.Lazebnik,C.Zach,D.Gallup,B.Clipp,R.Raguram,C.Wu,T.Johnson."FastRobustLarge-scaleMappingfromVideoandInternetPhotoCollections",Inspecialissue"100yearsofISPRS"oftheISPRSJournalofPhotogrammetryandRemoteSensing.

• D.Gallup,M.Pollefeys,J.-M.Frahm."3DReconstructionusingann-LayerHeightmap",DAGM2010.

• J.Heinly,J.L.Schönberger,E.Dunn,J.-M.Frahm,“ReconstructingtheWorld*inSixDays*(AsCapturedbytheYahoo100MillionImageDataset)“,IEEEConferenceonComputerVisionandPatternRecognition(CVPR),2015

• X.Li,C.Wu,C.Zach,S.Lazebnik,J.-M.Frahm.“ModelingandRecognitionofLandmarkImage“.ECCV2008

• R.Raguram,C.Wu,J.-M.Frahm,andS.Lazebnik.“ModelingandRecognitionofLandmarkImageCollectionsUsingIconicSceneGraphs.”IJCV,2011

• J.L.Schönberger,J.-M.Frahm."Structure-from-MotionRevisited",CVPR2016.

• J.L.Schönberger,F.Radenovic,O.Chum,J.-M.Frahm."FromSingleImageQuerytoDetailed3DReconstruction",CVPR2015.

• J.L.Schönberger,E.Zheng,M.Pollefeys,J.-M.Frahm."Pixelwise ViewSelectionforUnstructuredMulti-ViewStereo",ECCV2016.

• N.Snavely,S.M.Seitz,andR.Szeliski.“PhotoTourism:Exploringimagecollectionsin3D.”SIGGRAPH,2006

• N.Snavely,S.MSeitz,andR.Szeliski.“Modelingtheworldfrominternetphotocollections.”IJCV,2008

• N.Snavely,S.MSeitz,andR.Szeliski.“Skeletalgraphsforefficientstructurefrommotion.”InCVPR,2008.

• C.Sweeney,V.Fragoso,T.Hollerer,M.Turk.“LargeScaleSfM withtheDistributedCameraModel”,3DV2016.

• E.Zheng,E.Dunn,V.Jojic,J.-M.Frahm."PatchMatch BasedJointViewSelectionandDepthmap Estimation",CVPR2014.

9Large-scale3DModelingfromCrowdsourcedData

Page 10: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

WebsiteandSlides

• https://demuc.de/tutorials/cvpr2017

10Large-scale3DModelingfromCrowdsourcedData

Page 11: Large-scale 3D Modeling from Crowdsourced Data · Large-scale 3D Modeling from Crowdsourced Data Jan-Michael Frahm, UNC Enrique Dunn, SIT Marc Pollefeys, ETHZ, Microsoft Jared Heinly,

Questions?Thankyou!