Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

27
Mixed Reality Apps with Project Tango Mixing real and virtual worlds on Android +Jared Finder

Transcript of Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

Page 1: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

Mixed Reality Apps with Project TangoMixing real and virtual worlds on Android

+Jared Finder

Page 2: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

http://www.shutterstock.com/pic-160984304

Page 3: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

http://www.shutterstock.com/pic.mhtml?id=363721622&src=id

https://www.fotolia.com/id/77939208

1.5 m 1.5 m

1.5 m

Page 4: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

Area LearningMotion Tracking

Depth Perception

Page 5: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

Motion Tracking

Page 6: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

Depth Perception

Page 7: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

Area Learning

Page 8: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

https://www.flickr.com/photos/feidhli/14000664235/

Page 9: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

https://www.flickr.com/photos/brentschmidt/3401023012/With modifications

Page 10: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 11: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

2 Meters 2 Meters

Page 12: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

2 Meters 2 MetersSTART_OF_SERVICE

DEVICE

Page 13: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

TangoErrorType TangoService_getPoseAtTime( double timestamp, TangoCoordinateFramePair frame, TangoPoseData* pose);

-------------------------------------------------------------------------

TangoCoordinateFramePair frame_pair;frame_pair.base = TANGO_COORDINATE_FRAME_START_OF_SERVICE;frame_pair.target = TANGO_COORDINATE_FRAME_DEVICE;

TangoPoseData start_service_T_device;TangoService_getPoseAtTime(timestamp, frame_pair, &start_service_T_device);

Page 14: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 15: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

TangoPoseData pose_color_camera_t0_T_depth_camera_t1;TangoSupport_calculateRelativePose( last_color_time_, TANGO_COORDINATE_FRAME_CAMERA_COLOR, last_cloud_->timestamp, TANGO_COORDINATE_FRAME_CAMERA_DEPTH, &pose_color_camera_t0_T_depth_camera_t1);

TangoSupport_fitPlaneModelNearClick( last_cloud_, &color_camera_intrinsics_, &pose_color_camera_t0_T_depth_camera_t1, glm::value_ptr(uv), glm::value_ptr(double_depth_position), glm::value_ptr(double_depth_plane_equation));

Page 16: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 17: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 18: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 19: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 20: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

https://www.flickr.com/photos/stanglnator/8426802843/

Page 21: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 22: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 23: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

https://www.flickr.com/photos/kmardahl/9168885390/

Page 24: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

https://www.flickr.com/photos/62348225@N00/3825415639/

Page 25: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango
Page 26: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

#projecttango

+Jared Finder

Thank You!

https://developers.google.com/project-tango/

Page 27: Jared Finder (Google) Creating Mixed Reality Apps and Games with Project Tango

Old Slides