INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY

INTERNATIONAL SYMPOSIUM ONMIXED AND AUGMENTED REALITY

The IEEE ISMAR Committee gratefully acknowledges the following sponsors and supporters:

G E O R G I A T E C H

PLATINUM SPONSOR

SILvER SPONSOR

BRONzE SPONSOR

SUPPORTED BY

Welcome to the Eleventh IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2012)!

We are excited that this year’s symposium is being held on the campus of the Georgia Institute of Technology, at Georgia Tech’s Hotel and Conference Center. Located in the center of Altanta, Georgia, USA, Georgia Tech is one of the top public research universities in the United States, and a nationally ranked leader in many of the academic disciplines that form the heart of ISMAR: Computer Science, Engineering, HCI, Robotics & Computer Vision, and Digital Media. Atlanta is one of the largest cities in the United States, often considered the “capital of the South” and played a central role in the American Civil War and the Civil Rights movement. With a diverse and young population, Atlanta is a dynamic city with many cultural and historic attractions, restaurants, shopping, sports and outdoor activities.

This year’s conference showcases the diversity and quality of work in Mixed and Augmented Reality, with a top-quality collection of workshops, tutorials, panels, papers and posters in both the Science and Technology and Art, Media and Humanities programs. Many authors of these papers will showcase their work in the Demonstration program, joining work submitted directly to the Demonstration program with work from the sponsoring organizations.

We are extremely pleased to return ISMAR’s technical program to a single-track format, allowing attendees the opportunity to see all sessions, posters and demonstrations. We look forward to increased interaction between ISMAR’s increasingly diverse attendees, and hope these increased opportunities for cross-disciplinary contact sow the seeds for new and exciting future collaborations.

New to the program this year is the inaugural ISMAR Doctoral Consortium. The Consortium is an opportunity for PhD students to present their research, discuss their current progress and future plans, and receive constructive criticism and guidance regarding their future work and career objectives from a panel of academic and industrial researchers. The participants in the DC will also have posters in the poster session, allowing them to get feedback from all conference attendees.

Recognizing the diversity of ISMAR attendee interests, and the need to provide venues for practical as well as scientific topics, this year we have also added a Birds-of-a-Feather program. The BOF program allows any attendee to organize a session around a topic of interest relevant to ISMAR, allowing like-minded attendees to gather and discuss common interests and problems in an informal setting.

Our two keynote speakers, Sharhram Izadi and Perry Hoberman, represent the diversity of ISMAR research. Both speakers represent the best of multi-disciplinary research that sits at the heart of Mixed and Augmented Reality. Izadi combines advanced technology with cutting edge interaction and application research, while Hoberman sits at the intersection of technology, art and media. Ken Perlin will keynote the Authoring Workshop, and the Tracking Workshop will feature keynotes by Andrew Davison and Jan-Michael Frahm. We expect all to give exciting talks that will be inspirational to all attendees.

We are pleased to take advantage of the conference location and have arranged for a research demo event at Georgia Tech’s Center for Robotics and Intelligent Machines (RIM) and GVU Center. Together, these research centers comprise over a hundred researchers from disciplines across Georgia Tech’s campus (including engineering, computing, architecture, and the digital humanities), with research spanning robotics, computer vision, computational perception, HCI, graphics, augmented and mixed reality, health, design, cognitive science, education, architecture and gaming. We hope attendees will enjoy this opportunity.

We would like to thank the Program Chairs, program committees and reviewers of the Sciences and Technologies and of the Arts, Media and Humanities track, whose work has resulted in a top quality research program. We also want to thank the everyone on the conference committee for their hard work. This year we made a concerted effort to have the entire program set in advance of the early registration deadline, allowing potential attendees to see the entire conference program in advance of this deadline. This required a commitment and dedication on the part of the whole committee, for which they deserve tremendous credit.

Finally, we would like to thank the faculty, staff and students at Georgia Tech’s Institute for People and Technology and Augmented Environments Lab, who provided ongoing support over the year it took to organize the conference.

We hope that you will all enjoy ISMAR 2012, Atlanta, and the Georgia Tech community!

Symposium General ChairsBlair MacIntyreSchool of Interactive Computing, Georgia Institute of Technology

Greg WelchInstitute for Simulation & Training and Computer Science (EECS), The University of Central Florida

8:00am-7:00pm Registration

9:00-5:00Doctoral Consortium - Private SessionConf 7

9:00-10:30 BOF #1Conf 8

11:00-12:30BOF #2Conf 8

1:30-3:00 BOF #3

Conf 8

3:30-5:00 BOF #4

Conf 8

9:00-12:30 Tutorial: Integrating and Using Panoramas and Photographic Images in AR Experiences Conf 2

1:30-5:00 Tutorial: Augmented Reality (A2R): where AR meets user’s interest Conf 29:00-12:30

Tutorial: AR Mobile Game Development: Getting Started Conf 4

9:00-5:00 Tutorial: Quantitative and Qualitative Methods for Human-Subject Experiments in Augmented RealitySalon I-II

9:00-5:00 Workshop: Tracking Methods and Applications Salon III

9:00-5:00 Workshop: Authoring Solutions for Augmented RealitySalon IV

9:00-5:00 Workshop: Classifying the AR Presentation Space Salon V-VI

5:00-7:00Sponsor Reception Conf B and Break Area near Registration Desk

MONDAY NOv 5Th

MONDAY 7:30AM-7:00PM

Registration

MONDAY 9:00-5:00, Conf 7

Doctoral Consortium - Private Event


Tutorial: Integrating and Using Panoramas and Photographic Images in AR ExperiencesThis tutorial provides an introduction to the technical issues involved in creating and integrating panoramic imagery into an AR/MR application. It will also provide relevant historical background regarding panoramas and consider issues of aesthetics and user experience design.


Tutorial: AR Mobile Game Development: Getting StartedThis tutorial demonstrates the unique elements of AR mobile game development. Tools such as Unity, Maya and Vuforia will be used in this tutorial. Using these tools, the tutorial covers how to create an AR mobile game prototype from game design to art, animation and technical production.


Tutorial: Adaptive Augmented Reality (A2R): where AR meets user’s interestThis tutorial focuses on how to automatically adapt augmented reality-based information to a user’s interests. Techniques are presented for modeling users’ interest in the context of AR systems and some practical results in realizing such an approach in a multisensor AR system are demonstrated.

MONDAY 9:00-5:00, Salon I-II

Tutorial: Quantitative and Qualitative Methods for Human-Subject Experiments in Augmented RealityThis tutorial focuses on quantitative and qualitative approaches to conducting human-subject experiments in AR. It will cover (1) the basic principles of experimental design and analysis, and (2) qualitative studies (e.g., formative evaluation methods) for assessing and improving AR user interfaces and user interaction along with lessons learned from conducting many user-based studies.

MONDAY 9:00-5:00, Salon III

Workshop: Tracking Methods and ApplicationsThe focus of this workshop is on presenting, discussing and demonstrating recent tracking methods and applications that work well in practice and that show some superiority over state-of-the-art methods.Rather than focusing on pure novelty, this workshop encourages presentations that concentrate on complete systems and integrated approaches.

MONDAY 9:00-5:00, Salon IV

Workshop: Authoring Solutions for Augmented RealityThis workshop will gauge future directions in content authoring for Augmented Reality, and discuss the current state of art on content creation and authoring in the field.

We want to collect ideas and thoughts of research on various approaches for authoring content for AR, as well as debate about current and future needs to guarantee a high quality as well as quantity of content for AR.

MONDAY SchEDULE DETAIL

MONDAY 9:00-5:00, Salon V-VI

Workshop: Classifying the AR Presentation SpaceA clearly ordered taxonomy how information can be presented in AR is crucial for comparing systems and avoiding confounding factors in human factors experiments.

The workshop provides an open forum to develop a comprehensive set of dimensions of presentation principles in AR.


BOF #1Conf 8: See registration desk

MONDAY 11:00-12:30, Conf 8


MONDAY 1:30-3:00, Conf 8:




MONDAY 5:00-7:00, Conf B and Break Area near Registration Desk

Sponsor Reception

MONDAY SchEDULE DETAIL NOTES:

PLACE

POSTAGE

HERE

General Chairs Bruce H. Thomas Mark Billinghurst

Adelaide welcomes you to the next big

ISMAR

ISMAR 2013 Oct 1-4, 2013

Write a paper today! www.ismar2013.org

Submission due from early April University of South Australia

Adelaide, Australia


8:30-9:00 Welcome and Opening remarks, Grand Ballroom

9:00-10:00 Keynote: Perry HobermanGrand Ballroom

10:00-10:20 Break

10:20-11:20 Paper Session 1(S&T: Rendering)Grand Ballroom

10:20-11:20 BOF #5

Conf 7 & 8

11:20-11:50 Poster Fast Forward, Grand Ballroom

11:50-1:00 LunchFirst SeatingHotel Dining Room

Poster SessionConf A, B, 4

Tracking Competition Runs Conf C, D

11:50-1:00BOF #6

Conf 7 & 8

1:00-2:00 Lunch Second SeatingHotel Dining Room

BOF #7Conf 7 & 8

2:00-3:40 Paper Session 2 (S&T: Tracking)Grand Ballroom

BOF #8Conf 7 & 8

3:40-4:00 Break

4:00-5:20 Paper Session 3 (AMH: AR Art/Theory/Embodiment)Grand Ballroom

BOF #9Conf 7 & 8

6:00-7:00 Pre-Dinner ReceptionPrefunction area outside Grand Ballroom

BOF #10Conf 7 & 8

7:00-9:00pm BanquetGrand Ballroom

9:00-11:00pmPost Banquet Social: US Election ViewingGrand Ballroom*We will show election coverage on the big screens and have the cash bar remain open

TUESDAY NOv 6Th

TUESDAY 7:30AM-7:00PM Registration

TUESDAY 8:30-9:00, Grand Ballroom

Welcome and Opening remarks

TUESDAY 9:00-10:00, Grand Ballroom Keynote: Perry Hoberman, USC

Perry Hoberman is an artist, educator and researcher. His media works have been exhibited in museums, galleries and festivals worldwide, and he has been the recipient of numerous awards and honors, including Guggenheim and Rockefeller Fellowships, as

well as prizes from Ars Electronica, the ICC Bienniale and the Interactive Media Festival. He is currently an Associate Research Professor at the USC School of Cinematic Arts, where he works with a number of research labs including the ICT MxR Lab at the Institute for Creative Technologies, S3D@USC, the Annenberg Innovation Lab, and The Creative Media and Behavioral Health Center.

Portable Reality: Expanding Available SpaceAll of the components for creating fully immersive virtual worlds have suddenly become ubiquitous and cheap, often built into devices that we have already in our pockets and on our desktops. These devices have everything they need to become state-of-the-art platforms for immersive games and virtual reality: powerful graphics, high-resolution displays, and precision sensors. Just add some optics, and now a responsive, fully immersive virtual reality platform can be built for next to nothing. And once we can do that, there’s nothing to stop us from unleashing a flood of alternate and augmented worlds that can be colocated with our physical surroundings, anywhere and any time.

More than just information or annotation, we can begin to imagine a multiplicity of inhabitable, immersive, interactive, networked environments that can be coordinated with our everyday lives. The coming proliferation of virtual and augmented worlds will make manifest the idea that there is far more to reality than we are normally aware of, and that there are countless virtual realms that can now be brought into conscious experience. http://www.perryhoberman.com/

TUESDAY 10:00-10:20Break

TUESDAY 10:20-11:20, Grand Ballroom Paper Session 1 S&T: Rendering • Reduction of contradictory occlusion in Mixed Reality by using

characteristics of transparency perception Taiki Fukiage, Takeshi Oishi, Katsushi Ikeuchi

• PixMix: A Real-Time Approach to High-Quality Diminished Reality Jan Herling, Wolfgang Broll

• A Non-Photorealistic Rendering Framework with Temporal Coherence for Augmented Reality Jiajian Chen, Greg Turk, Blair MacIntyre

TUESDAY 10:20-11:20, Conf 7 & 8

BOF #5Conf 7: See registration deskConf 8: See registration desk

TUESDAY 11:20-11:50, Grand Ballroom

Poster Fast Forward Rapid Fire Presentations by all Poster Authors

TUESDAY SchEDULE DETAIL

TUESDAY 11:50-2:00 Lunch, Hotel Dining Room First Seating 11:50-1:00Second Seating 1:00-2:00

TUESDAY 12:00-2:00, Conf A, B, 4

Poster Session

TUESDAY 12:00-2:00, Conf C, D

Tracking Competition Runs

TUESDAY 11:50-1:00, Conf 7 & 8


TUESDAY 1:00-2:00, Conf 7 & 8


TUESDAY 2:00-3:40, Grand Ballroom Paper Session 2 (S&T: Tracking) • LDB: An Ultra-Fast Feature for Scalable Augmented Reality on

Mobile Devices Xin Yang, Tim Cheng• VRCodes: Unobtrusive and Active Visual Codes for Interaction

by Exploiting Rolling Shutter Grace Woo, Andy Lippman, Ramesh Raskar

• Representative Feature Descriptor Sets for Robust Handheld Camera Localization Daniel Kurz, Thomas Olszamowski, Selim Benhimane

• Multi-sensor Navigation Algorithm Using Monocular Camera, IMU and GPS for Large Scale Augmented Reality Taragay Oskiper, Supun Samarasekera, Rakesh Kumar

• Optical Outside-In Tracking using Unmodified Mobile Phones Daniel Pustka, Jan-Patrick Hülß, Jochen Willneff, Frieder Pankratz, Manuel Huber, Gudrun Klinker

TUESDAY 2:00-3:40, Conf 7 & 8


TUESDAY 3:40-4:00Break

TUESDAY 4:00-5:20, Grand Ballroom Paper Session 3 AMH: AR Art/Theory/Embodiment • A Framework for Debating Augmented Futures: Classifying the

Visions, Promises and Ideographs Advanced About Augmented Reality Tony Liao

• Improving the embodiment relations by means of phenomenological analysis on the “reality” of AR Nicola Liberati

• Body Topography: Simulating Human Form Oksana Kryzhanivska, Jeffrey Boyd

• Interactions and systems for augmenting a live dance performance, Alexis Clay, Nadine Couture, Laurence Nigay, Jean-Baptiste De la Riviere, Jean-Claude Martin, Matthieu Courgeon, Myriam Desainte-Catherine, Emmanuel Orvain, Vincent Girondel, Gael Domenger

TUESDAY 4:00-5:20, Conf 7 & 8

BOF #9Conf 7: The “Real” World Wide Web: Building AR Applications using Web Technologies (Host: Hafez Rouzati)Conf 8: See registration desk

TUESDAY 6:00-7:00, Conf 7 & 8


TUESDAY 6:00-7:00, Prefunction area outside Grand Ballroom Pre-Dinner Reception


NOTES:

TUESDAY 7:00-9:00PM, Grand Ballroom

Banquet

TUESDAY 9:00-11:00PM, Grand Ballroom

Post Banquet Social: US Election Viewing*We will show election coverage on the big screens, and have the cash bar remain open


WEDNESDAY NOv 7ThWEDNESDAY NOv 7Th


8:30-9:50 Paper Session 4 (S&T: Illumination)Grand Ballroom

8:30-9:50BOF #11

Conf 7 & 8

9:50-10:20 Break

10:20-11:20 Paper Session 5 (AMH: AR in Museum and Theater)Grand Ballroom

10:20-11:20BOF #12

Conf 7 & 8

11:30-2:00 Pick up box lunch and go to Demos atGeorgia Tech’s GVU and RIM Centers TSRB and CCB buildings

*The TSRB building is across the street from the hotel; the CCB building is an 8 min walk.

11:30-12:45BOF #13

Conf 7 & 8

12:45-2:00BOF #14

Conf 7 & 8

2:15-3:35 Paper Session 6 (S&T: Interaction)Grand Ballroom

2:15-3:35BOF #15

Conf 7 & 8

3:35-4:00 Break

4:00-5:00 Paper Session 7 (AMH: Education and Tourism)Grand Ballroom

4:00-5:00BOF #16

Conf 7 & 8

5:00-5:30 Demo Fast ForwardGrand Ballroom

5:30-7:00 Demo Session & Reception Conf A, B, 4

WEDNESDAY 8:00-5:00Registration

WEDNESDAY 8:30-9:50, Grand Ballroom Paper Session 4 S&T: Illumination

• Real-Time Surface Light-field Capture for Augmentation of Planar Specular Surfaces Jan Jachnik, Richard Newcombe, Andrew Davison

• High-Quality Reflections, Refractions, and Caustics in Augmented Reality and their Contribution to Visual Coherence Peter Kán, Hannes Kaufmann

• Instant Indirect Illumination for Dynamic Mixed Reality Scenes Philipp Lensing, Wolfgang Broll

• Real-time Photometric Registration from Arbitrary Geometry Lukas Gruber, Thomas Richter-Trummer, Dieter Schmalstieg

WEDNESDAY 8:30-9:50, Conf 7 & 8

BOF #11Conf 7: ARToolkit Users BOF (Host: PHiliP lamb)Conf 8: See registration desk

WEDNESDAY 9:50-10:20Break

WEDNESDAY 10:20-11:20, Grand Ballroom

Paper Session 5 AMH: AR in Museum and Theater• The Augmented Painting: Playful Interaction with Multi-Spectral

Images Wim van Eck, Yolande Kolstee• Tailoring the Adaptive Augmented Reality (A2R) Museum Visit:

Identifying Cultural Heritage Professionals’ Motivations and Needs Areti Damala, Nenad Stojanovic

• Exploring Interactivity and Augmented Reality in Theater: A Case Study of Half Real Michael Marner, Sam Haren, Matthew Gardiner, Bruce Thomas

WEDNESDAY 10:20-11:20, Conf 7 & 8

BOF #12Conf 7: Industrial Augmented Reality (Host: sabine Webel) Conf 8: See registration desk

WEDNESDAY 11:30-2: 00Pick up box lunch and go to Demos at Georgia Tech’s GVU and RIM Centers, TSRB and CCB buildings *The TSRB building is across the street from the hotel; the CCB building is an 8 min walk.

WEDNESDAY 11:30-12:45, Conf 7 & 8

BOF #13Conf 7: Indoor Positioning and Navigation for Mobile AR(Hosts: CHRistine PeRey and tsutomo miyasHita)Conf 8: See registration desk

WEDNESDAY12:45-2:00, Conf 7 & 8

BOF #14Conf 7: A Trade Organization for Augmented Reality (Host: oRi inbaR)Conf 8: See registration desk


Paper Session 6 S&T: Interaction• Tablet versus Phone: Depth Perception in Handheld Augmented

Reality Arindam Dey, Graeme Jarvis, Christian Sandor, Gerhard Reitmayr• Hand-held AR Magic Lenses with User-Perspective Rendering

Domagoj Bariević, Cha Lee, Matthew Turk, Tobias Höllerer, Doug Bowman• 3D Referencing Techniques for Shared Augmented Reality

Environments Ohan Oda, Steven Feiner• Quick Viewpoint Switching for Manipulating Virtual Objects in

Hand-Held Augmented Reality using Stored Snapshots Mengu Sukan, Steve Feiner, Barbara Tversky, Semih Energin

WEDNESDAY SchEDULE DETAIL

NOTES:


BOF #15Conf 7: Children’s Augmented Reality - A Community Discussion(Host: iulian Radu)Conf 8: See registration desk

WEDNESDAY 3:35-4:00Break


Paper Session 7 AMH: Education and Tourism• iFiction: Mobile technology, new media, mixed reality and

literary creativity in English Teaching Winyu Chinthammit, Angela Thomas

• Co-Creativity Fusions in Interdisciplinary Augmented Reality Game Developments Raymond Koon Chuan Koh, Henry Been-Lirn Duh, Cheng-Ho Chen, Yun-Ting Wong

• CityViewAR: A Mobile Outdoor AR Application for City Visualization Gun Lee, Andreas Duenser, Seungwon Kim, Mark Billinghurst


BOF #16Conf 7: Using Standards for Open and Interoperable AR(Hosts: CHRistine PeRey and neil tRevett)Conf 8: See registration desk


Demo Fast ForwardRapid Fire Presentations by all Demo Presenters

WEDNESDAY 5:30-7:00Demo Session & Reception *This will be the first of the two demo sessions; the 2nd is at lunch the next day. Cash bar and light snacks

WEDNESDAY SchEDULE DETAIL


8:30-10:05 Paper Session 8 (S&T: SLAM)Grand Ballroom

8:30-10:05 BOF #17Conf 7 & 8

10:05-10:20 Break

10:20-11:40 Paper Session 9 (S&T: Applications)Grand Ballroom

10:20-11:40 BOF #18Conf 7 & 8

11:40-12:40 Lunch Seating 1Hotel Dining Room

11:40-12:40Demo SessionConf A, B, 4

11:40-12:40BOF #19Conf 7 & 8

12:40-1:40Lunch Seating 2Hotel Dining Room

12:40-1:40BOF #20Conf 7 & 8

1:40-2:40 Panel Session (AMH: Aesthetics)Grand Ballroom

1:40-2:40BOF #21Conf 7 & 8

2:40-2:50 Break

2:50-3:50 Paper Session 10 (S&T: Visualization)Grand Ballroom

2:50-3:50 BOF #22Conf 7 & 8

3:50-4:00 Break

4:00-5:00 Keynote: Shahram IzadiGrand Ballroom

5:00-5:30 Closing Remarks

ThURSDAY NOv 8Th

8:00AM-5:00PM

Registration

ThURSDAY 8:30-10:05, Grand Ballroom

Paper Session 8 (S&T: SLAM)• Wide-Area Scene Mapping for Mobile Visual Tracking

Jonathan Ventura, Tobias Höllerer• Live Tracking and Mapping from Both General and Rotation-

Only Camera Motion Steffen Gauglitz, Chris Sweeney, Jonathan Ventura, Matthew Turk, Tobias Höllerer

• Kinectrack: Agile 6-DoF Tracking Using a Projected Dot Pattern Paul McIlroy, Shahram Izadi, Andrew Fitzgibbon

• Dense Multibody Motion Estimation and Reconstruction from a Handheld Camera Anastasios Roussos, Chris Russel, Ravi Garg, Lourdes Agapito

• Distributed Visual Processing for Augmented Reality Winston Yii, Wai Ho Li, Tom Drummond

ThURSDAY 8:30-10:05, Conf 7 & 8


ThURSDAY 10:05-10:20 Break


Paper Session 9 (S&T: Applications)• Using Developmental Psychology to Guide Augmented-Reality

Design for Children Iulian Radu, Blair MacIntyre• Learning Task Structure from Video Examples for Workflow

Tracking and Authoring Nils Petersen, Didier Stricker• Mobile Augmented Reality for Cultural Heritage: A Technology

Acceptance Study Anne-Cecilie Haugstvedt, John Krogstie• The Angiographic Virtual Mirror Jian Wang, Matthias Kreiser, Lejing

Wang, Pascal Fallavollita, Nassir Navab

ThURSDAY 10:20-11:40, Conf 7 & 8


ThURSDAY 11:40-1:40, Lunch, Hotel Dining Room

First Seating 11:40-12:40Second Seating 12:00-1:40

ThURSDAY 11:40-12:40, Conf A, B, 4

Demo Session

ThURSDAY 11:40-12:40, Conf 7 & 8


ThURSDAY 12:40-1:40, Conf 7 & 8



Panel Session (AMH: Aesthetics)Helen Papagiannis, Perry Hoberman, Jay David Bolter, Mark Billinghurst

ThURSDAY 1:40-2:40, Conf 7 & 8


ThURSDAY 2:40-2:50 Break

ThURSDAY SchEDULE DETAIL


Paper Session 10 (S&T: Visualization)• Subtle Cueing for Visual Search in Augmented Reality Weiquan Lu,

Henry Been-Lirn Duh, Steven Feiner• Interactive 4D Overview and Detail Visualization in Augmented

Reality Stefanie Zollmann, Denis Kalkofen, Christof Hoppe, Stefan Kluckner, Horst Bischof, Gerhard Reitmayr

• Image-Driven View Management for Augmented Reality Browsers Raphael Grasset, Markus Tatzgern, Tobias Langlotz, Denis Kalkofen, Dieter Schmalstieg

ThURSDAY 8:30-10:05, Conf 7 & 8


ThURSDAY 3:50-4:00Break


Keynote: Shahram Izadi, Microsoft ResearchProfessor Shahram Izadi is a senior research scientist within Microsoft Research Cambridge. He co-leads the Interactive 3D Technologies (I3D) group, and holds a visiting professorship in the Virtual Environments and Computer Graphics (VECG) group at University College London (UCL). He describes his work as: mashing together exotic sensing and display hardware with signal processing, vision and graphics algorithms to create new interactive systems, which enable users to experiences computing in magical ways. His group has had many notable projects and publications to date including: KinectFusion; KinEtre; Vermeer; HoloDesk;

Mouse 2.0; SurfacePhysics; SecondLight; and ThinSight. Shahram has been at Microsoft Research since 2005 and prior to that spent time at Xerox PARC. He received a TR35 award in 2009 and was nominated one of the Microsoft Next in 2012. He lives in Cambridge, UK, with his wife and daughter.

A New Era of Human Computer InteractionFor most researchers outside of the field, Human Computer Interaction (or HCI) is the study and evaluation of interactive systems and techniques. While this is an important part of our discipline, nowadays HCI is as much about _building_ the underlying technologies and systems as it is studying their use. In this talk I will demonstrate why it is an exciting time to be a computer science researcher in this discipline. You can play with the newest technologies, such as exotic cameras, displays and sensing hardware; readily embrace approaches outside of your discipline (e.g. within computer vision, machine learning, signal processing, or computer graphics); and even invent technologies and algorithms along the way. However, ultimately, you’ll build working systems that are grounded by real-world problems that have direct impact on users.

The Interactive 3D Technologies Group at Microsoft Research Cambridge, UK, has been born out of this new approach to HCI research. I will demonstrate examples of projects within the group, which are all motivated by pushing the boundaries of how people can interact with computers, but doing this through technical and systems innovation. These projects move computing beyond the mouse and keyboard into the physical world around us. A key part in this work is blurring the lines between the digital and physical worlds. The group is multi-discipline in nature, allowing us to not only to embrace but invent technologies and techniques from fields such as optics, computer vision, robotics and computer graphics. The talk will also hint at exciting new technologies around the corner – some of which our group is working on – which will be critical building blocks for like-minded researchers in the future.

Clearly there are many parallels between being an HCI researcher and an AR researcher. We both celebrate building working systems, embrace new technolo-gies, focus on real-time techniques, and systems that have direct user impact. My talk will argue that by bridging the gap between disciplines such as AR and HCI, we can solve grander challenges, such as making augmented reality a reality, and moving closer to one day building the HoloDeck (note: being a Star-Trek fan is not a requisite for this talk!).

This will be an interactive session, with demos, videos, and hopefully not too many explosions (unless one of the GPUs in my ridiculously big laptop overheats).


Closing Remarks

ThURSDAY SchEDULE DETAIL

ST1- Lighty: A Painting Interface for Room Illumination by Robotic Light Array Seung-tak Noh, Sunao Hashimoto, Daiki Yamanaka, Masahiko Inami, Takeo Igarashi

ST2- Depth Perception Control by Hiding Displayed Images Based on Car Vibration for Monocular Head-up Display Tsuyoshi Tasaki, Akihisa Moriya, Aira Hotta, Takashi Sasaki, Haruhiko Okumura

ST3- Generation of Virtual Display Surfaces for In-vehicle Contextual Augmented Reality Srinath Sridhar, Victor Ng-Thow-Hing

ST4- BurnAR: Stimulating Thermoception through Augmented Reality Peter Weir, Christian Sandor, Matt Swoboda, Thanh Nguyen, Ulrich Eck, Gerhard Reitmayr, Arindam Dey

ST5- Fractal Marker Fields Adam Herout, Michal Zachariáš, Markéta Dubská, Jiѓí Havel

ST6- Uniform Marker Fields István Szentandrási, Michal Zachariáš, Jiѓí Havel, Adam Herout, Markéta Dubská, Rudolf Kajan

ST7- A Component-based approach towards Mobile Distributed and Collaborative PTAM Authors: Tim Verbelen, Pieter Simoens, Filip De Turck, Bart Dhoedt

ST8- Control structure for an immersive mixed reality environment Authors: Marija Nakevska, Jun Hu, Geert Langereis, Matthias Rauterberg

ST9- AR Marker Hiding Based on Image Inpainting and Reflection of Illumination Changes Authors: Norihiko Kawai, Masayoshi Yamasaki, Tomokazu Sato, Naokazu Yokoya

ST10- Relation between Features of Augmented Reality and User Memorization Yuichiro Fujimoto, Goshiro Yamamoto, Takafumi Taketomi, Jun Miyazaki, Hirokazu Kato

ST11- GPGPU Accelerated SURF Descriptors on Mobile Devices Robert Hofmann, Hartmut Seichter, Gerhard Reitmayr

ST12- Occlusion Capable Optical See-through Head-Mounted Display Using Freeform Optics Chunyu Gao, Yuxiang Lin, Hong Hua

ST13- exture-Less Planar Object Detection and Pose Estimation Using Depth-Assisted Rectification of Contours João Lima, Hideaki Uchiyama, Veronica Teichrieb, Eric Marchand

ST14- Touch-n-Paste: Direct Texture Transfer Interaction in AR Environments Atsushi Umakatsu, Tomohiro Mashita, Kiyoshi Kiyokawa, Haruo Takemura

ST15- Hybrid Virtual-Physical Entities Joon Hao Chuah, Benjamin Lok

ST16- Distance-based modeling and manipulation techniques using Ultrasonic Gloves Thuong N. Hoang, Bruce H. Thomas

ST17- Augmented Prototyping of 3D Rigid Curved Surfaces Marina Atsumi Oikawa, Igor de Souza Almeida, Takafumi Taketomi, Goshiro Yamamoto, Jun Miyazaki, Hirokazu Kato

ST18- Digital Map based Pose Improvement for Outdoor Augmented Reality Joonsuk Park, Dong Hyun Lee, Jun Park

ST19- Real-Virtual Model-based Tracking for Closed-loop Registration Feng Zheng, Ryan Schubert, Gregory Welch

Posters

S&T Posters

ST20- SLAM Using Both Points and Planes for Hand-Held 3D Sensors Yuichi Taguchi, Yong-Dian Jian, Srikumar Ramalingam, Chen Feng

ST21- Integrating 3D object detection with in-situ modelling and tracking on a mobile phone Pished Bunnun, Dima Damen, Walterio Mayol-Cuevas

ST22- Effect of Eye and Body Movement on Augmented Reality in the Manufacturing Domain John Sausman, Alexei Samoylov, Meredith Hopps, Susan Harkness Regli

ST23- Relevance Based Multimodal Data Fusion: A User Centered Augmented Reality Editing Approach Abouzar Eslami, Amin Katouzian, Olivier Pauly, Pascal Fallavollita, Nassir Navab

ST24- ClonAR: Rapid Redesign of Real-World Objects Michael Csongei, Liem Hoang, Ulrich Eck, Christian Sandor

ST25- Toward a Practical Wall See-Through System for Drivers: How Simple Can It Be? Hiroshi Yasuda, Yoshihiro Ohama

ST26- Using Mixed Reality to Map Human Exercise Demonstrations to a Robot Exercise Coach Ayanna Howard, Luke Roberts, Rakale Quarells

ST27- Superman-like X-ray Vision: Towards Brain-Computer Interfaces for Medical Augmented Reality Tobias Blum, Ekkehard Euler, Nassir Navab

ST28- Subjective Evaluations on Perceptual Depth of Stereo Image and Effective Field of View of a Wide-view Head Mounted Projective Display with a Semi-transparent Retro-reflective Screen Duc Nguyen Van, Tomohiro Mashita, Kiyoshi Kiyokawa, Haruo Takemura

ST29- Interface Design for an Inexpensive Hands-Free Collaborative Videoconferencing System Nicolas Lehment, Katharina Erhardt, Gerhard Rigoll

ST30- An Interactive Augmented Reality System: a prototype for industrial maintenance training applications Bassem Besbes, Sylvie Naudet Collette, Mohamed Tamaazousti, Steve Bourgeois, Vincent Gay-Bellile

ST31- Development of the ubiquitous learning system for a dexterous hand operation. Kazutaka Mitobe, Masahiro Tomioka, Masachika Saito, Masafumi Suzuki

ST32- A Waist-mounted ProCam System for Remote Collaboration Shigeki Morishima, Tomohiro Mashita, Kiyoshi Kiyokawa, Haruo Takemura

ST33- Making Pretense Visible and Graspable: An Augmented Reality Approach to Promote Pretend Play Zhen Bai, Alan Blackwell, George Coulouris

ST34- Recreating the parallax effect associated with Fishtank VR in a real-time telepresence system using head-tracking and a robotic camera Christian Heinrichs, Andrew McPherson

ST35- Why should my students use AR? Reviewing the educational impacts of augmented-reality. Iulian Radu

AMH Posters

AMH1- Willing to be fooled: Security and autoamputation in augmented reality Bo Brinkman

AMH2- Aspects of what makes or breaks a museum AR experience Claus Madsen, Jacob Madsen, Ann Morrison

AMH3- GeoBoids: A Mobile AR Application for Exergaming Robert W. Lindeman, Gun Lee, Leigh Beattie, Hannes Gamper, Rahul Pathinarupothi, Aswin Akhilesh

AMH4-Development of an interactive Augmented Reality Exposure Treatment system Samuel Corbett-Davies, Andreas Duenser, Adrian Clark

AMH5- When AR Meets Food: A Structural Overview of the Research Space on Multi-facets of Food Jun Wei, Shengdong Zhao, Ryohei Nakatsu, Henry Been-Lirn Duh

AMH6- A Proposed Framework for AR UX Design: Applying AEIOU to Handheld Augmented Reality Browser Mandi Jieying Lee, Yuan Wang, Henry Been-Lirn Duh

AMH7- Augmented Reverse-Origami: from 3D Model to Square Paper Simona Maria Banu

AMH8- Plants and Zombies: Two Use Cases for On-Location Panorama Viewing in Handheld Mobile AR Isaac Kulka, Blair MacIntyre, Maribeth Gandy, Jay Bolter

AMH9- A Mixed Reality System for Teaching STEM Content using Embodied Learning and Whole-Body Metaphors Remo Pillat, Arjun Nagendran, Robb Lindgren

Doctoral ConsortiumDC1- Human-Computer Interaction Paradigm for Augmented Reality Systems Mikel Salazar

DC2- Closed-Loop Registration of Physical and Virtual Objects in Spatial Augmented Reality Feng Zheng

DC3- Interactive Remote Collaboration using Augmented Reality Steffen Gauglitz

DC4- Object Detection and Pose Estimation from Natural Features Using Consumer RGB-D Sensors: Applications in Augmented Reality João Paulo Lima

DC5- Two way Inside Interaction between the Real Person and the Virtual World in a Mixed Reality System Yiyan Xiong

DC6- Subtle Cueing in Augmented Reality Weiquan Lu

D1- RePublic-Re-Imagining Public SpaceBc Biermann, jordan seiler, ean mering, MOMO, camila mercado

D2- Augmented Reality for Underground Infrastructure and for ConstructionStéphane Côté, Philippe Trudel, Rob Snyder, Renaud Gervais

D3- Constrained-SLAM : a flexible framework for 3D object tracking Steve Bourgeois,Mohamed Tamaazousti, Vincent Gay-Bellile, Sylvie Naudet Collette

D4- Quick Response (QR) & Natural Feature Tracking (NFT) based Mobile Augmented Reality (AR) Framework1 Jian Gu, Daniel Tan, Zhiying Zhou

D5- Mass Market AR Games by Ogmento Ori Inbar

D6- Interactive & Adaptive Story-Telling in Museums and Science Centers with Augmented Reality on Mobile Devices Jens Keil, Timo Engelke, Harald Wuest, Folker Wientapper

D7- ARBlocks: Augmenting EducationRafael A. Roberto, Daniel Q. de Freitas, Veronica Teichrieb, Manoela M. O. da Silva

D8- Wide-area Scene Mapping for Mobile Visual TrackingJonathan Ventura, Tobias Höllerer

D9- Kaiju Kazoo and Mechanice: Creating AR Games out of Simple AR Toys Brian Schrank, Ted Molinski, David Bayzer, David Laskey, Paul Brom, Logan Wright, Brian Gabor Jr., Joe Stramaglia, Brian von Kuster, Majdi Badri, Phil Tibitoski, Michael Langley, Joe Elsey, Ray Tan, Dan Rose, Robert Polzin, Joe Scalzo

D10- Interactive Augmented Reality Exposure TherapySam Corbett-Davies, Andreas Du ̈nser,Adrian Clark‡

D11- Handheld AR/AV system using PDR localization and image based localization with virtualized reality models Koji Makita, Masakatsu Kourogi, Thomas Vincent, Takashi Okuma, Jun Nishida, Tomoya Ishikawa, Laurence Nigay, Takeshi Kurata

D12- Layar Creator - AR content authoring made easyJens de Smit, Ronald van der Lingen

D13- Outdoor AR Library – A Component based Framework for Mobile Outdoor AR Gun A. Lee, Leigh Beattie, Robert W. Lindeman, Raphaël Grasset, Mark Billinghurst

D14- Photometric Registration from Arbitrary Geometry DemoLukas Gruber, Dieter Schmalstieg

D15- SnapAR: Quick Viewpoint Switching for Manipulating Virtual Objects in Hand-Held Augmented Reality using Stored SnapshotsMengu Sukan, Steve Feiner, Barbara Tversky, Semih Energin

D16- Recreating the parallax effec associated with Fishtank VR in a real-time telepresence system using head-tracking and a robotic camera Christian Heinrichs, Andrew McPherson

D17- VRCodes: Unobtrusive and Active Visual CodesGrace Woo and Szymon Jakubcza

D18- VENTURI City gameSelim BenHimane

Demos

D19- Distributed Visual Processing for Augmented RealityWinston Yii, Wai Ho Li, Tom Drummond

D20- Vantage – Mobile phone navigation application with augmented reality directing arrow Wang Yuan, Mandi Lee Jieying, Dr. Henry Been-Lirn Duh

D21- Move it there: Image-Driven View Management for MARRaphael Grasset, Tobias Langlotz, Denis Kalkofen Markus Tatzgern, Dieter Schmasltieg

D22- High-Quality Reflections, Refractions, and Caustics in Augmented Reality Peter Kán and Hannes Kaufmann

D23- Real-Time Surface Light-field Capture for Augmentation of Planar Specular Surfaces Jan Jachnik, Richard A. Newcombe, Andrew J. Davison

D24- Texture-Less Planar Object Detection and Pose Estimation Using Depth-Assisted Rectification of Contours João Paulo Lima, Hideaki Uchiyama, Veronica Teichrieb, Eric Marchand

D25- The augmented painting Wim van Eck, Yolande Kolstee

D26- Interactive 4D Overview and Detail Visualization in Augmented Reality Stefanie Zollmann, Denis Kalkofen, Christof Hoppe, Stefan Kluckner, Horst Bischof, Gerhard Reitmayr

D27- Florence AR interactive tourist map (Bird’s view AR) Giovanni Landi, Giacomo Chegia, Nicola Pireddu

D28- TineMelk AR - augmenting 100 000 breakfast tables with talking cows Kim Baumann Larsen, Tuck Siver and David Jones

D29- Virtual Interactive Podium (VIPodium) Inga Nakhmanson, Aleksey Streltsov, David Esayan, Den Ivanov

D30- AR Marker Hiding Based on Image Inpainting and Reflection of Illumination Changes Norihiko Kawai, Masayoshi Yamasaki, Tomokazu Sato, Naokazu Yokoya

D31- Depth Perception Control by Hiding Displayed Images Based on Car Vibration for Monocular Head-up Display suyoshi Tasaki, Akihisa Moriya, Aira Hotta, Takashi Sasaki, Haruhiko Okumura

D32- Multisensor-driven Adaptive Augmented Reality in the Cultural Heritage Context Yongchun Xu, Ljiljana Stojanovic, Nenad Stojanovic, Tobias Schuchert

D33- Distance-based modeling and manipulation techniques using Ultrasonic Gloves Thuong N Hoang & Bruce H Thomas

D34- LDB: An Ultra-Fast Feature for Scalable Augmented Reality on MobileDevices Xin Yang and Kwang-Ting(Tim) Cheng

D35- A component-based approach towards Mobile distributed and Collaborative PTAM Tim Verbelen, Pieter Simoens, Filip De Turck, Bart Dhoedt

D36- Sphero MR Engine Ian Bernstein, Fabrizio Polo

NOTES:NOTES:

After enjoying the culinary treats of our Conference Dining Room, feel free to visit

some of our favorite local restaurants. Ask an associate for walking directions!

Baraonda710 Peachtree Street, NE

404-879-9962Mon-Thu: 11a-10:30p

Fri: 11a-12aSat: 5p-12a

Sun: 12p-10:00pWood-brick oven pizzeria &

café Italiano $$

www.baraondaatlanta.com.43 miles – walking distance

Ecco40 7th Street, NE404-347-9555

Mon-Wed: 5:30p-11pThu-Sat: 5:30p-2a

Sun: 5:30-10pItalian, Spanish & French

influenced cuisine$$-$$$

www.ecco-atlanta.com.41 miles – walking

distance

Steel Restaurant950 W. Peachtree Street

Suite 255404.477.6111

Mon-Thurs: 5p-10pFri-Sat: 5p-11p

Indochine Cuisine$$

www.steelatlanta.com.20 miles – walking distance

Gordon Biersch848 Peachtree Street, NE

404-870-0805Sun-Thu: 11:30a-Midnight

Fri-Sat: 11:30a-2:00aOn-site brewing with an

eclectic food menu$-$$

www.gordonbiersch.com.42 miles – walking distance

Marlow’s Tavern950 West Peachtree St.

404-815-0323Sun-Wed: 11:30a-12:00aThurs-Sat: 11:30a-2:00a

American Tavern Fare$$

www.marlowstavern.com .20 miles – walking distance

Mu Lan824 Juniper St, NE

404-877-5797Mon-Thu: 11:30a-10:30p

Fri-Sat: 11:30a-11:30pSun: 12p-10:30p

Hunan, Szechwan & Mandarin dishes

$$www.mulanatlanta.com .51 miles – request taxi

South City Kitchen1144 Crescent Avenue

404-873-7358Mon-Thurs : 5:00p -10:00p

Fri - Sat: 5:00p-10:30pSun: 5:00p-10:00p

Contemporary Southern cuisinew/ sophisticated twist

$$-$$$www.southcitykitchen.com

1.02 miles – Request Taxi

Taco Mac933 Peachtree Street, NE

678-904-7211Mon-Sat: 11 am- 2:30 am

Sun: 11 am-12:00 amwww.tacomac.com

Tacos, Wings, Nachos$$-$$$

.7 miles – request taxi

The Spence5th Street NW404-892-9111

Mon Fri: 11:30 am-10pmSat: 5:30pm-11pm

Sun: 5:30pm-10pamwww.thespenceatl.com

Chef Richard Blaise$$-$$$

Walking distance across from the hotel on 5th Street

Tin Lizzy’s1136 Crescent Avenue

404-537-5060 Mon-Sat: 11:30 am-

2:30 amSun: 11:30 am-12 am

www.tinlizzyscantina.comGourmet tacos and salads

$$-$$$1.0 miles – request taxi

Barrel House22 5th Street NW

404-844-5601 Mon-Thurs: 11am-1:30 am

Fri & Sat: 11 am-3 amSun: Closed

www.barrelhouseatl.comNeighborhood Pub

$$Walking distance

(on our street)

Cypress Street Pint & Plate@ the corner of 6th &

Cypress404-815-9243

Mon-Thurs: 11am- 2:20 amSat: 10 am-2:30 am

Sun: 10am-12amwww.cypressbarl.com

Tavern Fare$$

.12 Walking distance

INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY

Documents

Transcript of INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY