Daniel M-Augmented Reality

8/9/2019 Daniel M-Augmented Reality

1/18

Daniel M. Frommelt

UW - Platteville

Augmented Reality

Penn State Web 2009

Presentation and documentation are online @

http://www.uwplatt.edu/web/presentations


2/18

Augmented means...C Major

Augmented Triad B

Most people have heard about Virtual Reality, and everybody has heard of actual reality.

y G reater than beforey I ncreasedy Amplifiedy I mproved

So Augmented Reality is...... supplementing, enhancing, modifying, improving our reality.

Examples today!

y H eads up display


3/18

y NFL- first down marker y NHL - puck marker

y Museum tours

y Augmented reality is a mixture of the two and is an exciting technology that holds many possibilities for use in day to day life.y H eads up display in automobiles provide additional information regarding the vehicle, location, direction, areas of interest, etc.y NFL has a first down marker which shows up yellow on TV, but not when in the stadium.y NHL uses a red line to mark the motion of the puck for TV, to make the puck more visible for the audience at home.y Museums are using more dynamic listening devices that are not guided tours, but guide-less tours. Wander through the

museum to points of interest and the device recognizes your location and begins to provide additional information.

AR: ComputersAR can be achieved today, using simple technology. All that is required is:


4/18

y video displayy video cameray speakersy microphoney I n essence, basic input AND output

Though the devices required seem to be 'exotic', it is actually very standard. A fancy headset is not required. Most of us have thesetechnologies with us daily... a simple cell phone!

New Tech on the block Tuesday N ovember 3, 2008, Presidential Election night, CNN revealed a 'new' technology, which they called a "hologram".

Will I. Am became the first "hologram" broadcasted on television.


5/18

Not a "Hologram"

CNN tried to simplify the example about what was going on.

I mmediately, I knew what was going on... and it was Augmented Reality.


6/18

C NN explains their "Hologram"I t wasn't a hologram. People in the news room that night saw nothing, save a marker on the floor.

The marker was the key. I t told the computer where to place the supplemented information on the display.

MarkersMarkers are unique and asymmetric. The video stream is scanned live looking for the unique pattern.

As a marker is recognized, an augmentation is overlaid in it's place in the live video.


7/18

AR ProcessorThe image must be processed quickly, because of this, there is a threshold of certainty.

The simpler the pattern, the more reliable the threshold.


8/18

The level of certainty can be adjusted to accomodate for faster renderings, but with less accuracy.

Virtual Reality N ow that a marker is identified, the video can be modified based on user input.

Virtual reality is perfect for this type of augmentation.


9/18

y C omputer Aided Design ( C AD) programsy Annimation Modeling programsy Virtual Reality Modeling L anguage (VRM L ) - tutorial y 3D Rendering programs - Blender (free software)

AR: Challenge for the WebI nitially AR was designed as a stand alone application at Univeristy of Washington's H uman I nterface Technology ( HI T) L ab -ARToolKit

The application needed to be installed and configured on the client machine.

This is NO T acceptable for the standard web user.

The solution: Flash based AR - FLARToolKit

FLARToolKitF lash has the ability to access the video camera and microphone.

Papervision3D 2.0 library can display 3D images in F lash.

The ARToolKit was ported from Java into F lash.

As a marker is identified, Action Script will attach 3D objects to the video.

FL ARToolKit is AS3 version of ARToolKit. But it is not ported from the original C version but ported from Java version which iscalled N yARToolKit. ( N yARToolKit seems to executes much faster than the original C version after the great effort of nyatla)

FL ARToolkit will detect the marker from input image and calculate the camera position in the three dimension space. Something likeH elper library are planned to add but further processing like synthesize the 3D G raphics needs to implemented by yourself. This


10/18

abstract was taken from the FL ARToolKit website located at http://www.libspark.org/wiki/saqoosha/ FL ARToolKit/en F or displayingthe 3D images FL ARToolKit uses the Papervision3D 2.0 library.

FLARToolKit Usagey When FL ARToolKit is downloaded, there are sample files installed.y There is a sample marker along with the supporting library files.y Print off the marker, turn on the camera, and test the sample: 'simple cube'y The webcam window will be launched and the ported ARToolKit will look for the marker.y The exported F lash movie can then be embedded into a website, giving the user SIM PLE AR.

The FL ARToolKit demo that we took to study off of was written in actionscript as stated above. The goal that we tried to achieve wasto import our own objects into a flash based AR. The simple cube demo allowed us to do this. I t had the simple functionality of beingable to detect a marker and display a 3D image on top of it. There were only a few places needing adjustment to customize it for our own objects and markers.

To create our own marker we use the pattern creator provided with the C version of the ARToolkit. I t launches a webcam window andtries to locate a marker inside of the image. Then all we have to do is click the mouse button once the marker is located in the windowand give it a file name. O nce the pattern is created we just need to replace the pattern name in the actionscript.

Replacing the 3D object is as simple as creating an object from our exported 3D model, explanation on that below, and adding it to the base node.

Custom Virtual ModelingBlender can export 3D objects, or 3D movies.

Steps

1. C reate the model of the object in Blender 2. Export using ActionScript plugin for Blender


11/18

3. Move the generated AS file, and import it into the master AS file4. C reate and attach the object to the base N ode() in the master AS file

I mplementing objects

1. C reate model in Blender 1. Model using primitives or vertexes if more detail were wanted.2. Join objects together so exports as one object3. I f texture is needed unwrap using smart projections

1. Export texture layout, add textures to faces in editing software.2. O pen image in uv image editor window in blender

4. Export object using the Actionscript plugin in Blender 1. L eave the package name blank, give it a class name.2. Select Papervision3D 2.0 from dropdown box.3. Select a location and click export.

2. Move generated .as file into folder with main actionscript file3. I n main actionscript file under any imports type import *.as; (* denotes class name)4. C reate an object of the imported class type.

1. The objects are inherited from the triangleMesh class this means they can be manipulated in the same way.2. C reated a scaleAll() method to adjust the size of the objects when rendered.

5. Add the object to the base N ode via base N ode.add C hild(obj)

Custom PatternsMake a black and white image (K. I .S.S.)

1. C reate a pattern file using the C language ARToolKit: mk_patt is the executable2. Webcam window pops up and will try to detect possible markers: red and green angles appear on potential markers3. C lick the mouse button to capture the pattern4. G ive it a file name and it is generated in same folder as executable file5. Replace the f larLogo.pat with your_pattern_name.pat


12/18

The ARToolKit works on Mac, not sure if it works on P C .

The file mk_patt is the executable.

Penn State AR

Penn State Example and marker


13/18

B lender Skins and TexturesBlender models are created with no lighting and no colors... being grey.

By " unwrapping " the model, it becomes a flat plane which can be textured.


14/18

After the model is created texturing needs to be done. I n Blender you are able to unwrap the model onto a flat plane so that you canapply textures to each face. This UV unwrapping can be tricky, but the best way to do it for our purposes was to select the object, gointo edit mode (tab), and hit the U key, and then selecting unwrap (smart projections). That lays the squares out as evenly as

possible. Then you can save the uv layout to a .tga file and make your texture off of that.


15/18


16/18

y G eneral Electric : Augmented Reality - See H ow I t Works y Mini automotive ad y

Topps 3DL

ive BaseballC

ards

Technology Interface

y ARToolKit v4.4 running on iPhone y Augmented Reality for Mobile y Second L ife Augmented Reality in Physical Space y Second L ife as a Platform for Augmented Reality

The Future of AR

y G izmondo Augmented Reality G ame y Augmented Reality GI S Maps y AR encyclopedia y BMW augmented reality

What's next?


17/18

Where do you take AR?

AR Resourcesy http://www.hitl.washington.edu/artoolkit/ y http://www.libspark.org/wiki/saqoosha/ FL ARToolKit/en y http://saqoosha.net/en/flartoolkit/start-up-guide/ y http://www.squidder.com/tag/flartoolkit/ y http://arsecondlife.gvu.gatech.edu/

Q uestions ???

Augmented Reality


18/18

Presentation and documentation are online @http://www.uwplatt.edu/web/presentations

Email: [email protected]

Copyright InformationC opyright Daniel M. F rommelt, 2009. This work is the intellectual property of the author. Permission is granted for this material to beshared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials andnotice is given that the copying is by permission of the author. To disseminate otherwise or to republish requires written permissionfrom the author.

Daniel M-Augmented Reality

Documents

Transcript of Daniel M-Augmented Reality