Weetfabriek KB: Virtual & Augmented Reality
-
Upload
robin-de-lange -
Category
Education
-
view
122 -
download
1
Transcript of Weetfabriek KB: Virtual & Augmented Reality
Slide 1
De Virtuele BibliotheekRobin de LangeDe Weetfabriek20 September 2016
Welcome everybody
Kind of ironic that Im on the Digital Entertainment Stage, as Im actually interested in any use of Virtual Reality other than entertainment.1
Wat betekenen Virtual en Augmented Reality voor de bibliotheek?
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
In my graduation project I could bring a lot of interests together.
I created an Augmented Reality application and focused on the influence it could have on the way we solve problems.
The app was an early prototype and mainly tried to raise questions and discussion.
How does this change the way we solve problems?How should education respond to these developments?
2
Robin de Lange - CVBachelorPhysicsPhilosophyArtificial Intelligence
MSc. Media TechnologyFocus: Extended cognition & Augmented Reality
EDUCATIONWORKOwner tutoring company
Video production 1st MOOC in the Netherlands
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
3
Graduation projectAugmented Reality prototype
Raise discussion
PhD proposal
https://dl.dropboxusercontent.com/u/20732302/Demo%20ARMath.wmv
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
In my graduation project I could bring a lot of interests together.
I created an Augmented Reality application and focused on the influence it could have on the way we solve problems.
The app was an early prototype and mainly tried to raise questions and discussion.
How does this change the way we solve problems?How should education respond to these developments?
4
Graduation projectAugmented Reality prototype
Raise discussion
PhD proposal
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
In my graduation project I could bring a lot of interests together.
I created an Augmented Reality application and focused on the influence it could have on the way we solve problems.
The app was an early prototype and mainly tried to raise questions and discussion.
How does this change the way we solve problems?How should education respond to these developments?
5
Robin de Lange - CVBachelorPhysicsPhilosophyArtificial Intelligence
MSc. Media TechnologyFocus: Extended cognition & Augmented Reality
EDUCATIONWORKOwner tutoring company
Video production 1st MOOC in the Netherlands
PhD researcher @ Media TechnologyPromotor: Bas Haring
Founder Lyceo CodeLab
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
After my graduation project I wanted to continue doing research, so I started doing part-time PhD research as a buitenpromovendus and went searching for funding.
At the same time I started doing all sorts of freelance work. The biggest project at the moment is the Lyceo CodeLab, where we teach high school children how to code.
6
2013: Oculus Rift
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Around 2014 I decided to change my focus of research from Augmented Reality to Virtual Reality. Devices like Google Glass were still a bit disappointing, while at the same time the Oculus Rift showed very promising results.
I bought an Oculus Rift in 2014 and was impressed with the experience. I played around with the different demos and started experimenting with creating VR content myself using Unity3D.
After this playing around it was time for a real project.7
Hack the Brain: Project BrainstormLive EEG data visualization for Oculus Rift
With Eva Delincakova & Bert Spaan @ Hack the Brain hackathon
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
A good occasion for this came by as I joined the Hack the Brain hackathon, organized by the Waag.
During this three day event the participants were challenged to hack the human brain. The Waag arranged EEG scanners and lots of help from neuroscientists, to see what people outside of the field could do with those devices.
Our project was a live visualization of the data from the EEG scanner through the Oculus Rift. You would put the Rift on, wear a cap full with electrodes and find yourself in a huge model of a brain. In this model you would see a live visualization of the alpha waves of your brain, measured by the different electrodes.
Its quite hard to get useful data from EEG sensors, but you could clearly see an increase in alpha waves when you became relaxed. This created an interesting form of feedback.8
Focus of research: phase I
In what ways can VR be used as a tool for learning?
What are the obstacles and opportunities for implementing VR in the field of education?
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
This project was a lot of fun and more importantly: it made me realize that it was possible to create an interesting VR prototype in just three days. This made me change the focus of my research to these two research questions:9
Method
Elective research course
Explorative qualitative research
Symposium
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Parallel to this research course I did explorative, qualitative research myself.
The challenge of my research is to form some sort of theoretical framework to understand the potential of VR for education a little better. For this, I have read a lot of papers, experienced many VR applications, went to VR meetups, hosted workshops, gave talks, written a lot and spoke to many different people.10
Virtual Reality for Science & EducationElective research course for 25 bachelor and master students
Exploring the potential of VR for science & education;
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
called Virtual Reality for Science & Education. This was an elective course for bachelor and master students with participants from many different directions. Media Technology, Computer Science, Psychology, Chemistry and archeology.
Part of the challenge of the course was to obtain skills to create interactive VR content. As a final project all the students created a VR prototype with a small group.11
Virtual Reality for Science & EducationExperience VR and analyze it as a medium
Obtaining skills to create interactive VR content using e.g. Unity3D and 360 film technology;
Creating a VR prototype as final project
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Analyse VR as a medium. During the course we took the time to analyze VR intensively. What sets it apart from screen-based media? What are the main characteristics.
During an earlier course we focussed on the relation between cinema and VR. In the first part of the course they learnt about the history of cinema. In the second part they explored to what extent the visual effects of cinema can be used in VR. Can we use editing? How does a green screen work? What does a split screen look like?Hier ook met studenten vanuit allerlei verschillende richtingenToen vooral nog veel first person ervaringen, zonder cuts of wat dan ook12
SymposiumWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
https://www.youtube.com/watch?v=hfYI9IJB4vc
13
Student projectsWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
14
Student projectsWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
https://www.youtube.com/watch?v=D7PfdWZTSB4
15
Student projects
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
16
Student projectsWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
https://www.youtube.com/watch?v=bVaE968FnUc
17
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Virtual Reality Learning Lab
Research & prototyping
Honours Class Learning through Virtual Reality
Development & implementation in educational practice
Open for collaboration
To start answering these questions I started doing research.
An important part of this was an elective course.18
A Brief History of VRVirtual Reality is not new
WWW. ROBINDELANGE .COMWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Lets first zoom out a bit and talk about the history of VR
The first thing to notice is that Virtual reality is not new.19
A Brief History of VRSensorama1955 by Morton HeiligExperience TheaterMulti-sensoryNo financial support
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
20
A Brief History of VRHeadsight1961 by Philco Corp.First Head Mounted DisplayMagnetic tracking systemLive stream from camera system
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
21
A Brief History of VRLEEP Cyberface1989By Eric HowlettFirst commercial HMDVery wide angle stereoscopic optics
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
22
A Brief History of VRNintendo Virtual Boy1995Monochromatic displayNo head-tracking, fixed positionCommercial failureFrom VR hype to disappointment
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
23
A Brief History of VR
https://youtu.be/tdAaU0CRHng?t=1m51sWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
24
A Brief History of VROculus Rift2012: Kickstarter campaignMuch wider FOVLow latency trackingAimed at consumer marketBenefits from developments in computer hardwareAcquired by Facebook in 2014Consumer version ships Q1 2016
https://www.youtube.com/watch?v=DhcOMOWRMnA
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
25
A Brief History of VRGoogle CardboardGift at 2014 Google I/OOpen source designStarting from $2Start of mobile VRMagnet as input button
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Everything that is needed for a VR experience is present in a recent smartphone. Gyroscopes for tracking26
27
State of the artDesktop VRPowered by desktopBest image qualityInteractive possibilitiesWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
28
State of the artDesktop VR
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
29
State of the artDesktop VRPowered by desktopBest image qualityInteractive possibilitiesWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
~ 2000 per systemNeeds lot of space
30
State of the artMobile VRPowered by smartphone~ 500 per system + BYOD
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Okay good image qualityLimited interaction
31
State of the artMobile VRPowered by smartphone~ 500 per system
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEOkay good image qualityLimited interaction
Desktop VRPowered by desktopBest image qualityInteractive possibilities~ 2000 per systemNeeds lot of space
32
VR content creationGAME ENGINESe.g. Unity3D
Combination of 3D designing and coding environment
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
The first way is to use a game engine, such as Unity3D. This is a combination of 3D designing and coding environment.33
VR content creationPHOTO / VIDEORicoh Theta or GoPro-based setup
Workflow similar to regular video
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
The second way is to use 360 cameras. The consumer versions, like this one, create a spherical photo or video with the click of a button. More advanced cameras usually consist of a clever combination of GoPro action cameras.34
VR content creationUSER GENERATEDExisting VR applications where users create content
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
A third type of creating VR content is within existing applications. Programs like VRChat or Beloola are large multiplayer worlds where you can easily create your own spaces and fill them with content for your class for example.35
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
36
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek als toegangspoort tot kennisVR als nieuwe informatiedrager
Bibliotheek als toegangspoort tot kennis
37
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
https://www.youtube.com/watch?v=MXGSvjryXSo
38
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek als toegangspoort tot kennisVR content lenen in de bibliotheek
Bibliotheek als toegangspoort tot kennis
39
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek voor mediawijsheidVR als nieuw medium
Bibliotheek als toegangspoort tot kennis
40
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek als toegangspoort tot kennisVR als nieuwe poort
Bibliotheek als toegangspoort tot kennis
41
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Een bibliotheek nabootsen in Virtual Reality is misschien niet zo spannend.
Maar wat als je een virtuele bibliotheek helemaal kunt inrichten voor de individuele gebruiker? Een bibliotheek die aansluit op wat de gebruiker al eerder heeft gelezen en wat anderen aanraden?
Niet beperkt tot de beschikbare boeken. Maar alle42
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
http://www.erikvlemmix.nl/images/LOOP.mp4
Een bibliotheek nabootsen in Virtual Reality is misschien niet zo spannend.
Maar wat als je een virtuele bibliotheek helemaal kunt inrichten voor de individuele gebruiker? Een bibliotheek die aansluit op wat de gebruiker al eerder heeft gelezen en wat anderen aanraden?
Niet beperkt tot de beschikbare boeken. Maar alle43
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
Een bibliotheek nabootsen in Virtual Reality is misschien niet zo spannend.
Maar wat als je een virtuele bibliotheek helemaal kunt inrichten voor de individuele gebruiker? Een bibliotheek die aansluit op wat de gebruiker al eerder heeft gelezen en wat anderen aanraden?
Niet beperkt tot de beschikbare boeken. Maar alle44
Virtual Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
https://www.youtube.com/watch?v=EYMJKDTBTao
45
Augmented Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
46
State of the artScreen-based ARReadily availableBYODImpressive resultsWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEToo much effortNo real 3D effect
47
State of the artGlasses-based ARIntegration with your experience of the worldAlways onWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE> 2000 per systemBulkyNot consumer-ready
48
State of the artWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
49
Augmented Reality in de bibliotheekWWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGEBibliotheek verrijken met digitale informatie
Bibliotheek als toegangspoort tot kennis
50
ARBieb
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
https://www.youtube.com/watch?v=LMc7_bgCuOU
51
Workshops
Op wat voor manieren kunnen we in VR de digitale collecties verkennen?
Met wat voor informatie kun je de bibliotheek verrijken?
Moet de bibliotheek VR content aanbieden?
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
However, many brainstorm sessions also showed that there are potential use cases for almost any field of study. Some fields are somewhat obvious, as 3D objects have an important role in that field of study. But there are also possibilities for fields which wouldnt come directly to mind.
52
Workshops
Mogelijkheden VR & AR voor bibliotheek verder verkennen
Meer demos ervaren
Ideen genereren en concepten maken
Aantal deelnemers: max 15
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
However, many brainstorm sessions also showed that there are potential use cases for almost any field of study. Some fields are somewhat obvious, as 3D objects have an important role in that field of study. But there are also possibilities for fields which wouldnt come directly to mind.
53
Demo & discussie
WWW. ROBINDELANGE.COM UNIVERSITEIT LEIDEN @ROBINDELANGE
However, many brainstorm sessions also showed that there are potential use cases for almost any field of study. Some fields are somewhat obvious, as 3D objects have an important role in that field of study. But there are also possibilities for fields which wouldnt come directly to mind.
54