Mixed Reality Research: The European...

43
Mixed Reality Research: Mixed Reality Research: The European Dimension The European Dimension ISMAR 05 6/10/05 ISMAR 05 6/10/05 Eric Eric Badiqu Badiqu é é European Commission European Commission

Transcript of Mixed Reality Research: The European...

Page 1: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Mixed Reality Research: Mixed Reality Research:

The European Dimension The European Dimension

ISMAR 05 6/10/05ISMAR 05 6/10/05

Eric Eric BadiquBadiquééEuropean CommissionEuropean Commission

Page 2: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

European Institutions: a reminderEuropean Institutions: a reminder

European Council

-> represents the individual member states

European Parliament-> represents the EU’s citizens

European Commission-> upholds the interests of the Union as a whole

-> funding agency for EU-wide research through

‘Framework Programmes’ (FP)

-> Currently implementing FP6

Page 3: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Outline of presentationOutline of presentation

��European Programmes: European Programmes: Where are we Where are we today ?today ?

��Support to Mixed and Augmented Reality Support to Mixed and Augmented Reality researchresearch

��The future: Main trends and driversThe future: Main trends and drivers

��The proposal for the next Framework The proposal for the next Framework ProgrammeProgramme

��Options for supporting MR researchOptions for supporting MR research

��ConclusionConclusion

Page 4: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

core technologies & core technologies & ““pullpull--throughthrough”” applicationsapplications

components & components & µµ systemssystemsKnowledge & interface Knowledge & interface

technologiestechnologies

Communication, computing Communication, computing

& software technologies& software technologies

CommunicationCommunication

& networking& networkingSoftwareSoftware

µµ , , nanonano & & optoopto

electronicselectronics

µµ and and nanonano

systemssystems

Knowledge Knowledge

technologiestechnologiesInterfacesInterfaces

Applied IST for societal and economic challengesApplied IST for societal and economic challenges

Trust &Trust &

Security Security

IST for societal IST for societal

challenges challenges

IST for work & businessIST for work & business

challenges challenges

IST for content IST for content

and cultural heritageand cultural heritage

Information Society Technologies (2003Information Society Technologies (2003--2006)2006)

Future & Emerging Technologies

3.8 B€

/ 4 years

Page 5: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

�� Integrated ProjectsIntegrated Projects (IPs) (IPs) �� Integrate a critical mass of activities and resources Integrate a critical mass of activities and resources �� Ambitious objectives of a clear European dimensionAmbitious objectives of a clear European dimension

�� Specific Targeted Research ProjectsSpecific Targeted Research Projects (STREPs) (STREPs) �� Improves existing or develops new products, processes or serviceImproves existing or develops new products, processes or services s �� Proves the viability of new technologiesProves the viability of new technologies

�� Networks of ExcellenceNetworks of Excellence (NoEs) (NoEs) �� Overcome the fragmentation of the European research landscape inOvercome the fragmentation of the European research landscape in a given a given

areaarea�� Establish a Establish a durabledurable restructuring/shaping and integration of effortsrestructuring/shaping and integration of efforts

�� Coordination ActionsCoordination Actions ((CAsCAs) ) andand Specific Support ActionsSpecific Support Actions ((SSAsSSAs))�� Support, networking, coSupport, networking, co--ordination of research and innovation activitiesordination of research and innovation activities

Types of projects: Forgive the jargon..Types of projects: Forgive the jargon..

Page 6: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

1.0

43,1

7

496,5

3

26,7

8 1.0

68,2

0

110,0

2

2.7

44,7

0

0500

10001500200025003000

Millions

Total Funding per Call

Call 1 Call 2 Call 3 Call 4 Other calls Grand Total

740* projects launched

so far…

..for a total of

2.74 BEuros

* Call 4 under negotiation

219146

44

276

55

740

0

100

200

300

400

500

600

700

800

Total Number of retained projects per Call

Call 1 Call 2 Call 3 Call 4 Other calls Grand Total

Page 7: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

3.625

1.688

426

3.401

489

9.629

0

2000

4000

6000

8000

10000

Ca

ll 1

Ca

ll 2

Ca

ll 3

Ca

ll 4

Oth

er

calls

Gra

nd

To

tal

Total Number of Participants per Call

More than 9600

participating organisations

Page 8: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Average Project Funding per Instrument (Call 1-4)

4,85

2,290,84

8,94

0,91

0

2

4

6

8

10

CA IP NOE SSA STREP

Mil

lio

ns

Concentration of efforts

on more strategic

projects…

Number of Projects per Instrument

(Call 1-4 / Total =740)

42

167

51

102

378

CA

IP

NOE

SSA

STREP

Total Funding per instrument (call 1-4)

1.507,53

859,52

2.744,70

72,43268,86

36,350

500

1000

1500

2000

2500

3000

CA IP NOE SSA STREP Grand Total

Mil

lio

ns

Total Funding per instrument (call 1-4)

1%

55%

10%

31%

3%

CA

IP

NOE

SSA

STREP

Page 9: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

inteliGRID – 2 M€Semantic Grid based virtual organisations

Provenance – 2M €Trust and provenance

for Grids

DataminingGrid - 1.8 M€

Dataminingtools & services

UniGridS – 1.9M€

Extended OGSAImplementation based

on UNICORE

K-WF Grid – 1.7M€Knowledge based

workflow & collaboration

GRIDCOORDBuilding the ERA in Grid research

960 K€

A A coherentcoherent set set ofof projectsprojectsExampleExample: : GridGrid ResearchResearch

OntoGrid – 2.6 M€

Knowledge Services for the semantic Grid

HPC4U – 1.7 M€Fault tolerance,dependability

for Grid

Grid-based generic enabling

application technologies to facilitatesolution of industrial problems

SIMDAT – 11 M€

EU-driven Grid services architecture for businesS

and industry

NextGRID - 11 M€

Mobile Grid architecture and services for dynamic

virtual organisations

Akogrimo - 7 M€

European-wide virtual laboratory for longer term Grid

research-creating the foundation for next generation Grids

CoreGRID – 8.2 M€

Specific support action Integrated project Network of excellence Specific targeted research project

Page 10: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Austrian participation in the ProgrammeAustrian participation in the Programme

Call 1 Call 1 –– 3 3

– 196 participations – 18 coordinations

– Financial contribution: 47 MEuros (2.9%)

–– Top 5 ParticipantsTop 5 Participants•JOANNEUM RESEARCH

•ARC SEIBERSDORF RESEARCH GMBH

•UNIVERSITAET INNSBRUCK

•KARL-FRANZENS-UNIVERSITAET GRAZ

•TECHNISCHE UNIVERSITAET WIEN

– Main domains of activity•Dependability and security

•Embedded Systems

•Semantic-based Knowledge Systems

•e-Health

•e-Culture

•Applications for mobile workers

•Micro and Nano systems

Call 4Call 4

– 95 participations – 10 coordinations

– Financial contribution: 38 MEuros (3.5%)

-> Under negotiation

Page 11: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Outline of presentationOutline of presentation

��European Programmes: European Programmes: Where are we Where are we today ?today ?

��Support to Mixed and Augmented RealitySupport to Mixed and Augmented Realityresearchresearch

��The future: Main trends and driversThe future: Main trends and drivers

��The proposal for the next Framework The proposal for the next Framework ProgrammeProgramme

��Options for supporting MR researchOptions for supporting MR research

��ConclusionConclusion

Page 12: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Between 1999 and 2004: more than 40 projects related to MRBetween 1999 and 2004: more than 40 projects related to MR

1 Action Line on ‘Mixed Realities and New Imaging Systems’

25 projects

� key technologies

– high realism visualisation– computer vision – active 3D-acquisition– mixing of real and synthetic live action in

virtual studios – animation’ & virtual humans– Augmented Reality – 3D displays (single and multi-user)

� Applications

– MR authoring and digital story telling– Large screen MR experiences for

entertainment – MR for design and education – MR for industrial maintenance and training– VR for team working– shared AR-based working spaces for

architecture design– AR-based interior design and e-Commerce– Enhanced interactive TV experience– Cultural and industrial applications of AR– 3D TV

Other activities within the Programme

–– AR guide for museums AR guide for museums –– MR for artistic expressionMR for artistic expression–– MR for presence researchMR for presence research–– AR and VR for mental health applicationsAR and VR for mental health applications–– AR for minimal invasive surgeryAR for minimal invasive surgery–– MR for tourism applicationsMR for tourism applications–– VR for emergency simulationsVR for emergency simulations

FP5 (1999FP5 (1999--20042004))–– Overall 40+ projects Overall 40+ projects –– Estimated funding: 70MEstimated funding: 70M€€ ++

Page 13: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Current frameworkCurrent framework

FP6 (2003FP6 (2003--2006)2006)

No dedicated action lineNo dedicated action line

–– 8 projects8 projects–– < 20 M< 20 M€€ EC contributionEC contribution–– Areas of activityAreas of activity

•• Virtual environments in the work placeVirtual environments in the work place•• Scalable VR platformsScalable VR platforms•• CrossCross--media content productionmedia content production•• VR for VR for medecinemedecine•• HapticHaptic interfaces for virtual environmentsinterfaces for virtual environments•• Increased realism for computer gamesIncreased realism for computer games•• AR for industrial maintenanceAR for industrial maintenance•• ……

Page 14: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Example: INTUITION Network of ExcellenceExample: INTUITION Network of Excellence

““Virtual reality and virtual environments for futureVirtual reality and virtual environments for future

work spaceswork spaces””

48 Months 48 Months –– 6 M6 M€€ funding funding –– 58 partners58 partners

Working groupsWorking groups

–– AerospaceAerospace–– Automotive and TransportAutomotive and Transport–– ConstructionsConstructions–– EnergyEnergy–– Engineering/DesignEngineering/Design–– Entertainment and CultureEntertainment and Culture–– Evaluation and TestingEvaluation and Testing–– Education and TrainingEducation and Training–– HapticHaptic InteractionInteraction–– Medicine/NeuroscienceMedicine/Neuroscience–– VR / VE TechnologiesVR / VE Technologies

Page 15: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Reduced supportReduced support

� Only one large related initiative supported

� MR-related activities scattered around Programme

� No coordinated activity covering MR

� Very little visible activity on MR-enabling technology

� Has support been reduced at National level (in other

regions) as well ?

� Has the hype faded away or have we missed an

opportunity?

�Should this domain be

reinforced in next

framework ?

Page 16: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Where is MR on the hype cycle?Where is MR on the hype cycle?

Technology Trigger

Peak of Inflated Expectations

Trough of Disillusionment

Slope of Enlightenment

Plateau of Productivity

Maturity

Visibility

As of June 2003

WirelessFidelity and

802.11b

Text-to-Speech and Speech Synthesis

Speech Recognition for Telephony and Call Centers

VoIP

PKI

Mobile Payments

Location "Aware" Services and Technology

Peer-to-Peer Technologies

Internal Web Services

External Web Services

Deployments

Open Source Web Infrastructure Servers

Open Source Desktop Applications

Public Sector Vertical Applications

Biometrics

Natural Language Search

Smart Cards

Semantic Web

E-Tags

16

Page 17: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Outline of presentationOutline of presentation

��European Programmes: European Programmes: Where are we Where are we today ?today ?

��Support to Mixed and Augmented Reality Support to Mixed and Augmented Reality researchresearch

��The future: Main trends and driversThe future: Main trends and drivers

��The proposal for the next Framework The proposal for the next Framework ProgrammeProgramme

��ConclusionConclusion

Page 18: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

EuropeEurope’’s Challengess Challenges

�� GlobalGlobal

–– Increasing global competition Increasing global competition –– DeDe--localisation localisation ((including of R&D !including of R&D !))

–– R&D investment gapR&D investment gap

�� SocietalSocietal

–– Ageing populationAgeing population–– SecuritySecurity–– TransportationTransportation–– EnvironmentEnvironment–– EnergyEnergy–– Content and cultureContent and culture

Source: IDATE (for EU-15); OECD

35%34%18%ICT R&D as % Total R&D

400€.350€80 €Investments / inhabitant

127 m296 m383 mInhabitants

11 B€20 B€8 B€Public sector investments

40 B€83 B€23 B€Private sector investments

JapanUSEU-15ICT R&D

Page 19: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Information and Communication Technologies Information and Communication Technologies

Key to Future Wealth & WelfareKey to Future Wealth & Welfare

�� ICT ICT –– a key enabler for productivity growth & competitivenessa key enabler for productivity growth & competitiveness–– ICT investments contribute half of EuropeICT investments contribute half of Europe’’s productivity gainss productivity gains

�� ICT ICT –– an important sector in its own rightan important sector in its own right–– From 4% of EU GDP in early 90s to more than 6% todayFrom 4% of EU GDP in early 90s to more than 6% today

�� ICT ICT –– a facilitator for more efficient public servicesa facilitator for more efficient public services–– ICT also allows more participation in democracy and public lifeICT also allows more participation in democracy and public life

�� ICT ICT –– providing tools for addressing societal challenges providing tools for addressing societal challenges –– Ageing population, health and social care, security etc.Ageing population, health and social care, security etc.

�� ICT ICT –– underpinningunderpinning progressprogress in in allall science & science & technologytechnology fieldsfields–– GGÉÉANT, the worldANT, the world--leading research network, Grid infrastructures etc.leading research network, Grid infrastructures etc.

Page 20: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

The way to increase Europe competitiveness ?The way to increase Europe competitiveness ?

““Creating value from new Creating value from new knowledge resulting from knowledge resulting from research and innovationresearch and innovation””

�� More R&D investmentMore R&D investment

�� More researchers and a more More researchers and a more attractive environmentattractive environment

�� More mobilityMore mobility

�� More competition to stimulate More competition to stimulate excellenceexcellence

�� Better coordination of National Better coordination of National research effortsresearch efforts

�� Better innovation systemsBetter innovation systems R&D

Spending

Lemonde/OECD

Triadic

patents

DG RTD

/OECD

Page 21: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Joining forces to

Reach critical mass

R&D expenditure of

EU 25 compared

with top 10 multinationals

Page 22: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

R&D: What for ?R&D: What for ?

The 7 years horizonThe 7 years horizon

““everything that can be invented has been inventedeverything that can be invented has been invented””

Charles H. Charles H. DuellDuell, Commissioner of the U.S. Office of Patents, , Commissioner of the U.S. Office of Patents, 18991899

""there is a world market for maybe five computersthere is a world market for maybe five computers""

Thomas Watson, chairman of IBM, 1943Thomas Watson, chairman of IBM, 1943

""there is no reason anyone would want a computer in there is no reason anyone would want a computer in

their hometheir home""

Ken Olson, founder of Digital Equipment Corp., 1977 Ken Olson, founder of Digital Equipment Corp., 1977

Page 23: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

A few of the opportunities ?A few of the opportunities ?

�� TechnologyTechnology–– Mixed Reality and 3DMixed Reality and 3D–– Search technologySearch technology–– AudioAudio--Visual NetworksVisual Networks–– Sensor networksSensor networks–– Cognitive systemsCognitive systems–– ....

�� Applications Applications –– Visual interfacesVisual interfaces–– LocationLocation--based servicesbased services–– Gaming and entertainmentGaming and entertainment–– Ambient assisted livingAmbient assisted living–– New forms of content and HDNew forms of content and HD–– Multimodal communicationMultimodal communication–– ……

Page 24: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

�� Understanding user requirementsUnderstanding user requirements

�� Understanding business and marketsUnderstanding business and markets

�� Regulatory frameworkRegulatory framework

�� StandardsStandards

�� Take up and innovationTake up and innovation

Changing the mindset..Changing the mindset..

-- How can we better exploit research results ? How can we better exploit research results ?

-- How can we create more successful startHow can we create more successful start--ups ?ups ?

-- How can we further promote an entrepreneur culture ? How can we further promote an entrepreneur culture ?

-- How can How can youyou help ?help ?

More than just technology and research..More than just technology and research..

Page 25: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Outline of presentationOutline of presentation

��European Programmes: European Programmes: Where are we Where are we today ?today ?

��Support to Mixed and Augmented Reality Support to Mixed and Augmented Reality researchresearch

��The future: Main trends and driversThe future: Main trends and drivers

��The proposal for the next Framework The proposal for the next Framework ProgrammeProgramme

��Options for supporting MR researchOptions for supporting MR research

��ConclusionConclusion

Page 26: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

FP7 Specific Programmes: 2007 FP7 Specific Programmes: 2007 -- 20132013

Collaborative R&D: 44 B€ (61%)Basic research: 12 B€ (16%)

People: 7 B€ (10%)

Research infrastructure: 7 B€ (10%)JRC: 1.8 B€ (3%)

Commission proposal (April 6)Commission proposal (April 6)

Page 27: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Collaborative Research ThemesCollaborative Research Themes

Health: 8 B€ (18%)

Food, agri, biotech: 2.4 B€ (6%)

Information & Communication

Technologies: 12 B€ (28%)

Nano, materials, production: 4.8 B€ (11%)

Energy: 2.9 B€ (7%)

Environment: 2.5 B€ (6%)

Transport: 5.9 B€ (13%)

Socio-econ research: 800 m€ (2%)

Space and security: 3.9 B€ (9%)

Commission proposal (April 6)Commission proposal (April 6)

Page 28: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

FP7 FP7 –– Continuity & New ImpetusContinuity & New Impetus

�� ContinuityContinuity–– European Research AreaEuropean Research Area–– Thematic prioritiesThematic priorities–– ResearcherResearcher’’s mobilitys mobility–– SME measuresSME measures

--> Seven years duration> Seven years duration

�� New ImpetusNew Impetus–– Joint Technology InitiativesJoint Technology Initiatives–– European Research CouncilEuropean Research Council–– New research infrastructuresNew research infrastructures–– Flexible instrumentsFlexible instruments

--> Doubling of budget ??> Doubling of budget ??

Commission proposal (April 6)Commission proposal (April 6)

Page 29: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

TimetableTimetable

FP6

FP7

New Financial Perspectives

2003 2004 2005

2007 - 2013

2006

Call 4 Call 5

Adoption

FP7, SPs, RfP

proposals

Communication on

FP7 orientationsFP7 Work Programmes + Calls

Communication on

new financial perspectives

2007 - 2013

Legislative proposals

Agreement

Call 1 Call 2 Call 3

?

Page 30: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Outline of presentationOutline of presentation

��European Programmes: European Programmes: Where are we Where are we today ?today ?

��Support to Mixed and Augmented Reality Support to Mixed and Augmented Reality researchresearch

��The future: Main trends and driversThe future: Main trends and drivers

��The proposal for the next Framework The proposal for the next Framework ProgrammeProgramme

��Options for supporting MR researchOptions for supporting MR research

��ConclusionConclusion

Page 31: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Integration Environments

Personal environments

Intelligent infrastructures

Robotic systems

Home environments

Nano-electronics, photonics and micro/nano-systems

CommunicationNetworks

Embedded systems,Computing andcontrol

Software, Grids,Security anddependability

Knowledge, cognitiveand learning systems

Simulation, visualisationInteraction and mixedRealities

New perspectives in ICTDrawing on other science and technology disciplines

FET

Technology pillars

Societal challenges

Business and industry

Content, creativity and personal development

Applications research

Trust and confidence

Proposed structureProposed structure

Page 32: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

RationaleRationale

�� Growing demand for increasingly interactive and visual contentGrowing demand for increasingly interactive and visual content

�� Emergence of rich multimodal interpersonal communication Emergence of rich multimodal interpersonal communication systems systems

�� Need for industry and creators to efficiently prototype new desiNeed for industry and creators to efficiently prototype new designsgns

key importance of simulation, visualisation, interaction and key importance of simulation, visualisation, interaction and MR technologiesMR technologies

help European industry concentrate on highhelp European industry concentrate on high--value segments value segments of the market where design and content play a key roleof the market where design and content play a key role

new enabling technology domain to provide basis for new, new enabling technology domain to provide basis for new, valuevalue--added products, systems and servicesadded products, systems and services

�� Existing research efforts are fragmented Existing research efforts are fragmented

�� MultiMulti--disciplinary and collaborative approaches to research are disciplinary and collaborative approaches to research are essentialessential

Page 33: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

A new A new ““Technology pillarTechnology pillar””: Simulation, visualisation, : Simulation, visualisation,

interaction and mixed realityinteraction and mixed reality

�� Tools for innovative design, creativity in products, services anTools for innovative design, creativity in products, services and d digital audiodigital audio--visual mediavisual media

�� Tools for augmented personal capacities and new ways to Tools for augmented personal capacities and new ways to interact with technology, machines, devices and other artefactsinteract with technology, machines, devices and other artefacts

“Integration Environments”Examples:

• closed loop system for surgery training and operation support• integration of design, interaction (AR) and knowledge management for augmented engineering

Page 34: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Interaction and MRInteraction and MR

�� VisionsVisions–– Interaction within distributed environmentsInteraction within distributed environments

•• Create presence Create presence –– provide applications supportprovide applications support–– Richer interactionsRicher interactions

•• Natural behaviour Natural behaviour –– affective, motivating and engaging interactionsaffective, motivating and engaging interactions–– Richer mixedRicher mixed--reality environmentsreality environments

•• Populated worlds Populated worlds –– content and creativitycontent and creativity–– Ease of useEase of use

•• Ubiquitous cross platform usage conceptsUbiquitous cross platform usage concepts

�� ChallengesChallenges–– MultiMulti--disciplinaritydisciplinarity (CV/CG/interfaces/different modalities..)(CV/CG/interfaces/different modalities..)–– Interactive entities (intelligence Interactive entities (intelligence -- realistic interactions)realistic interactions)–– Human perceptions (how do we perceive MR environments?)Human perceptions (how do we perceive MR environments?)–– Better interfaces (interaction concepts Better interfaces (interaction concepts –– integration in standard apps)integration in standard apps)–– Usability (Usability (ergonomyergonomy, cost, reliability..), cost, reliability..)

Page 35: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Key enablers for future research ?Key enablers for future research ?

–– reusable components, modules and frameworksreusable components, modules and frameworks–– open standards, specifications, architectures and open sourceopen standards, specifications, architectures and open source–– new algorithms, models and toolsnew algorithms, models and tools–– better interfaces, displays and devicesbetter interfaces, displays and devices–– specialised processors and advanced rendering techniquesspecialised processors and advanced rendering techniques–– secure and commoditised high performance computing and Gridssecure and commoditised high performance computing and Grids–– usability issues usability issues –– cognitive sciencescognitive sciences–– Involvement of creative sectorInvolvement of creative sector

And also..And also..

–– endend--users involvementusers involvement–– societal and economic impacts of new technologysocietal and economic impacts of new technology–– bridges between the academic community and industry (emphasis onbridges between the academic community and industry (emphasis on

proofproof--ofof--concept, demonstrators and testconcept, demonstrators and test--beds) beds)

Page 36: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

Consultation process Consultation process –– contributions welcomecontributions welcome

For ICT in general and MR ++ in particular:For ICT in general and MR ++ in particular:

�� What are the main trends and challenges?What are the main trends and challenges?

�� What are the enablers?What are the enablers?

�� What are the main research issues?What are the main research issues?

�� Who should be involved?Who should be involved?

�� What is the rationale for EUWhat is the rationale for EU--level intervention?level intervention?

Time frame: end 05 Time frame: end 05 –– early 06early 06

Could a common position

on MR/AR be contributed ?

Page 37: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

MRMR--specific issuesspecific issues

�� Is the field mature ?Is the field mature ?

�� What can MR contribute to the solving of societyWhat can MR contribute to the solving of society’’s problem and to s problem and to industrial innovation ?industrial innovation ?

�� How should the field be covered in future R&D Programmes ? How should the field be covered in future R&D Programmes ? (technology (technology –– integration integration -- applications ?)applications ?)

�� Does the current thinking bringing simulation, visualisation, Does the current thinking bringing simulation, visualisation, interaction and MR together make sense to you ?interaction and MR together make sense to you ?

�� Is it necessary to get organised on a large scale or is it bettIs it necessary to get organised on a large scale or is it better to let er to let things evolve organically ?things evolve organically ?

�� Is it important to develop joint projects with nonIs it important to develop joint projects with non--European teams ?European teams ?

Page 38: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

ConclusionsConclusions

��EU programmes play an important role in structuring research EU programmes play an important role in structuring research activities in Europeactivities in Europe

��MR/AR/VR benefits significantly from EU research MR/AR/VR benefits significantly from EU research programmes (with ups and down)programmes (with ups and down)

��Information and Communication Technologies can help Information and Communication Technologies can help Europe respond to serious global and societal challenges Europe respond to serious global and societal challenges

��MR can help provide some of the answers: MR can help provide some of the answers: YouYou need to show need to show howhow

��We need your support to refine future research prioritiesWe need your support to refine future research priorities��Beyond R&D, it is important to further develop a culture of Beyond R&D, it is important to further develop a culture of

entrepreneurship and innovation and entrepreneurship and innovation and youyou can help. can help.

Page 39: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

For Further InformationFor Further Information

IST IST infodeskinfodeskEE--Mail : Mail : [email protected]@cec.eu.intFax : +32 2 296 83 88Fax : +32 2 296 83 88

IST:IST:

http://http://www.cordis.lu/ist/contactswww.cordis.lu/ist/contacts

General FP6/FP7:General FP6/FP7:http://europa.eu.int/comm/research/fp6/http://europa.eu.int/comm/research/fp6/

……./research/future/./research/future/index_en.cfmindex_en.cfm

Page 40: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

On to youOn to you……

�� How important is European How important is European Research to you ?Research to you ?

�� Do you think the new Do you think the new orientations taken at the orientations taken at the beginning of FP6 will lead to beginning of FP6 will lead to success ? success ?

�� What should be the main What should be the main priorities for FP7 ?priorities for FP7 ?

�� What needs to be changed ?What needs to be changed ?

�� ……

Page 41: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

SimulationSimulation

�� VisionsVisions–– MultiMulti--parametric and multiparametric and multi--level simulationslevel simulations

–– Interactive and realInteractive and real--time simulationstime simulations

–– Social simulationsSocial simulations

–– Complex systemsComplex systems

–– Predictive powerPredictive power

–– Personalised interventionsPersonalised interventions

�� ChallengesChallenges–– Coping with uncertaintyCoping with uncertainty

–– Integrating simulation and experimentIntegrating simulation and experiment

–– Scalable hierarchies and simulation couplingScalable hierarchies and simulation coupling

–– Better models, algorithms, parameters and toolsBetter models, algorithms, parameters and tools

–– Expert interactionExpert interaction

Page 42: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

VisualisationVisualisation

�� VisionsVisions–– True ImmersionTrue Immersion

–– Interactive visualisationInteractive visualisation

–– ‘‘SmartSmart’’ visualisationvisualisation

–– A A ““universal universal visualiservisualiser””

�� ChallengesChallenges–– Handling large datasetsHandling large datasets

–– MultiMulti--dimensional visualisationdimensional visualisation

–– PurposePurpose--driven realismdriven realism

–– Processing, rendering and display technologiesProcessing, rendering and display technologies

–– Integrated visualisationIntegrated visualisation

Page 43: Mixed Reality Research: The European Dimensioncampar.in.tum.de/twiki/pub/ISMAR/WebHome/badique_ismar05.pdf1.043,17 496,53 26,78 1.068,20 110,02 2.744,70 0 500 1000 1500 2000 2500 3000

IntegrationIntegration

�� VisionsVisions–– Closing the LoopClosing the Loop

–– HumanHuman--inin--thethe--LoopLoop

–– UserUser--centred approachescentred approaches

–– Seamless environmentsSeamless environments

–– Integration across distributed environmentsIntegration across distributed environments

–– Going mainstreamGoing mainstream

�� ChallengesChallenges–– InteroperabilityInteroperability

–– Application integrationApplication integration

–– Building the communityBuilding the community