3D-ICONS: Interactive storytelling through innovative interfaces, Carlotta Capurro, Daniel...

3D-‐ICONS: Interac1ve storytelling through innova1ve interfaces

Carlo<a Capurro, Daniel Ple1nckx Visual Dimension bvba

carlo<[email protected] [email protected]

This project has been funded with support from the European Commission‘s CIP ICT PSP programme

Click to edit Master 1tle style Introduc1on

!   Funded under the European Commission’s ICT Policy Support Programme

!   Built on the results of CARARE and 3D-‐COFORM EU

projects !   16 partners from across Europe (11 countries) with

relevant exper1se in 3D modelling and digi1za1on.

Click to edit Master 1tle style The 3D-‐ICONS Project

!   3D-‐ICONS provides Europeana with 3D models of architectural and archaeological monuments of remarkable cultural importance (World Heritage)

!   Purpose of the project: to produce around 4000 accurate 3D models, to be processed into a simpler form in order to be visualised also on low end personal computers and on the web.

!   Challenge for Cultural Heritage sector to bring their 3D models used for scien1fic & research purposes into the public domain

Click to edit Master 1tle style What is Europeana? h<p://www.europeana.eu

!   A huge database of informa1on about digital content

(metadata) held by European cultural heritage ins1tu1ons

–  Funded by the European Commission –  Supplied by a range of Best Prac1ces and other Pilot Projects as well as

directly by (larger) ins1tu1ons

!   Catalyst for new content services

–  Europeana services and tools, standards, Linked Open Data, … –  Hackathons – new content-‐based apps –  Europeana Research, next stage

!   Source of on-‐line exhibi1ons (engaging the public) !   Network of cultural heritage organisa1ons and exper1se

Click to edit Master 1tle style Guidelines:

!   The 3D-‐ICONS project exploits exis1ng tools and methodologies and integrates them in a complete supply chain of 3D digi1sa1on.

!   Creates a complete pipeline which covers all technical and logis1c aspects to create 3D models of cultural heritage objects with a variety of digi1sa1on techniques.

1. 3D Data Capture Techniques 2. Post Processing of 3D Content 3. 3D Publishing Methodology 4. Metadata 5. Licensing & IPR Considera1ons

Click to edit Master 1tle style 3D Data Capture Techniques:

Non-‐invasive

and

Non-‐destruc0ve

Non-‐contact systems (means that they do not require physical contact with poten1ally fragile artefacts and structures):

-‐ ac1ve

-‐ passive

Click to edit Master 1tle style 3D Data Capture Techniques:

l  Short Range Techniques

-‐ Laser Triangula1on (LT)

-‐ Structured Light (SL)

l  Long & Mid Range Techniques

-‐ Time of Flight (TOF)

-‐ Phase shig laser scanning (PS)

l  Mul1 Scale Image based Techniques

-‐ Tradi1onal Photogrammetry

-‐ Semi Automated Image Based Methods

Click to edit Master 1tle style Post Processing of 3D Content: •  A sequence of steps that result in the

direct improvement of acquired 3D data and its transforma1on into visually enriched geometric representa1ons.

•  It allows the crea1on of mul1ple 3D

models star1ng from the same gathered data according to the desired applica1on, level of detail and other addi1onal criteria.

•  The results are 3D geometric

representa1ons accompanied by complementary 2D media, which are the digital assets ready to be converted (or embedded) into the final web publishing formats.

Click to edit Master 1tle style Post Processing of 3D Content: Processing of point clouds data: involves cleaning and the alignment phases. Processing mesh data: transforma1on of point cloud data into a surface of triangular

meshes. Mesh Cleaning: filling holes, remove spikes, unreferenced ver1ces, and non-‐manifold edges. Mesh Simplifica1on: reduce the amount of data required to describe the surface of an

object while retaining the geometrical quality of the 3D model. Mesh retopologisa1on: generate a simpler version of the original dense model, by u1lising

the original topology as a suppor1ve underlying layer. Texture mapping: topological enhancement of low complexity geometry with special 2D

relief maps, that can carry high frequency informa1on about detailed topological features.

Click to edit Master 1tle style Post Processing of 3D Content:

•  Digital restora1on: -‐ Reconstruc1on of missing details based on the predic1on of their shape •  Hypothe1cal reconstruc1on:

-‐ Modeling based on addi1onal sources -‐ Valida1on by a range of different experts -‐ Document reconstruc1on process and uncertain1es

Click to edit Master 1tle style 3D Publishing Methodology:

Op1mal delivery and display of rich and complex 3D assets online.

-‐ 3D PDF

-‐ HTML5/WebGL Solu1ons

-‐ Unity -‐ Serious Games Solu1ons

-‐ Pseudo-‐3D (ObjectVR) solu1ons

-‐ 3DHOP (3D Heritage Online Presenter)

→ 3D Streaming

Click to edit Master 1tle style Metadata: The metadata provides key informa1on and

context data to five key areas: •  It describes in detail the artefact or monument and

its provenance

•  It describes in detail the digital representa1on of the artefact or monument and its online loca1on

•  It provides informa1on on technical methods u1lised in the digi1sa1on and modelling of heritage objects

•  It provides informa1on on the access, licensing and reuse of the created 3D models and any associated digital content

•  It enables the search and discovery of content through the mapping of metadata based on the Europeana Data Model (EDM)

Click to edit Master 1tle style Licensing & IPR Considera1ons:

In order for the effec1ve sharing and reuse of 3D content of heritage objects a common framework is required.

Example: Ename, Belgium

Archaeological site of Ename, Belgium

Ename

4D visualisation of evolution of the Ename abbey site (1065)

Ename


Interpreta1on of archaeology

Aerial photo of the archaeological site of Ename


Synthetic archaeology map with the first abbey highlighted


Conceptual model of buildings and terrain

Interpreta1on of sources

Depiction of the early Ename abbey (around 1100) in Viel Rentier (1275)

Object modelling

Blender model of building crane

Object modelling

Blender model of ferry boat

Object modelling

Painting of Dutch ferry boat (Salomon van Ruysdael, 1649)

Object modelling and behaviour

Animated Blender model of medieval chariot and horse

Object modelling and anima1on

13th century depiction of medieval chariot and horse (Viel Rentier)

Ename 1020

Resistivity measurements at the archaeological site of Ename

Ename 1020

Resistivity results of the archaeological site of Ename

E

B EA

AR

NS

TR A

AT

UC

EN

AM

LE

PE IN

St.-

SAL

V AT

R

TR A

A

O

S

T

N

0

A KKE R

BR A A K

A K KE R

WE ILA N D

WE ILA N D

BR A A K

RIE TV E LD

BR A A K

10.000

12.299

12.058

912.16

12.212

10.850

9.420

.5989

9815.

9.648 10.913

9.148

3659.

9.193

10.220

9.874

10.027

9.978

9.495

9 .251

9.030

149.0

10.0570710.7

9649.

79.9 2

9.869

9.068

9.755

9.696

9.629

569.5

9.4 94

9428.

9367.

.2899

.1749

9065.

9.216

9.414

9.568

9.672

7549 .

9.877

9.818

9.850

983.8

99.21

9.974 10.005

1 0.111

01.170

11920.

710.1810 4.1210.1 34

10.13810.128

10.131

10136.

9.9079942.

11.792

194

1 .7

9011.8

11965.

83311.

11 6.81

11.887

913.1

8

24.363

12.584

10.000

9.520

fenopal pa vilioen kijkenter

avs

enopa lwkt

F- a erfee

s

Dorpel elektri citei

tcabnei

pselu ntotp

p-udnaa rvoe de

GIN

-tkes te

vpsie-ijkvnr

evp-site-ke t

mepuntet

P

H

Hm

P

© Archaeological P r ospection Services of Southam pton

Ename, Belgium

0 100m

N

Ename 1020

Magnetometer results of the archaeological site of Ename

E

B EA

AR

NS

TR A

AT

UC

EN

AM

LE

PE IN

St.-

SAL

V AT

R

TR A

A

O

S

T

N

0

A KKE R

BR A A K

A K KE R

WE ILA N D

WE ILA N D

BR A A K

RIE TV E LD

BR A A K

10.000

12.299

12.058

912.16

12.212

10.850

9.420

.5989

9815.

9.648 10.913

9.148

3659.

9.193

10.220

9.874

10.027

9.978

9.495

9 .251

9.030

149.0

10.0570710.7

9649.

79.9 2

9.869

9.068

9.755

9.696

9.629

569.5

9.4 94

9428.

9367.

.2899

.1749

9065.

9.216

9.414

9.568

9.672

7549 .

9.877

9.818

9.850

983.8

99.21

9.974 10.005

1 0.111

01.170

11920.

710.1810 4.1210.1 34

10.13810.128

10.131

10136.

9.9079942.

11.792

194

1 .7

9011.8

11965.

83311.

11 6.81

11.887

913.1

8

24.363

12.584

10.000

9.520

fenopal pa vilioen kijkenter

avs

enopa lwkt

F- a erfee

s

Dorpel elektri citei

tcabnei

pselu ntotp

p-udnaa rvoe de

GIN

-tkes te

vpsie-ijkvnr

evp-site-ke t

mepuntet

P

H

Hm

P

© Archaeological P r ospection Services of Southam pton

Ename, Belgium

0 100m

N

Ename 1020

Reconstruction of Ename in 1020, before the abbey phase

Ename 1020

Reconstruction of Ename in 1020, trade settlement

Ename 1020

Reconstruction of Ename in 1020, harbour and castrum

Ename 1020

Reconstruction of Ename in 1020, harbour and Saint Salvator church

Ename 1020

Reconstruction of Ename in 1020, market place and Saint Salvator church

Workflow

Conceptual model of reconstructed buildings and terrain features

Workflow

Top view map in Photoshop

Workflow

Terrain types and applied height map (Vue)

Workflow

Terrain without vegetation (Vue)

Workflow

Terrain with water and vegetation after population (Vue)

Workflow

Terrain with vegetation, buildings and (animated) objects (Collada)

4D visualisa1on: 1020-‐1730

Procedural landscape simulation in Vue (1730)

Interac1ve storytelling

•  Exploration through POIs (points of interest)

– Panorama based (TimeScope) – ObjectVR based (TimeLine)

•  3D-ICONS approach

– ObjectVR based (9 periods + 1 evolution) – Linked sources (images)

Ename TimeScope

Ename TimeScope on the archaeological site

Ename TimeScope

Ename TimeScope (new version in 2013)

Ename TimeLine

Ename TimeLine (new version in 2014)

Thank You!

h<p://www.3dicons-‐project.eu

3D-ICONS: Interactive storytelling through innovative interfaces, Carlotta Capurro, Daniel...

Internet

Transcript of 3D-ICONS: Interactive storytelling through innovative interfaces, Carlotta Capurro, Daniel...