CONTENTUS—A Semantic Multimodal Search User Interface
-
Upload
johannes-p-osterhoff -
Category
Technology
-
view
1.613 -
download
0
Transcript of CONTENTUS—A Semantic Multimodal Search User Interface
![Page 1: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/1.jpg)
More than the Sum of its Parts
CONTENTUS— A Semantic Multimodal Search User Interface
Jörg Waitelonis, Johannes Osterhoff, Harald Sack
Visual Interfaces to the Social and Semantic Web (VISSW 2011) In conjunction with the International Conference on Intelligent User Interfaces (IUI 2011), J. Osterhoff, February 13, 2011
![Page 2: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/2.jpg)
CONTENTUS? A Teaser
Semantic Search Engine
Cultural Heritage Domain
Media types
Articles, Books, Video, Audio, …
People, Locations, …
Part of the HPI research project
Semantic Media Explorer
VISSW 2011 | Johannes Osterhoff | February 13, 2011
2
![Page 3: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/3.jpg)
CONTENTUS? A Teaser
VISSW 2011 | Johannes Osterhoff | February 13, 2011
3
![Page 4: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/4.jpg)
Issue #1
How to find the needle
in the haystack?
VISSW 2011 | J. Osterhoff | February 13, 2011
4
![Page 5: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/5.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
5
Image:
iSto
ckphoto
![Page 6: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/6.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
6
needle
![Page 7: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/7.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
7
Google Results
![Page 8: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/8.jpg)
Needless to say…
8
needless
VISSW 2011 | J. Osterhoff | February 13, 2011
![Page 9: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/9.jpg)
“needle”
VISSW 2011 | J. Osterhoff | February 13, 2011
9
![Page 10: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/10.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
10
Jimmy Needles American basketball coach
1900—1969
Person Image:
Jay P
. Lee
![Page 11: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/11.jpg)
“needle”
VISSW 2011 | J. Osterhoff | February 13, 2011
11
![Page 12: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/12.jpg)
Needles, CA
VISSW 2011 | J. Osterhoff | February 13, 2011
12
Location
Image:
Eddie
Big
gs
![Page 13: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/13.jpg)
“needle”
VISSW 2011 | J. Osterhoff | February 13, 2011
13
![Page 14: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/14.jpg)
“Needle”
VISSW 2011 | J. Osterhoff | February 13, 2011
14
Blockbuster by John V. Soto from 2010
Film
Image:
IMD
B
![Page 15: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/15.jpg)
Issue #1
How to find different “needles”
in the haystack?
VISSW 2011 | J. Osterhoff | February 13, 2011
15
![Page 16: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/16.jpg)
Issue #2
How to present
“needles”
as search results?
VISSW 2011 | J. Osterhoff | February 13, 2011
16
![Page 17: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/17.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
17
Google Results
![Page 18: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/18.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
18
Flickr Results
![Page 19: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/19.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
19
YouTube Results
![Page 20: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/20.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
20
Wikipedia Results
![Page 21: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/21.jpg)
Issue #2
How to present
different “needles”
as distinguishable
search results
on one page?
VISSW 2011 | J. Osterhoff | February 13, 2011
21
![Page 22: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/22.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
22
Why?
![Page 23: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/23.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
23
30,000+ Libraries in Germany
![Page 24: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/24.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
24
30,000+ Libraries in Germany
![Page 25: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/25.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
25
Books
Image:
Lib
rary
of
Congre
ss
![Page 26: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/26.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
26
Articles
![Page 27: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/27.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
27
Video
Image:
Lib
rary
of
Congre
ss
![Page 28: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/28.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
28
Audio
![Page 29: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/29.jpg)
Issue #3
How to make the German
cultural heritage available?
VISSW 2011 | J. Osterhoff | February 13, 2011
29
![Page 30: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/30.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
30
Authors i.e. Bertolt Brecht
![Page 31: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/31.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
31
Years i.e. 1848
![Page 32: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/32.jpg)
People i.e. from Ulm
![Page 33: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/33.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
33
Locations among many others…
Image:
Wik
ipedia
(Soft
eis
)
![Page 34: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/34.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
34
Music Style
Image:
Wik
ipedia
![Page 35: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/35.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
35
Process Chain
HPI Research
![Page 36: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/36.jpg)
Books, Articles, Video, Audio
Authors, Year of Creation,
People, Locations, Music Styles,
Organizations etc.
VISSW 2011 | J. Osterhoff | February 13, 2011
36
Media Assets
Cultural Categorizations
On the Interface
![Page 37: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/37.jpg)
Issue #3
How to make the German
cultural heritage available
in meaningful
information retrieval?
VISSW 2011 | J. Osterhoff | February 13, 2011
37
![Page 38: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/38.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
38
![Page 39: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/39.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
39
1. What is CONTENTUS?
2. Interface Design
3. Demonstration of the System
4. Summary
![Page 40: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/40.jpg)
What is CONTENTUS? Introduction
■ a semantic search engine and a multimedia
retrieval system
VISSW 2011 | Johannes Osterhoff | February 13, 2011
40
![Page 41: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/41.jpg)
What is CONTENTUS? Introduction
■ a semantic search engine and a multimedia
retrieval system
■ web-based graphical user interface
VISSW 2011 | Johannes Osterhoff | February 13, 2011
41
![Page 42: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/42.jpg)
What is CONTENTUS? Introduction
■ a semantic search engine and a multimedia
retrieval system
■ web-based graphical user interface
■ content-based suggestions and
a multi-modal presentation of
search results to support semantic search
VISSW 2011 | Johannes Osterhoff | February 13, 2011
42
![Page 43: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/43.jpg)
What is CONTENTUS? Introduction
■ a semantic search engine and a multimedia
retrieval system
■ web-based graphical user interface
■ content-based suggestions and
a multi-modal presentation of
search results to support semantic search
■ developed in the context of the German
research project THESEUS
VISSW 2011 | Johannes Osterhoff | February 13, 2011
43
![Page 44: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/44.jpg)
What is CONTENTUS? Introduction
■ Combination of a facetted browsing and
breadcrumb-based navigation
■ A time-line enables time-based filtering
of search results
■ Personalized search (in the next demonstrator)
VISSW 2011 | Johannes Osterhoff | February 13, 2011
44
![Page 45: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/45.jpg)
What is CONTENTUS? Introduction
“More than the sum of its parts”
VISSW 2011 | J. Osterhoff | February 13, 2011
45
![Page 46: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/46.jpg)
What is CONTENTUS? Introduction
More efficient
and more pleasant
user experience.
VISSW 2011 | J. Osterhoff | February 13, 2011
46
![Page 47: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/47.jpg)
What is CONTENTUS? Context
■ new technologies for managing,
organizing, and searching multimedia
content gets more efficient
■ tremendous diversity of multimedia
data affects the retrieval and search
process
■ image and video search technology is
evolving rapidly
VISSW 2011 | Johannes Osterhoff | February 13, 2011
47
![Page 48: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/48.jpg)
What is CONTENTUS? Context
VISSW 2011 | J. Osterhoff | February 13, 2011
48
■ semantic search technology promises
more accurate and complete search
results
■ new user interfaces
are required to enable query formulation
and intelligent visualization of search
results
![Page 49: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/49.jpg)
What is CONTENTUS? Technologies
VISSW 2011 | Johannes Osterhoff | February 13, 2011
49
■ all types of media assets
■ technologies
media optimization
content analysis
semantic metadata generation
speech transcripts
OCR
extraction of semantic entities (i.e. people, places, events)
■ highly heterogeneous collection of semantically
annotated data
![Page 50: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/50.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
50
1. What is CONTENTUS?
2. Interface Design
3. Demonstration of the System
4. Summary
![Page 51: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/51.jpg)
User Interface Paradigms
No research on
a single aspect of
current approaches
in semantic multimedia
retrieval…
VISSW 2011 | Johannes Osterhoff | February 13, 2011
51
![Page 52: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/52.jpg)
User Interface Paradigms
But:
exploiting synergies
by combining
state-of-the-art
technologies instead.
VISSW 2011 | Johannes Osterhoff | February 13, 2011
52
![Page 53: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/53.jpg)
User Interface Paradigms
semantic
multimedia
technologies
VISSW 2011 | Johannes Osterhoff | February 13, 2011
53
![Page 54: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/54.jpg)
User Interface Paradigms
semantic +
multimedia
technologies
VISSW 2011 | Johannes Osterhoff | February 13, 2011
54
![Page 55: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/55.jpg)
User Interface Paradigms
semantic +
multimedia
technologies +
interface design
VISSW 2011 | Johannes Osterhoff | February 13, 2011
55
![Page 56: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/56.jpg)
User Interface Paradigms
combination of multimedia
and semantic search
= new challenges in visualizing
search results and facilitating
navigation
VISSW 2011 | J. Osterhoff | February 13, 2011
56
![Page 57: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/57.jpg)
User Interface Paradigms
compare different media at one glance
how to summarize content most
meaningfully in one single search
result item
time-based information (audio, video)
VISSW 2011 | J. Osterhoff | February 13, 2011
57
![Page 58: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/58.jpg)
User Interface Paradigms
multimodal
VISSW 2011 | Johannes Osterhoff | February 13, 2011
58
![Page 59: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/59.jpg)
User Interface Paradigms
multimodal
= articles, books,
video, audio, people,
locations on one
result-page
VISSW 2011 | Johannes Osterhoff | February 13, 2011
59
![Page 60: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/60.jpg)
User Interface Paradigms
The route with the
user‟s experience
gets more important
than the original goal
of fact finding.
VISSW 2011 | Johannes Osterhoff | February 13, 2011
60
![Page 61: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/61.jpg)
User Interface Paradigms
main goal
satisfying search experience
for the user
VISSW 2011 | J. Osterhoff | February 13, 2011
61
![Page 62: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/62.jpg)
62
![Page 63: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/63.jpg)
63 Search Area
![Page 64: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/64.jpg)
64 Search Field breadcrumbs
![Page 65: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/65.jpg)
65
![Page 66: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/66.jpg)
66
![Page 67: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/67.jpg)
67
Result Area
![Page 68: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/68.jpg)
68
organize and filter
media types
history
collection
![Page 69: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/69.jpg)
69
refine and filter
time-line
faceted suggestions
![Page 70: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/70.jpg)
70 search results
![Page 71: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/71.jpg)
71
article
audio
video
location
article
person video
search results
![Page 72: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/72.jpg)
72
![Page 73: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/73.jpg)
73
![Page 74: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/74.jpg)
74
![Page 75: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/75.jpg)
75
![Page 76: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/76.jpg)
76
less important search results
![Page 77: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/77.jpg)
77
![Page 78: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/78.jpg)
User Interface Detail Page for Books
VISSW 2011 | Johannes Osterhoff | February 13, 2011
78
Detail View
![Page 79: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/79.jpg)
User Interface Detail Page for Books
VISSW 2011 | Johannes Osterhoff | February 13, 2011
79
Detail View detected entities
full page
other pages
articles on this page
text snippet (OCR)
![Page 80: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/80.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
80
1. What is CONTENTUS?
2. Interface Design
3. Demonstration of the System
4. Summary
![Page 81: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/81.jpg)
VISSW 2011 | Johannes Osterhoff | February 13, 2011
81
Demo http://mediaglobe.yovisto.com:8081/contentus/
![Page 82: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/82.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
82
1. What is CONTENTUS?
2. Interface Design
3. Demonstration of the System
4. Summary
![Page 83: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/83.jpg)
VISSW 2011 | J. Osterhoff | February 13, 2011
83
Issue #1
How to find the needle
in the haystack?
Issue #2
How to present
“needles”
as search results?
Issue #3
How to make the German
cultural heritage available?
Issue #1
How to find different
“needles” in the haystack?
Issue #2
How to present
different “needles” as
distinguishable search
results?
Issue #3
How to make the German
Cultural Heritage available
in meaningful Information
Retrieval?
Summary
![Page 84: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/84.jpg)
Future Work
■ Feedback that lets the user know why exactly the listed
items have been presented
■ Possibility to connect with friends and to share results
with them
■ Suggestions based on friends„ likes
■ State-of-the-art multi-platform web design
■ Next demonstrator to be presented at
IBC 2011 Amsterdam
VISSW 2011 | Johannes Osterhoff | February 13, 2011
84
![Page 85: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/85.jpg)
VISSW 2011 | Johannes Osterhoff | February 13, 2011
85
![Page 86: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/86.jpg)
VISSW 2011 | Johannes Osterhoff | February 13, 2011
86 Person
Location
Book
Video
Audio
![Page 87: CONTENTUS—A Semantic Multimodal Search User Interface](https://reader035.fdocuments.net/reader035/viewer/2022062901/58f32da41a28ab2c018b45e3/html5/thumbnails/87.jpg)
Thank you!
Johannes P Osterhoff, M.A.
[email protected] Hasso-Plattner-Institute, Prof.-Dr.-Helmert-Str. 2-3, 14482 Potsdam, Germany
VISSW 2011 | Johannes Osterhoff | February 13, 2011
87