Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges...
-
Upload
cleopatra-frederica-barrett -
Category
Documents
-
view
218 -
download
0
Transcript of Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges...
![Page 1: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/1.jpg)
Semantics enhanced Data, Social and and Sensor Webs
Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking
Amit Sheth
Kno.e.sis Center, Wright State University
![Page 2: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/2.jpg)
Machine Sensing
• Inert, fixed sensors
• Carried on moving objects– Vehicles, pedestrians (asthma research)– anonymous data from GPS-enabled
vehicles, toll tags, and cellular signaling
to mark how fast objects are moving – and overlaying that information with location data and maps (traffic.com, Nokia experiment, …)
2Text from http://www.geog.ucsb.edu/~good/presentations/icsc.pdf Images credit – flickr.com, cnet.com
![Page 3: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/3.jpg)
Semantic Sensor Web
![Page 4: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/4.jpg)
Semantically Annotated O&M
<swe:component name="time"><swe:Time definition="urn:ogc:def:phenomenon:time" uom="urn:ogc:def:unit:date-time">
<sa:swe rdfa:about="?time" rdfa:instanceof="time:Instant"><sa:sml rdfa:property="xs:date-time"/>
</sa:swe></swe:Time>
</swe:component><swe:component name="measured_air_temperature">
<swe:Quantity definition="urn:ogc:def:phenomenon:temperature“ uom="urn:ogc:def:unit:fahrenheit"><sa:swe rdfa:about="?measured_air_temperature“
rdfa:instanceof=“senso:TemperatureObservation"><sa:swe rdfa:property="weather:fahrenheit"/><sa:swe rdfa:rel="senso:occurred_when" resource="?time"/><sa:swe rdfa:rel="senso:observed_by" resource="senso:buckeye_sensor"/>
</sa:sml></swe:Quantity>
</swe:component>
<swe:value name=“weather-data">2008-03-08T05:00:00,29.1
</swe:value>
![Page 5: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/5.jpg)
Semantic Sensor ML – Adding Ontological Metadata
5
Person
Company
Coordinates
Coordinate System
Time Units
Timezone
SpatialOntology
DomainOntology
TemporalOntology
Mike Botts, "SensorML and Sensor Web Enablement," Earth System Science Center, UAB Huntsville
![Page 6: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/6.jpg)
6
Semantic Query• Semantic Temporal Query
• Model-references from SML to OWL-Time ontology concepts provides the ability to perform semantic temporal queries
• Supported semantic query operators include:– contains: user-specified interval falls wholly within a sensor reading interval
(also called inside)– within: sensor reading interval falls wholly within the user-specified interval
(inverse of contains or inside)– overlaps: user-specified interval overlaps the sensor reading interval
• Example SPARQL query defining the temporal operator ‘within’
![Page 7: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/7.jpg)
Kno.e.sis’ Semantic Sensor Web
7
![Page 8: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/8.jpg)
Semantic Sensor Web demo
Sensor Discovery on Linked Data demo
(Google “Semantic Sensor Web”, demos at the bottom of the Kno.e.sis project page)
![Page 9: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/9.jpg)
Citizen Sensing
• Where humans act as sensors or observers• Around them is a network of sensors, computing and
communicating with each other– Processing and delivering multi-modal information – Collective Intelligence
• Information-centric to Experience-centric era– Modeling, processing, retrieving event level information
• Use of domain knowledge – ….
• Understanding of casual text
9
![Page 10: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/10.jpg)
Citizen Sensors
• Human beings– 6 billion intelligent sensors, 4 million mobile devices– informed observers– rich local knowledge– uplink technology
• broadband Internet• mobile phone
10
Christmas Bird Count
![Page 11: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/11.jpg)
mumbai, india
![Page 12: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/12.jpg)
november 26, 2008
![Page 13: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/13.jpg)
another chapter in the war against civilization
![Page 14: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/14.jpg)
and
![Page 15: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/15.jpg)
![Page 16: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/16.jpg)
![Page 17: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/17.jpg)
the world saw it
Through the eyes of the people
![Page 18: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/18.jpg)
the world read itThrough the words of the people
![Page 19: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/19.jpg)
PEOPLE told their stories to PEOPLE
![Page 20: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/20.jpg)
A powerful new era in Information dissemination had
taken firm ground
![Page 21: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/21.jpg)
Making it possible for us to
create a global network of citizens
Citizen Sensors – Citizens observing, processing,
transmitting, reporting
![Page 22: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/22.jpg)
Image Metadatalatitude: 18° 54′ 59.46″ N, longitude: 72° 49′ 39.65″ E
Geocoder (Reverse Geo-coding)
Address to location database
18 Hormusji Street, Colaba
Nariman House
Identify and extract information from tweetsSpatio-Temporal Analysis
Structured Meta Extraction
Income Tax Office
Vasant Vihar
![Page 23: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/23.jpg)
Research Challenge #1
• Spatio Temporal and Thematic analysis– What else happened “near” this event
location?– What events occurred “before” and
“after” this event?– Any message about “causes” for this
event?
![Page 24: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/24.jpg)
Spatial Analysis….Which tweets originated from an
address near 18.916517°N 72.827682°E?
![Page 25: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/25.jpg)
Which tweets originated during Nov 27th 2008,from 11PM to 12 PM
![Page 26: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/26.jpg)
Giving us
Tweets originated from an address near 18.916517°N, 72.827682°E during time interval 27th Nov 2008 between 11PM to 12PM?
![Page 27: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/27.jpg)
Research Challenge #2:Understanding and Analyzing Casual Text
• Casual text– Microblogs are often written in SMS
style language– Slangs, abbreviations
![Page 28: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/28.jpg)
Understanding Casual Text
• Not the same as news articles or scientific literature– Grammatical errors
• Implications on NL parser results
– Inconsistent writing style• Implications on learning algorithms that
generalize from corpus
![Page 29: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/29.jpg)
Nature of Microblogs
• Additional constraint of limited context– Max. of x chars in a microblog– Context often provided by the discourse
• Entity identification and disambiguation
• Pre-requisite to other sophisticated information analytics
![Page 30: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/30.jpg)
NL understanding is hard to begin with..
• Not so hard– “commando raid appears to be nigh at
Oberoi now”• Oberoi = Oberoi Hotel, Nigh = high
• Challenging– new wing, live fire @ taj 2nd floor on
iDesi TV stream• Fire on the second floor of the Taj hotel, not
on iDesi TV
![Page 31: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/31.jpg)
Social Context surrounding content
• Social context in which a message appears is also an added valuable resource
• Post 1: – “Hareemane House hostages said by
eyewitnesses to be Jews. 7 Gunshots heard by reporters at Taj”
• Follow up post– that is Nariman House, not (Hareemane)
![Page 32: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/32.jpg)
Understanding content … informal text
• I say: “Your music is wicked”
• What I really mean: “Your music is good”
33
![Page 33: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/33.jpg)
Structured text (biomedical literature)
Multimedia Content and Web
data
Web Services
Semantic Metadata: Smile is a TrackLil transliterates to Lilly Allen
Lilly Allen is an Artist
Informal Text (Social Network
chatter)
Your smile rocks Lil
Urban Dictionary
MusicBrainz Taxonomy
Artist: Lilly AllenTrack: Smile
Sentiment expression: Rocks Transliterates to: cool, good
![Page 34: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/34.jpg)
Example: Pulse of a Community
• Imagine millions of such informal opinions– Individual expressions to mass opinions
• “Popular artists” lists from MySpace comments
Lilly Allen
Lady Sovereign
Amy Winehouse
Gorillaz
Coldplay
Placebo
Sting
Kean
Joss Stone
![Page 35: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/35.jpg)
Domain Knowledge: A key driver
• Places that are nearby ‘Nariman house’– Spatial query
• Messages originated around this place– Temporal analysis
• Messages about related events / places– Thematic analysis
![Page 36: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/36.jpg)
Research Challenge #3But Where does the Domain Knowledge come from?
• Expert and committee based ontology creation … works in some domains (e.g., biomedicine, health care,…)
• Community driven knowledge extraction – How to create models that are “socially scalable”?– How to organically grow and maintain this model?
![Page 37: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/37.jpg)
Building models…seed word to hierarchy creation using WIKIPEDIA
Seed Query
BWikipedia
Fulltext Concept Search
Wikigraph-Based expansion
Graph Search
Graph Search
Graph Search
Hierarchy Creation
Query: “cognition”
![Page 38: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/38.jpg)
Today’s Network of Sensors
• Are sensing, computing, transmitting
• Are acting in concert – Sharing data – Processing them into meaningful digital representations of the
world
• Researchers using 'sensor webs' to ask new questions or test hypotheses
• 2009: 1.1 billion PCs, 4 billion mobile devices, 40+ billion mobile sensors (Nokia: Sensing the World with Mobile Devices)
39
![Page 39: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/39.jpg)
Consider
• that all objects, events and activities in the physical world have a counterpart in the Cyberworld (IoT)
• multi-facted context of real world is captured in the cyberworld (multilevel & citizen sensors/participatory sensing)
• each object, event and activity is represented – with semantic annotations (semantic sensor web)
• for a chosen context, with an ability to explicate and associate variety of relationships and events (Relationship Web, EventWeb)
• appropriate reasoning and human/social interaction are available and applied, insights extracted (semantic web, social semantic web, experiential computing)
• Activity anticipated/answers obtained/ decisions reached/communicated/applied
40
![Page 40: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/40.jpg)
41
Psyleron’s Mind-Lamp (Princeton U), connections between the mind and the physical world. Neuro Sky's mind-controlled headset
to play a video game.
MIT’s Fluid Interface Group: wearable device with a projector for deep interactions with the environment
Physical-Cyber divide is narrowing
Sensing emotion is increasingly possibleand sensors are being developed to captureEmotions.
![Page 41: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/41.jpg)
imagine
![Page 42: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/42.jpg)
imagine when
![Page 43: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/43.jpg)
meets
Farm Helper
![Page 44: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/44.jpg)
with this
• Latitude: 38° 57’36” N• Longitude: 95° 15’12” W• Date: 10-9-2007• Time: 1345h
![Page 45: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/45.jpg)
that is sent to
Geocoder
Farm Helper
Services Resource
Sensor Data ResourceStructured Data Resource
Agri DBSoil Survey
Lat-Long
Lawrence, KSWeather
data
Soil InformationPest information …
Weather Resource
LocationDate /Time
Weather Data
![Page 46: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/46.jpg)
and
![Page 47: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/47.jpg)
Six billion brains
![Page 48: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/48.jpg)
imagination today
![Page 49: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/49.jpg)
impacts our experience tomorrow
![Page 50: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/50.jpg)
What Drives the Spatio-Temporal-Thematic Analysis and Casual Text
Understanding
Semantics with the help of
1. Domain Models2. Domain Models3. Domain Models
(ontologies, folksonomies)
![Page 51: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/51.jpg)
And who creates these models?
YOU, ME,
We DO!
![Page 52: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/52.jpg)
• How do you get comprehensive situational awareness by merging “human sensing” and “machine sensing”?
53
![Page 53: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/53.jpg)
Synthetic but realistic scenario
• an image taken from a raw satellite feed
54
![Page 54: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/54.jpg)
• an image taken by a camera phone with an associated label, “explosion.”
Synthetic but realistic scenario
55
![Page 55: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/55.jpg)
• Textual messages (such as tweets) using STT analysis
Synthetic but realistic scenario
56
![Page 56: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/56.jpg)
• Correlating to get
Synthetic but realistic scenario
![Page 57: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/57.jpg)
Create better views (smart mashups)
![Page 58: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/58.jpg)
Twitris demo
(Search “Twitris” on YouTube)
![Page 59: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/59.jpg)
A few more things
• Use of background knowledge• Event extraction from text
– time and location extraction • Such information may not be present• Someone from Washington DC can tweet about
Mumbai
• Scalable semantic analytics– Subgraph and pattern discovery
• Meaningful subgraphs like relevant and interesting paths
• Ranking paths
![Page 60: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/60.jpg)
The Sum of the Parts
Spatio-Temporal analysis– Find out where and when
+ Thematic – What and how
+ Semantic Extraction from text, multimedia and sensor data- tags, time, location, concepts, events
+ Semantic models & background knowledge– Making better sense of STT– Integration
+ Semantic Sensor Web– The platform
= Situational Awareness
![Page 61: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/61.jpg)
Observation
(senses)
Observation
(sensors)
Perception
(analysis)
Perception
(cognition)
Communication
(language)
Communication
(services)
People Web(human-centric)
Sensor Web(machine-centric)
![Page 62: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/62.jpg)
Observation
PerceptionCommunication
Enhanced Experience (humans & machines working in
harmony)
Semantics for shared conceptualization and interoperability between machine and human
Ability to share common communication
![Page 63: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/63.jpg)
PARADIGM SHIFT
Sensing, Observation, Perception, Semantic, Social Experiential
65
![Page 64: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/64.jpg)
From the Semantic Web Community
• Several key contributing research areas– Operating Systems, networks, sensors, content management
and processing, multimodal data integration, event modelling, high-dimensional data visualization ….
• Semantics and Semantic technologies can play vital role – In the area of processing sensor observations, the Semantic
Web is already making strides– Use of core SW capabilities: knowledge representation, use of
knowledge bases (ontologies, folkonomies, taxonomy, nomenclature), semantic metadata extraction/annotation, exploiting relationships, reasoning
66
![Page 65: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/65.jpg)
THERE IS MORE HAPPENING AT KNO.E.SIS
http://knoesis.org
67
Thanks: NSF (SemDis, Spatio-temporal-thematic), NIH, AFRL,and also Microsoft Research, HP Research, IBM Research. Seehttp://knoesis.wright.edu/projects/funding/
![Page 66: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/66.jpg)
KNO.E.SIS MEMBERS – A SUBSET
![Page 67: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/67.jpg)
Kno.e.sis Center Labs (3rd Floor, Joshi)
Amit Sheth•Semantic Science Lab•Semantic Web Lab•Service Research Lab
TK Prasad•Metadata and Languages Lab
Shaojun Wang•Statistical Machine Learning
Pascal Hitzler•Formal Semantics & Reasoning lab
Michael Raymer•Bioinformatics Lab
Guozhu Dong•Data Mining Lab
Keke Chen•Data Intensive Analysis and Computing Lab
![Page 68: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/68.jpg)
Interested in more background?
References/More Details• Amit Sheth, Cory Henson, and Satya Sahoo, Semantic Sensor Web, IEEE Internet
Computing, July/August 2008, p. 78-83. Also see: http://wiki.knoesis.org/index.php/SSW
• Amit Sheth and Meenakshi Nagarajan, Semantics-Empowered Social Computing. IEEE Internet Computing Jan/Feb 2009, pages 76-80
• Amit Sheth, Semantic Integration of Citizen Sensor Data and Multilevel Sensing: A comprehensive path towards event monitoring and situational awareness, Keynote, February 17, 2009.
• Amit Sheth, Citizen Sensing, Social Signals, and Enriching Human Experience, IEEE Internet Computing, July/August 2009, pp. 80-85.
• Meena Nagarajan, User-Generated Content on Social Media, Keynote talk at Social Data on the Web (SDOW09) workshop collocated with ISWC, October 2009. Also http://knoesis.wright.edu/research/semweb/projects/socialmedia/
• M. Nagarajan et al., Spatio-Temporal-Thematic Analysis of Citizen-Sensor Data - Challenges and Experiences, Tenth International Conference on Web Information Systems Engineering, Oct 5-7, 2009, Poland.
• Amit Sheth, 'Computing for Human Experience: Semantics-Empowered Sensors, Services, and Social Computing on the Ubiquitous Web,' IEEE Internet Computing (Sp. Issue on Internet Predictions: V. Cerf and M. Singh, Eds.), vol. 14, no. 1, pp. 88-91, Jan./Feb. 2010. Also: http://wiki.knoesis.org/index.php/Computing_For_Human_Experience
• Prateek Jain, Pascal Hitzler, Peter Z. Yeh, Kunal Verma and Amit P. Sheth, Linked Data is Merely More Data, AAAI Spring Symposium Linked Data Meets Artificial Intelligence, Stanford, CA, USA, March 22-24, 2010.
![Page 69: Semantics enhanced Data, Social and and Sensor Webs Talk at Dagstuhl Seminar on Semantic Challenges in Sensor Networking Amit Sheth Kno.e.sis Center, Wright.](https://reader035.fdocuments.net/reader035/viewer/2022062423/56649cf35503460f949c104a/html5/thumbnails/69.jpg)
On-line Demos:• [SSW] Semantic Sensor Web – Spatio-teporal-thematic and role-based queries over
Mesowest Data• [SDLoD] Sensor Discovery on Linked Data: 1+ billion triple of US storms data on
LOD cloud, with Sensor Discovery Mashup• [Twitris] Twitris: Twitter through Theme, Space, and Time. ISWC Semantic Web
Challenge, October 2009.
Contact/more details: amit @ knoesis.org
Special thanks: Karthik Gomadam, Cory Henson, Meena Nagarajan, Christopher Thomas
Partial Funding: NSF (Semantic Discovery: IIS: 071441, Spatio Temporal Thematic: IIS-0842129), AFRL and DAGSI (Semantic Sensor Web), Microsoft Research and IBM Research (Analysis of Social Media Content),and HP Research (Knowledge Extraction from Community-Generated Content).