The Role of Semantic Web Technologies in Smart Environments

The Role of Semantic Web Technologies in Smart Environments

Faisal Razzak

Politecnico di TorinoDip. Automatica e Informatica

Torino, ItalyFinal PhD Presentation @ DAUIN

My PhD work

Semantic Data Exchange• Linked Open Dynamic Data -- LO(D)D • Semantic Energy Information Publishing Framework (SEIPF)

User Intelligible Goals• Domotic Effects• Modeling• Evaluation• Enforcement• Optimization in Energy Management domain

Other Works – Internet of Things• Spamming the Internet of Things (IoT) • Web of Domotics (WoD)• Eye Tracking Systems (Cogain Project)

Presentation @DAUIN, Politecnico di Torino, Italy

Razzak 2

User Intelligible goals


Razzak 3

Motivation Users pour their personalities in order to use and

transform their personal environments (2006). Resulted in “Programmable smart/

personal environments”.


Davidoff, Scott, Min Lee, Charles Yiu, John Zimmerman, and Anind Dey. "Principles of smart home control." UbiComp 2006: Ubiquitous Computing (2006): 19-34

Razzak 4

Motivation IST Advisory group published a draft titled

‘Ambient Intelligence: From vision to reality’. In order to build intelligence, we need to innovate abstract concepts and models to address human centric expressions of personal style. (2003)

A series of workshops and interviews, concluded that designers work top-down and like to start from abstract descriptions. (2008) The need for abstract models to address human

centric expressions


1) Ducatel, K., M. Bogdanowicz, F. Scapolo, J. Leijten, and J. C. Burgelman. "Ambient intelligence: From vision to reality." IST Advisory Group Draft Rep., Eur. Comm(2003).

2) van Doorn, Mark, Arjen de Vries, and Emile Aarts. "End-User Software Engineering of Smart Retail Environments: The Intelligent Shop Window." Ambient Intelligence(2008): 157-174.

Razzak 5

The Issues The issue of Device centric vision? The question of Enforcement? The question of Evaluation (monitoring)? Can there be a unified model?


Razzak 6

Domotic Effects Framework

Domotic Effects model Human intelligible state and goal.

• It provides AMI designers with an abstraction layer that enables defining generic goals inside the environment, in a declarative way.

• The high-level nature allows the residents to program their personal, office or work spaces as they see fit.

• Simple Effect (SE) and Complex Effect (CE)Presentation @DAUIN, Politecnico di

Torino, Italy

DogEffects Ontology

Razzak 7

Boolean Application Domain


Razzak 8

Energy Application Domain


Razzak 9

Example: Boolean Application Domain


Razzak 10

Example: Energy Application Domain


Razzak 11

?Users’ Goals

Users

Devices

Enforcement Evaluation

How to put it simply?


Razzak 12

More Details


Mathematical

Formulation

Enforcement

Architecture

Evaluation Architectur

e

Results

Razzak 13

Enforcement


Razzak 16

Evaluation – Zero Delay Simulation


Razzak 17

Is it Applicable? -- Evaluation Evaluation

In one experiment, results showed that for an iteration the presence of 1500 CEs with the maximum level of 177 can be evaluated in 118 ms (averaged over 150 times).

In another experiment results showed that for a single device change, the presence of 1400 CEs with the maximum level of 272 can be evaluated in 258 ms.

The goal was in less than 1 or 2 seconds.


Razzak 18

Is it Applicable? -- Enforcement Six use cases

Secure Home Home Illumination Morning Wakeup Isolated Kitchen Room Illumination Air Passage across Home

All possible combination of use cases, i.e., 64 In summary, the implemented enforcement module

was able to resolve to devices in less than 100 ms. The goal was in less than 1 or 2 seconds.


Razzak 19

Results Compared against

Enumeration approach.

For 90% of iterations the result of power consumption was better or at least equal (in case of minimal).

The heuristic solution time was between 1 to 2 seconds for all cases. Even for cases with more than 100,000 (enumerated) solutions.

An enforcement with minimal power consumption


Formulation

Razzak 20

User Intelligible goals – Domotic Effects (Papers) Published (ISI-Journal)

Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User Intelligible Goals in Smart Home Environments." IEEE Transactions on Smart Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135, ISSN - 1949-3053

Submitted (ISI-Journal) Fulvio Corno and Faisal Razzak: SAT Based enforcement of Domotic

Effects in Smart Environments

Fulvio Corno and Faisal Razzak: Monitoring of Smart Environments using Domotic Effects

Currently Writing Dario Bonino, Fulvio Corno and Faisal Razzak: Modeling Intelligible

Effects in Smart Homes


Razzak 22

An Alternate View Semantic web technologies provide both

strong structural representation and semantics.

Semantic web technologies provide only strong structural representation.

Semantics comes from context (User and current settings).


AGAINST

Razzak 24

Semantic Data Exchange


Razzak 25


26

Context

Razzak

Smart Sensing and Measuring Environments

Smart HomesSmart Factories

Smart Grid

Sensor and Actuator Networks

Smart Appliances

Affordable and efficient sensors

Environment monitoringSocial mobile applications


27

Context

Razzak


Smart Appliances


energy (active, reactive, reverse, kVAr, ...)

acceleration compass GPS proximity microphone camera BT Scan

accelerationcompassair pressure temperature light


28

Context

Razzak



Smart Appliances

Motion

Proximity

SmokeGyroscope

PressureRFID

2D codes

Motivation Applications need to

access information from multiple environments

Standard way to publish and consume information About accessible

environments About available

applicances, sensors and their characteristics

About the actual data measured by sensors

Razzak Presentation @DAUIN, Politecnico di Torino, Italy

29

Environment

Appliances

sensors

Environment

Appliances

sensors

Environment

Appliances

sensors

Application Application

Other Approaches Handling Temporal Data (Time Ontology) RDF Streaming Engines (C-SPARQL,

SPARQLStream, EP-SPARQL)


30

1. http://www.w3.org/TR/owl-time/2. D. Anicic, P. Fodor, S. Rudolph, N. Stojanovic, EP-SPARQL: a unified language for event processing and stream

reasoning, in: Proceedings of the 20th international conference on World wide web, ACM, 2011, pp. 635–644.3. D. Barbieri, D. Braga, S. Ceri, E. Della Valle, M. Grossniklaus, C-SPARQL: SPARQL for continuous querying, in:

Proceedings of the 18th international conference on World wide web, ACM, 2009, pp. 1061–1062.4. S. Groppe, J. Groppe, D. Kukulenz, V. Linnemann, A SPARQL engine for streaming RDF data, in: Signal-Image

Technologies and Internet-Based System, 2007. Third International IEEE Conference on, IEEE, 2007, pp. 167–174.

5. D. Le-Phuoc, M. Dao-Tran, J. Xavier Parreira, M. Hauswirth, A native and adaptive approach for unified processing of linked streams and linked data, The Semantic Web–ISWC 2011 (2011) 370–388.

http://www.w3.org/TR/owl-time/

Approach Applications need to

access information from multiple environments

Standard way to publish and consume information About accessible

environments About available

applicances, sensors and their characteristics

About the actual data measured by sensors


31

Adopt Semantic Web «Linked Open Data

(LOD)» approach

Static information:Can be encoded in RDF according to a public

Ontology

Dynamic information:

New approach to represent streams of

RDF events

Razzak 32 Presentation @DAUIN, Politecnico di Torino, Italy

Producer Applicati

on

Consumer

Application

Publisher

Component

Subscriber

Component

PID Docume

nt

Channel 1

Channel2

Smart Environment

Transport Mechanism (3rd party Cloud based Service)

EE EE

EEE E

E

E

E

E

Publishes

Views &

Subscribes to Channels


General LO(D)D Architecture


34

Producer Applicati

on

Smart Environment

Static informatio

n about sensor

streams

publishes

E

GFmonitors



35

Producer Applicati

on

Smart Environment

Static informatio

n about sensor

streams

Sensor data

channel

Sensor data

channel

Sensor data

channel

describes

updates

publishes

E

G

E

E

G

G

G

G

EE

F

F

F

F

monitors



36

Producer Applicati

on

Consumer

Application

Smart Environment

Consumer

Application

Static informatio

n about sensor

streams

Consumer

Application

Sensor data

channel

Sensor data

channel

Sensor data

channel

describes

updates

publishes

receives

subscribes

E

G

E

E

G

G

G

G G

G

EE

E

E

E

E

F

F

F

FF

monitors

Proposed solutions Open source libraries and API to enable

application to interact with LO(D)D data RDF document with meta-data (PID)

Publisher information List of channels, their source data,

their datatypes, and subscription URI/key

RDF «fragments» representing each event Contains: event#, sensor id,

timestamp, value, unit of measure Uses publish-subscribe pattern as

transport mechanism for distributing RDF fragments


37

Producer Applicati

on

Consumer

Application

Static informatio

n about sensor

streams

Sensor data

channel

E

E

GF

Publisher Information Document (PID) According to lightweight «Publisher» ontology Contains declarations of all channels handled by this

publisher – all needed static information Gives information to subscribe to channels Created by

publisher API Published

over http


38

<RDF:Description RDF:about="&Publisher;energymtr"> <publisher:Location RDF:datatype="&xsd;string"> Torino, Italia</publisher:Location>

<publisher:subscribekey>sub-xxxxxx-42904d46dEEEEE </publisher:subscribekey>

<publisher:channelName>Energy Meters </publisher:channelName>

<RDF:type RDF:resource="&Publisher;Channel"/></RDF:Description>

Event data fragments Individual data points encoded in RDF Self-consistent information (e.g. Unit of measure) Standard syntax and semantics Application-independent representation Compact

encodingsavailable


39

<rdf:Description RDF:about = "&publisher;emergymtrChan1"> <publisher:MeterNumber RDF:datatype="&xsd;int"> 231 </publisher:MeterNumber>

<publisher:Unit RDF:datatype="&xsd;string" > http://purl.oclc.org/NET/muo/ucum/unit/power-level/ bel-kilowatt</publisher:Unit>

<publisher:hasTimeStamp RDF:datatype="&xsd;dateTime"> 2012-02-02T13:06:41.056Z </publisher:hasTimeStamp>

<publisher:hasCurrentValue RDF:datatype ="&xsd;double"> 0.3 </publisher:hasCurrentValue></RDF:Description>


40

Cloud based Transport mechanism Provides the updates to subscribers whenever

publishers update data New RDF fragments are sent to the cloud service

Maintains list of subscribers Handles logic to provide transport from

Publisher to many Subscriber in real time It makes the Publisher a “light-weight

component” Publisher is independent from the number of

connected subscribers

Razzak

pubsubhubbub

...and others


42

P

Building InfrastructurePolitecnico di Torino

C

P

C

poliEnergyPID

poliEnergy

AggregatorPID

Publishes

• 126 Electrical Meters.

• Take reading every 15 minutes • Aggregates

reading into 3 ranges.

• Publishes using 3

channels

Experiment

Razzak

Other Works

Spamming the Internet of Things Faisal Razzak "Spamming the Internet of Things: A Possibility and

its probable Solution." Procedia Computer Science 10 (2012): 658-665.

MobiWIS 2012 in Canada.

Semantic Web Technologies’ role in Smart Environments Faisal Razzak. "Semantic Web Technologies’ role in Smart

Environments." P. Herrero et al. (Eds.): OTM 2012 Workshops, LNCS 7567, pp. 54–58, 2012.

OTM Workshops 2012 (Rome)

Semantic Energy Information Publishing Framework1. Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine

understandable exchange of energy consumption information in intelligent domotic environments." Energy and Buildings 43, no. 6 (2011): 1392-1402.

Web of Domotics1. Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction

with smart environments through linked data." In Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on, IEEE, pp. 2922-2929. 2010.


Razzak 43

PublicationsInternational Journals1. Fulvio Corno and Faisal Razzak. "Intelligent Energy Optimization for User Intelligible Goals

in Smart Home Environments." IEEE Transactions on Smart Grid (2012): Vol. 3 Issue: 4, pp. 2128-2135, ISSN - 1949-3053

2. Dario Bonino, Fulvio Corno, and Faisal Razzak. "Enabling machine understandable exchange of energy consumption information in intelligent domotic environments." Energy and Buildings 43, no. 6 (2011): 1392-1402.

Proceedings3. Fulvio Corno and Faisal Razzak. "Publishing LO (D) D: Linked Open (Dynamic) Data for

Smart Sensing and Measuring Environments." Procedia Computer Science 10 (2012): 381-388.

4. Faisal Razzak "Spamming the Internet of Things: A Possibility and its probable Solution." Procedia Computer Science 10 (2012): 658-665.

5. Faisal Razzak. "Semantic Web Technologies’ role in Smart Environments." P. Herrero et al. (Eds.): OTM 2012 Workshops, LNCS 7567, pp. 54–58, 2012.

6. Faisal Razzak, Dario Bonino, and Fulvio Corno. "Mobile interaction with smart environments through linked data." In Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on, IEEE, pp. 2922-2929. 2010.

7. Emiliano Castellina, Faisal Razzak, and Fulvio Corno. "Environmental Control Application Compliant with COGAIN Guidelines." COGAIN2009 Proceedings (2009): 31.


Acknowledgement My work in PhD (till now) would not have been possible

without the knowledge and guidance of following people: Prof. Fulvio Corno Dr. Emiliano Castellina (now with Reply) Dr. Dario Bonino Muhammad Sanaullah And all the teachers who taught PhD courses.

Razzak 45

Faisal Razzak ([email protected])Skype: faisal.razzak27

Presentations: http://www.slideshare.net/konware

Profile: http://polito.academia.edu/FaisalRazzak

LinkedIn: http://it.linkedin.com/pub/faisal-razzak/50/511/421/

Thank you all & Any Questions?

References

http://www.slideshare.net/konware

http://polito.academia.edu/FaisalRazzak

http://it.linkedin.com/pub/faisal-razzak/50/511/421/

The Role of Semantic Web Technologies in Smart Environments

Documents

Transcript of The Role of Semantic Web Technologies in Smart Environments