Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went...
Transcript of Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went...
![Page 1: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/1.jpg)
Sanxingdui
Ativity/context-awareness in wearable computing
Dr. Daniel RoggenSeptember 2013
![Page 2: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/2.jpg)
Naylor, G.: Modern hearing aids and future development trends, http://www.lifesci.sussex.ac.uk/home/Chris_Darwin/BSMS/Hearing%20Aids/Naylor.ppt
![Page 3: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/3.jpg)
Vannevar Bush, As we may think. Life magazine, 1945
![Page 4: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/4.jpg)
Mann, Smart Clothing: The Shift to Wearable Computing, Comm. of the ACM, 1996
![Page 5: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/5.jpg)
Wearables as fashion statement
![Page 6: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/6.jpg)
Why wearable?
• Augmenting senses, cognition, communication
• Discreet
• Eminently personal
• Continuously available
• Senses from my perspective
• Privacy (no cloud)
![Page 7: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/7.jpg)
•What did I do yesterday?.....
• What am I doing in the kitchen?....• You went to the supermarket, and enjoyed a coffee with Lisa
• If you want to cook spaghettis, think of heating the water
The science is about human activity understanding
![Page 8: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/8.jpg)
Activity understanding
• Implicit (micro-) interactions
• Proactive
• With the right modality
![Page 9: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/9.jpg)
• Sports
• Gaming
• Assisted living
• Event management
• HCI / HRI
• Industry
• Virtual reality• Greener society
• Safety
![Page 10: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/10.jpg)
![Page 11: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/11.jpg)
Low-level activity models (primitives)
Design-time: Training phase
Optim
ize
Sensor data
Annotations High-level activity models
Optim
ize
ContextActivity
Reasoning
Symbolic processing
Activity-aware application
A1, p1, t1
A2, p2, t2
A3, p3, t3
A4, p4, t4
t
[1] Roggen et al., Wearable Computing: Designing and Sharing Activity-Recognition Systems Across Platforms, IEEE Robotics&Automation Magazine, 2011
Runtime: Recognition phase
FS2 P2
S1 P1
S0 P0
S3 P3
S4 P4
S0
S1
S2
S3
S4
F1
F2
F3
F0 C0
C1
C2
PreprocessingSensor sampling Segmentation
Feature extractionClassification
Decision fusion
R
Null classrejection
Subsymbolic processingStatic pipeline – static sensor configuration!
![Page 12: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/12.jpg)
Size for « meaningful computing » is zero in 2020
Intel developer forum, 2012
![Page 13: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/13.jpg)
www.opportunity-project.euEC grant n° 225938
pattern recognition in opportunistic configurations of sensors(problem of distributed signal processing and machine learning)
EU funding ~ 1.5M€ / 3yr
![Page 14: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/14.jpg)
The OPPORTUNITY dataset for reproducible research(avail. on UCI ML repository)
Activity of daily living• 12 subjects• > 30'000 interaction primitives
(object, environment)
Roggen et al., Collecting complex activity datasets in highly rich networked sensor environments, INSS 2010http://opportunity-project.eu/challengeDatasethttp://vimeo.com/8704668
Sensor rich• Body, objects, environment• 72 sensors (28 sensors in 2.4GHz band)• 10 modalities• 15 wired and wireless systems
![Page 15: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/15.jpg)
![Page 16: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/16.jpg)
![Page 17: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/17.jpg)
![Page 18: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/18.jpg)
Third party usage
• Plötz, Hammerla, Olivier. Feature Learning for Activity Recognition in Ubiquitous Computing, IJCAI, 2011• Manzoor et al., Identifying Important Action Primitives for High Level Activity Recognition, Proc.
European Conference on Smart Sensing and Context (EuroSSC), 2010• Ploetz, Hammerla, Rozga, Reavis, Call, Abowd. Automatic Assessment of Problem Behavior in
Individuals with Developmental Disabilities. Proc. 14th Int Conf on Ubiquitous Computing, 2012.• Gordon, Czerny, Beigl. Activity Recognition for Creatures of Habit: Energy-Efficient Embedded
Classification using Prediction. Personal and Ubiquitous Computing, 2013.• Melibari et al, Dynamic Sum-Product Networks, Tech Rep University of Waterloo, 2013• Helaoui et al., Towards Activity Recognition Using Probabilistic Description Logics, AAAI 2012• Helaoui et al, A Probabilistic Ontological Framework for the Recognition of Multilevel Human Activities,
Ubicomp, 2013
![Page 19: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/19.jpg)
http://www.wearable.ethz.ch/resources/Dataset
![Page 20: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/20.jpg)
Challenge 1: Data recording with heterogeneous sensor networks
Integration at system level+ Central control & monitoring+ Synchronized data acquisition- Internals of sensor systems- Fixed real-time merge
Integration at data level+ Independent data recorders+ Robustness, flexibility- Complex control & monitoring- Offline synchronization
Obtain synchronized data streams for further processing
• 7 computers recording sensor data– Store data and data reception time– Coarse NTP synchronisation– Fine synchronisation with specific gestures (“jump and clap”)
![Page 21: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/21.jpg)
Challenge 2: data handling after recording
Burst equalization w/ streaming sensors Missing data represented as NaNs
Stream alignment to video footage
![Page 22: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/22.jpg)
Challenge 3: flexible activity annotations, at all levels
~60 instances
~30'000 instances
Solution: annotation on multiple tracks, hand-action-object representation
![Page 23: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/23.jpg)
LEGO approachSet of methods that can be richly combined
Domain knowledgeSolve the problem in an initially restricted setup out of the box,
Autonomous evolutionDiscover new solutions at runtime
Inspiration from Artificial Intelligence
![Page 24: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/24.jpg)
Recognition goal
System
monitoring
Dynamic configuration
Autonomous evolution
Sk
Sl
Sj
Si
Sm
Sn
Recognition chain
Context /activities
Ci
Cj
Ck
Cl
Fi
Fj
Fk
Fl
Fm
Pi
Pk
Pl
Pm
Pn
Pj
OPPORTUNITY framework
Opportunistic recognition pipeline
Dynamic classifier ensembles
• Static properties• "Acceleration"
• Dynamic properties• "Hip"
• ExperienceItem "walk"• Accuracy• Recognition models
![Page 25: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/25.jpg)
OPPORTUNITY FrameworkPlanner-based recognition chain optimization
Domain-adaptable
• Planner– Reconfiguration (Knapsack, LinearEfficiencyAnalysis, Inf Theoretical)– Self-monitoring: anomaly & change detection– Knowledge discovery
• Sensor management• Standard recognition algorithms• Java & OSGi bundles• Runs on x86 or ARM
Kurz et al. The opportunity framework and data processing ecosystem for opportunistic activity and context recognition. International Journal of Sensors, Wireless Communications and Control, 2011
Activity
Locomotion
Walk
RunBike
Domain ontology Sensor transformations
![Page 26: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/26.jpg)
Walkthrough: setting-up the recognition goal « Locomotion »
• Goal reasoning: locomotion = walk|run
• Instantiation of the RecognitionChain with Smartphone
• Static properties• "Acceleration"
• Dynamic properties• “Hip"
• ExperienceItem "walk"• Accuracy• Recognition chain parameters
• ExperienceItem “run"• Accuracy• Recognition chain parameters
• Static properties• "Acceleration"
• Static properties• "Acceleration"
• Dynamic properties• “Wrist"
![Page 27: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/27.jpg)
Walkthrough: knowledge discovery - using unknown sensors
• Static properties• “3D skeleton"
• ExperienceItems “HCI-VolumeUp”• ExperienceItems “HCI-VolumeDn”• ExperienceItems “HCI-Next”• ExperienceItems “HCI-Prev”
• Static properties• “Acceleration“
• Dynamic properties• “Wrist“
Physical and geometricalrelation between sensors
readings!
• Static properties• "Acceleration"
• Dynamic properties• “Wrist“
• ExperienceItems “HCI-VolumeUp”• ExperienceItems “HCI-VolumeDn”• ExperienceItems “HCI-Next”• ExperienceItems “HCI-Prev”
Baños et al, Kinect=IMU? Learning MIMO Models to Automatically Translate Activity Recognition Models Across Sensor Modalities, ISWC 2012
![Page 28: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/28.jpg)
Translation performance
• Same limb translation: accuracy <4% below baseline (accuracy ~95%)• System identification: 3 seconds• Self‐spreading of recognition capabilities!
![Page 29: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/29.jpg)
Walkthrough: self-adaptation to gradual changes
Förster, Roggen, Tröster, Unsupervised classifier self-calibration through repeated context occurences: is there robustness against sensor displacement to gain?, Proc. Int. Symposium Wearable Computers, 2009
Calibration dynamics
Self-calibration to displaced sensors increases accuracy:• by 33.3% in HCI dataset• by 13.4% in fitness dataset
“expectation maximization”
![Page 30: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/30.jpg)
Walkthrough: minimally user-supervised self-adaptation
• Adaptation leads to:• Higher accuracy in the adaptive case v.s. control• Higher input rate• More "personalized" gestures
Förster et al., Online user adaptation in gesture and activity recognition - what’s the benefit? Tech Rep.
Förster et al., Incremental kNN classifier exploiting correct - error teacher for activity recognition, ICMLA 2010
![Page 31: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/31.jpg)
Förster et al., On the use of brain decoded signals for online user adaptive gesture recognition systems, Pervasive 2010
Walkthrough: brain-guided self-adaptation
• ~9% accuracy increase with perfect brain signal recognition• ~3% accuracy increase with effective brain signal recognition accuracy•Adaptation guided by the user’s own perception of the system• User in the loop
![Page 32: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/32.jpg)
What if activity recognition is possible “anytime and anywhere” ?
Roggen et al. Opportunistic human activity and context recognition, IEEE Computer Magazine, February 2013
• Energy use: -17%– Implicity energy management– 15 households
• Health care costs: -400K£/day in UK – Ensuring regular training to avoid falls– Reduces fall rate by 50%
![Page 33: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/33.jpg)
Daily routines are open-ended!
Lifelong learning + Crowd-sourcing
Activity models ?
![Page 34: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/34.jpg)
Personalized models
I think you are doing
walk
Minimal user supervision
If not, tap to correct
BicycleSteps
Anything else
Or type:
Motif discovery
+Global models
Other learningsources
SMS
Online data
Bootstrapping
Training data
![Page 35: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/35.jpg)
Exemplary challenge: label jitter
Hey! I did drink a moment ago!
I'll go for a walk soon....
![Page 36: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/36.jpg)
Labels with noisy boundaries: Longest Common Substring
Nguyen-Dinh et al., Human Activity Spotting Using LCSS in Accelerometer Data, SOCPAR 2012
+10% in highvariability dataset
= in low variabilitydataset
![Page 37: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/37.jpg)
Crowd-sourced annotations on Amazon’s mechanical Turk
Mittwoch, 25. September 2013 43D-ITET Electronics LaboratoryNguyen-Dinh et al. Tagging human activities in video by crowdsourcing, ICMR, 2013
![Page 38: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/38.jpg)
Experts tag VideosAccuracy: AccurateTime: 10hrs / 10mn VideoCost: 60 * 30$ = 1800$ / hr Video
CrowdsourcingAccuracy: 80% / 10%Time: “overnight” if parallelCost: ~100 $ / hr Video
Nguyen-Dinh et al. Tagging human activities in video by crowdsourcing, ICMR, 2013
![Page 39: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/39.jpg)
EC grant Nr FP6-018474-2 EC grant FP7-288516
![Page 40: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/40.jpg)
![Page 41: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/41.jpg)
M. Bächlin, M. Plotnik, D. Roggen, I. Maidan, J. M. Hausdorff, N. Giladi, and G. Tröster. Wearable Assistant for Parkinson's DiseasePatients With the Freezing of Gait Symptom. IEEE Transactions on Information Technology in Biomedicine, 14(2):436 - 446, 2010.
thigh sensor
shank sensor
trunk sensor
Freezing of gait (transient motor block)
Audio and visual cueing
wearablecomputer
head sensor ?
![Page 42: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/42.jpg)
Indoor localization without (any ambient) infrastructure
Hardegger, Tröster, Roggen. Improved ActionSLAM for Long-term Indoor Tracking with Wearable Motion Sensors. ISWC 2013
![Page 43: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/43.jpg)
Hardegger, Tröster, Roggen. Improved ActionSLAM for Long-term Indoor Tracking with Wearable Motion Sensors. ISWC 2013
Indoor localization without (any ambient) infrastructure
![Page 44: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/44.jpg)
Context-aware medication reminders
• Main drug: Levodopa– Effect wears off quickly (2h-6h)– Abrupt “on”-”off” transitions
• Precise intake timing needed
Janssen Care4Today phone application
?• Context-aware reminders
• Anticipation of wear-off effect
• Automatic detection of intake
![Page 45: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/45.jpg)
Speech loudness cueing
• Lee Silverman voice treatment• Loudness & Intelligibility• Training (at home) or live (in the wild)
http://en.wikipedia.org/wiki/Lee_Silverman_voice_treatment
?
![Page 46: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/46.jpg)
Workshop @ Newcastle University (28.08.2013)
• 7 participants (3F, 4M)• Discussion
– Current artefacts used for self-management– Promotional videos of Glass & live Glass demo
• Glass tryouts • Feedback
Briggs P, Blythe M, Vines J, Lindsay S, Dunphy P, Nicholson J, Green D, Kitson J, Monk A, Olivier P. Invisible design: exploringinsights and ideas through ambiguous film scenarios. In: 9th ACM Conference on Designing Interactive Systems. 2012
![Page 47: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/47.jpg)
Workshop @ Newcastle University (28.08.2013)
• Accept positive “Benefit – privacy” tradeoffs• “Sharing under my control to whom I choose”• “Same as a phone / computer”, “just another interaction”• “Gives me confidence back, that is what I need”• “I cannot use a phone with shopping bags and a stick, Glass
would be always ready”• “Everybody is different – interface should be customizable”
![Page 48: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/48.jpg)
• Be opportunistic
• More digital traces == better!– Large datasets (many users, long-term recordings)– Mechanical Turk, online databases– More sensors (wearable & ambient)– Social platforms, emails
• Beyond "spotting" to "understanding"– (hidden context)
• Exlore new sensor technologies
Summary
![Page 49: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/49.jpg)
Intro to HAR & Wearable Computing:
http://www.slideshare.net/danielroggen
Part I: What is wearable computing?Part II: Sensors
Part III: The activity recognition chain
![Page 50: Ativity/context-awareness in wearable computing · •WhatamI doingin the kitchen?.... • You went to the supermarket, and enjoyeda coffee withLisa •If youwantto cook spaghettis,](https://reader034.fdocuments.net/reader034/viewer/2022050200/5f536b1a0417e549e0535adb/html5/thumbnails/50.jpg)
Thanks!