ADAPTIVE USER INTERFACE SUPPORT FOR UBIQUITOUS COMPUTING ENVIRONMENTS Heiko Desruelle, Dieter Blomme, George Gionis, Frank Gielen International Workshop on User Interface Description Languages (UIDL’2011) International Conference on Human-Computer Interaction (INTERACT’2011)

Overview

!   Introduction

!  Webinos

!  Context-driven UI Adaptation !  Webinos Context Model and Framework

!  Webinos UI Framework

!  Case Study

!  Future Work

Introduction

!   Number and types of connected devices ñ !   The web as universal application platform

!   Anytime, anywhere, and on any device

!   Ubiquitous environments !   Variety of presentation and interaction modalities

3

Introduction

!  Web → separation of concerns

!  Adaptability remains a challenge

!  Apps should adapt to context of use !  Situations not foreseen at design time

4

Webinos

!   A web platform designed to allow apps to run across mobile, home media, PC and automotive comprising !   Terminal specifications !   Open source platform developments !   Proof of concept applications and demos

!   Plus eco-system building in form of !   workshops and seminars, !   research publications and !   liaisons with industry standards

5

Driving Webinos

6

!  Today !   22 founding partners from 9

countries who committed resources for 3 years to deliver webinos

!   Academic + industrial !   Non-polarized !   Cross-domain !   Affiliate Members

!  Tomorrow !   Open (source) community

of academia, industrial and developers driving and using the developments

Webinos Platform

7

Context-Driven UI Adaptation

8

Context-Driven UI Adaptation

!  Webinos Context Model !  User context

!  Device context

!  Environment context

!  Application context

9

Managed by Webinos

For developers

Context-Driven UI Adaptation

10

Context-Driven UI Adaptation

11

Context-Driven UI Adaptation

!  Webinos transformation process

Φ := P ? [S] : [T]

!  Predicate P states required condition !  Actual transformation:

S = e[l := r]

!   Expression e !   Matched for pattern l !   Which is substituted for expression r

12

Case Study

!   Learning assistance for disabled students

!  Current technologies !  Braille readers, text-to-speech (TTS), speech

recognition, …

!   Increased accessibility opportunities

!  But largely unused

!  Developers now mostly use ad hoc processes

!  Multiple versions of the same application

13

Case Study

14

Case Study

AUI Transformation Model

Context Model

Domain Model

Behav. Model

Webinos App developer

Status and Future Work

Official start

Sept Dec Jan 2011

Feb

Assessment of existing Platforms

Requirements and State of the Art

3rd party engagement activities

User Expectations on security and privacy

External communication

Scenarios and use cases

Assessment of Open Source Governance and IPR models

System and API specifications

Mar Apr May

Development of the system

Design of proof-of-concept apps

June July Aug Sept Oct

Status and Future Work

!  Focus group validation !  Evaluate stakeholders’ expectations

!   In progress, currently carried out 3 focus groups

!  Various user and developer personas

!  Proof-of-concept applications !  Model driven specification

!  Gaming, social, e-health, business, …

17

Conclusion

!  Providing end-users with UI optimized to their context of use is essential

!  Even more so for ubiquitous environments

!  A higher level of abstraction is required

!  Webinos platform !  Adaptive UI framework

!  Driven by detailed delivery context description

18

!   Website http://webinos.org/ !   “webinos” group

!   #webinos_project

Thank you

!   E-mail heiko.desruelle@intec.ugent.be