Architectures and experiences with design and monitorization
description
Transcript of Architectures and experiences with design and monitorization
![Page 1: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/1.jpg)
Architectures and experiences with design and monitorization
María Jesús Rodríguez-Triana( [email protected] )
GSIC/EMIC research groupUniversidad de Valladolid
May, 2013
Architectures and experiences withdesign and monitorization
![Page 2: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/2.jpg)
What is this presentation about?
EEE Global Objective 3
Evaluation of learning situations in
ubiquitous learning and reflected spaces
(Iván)
Architectures for supporting learning
across web & physical spaces using AR(Luis P. & Juan)
2
EEE GO3:To define methods and
technologies to support the evaluation of ubiquitous learning,
taking into account the students’ actions in different spaces.
![Page 3: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/3.jpg)
• Introduction• Proposal• Use in real settings• Adding new spaces• Work in Progress & Future work
3
Index
![Page 4: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/4.jpg)
• Orchestration framework for TEL scenarios
4
5 + 3 aspects[Prieto et al. 2011]
Introduction (1/3)
![Page 5: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/5.jpg)
• Orchestration framework for TEL scenarios– Awareness for regulation, management and assessment
5EEE Global Objective 3
UVA Specific Objective 3
5 + 3 aspects[Prieto et al. 2011]
EEE GO3
UVA SO3
Introduction (2/3)
![Page 6: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/6.jpg)
6
• Synergies may appear when the analysis is aligned with the design [Carter, 2008] [Locyer & Dawson, 2011] [Looney & Siemens, 2011] [Martínez-Monés et al., 2011]
Scripting
Monitoring
… however, the integration is not straightforward:
design & technological problems may
appear[Martínez-Monés et al., 2011]
Introduction (3/3)
![Page 7: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/7.jpg)
7
Monitoring-awaredesign processof CSCL scripts
Monitoring-awaredesign modelof CSCL scripts
Script-aware monitoring process
of CSCL scenarios
Architecturefor data gathering & integration in DLEs
Provide teachers with design and enactment support capable of linking pedagogical intentions with monitoring needs for orchestrating
blended CSCL scenarios in distributed learning environments
Provide teachers with coarse-grained information about the evolution of the CSCL scenario,
based on the constraints obtained from the learning
design.
Support teachers to identify and include the
monitoring issues of pedagogical significance throughout the design
process of CSCL scenarios.
Automatize the data gathering and integration
tasks in technologically distributed and
heterogeneous CSCL environments.
Proposal (1/7)
![Page 8: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/8.jpg)
8[Rodríguez-Triana et al., 2012a] [Rodríguez-Triana et al., 2013a]
Pattern-based design process for CSCL scripts[Villasclaras-Fernández
et al., 2009]
Pattern-based design process for CSCL scripts[Villasclaras-Fernández
et al., 2009]
Proposal (2/7)Monitoring-aware design of CSCL scripts
![Page 9: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/9.jpg)
[Soller et al., 2005] Main steps for the management of collaboration
(1) Collect Interaction Data
(2) Construct a Model of
Interaction
(3) Compare the Current State of Interaction to
the Desired State
(4) Advise/ Guide the Interaction
(5) Evaluate Interaction
Assessment and Diagnosis
Proposal (3/7)Script-aware monitoring of CSCL scenarios
9
![Page 10: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/10.jpg)
ScriptingMonitoring
[Rodríguez-Triana et al., 2011a][Rodríguez-Triana et al., 2013b]
[Soller et al., 2005] Main steps for the management of collaboration
(1) Collect Interaction Data
(2) Construct a Model of
Interaction
(3) Compare the Current State of Interaction to
the Desired State
(4) Advise/ Guide the Interaction
(5) Evaluate Interaction
Assessment and Diagnosis
Guided by the script definition
(participants, resources,
deadlines, …)
Based on the script constraints
(obtained form the definition of the
activities)
i.e comparing the gathered evidence with
the script definition
Teacher are informed about the comparison
between the script and the gathered
evidenced
Proposal (4/7)Script-aware monitoring of CSCL scenarios
10
![Page 11: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/11.jpg)
11
GLUE! – Architecture for implementing DLEs [Alario-Hoyos, et al. 2013]
Proposal (5/7)Architecture for data gathering and integration in DLEs
![Page 12: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/12.jpg)
12[Rodríguez-Triana et al., 2011b] [Rodríguez-Triana et al., 2011c]
GLUE!-CAS (GLUE! - Collaboration Analysis Support)
GLUE! – Architecture for implementing DLEs [Alario-Hoyos, et al. 2013]
Proposal (6/7)Architecture for data gathering and integration in DLEs
![Page 13: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/13.jpg)
13
Proposal (7/7)Architecture for data gathering and integration in DLEs
![Page 14: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/14.jpg)
14
FPAD(170 students)
MASUP 2013(15 students)
OyT(60 students)
MASUP 23(14 students)
MASUP 32(14 students)
Blended CSCL scenarios supported by VLE’s & Web tools
Use in real settings (1/10)
![Page 15: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/15.jpg)
15
EVALUATION
ENACTMENTDESIGN INSTANTIATION
Monitoringconfiguration
Use in real settings (2/10)
![Page 16: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/16.jpg)
Monitoring-aware design process:Monitoring configuration of the activities
Use in real settings
16
![Page 17: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/17.jpg)
Use in real settings
![Page 18: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/18.jpg)
Monitoring-aware design process:Monitoring enhancement
Use in real settings
18
![Page 19: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/19.jpg)
Use in real settings
![Page 20: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/20.jpg)
20
EVALUATION
ENACTMENTDESIGN INSTANTIATION
Monitoringconfiguration
Deploy
Use in real settings (8/10)
![Page 21: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/21.jpg)
21
EVALUATION
ENACTMENTDESIGN INSTANTIATION
Monitoringconfiguration
Deploy
Use in real settings (8/10)
![Page 22: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/22.jpg)
22
EVALUATION
ENACTMENTDESIGN INSTANTIATION
Logs
Teacherobservations Students
feedback
Monitoringconfiguration
Deploy
Use in real settings (8/10)
![Page 23: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/23.jpg)
Monitoring configuration + Deploy
Use in real settings (9/10)Script-aware monitoring process:Monitoring reports
![Page 24: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/24.jpg)
Use in real settings (10/10)
24
“Identifying the dependences with other activities is not trivial “
“Focusing the analysis around the activity and the pattern constraints is very useful for
teachers, even in situations like these where there were not many eventualities, it allows you
to check whether the original idea is being verified.”
“… information from face-to-face activities was helpful for the evaluation purposes. An overview of the whole learning situation facilitates the review of the learning process.“
![Page 25: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/25.jpg)
25
• The same problems appear again: [Martínez-Monés et al., 2011] – Design problems:
• Which tools provide awareness information? There are not many choices– Technological problems:
• Data gathering issues: – Some tools do not register any kind of data about the user activity – Does not exist a standard format to store information from user’s interaction– Tools do not provide documentation explaining how the information can be obtained
• Data interpretation issues:– Some applications do not provide ready to use data– Many applications do not store data for analysis purposes but for others such as debugging.
» Need of taking into account the monitoring requirements when designing and developing ICT tools [Carter, 2008].
• Data integration issues: – Data synchronization– User identities
• It’s necessary to identify teacher’s awareness needs in each space:– http://www.encuestafacil.com/RespWeb/Qn.aspx?EID=1520807
Adding new spaces
![Page 26: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/26.jpg)
• [WIP] Adapt GLUE!, GLUE!-PS, GLUEPS-AR to better provide awareness information
• [WIP] Integration of AR data sources• [WIP] Analysis of teacher’s awareness needs-------------------------------------------------------------------------------• [FW] Integrate the monitoring-aware design process with
authoring tools• [FW] Provide an integrated view of the different data
sources• [FW] Student’s awareness needs
26
Work in progress & Future work
![Page 27: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/27.jpg)
?Questions, doubts?
![Page 28: Architectures and experiences with design and monitorization](https://reader035.fdocuments.net/reader035/viewer/2022062301/56815f30550346895dcdfef4/html5/thumbnails/28.jpg)
THANK YOU!For further information, please contact [email protected]
GSIC-EMIC research groupUniversidad de Valladolid, Spain