Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development
-
Upload
perspegrity5 -
Category
Technology
-
view
102 -
download
2
description
Transcript of Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development
![Page 1: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/1.jpg)
Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development:
“What works for authors?”
Tom MurrayUniversity of Massachusetts
ITS 2014 Workshop:Intelligent Tutoring System Authoring Tools
![Page 2: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/2.jpg)
# 2
Authoring Tool Projects• SETS – (1991) Equipment
maintenance training• Eon - ITS authoring for
domain, student, teaching models, and interface
• MetaLinks - hyperbook authoring tool
• SimForest-G - Glass box simulation authoring
• Rashi - Coached inquiry learning environment w/ authoring tool
• Wayang/MathSprings – (2014) teacher tools
![Page 3: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/3.jpg)
Authoring Tools for Advanced Technology Learning Environments
Murray, Blessing, Ainsworth (Eds) (2003)
![Page 4: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/4.jpg)
Recent interests applied to ITS authoring -- Theory
• User Roles vs Tools: Matching Complexity• Activity Theory: Tools, Tasks, Users,
Community• Epistemic Forms/Games• Developmental Theory (of complexity)
![Page 5: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/5.jpg)
ITS Authoring Tool Design Tradeoffs
Usability
DepthFlexibility
Studentmodel
Expertmodel
Pedagogymodel
Curriculummodel
easy,efficient?
realistic, “intelligent?
• Interoperability• Multi-user ITS• ...
Many domains, and types?
![Page 6: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/6.jpg)
Authoring Tool Users
![Page 7: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/7.jpg)
Matching Complexity—Tools vs. User capacity
Complexity?
Tools Users
1) Know your user (anticipate user needs)2) Usability Testing (“early and often”)3) Theory (of usability, cognition...)
![Page 8: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/8.jpg)
Complex Software:(investment) Risk Assessment
ITS design == AI-complete…….ITS A-Tool design == ITS-Complete!
![Page 9: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/9.jpg)
Activity TheoryAuth. tool(artifact)
User(cognition)
Task(goals)
Com. ofPractice
Rules(“forms, games”)
Div. of Labor
ITS(outcome)
Jonassen & Rohrer-Murphy 1999; Engestrom et al. 1999;
![Page 10: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/10.jpg)
Complexity CoordinationAuth. tool(artifact)
User(cognition)
Task(goals)
Com. ofPractice
Rules(“forms, games”)
Div. of Labor
ITS(outcome)
Complexity matching:1. User <> Tool2. Task <> User3. COP (& user) <> Tool
• Cognitive Complexity (user)• Task Complexity• Tool Complexity• Socio-cognitive complexity
(COP)
![Page 11: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/11.jpg)
Authoring Tools for All Users?(Tiered Authoring/Work Flow)
![Page 12: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/12.jpg)
Capacity is context-dependent
• User complexity capacity: f(S,I,T)
Background skill (generic—see table)+ Investment in training A-Tool+ Time available to author this ITS
![Page 13: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/13.jpg)
Sources of (software) system complexity
• Structural complexity (space)– Object has many properties– Many parts– Many types of parts– Many relationships – Many types of relationships
• Perspectival complexity– alternatives, hypotheticals,
variables, decision spaces• Dynamic complexity
– Loops, Feedback, recursion relationships (“non-linearity”)
![Page 14: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/14.jpg)
Epistemic Forms & Games(Mental Models)
(Collins & Furgeson, 1993)
• list• matrix or table• molecular model• periodic table • web page menu• x-y graph• pert chart• binary tree• floor plan
• street map• org. chart• musical score• timeline• cause/effect diagram• network• relational database• sentence diagram• term paper outline
![Page 15: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/15.jpg)
Epistemic forms in interfaces
![Page 16: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/16.jpg)
Can we estimate the complexity of epistemic forms/games in authoring tools?
• >> use cognitive developmental theory
![Page 17: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/17.jpg)
Cognitive Developmentalists
Kegan; Fisher; Commons; Cook-Greuter...
• Human development and learning can be described in terms of "qualitative differences in mental complexity."
• …that add a hierarchical "structural perspective in analyzing the organization of actions and thought."
![Page 18: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/18.jpg)
Development: the concept of FunSingle Rep. (unconnected list)
Fun is swinging on a swing. It’s sliding on a slide.
Rep.Mapping(connections)
Fun is when Tommy and I put blocks together and then knock them down so that they make a loud noise that makes us laugh.
Rep. System(interconnections)
Fun is different things. Sometimes I like to climb…that makes me…
Single Abstr.(unconnected list)
Fun is a way of enjoying yourself. It is a form of pleasure.
Abst. Mapping(connections)
There are a variety of ways that a person can have fun. Some people enjoy physical activities, like sports or just exercise. Some people…
![Page 19: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/19.jpg)
• Actions at a higher order of hierarchical complexity organize and transform the lower order actions
• Complexity level (or “order”) based on:1. complexity of objects operated upon (vertical complexity; order of abstraction)2. complexity of object coordination (horizontal complexity; structure of objects)
![Page 20: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/20.jpg)
Fisher’s Skill Theory
For any skillalgebra, reading, piano, parenting, tennis…
![Page 21: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/21.jpg)
Addition > Multiplication > Algebra > Calculus > …
• Single Set (e.g. a list)
(e.g. addition; subtraction…)
• Mapping (e.g. linear causal link)
(coordinating addition & subtraction)
• System (e.g. many interconnected parts)
(e.g. coordinating +, -, x, /)
• [System of Systems (an entire complex system)
(moving to Algebra)]
![Page 22: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/22.jpg)
• System of Systems (an entire complex system with feedback loops)
• System (e.g. many interconnected parts)
• Mapping (e.g. linear causal link)
• Single Set (e.g. a list)
![Page 23: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/23.jpg)
(concrete operations)
(formal op.)
…(post-formal op.)
SYNTAX(STRUCTURE)
SEMANTICS(OBJECTS)
![Page 24: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/24.jpg)
Increasing complexity of theMental Model
![Page 25: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/25.jpg)
Epistemic Forms Complexity1. Simple objects: lists, sliders, simple relationships
2. Complex mappings: tables, trees, scripts, concept nets
![Page 26: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/26.jpg)
(cont.)
NEED TESTING/DEBUGGING TOOLS
3. Formal systems: Add variables, equations, static models
4. Dynamic Systems: Loops, conditionals, dynamic/constrain models, rule systems
![Page 27: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/27.jpg)
(cont.)
5. Dynamic Systems/ Architectures(version control; constant monitoring)
![Page 28: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/28.jpg)
Increasing complexity of theMental Model
![Page 29: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/29.jpg)
![Page 30: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/30.jpg)
Review
• User Roles vs Tools: Matching Complexity• Activity Theory: Tools, Tasks, Users,
Community• Epistemic Forms/Games• Developmental Theory (of complexity)
![Page 31: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/31.jpg)
Conclusions:If “we build it will they come”?
• Market & Buy-in: Have ITSs demonstrated cost-benefit yet? In what situations?
• Creating a pipeline for training and trained ITS authors and knowledge engineers
• Building communities of practice (examples: CTAT, WISE, Knowledge Forum…)
• Expectation management: matching tool and user complexity (and constraining the breadth/depth of the outcome ITSs)
• Building an ITS authoring tool is like…?? What known completed project? Using lessons from a parallel domain?
![Page 32: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/32.jpg)
Thank You
![Page 33: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/33.jpg)
Extra Slides
![Page 34: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/34.jpg)
![Page 35: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/35.jpg)
GIFT Functional Block Diagram
![Page 36: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/36.jpg)
Behavior Recorder
Data Shop
CTAT’s Modular Architecture
Student Interface(or external problem-solving environment)
Cool Modes
CyclePad
Java Swing
Flash
Learner Management System
LMS
Tutor Shop
Cognitive Model Development Tools
TDK (Lisp-based)Jess tools (Java-
based)
Editor
Eclipse
Tutor Engine
Tertle (Lisp-based) + Model TracerJess (Java--based) + Model Tracer
Example Tracer (Java-based)
Example Tracer (Flash-based)
GUI Builder
IntelliJ
Dreamweaver
Code Warrior
Netbeans
Flash MX 2004
![Page 37: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/37.jpg)
![Page 38: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/38.jpg)
![Page 39: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/39.jpg)
![Page 40: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/40.jpg)
![Page 41: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/41.jpg)
Principles
• Syntax/structure in increasing complexity (first); – they repeat for each:
• Semantic tier (abstraction level; “depth” of the objects)
• New semantic tiers (depth) emerge with sufficient syntax (breadth)
• You can’t skip levels in “development”• Building intuitions of complexity is more
important that a formal theory of complexity.
![Page 42: Authoring Tools, Complexity, Epistemic Forms, and Cognitive Development](https://reader034.fdocuments.net/reader034/viewer/2022051817/54877a63b47959ce0c8b54d7/html5/thumbnails/42.jpg)
About 40 ALE authoring tools
40-60as of2002