Effect of instruction types and task assignments

13
Effect of instruction types and task assignments

description

Effect of instruction types and task assignments. Overview. Asynchronous. Synchronous. Local. Autologging. User Reporting. Remote. Instructions. Three types of instruction: Definition Examples Definition + Examples Definition: Usability problems are present when the system is: - PowerPoint PPT Presentation

Transcript of Effect of instruction types and task assignments

Page 1: Effect of instruction types and task assignments

Effect of instruction types and task assignments

Page 2: Effect of instruction types and task assignments

Overview

Synchronous

2

Autologging User Reporting

Asynchronous

Loca

lR

em

ote

Page 3: Effect of instruction types and task assignments

Instructions

Three types of instruction:DefinitionExamplesDefinition + Examples

Definition:Usability problems are present when the system is:

• Unuseful: You cannot find the documents or functions you need to solve your tasks. • Difficult to learn: It takes a long time to learn how to use the system.• Difficult to remember: It takes a long time to find elements in the system, which you

have used previously.• Ineffective to use: It takes a long time to solve certain tasks with the system.• Unsatisfying to use: The system does not feel comfortable to use, it is not joyful to work

with it.

3

Page 4: Effect of instruction types and task assignments

Instructions

Three types of instruction:DefinitionExamplesDefinition + Examples

Example of a usability problem:I wanted to insert a footnote in my document. I expected to find this function under the menu called 'Insert', but I could not find it. I also tried to look in the menus 'Page layout' and 'View', but without any luck. It was somewhat irritating. I tried to solve the problem by using the help function and found that I must select the 'Reference' menu, which provided me with the correct functionality. It was not intuitive that something I want to insert is located within the 'Reference' menu and not within the 'Insert' menu.

4

Page 5: Effect of instruction types and task assignments

Task types

Predefined tasksExample: Imagine that you failed an exam for the third time. Find out what you must do to get a fourth try.

No tasksUsers were asked to solve tasks relevant for their daily work.

5

Page 6: Effect of instruction types and task assignments

Experimental Setup

53 ICT students (Computer Science, Informatics, Software Engineering etc.)Evaluation of a website for students (sict.aau.dk)

6

Tasks No tasks

Definition 8 8

Examples 7 6

Definition + Examples

8 6

Conventional Lab

10

Remote asynchronous

Page 7: Effect of instruction types and task assignments

Experimental Setup

7

Page 8: Effect of instruction types and task assignments

Effect of instruction types

No. of problems found

Subjective ratings (1 = lowest satisfaction, 5 = highest satisfaction)

8

Critical Serious Cosmetic Total

Definition + Examples 10 9 6 25 (59)

Definition 9 8 0 17 (40)

Examples 13 10 6 29 (69)

LAB 12 13 11 36 (86)

Definition Examples Definition + Examples

4 5 4

Page 9: Effect of instruction types and task assignments

Effect of task types

No. of tasks solved

No tasks = 1.5 (average)

Tasks = 3.7 (average)

9

No. of problems found

No tasks = 2.16 (average)

Tasks = 6.67 (average)

Page 10: Effect of instruction types and task assignments

Effect of task types

Total number of problems found

Problem Agreement

10

Critical Serious Cosmetic Total

No Tasks 4 6 3 13 (31)

Tasks 13 10 6 29 (69)

LAB 12 13 11 36 (86)

Total 15 15 12 42 (100)

Def.

Tasks

Def.

No Tasks

Ex.

Tasks

Ex.

No Tasks

Def.+Ex.

Tasks

Def.+Ex.

No Tasks

LAB

0.24 0.06 0.33 0.02 0.27 0.05 0.54

Page 11: Effect of instruction types and task assignments

Konklusion

Users receiving examples:Identified more problemsGave higher satisfaction ratings

Users receiving predefined tasks:Solves more tasksIdentify more problemsHave a higher problem agreement

Users that don’t receive predefined tasks identify a more varied set of problems

11

Page 12: Effect of instruction types and task assignments

Fremtidig forskning: Remote evaluering i praksis

Andre brugertyperAnvendelse i virksomhedDirekte integration i software

12

Page 13: Effect of instruction types and task assignments

Efter pausen

Individuelle spørgeskema udfyldt

13