Ecological Interface Design The Application of Cognitive Interface Design Methodology

for a Digitalized Human Machine System

Prof. Woo Chang Cha

Kumoh National Institute of Technology, Korea

Courtesy faculty in Oregon State University

Guest Lecture of IE546 Human Machine Systems Engineering

2014.5.22

WOO CHANG CHA

Academic Background BS(1984), Industrial Engineering, Hanyang University, Korea

MS(1990), Industrial Systems Engineering, Ohio University

PhD(1996), Industrial & MFG Engineering, Oregon State University Communicating Pilot Goals To An Intelligent Cockpit Aiding System

Advisor: Ken Funk

Work Experiences 1998-2014: Professor in Dept. of Engineering Design @ School of Industrial

Engineering. Kumoh National Institute of Technology.

2001~2006: Director of National Research Lab for HFE Guidelines in NPP, Ministry of Education, Science and Technology, Korea:

2005-2006: Research scholar, in department of Industrial Engineering of San Jose State University, Cowork with NASA Ames Research Center (Dr. Corker)

2007~2009: Project director of environment design of main control room of KNGR and UAE nuclear power plant for KEPCO(Korea Electric Power Company)

2005~2014: Editor of Journal of the Ergonomic Society of Korea

2014~2015: Courtesy faculty in MIME @ Oregon State University

2/48

WOO CHANG CHA

Teaching/Research Interests Cognitive systems engineering

Human factors engineering in system safety

Human performance and process modeling & simulation

Applied artificial intelligence

Performed and on-going main researches Pilot goal tracking system in avionic system (1994 ~ 2002)

NASA-AMES, Korea Air Force Academy,..

NPP MCR Design & Evaluation (2001 ~ 2013) KINS, KAERI, KOPEC, KEPRI, ENEC..

Railroad Human Error Research (2012 ~ 2014) Korea Railroad, KTX

Size Korea Anthropometry (2013 ~ 2014)

Product design researches and so on …

Cognitive Systems Lab since 2002, http://csm.kumoh.ac.kr

3/48

Background: Human Machine System A system with one or more human components Three components: Human, Machine and Interface Human-Computer Interface (Interface)

Controls, displays, and other features that transmit information and energy between humans and machines

A boundary across which two independent systems meet and act on or communicate with each other

Similar terms: Human Computer Interaction(HCI)

Interface

Intelligent Machine

(Computers)

Human(s) User

Display

Control

4/48

Background: Human-Computer Interaction

Design – Evaluation - Implementation Iterative process

Usability engineering

of Interactive computing systems Goal communication

between human and computer

for Human use Human centered design

concerns Safety, usability, privacy Adapted from Figure 1 of the ACM SIGCHI

Curricula for Human-Computer Interaction

5/48

Interactive Computing System Design Trends

Independent being => Relational being

Computer Centered => Human Centered

Design Oriented => User Oriented

User Interface(UI) => User Experience(UX)

Work in Socio-Technical System

Norman, D.A. (1986). Cognitive Engineering, User Centered System Design-New Perspective on Human-Computer Interaction.

6/48

A Definition of Good Design

A design to reduce a cognitive distance between user’s mental model and

designer’s conceptual model about a product or a system (HMS)

Cognitive distance The distance people perceive to exist in a given situation

How subjectively two pieces of information are related for the user.

Ontological drift

Gulf of execution: Mismatch between the users' intentions and the allowable actions

Gulf of evaluation : Mismatch between the system's representation and the users' expectations

Display compatibility

Display representation compatible with physical system and mental model

Compatible design with user’s expectation of stimulus and response to information display.

Rapid learning time and response time

Reduce human errors

Reduce mental workload

Increase user satisfaction

The best way to reduce a cognitive distance is to develop an interface in term of UI design principles such as usefulness, usability and affectiveness. How can we develop useful, usable, and even aesthetic computer systems?

7/48

Background: Digitalized Interface Design

8/48

Totally Digitalized System Environment: Korea Next Generation Reactor Main Control Room

Conventional MCR

Shingori 3&4 MCR 3D Mockup

9/48

KNGR MMIS: Large Display Panel(LDP)

10'-9"

Mimic Section

(RO)

Mimic Section

(TO)

PPS/CFM/SPM/BISI

Section

Variable Display Section

(RO)

Variable Display Section

(TO)

Plant Overview

Message Section

120" 120"67"

67"

67"

67"

67"

67"

24'-5"

10/48

KNGR MMIS: Soft Control

SAFETY INJECTION SYSTEM2002

08. 21

14:30:01A

SI VALVESI-HS-698

OPEN

ESF-2

TROUBLE

DISABLED

CLOSE

SYS-1 SYS-2

SI

System NameHeartbeat

Timer

Channel Indicator

Navigation Button to

System Directory Page 1

Navigation Button to

System Directory Page 2

Navigation Button to

System Mimic Display

ESCM Control Switch (Safety Level) SC Display(Non-Safety)

11/48

KNGR MMIS: Computerized Procedure System

PBP: Paper Based Procedure

CBP: Computer Based Procedure

12/48

NPP MCR Development Process Human Factor Engineering Program Review Model

(NUREG-0711 Rev.2, 2004)

A. Planning & Analysis 1. HFE Program Management 2. Operating Experience Review 3. Function Analysis 4. Task Analysis 5. Staffing & Qualification 6. Human Reliability Analysis B. Design 7. Human-System Interface Design 8. Procedure Development 9. Training Program Development C. Verification & Validation 10. Human Factor V & V D. Implementation & Operation 11. Design Implementation 12. Human Performance Monitoring

13/48

HMSE Process Adapted from IE546

2014 Funk

14/48

What should be analyzed?

Interface

Work domain (Functional) constraints

User’s constraints

Possibilities of information technology

Designer

Organizational/ social/ cultural

environment

Interaction

(Task)

CSE is concerned with what and how should be analyzed to provide

design/evaluation requirements

15/48

HMS Complexity

Complexity of human-machine interaction can be affected by several factors

Typical dimension of complexity Structural complexity

Number of components in the technical system

Number of connections between components

Number of common nodes

Type of components and the connections

Functional complexity

Order of systems and subsystems

Number of functions at a components

Loop time constraints

Interface complexity

Level of interaction

Type of interaction

16/48

Information Displays in Digitalized MCR

Various type of information displays: PMAS Graph(Plot),List-Table, Graphics, Logic Diagram, Box Fill-in

Digitalized information displays of MCR Present information exceeding human cognitive processing limitation.

Decision making by integrating the information Increases cognitive demand

Occurs new types of human error: TM error, Mode error,..

Needs to provide cognitively oriented interface Not simple P&ID, but displays reflecting system dynamics characteristics and the

relationship between system variables

Cognitive tasks based interface design => EID

17/48

Cognitive Oriented Information Display

Cognitive System Engineering(CSE)

Is about developing concepts, methods, and tools for analyzing,

designing, and evaluating usable and safe systems to help humans as

they carry out their daily cognitive endeavors

Is systems engineering activity to enhance the performance of human-

machine systems to be considered as a total cognitive system

18/48

CSE approach to development of HMS

Analysis Design Evaluation Operation

Why

To provide design/ evaluation requirements

To achieve artificial cognitive systems that enhance user’s performance

To verify and validate the design elements and to assess the performance of total cognitive system

To enhance the performance of total cognitive system

What

Work domain (Functionality)

User’s task

User’s mental strategies

Organization structure

User’s knowledge and competencies

Error and reliability

Information display

Alarm

Computerized and written procedure

Training system

Automation

Information aiding

Staffing and organization

Each design element

Human-work interaction

Functionality

Usability

Safety and reliability

Affordability

Maintenability

Safety

Reliability

Usability

Functionality

Maintenability

Affordability

How

Analysis framework

Conceptual tools

Method

Design framework

Creativity

Principles and guidelines

Evaluation framework

Analytic method

Experimentation

Analytic method

Experimentation

19/48

Cognitive task analysis (CTA)

Characteristics of tasks requiring CTA Involve a high degree of problem

solving and decision making

Place high mental workload on operators

Require large amounts of information to be assimilated

Are difficult to verbalize or are not observable

Have substantial time pressures

…

What to be analyzed

Knowledge

Declarative knowledge

Structural knowledge

Operational knowledge

Skill

Automated skill

Procedural skill

Representational skill

Decision making skill

Heuristics

Cognitive bias

Strategies

20

Cognitive task analysis (CTA)

Typical CTA methods

Decision ladder and Information flow map

Critical decision method

Consistent component method

Diagramming method

Simplified PARI (precursor, action, result, interpretation)

Verbal reports

Conceptual graph analysis

GOMS

Cognitive walkthrough

…

21/48

CTA tool: Decision Ladder

Predict consequences

Evaluate options

Informatio

n

Goals

State Target

Option Goal chosen

Identification Choice of task

Task

Alert

Observation

Activation

Planning

Procedure

Execution

Information processing activities

States of knowledge

Heuristics, shortcuts

22/48

CTA tool: Information flow map

Failed system

Model of function in hypothetica

l failed state

Modify the model of function

according to hypothesis

Fault found

Yes

Reference symptom pattern

Hypothesis of fault in

system

Search strategy

Next

hypothesis

Hypothesis from other sources

Present operational input

Model of normal

function

Deduce response pattern

Pattern matching

MATCH?

No

Hypothesis and test search strategy for fault diagnosis task

23/48

Abstraction hierarchy (AH)

AH is a multilevel knowledge representation framework for describing the functional structure of work domain

AH is defined by goal-means relations between levels

Five abstraction levels are known to be useful for describing complex system such as NPP Functional purpose (FP): the purpose for which the system was

designed

Abstract function (AF): the causal structure of the process in terms of mass, energy, information and value flows

General function (GF): the basic functions that the system was designed to achieve

Physical function (PF): the characteristics of the components and their interconnections

Physical form (P): the appearance and spatial location of those components

24/48

Abstraction hierarchy (AH)

Example of goal-means abstraction hierarchy

Washing machine Property

Functional purpose Washing specifications Energy waste requirements

Abstract function Energy, water, and detergent flow topology

General function Washing, draining, drying, Heating, temperature control

Physical function Mechanical drum drive

Pump and valve function Electrical/ gas heating circuit

Physical form Configuration and weight, size Style and color

25/48

Abstraction-Decomposition matrix

Whole-part

Goal-means Total system Subsystem

Functional unit

Subassembly Component

Functional purpose

Why

Abstract function, priority, measure

Why What

General function

What How

Physical function

How

Physical form

26/48

Strategy analysis using the AH

Whole-part

Goal-means Total system Subsystem

Functional unit

Subassembly Component

Functional purpose

Abstract function, priority, measure

General function

Physical function

Physical form

1

2

3

4

5 6

7 8

9 10

27/48

A road from analysis to design

(Vicente, 1999)

Identify Realize Develop Form Build Conceptual distinctions

Modeling tools

Models of intrinsic

work constraints

Systems design interventions

Work domain

Control tasks

Strategies

Social-organizationa

l

Worker competencies

Abstraction hierarchy

Decision ladder

Information flow map

All of the above

SRK taxonomy

Sensors, models, DB

Procedures, automation, context-sensitive

interface

Dialogue modes, process flow

Role allocation, organizational

structure

Selection, training, interface form

28/48

What should be designed?

CSE aims to provide framework, principles, guidelines, rules, and standards to help HMS designers develop artificial

cognitive system that are safe and pleasant to use, thereby realizing proper human-machine (computer) interaction

Information display

Alarm

Procedure

Automation

Information aiding

Training system

Staffing and organization

Design of total cognitive system

29/48

User interface design methods

Data analysis methods

List of users

List of environments

Users’ profiles

Workflow diagrams

Task sequences

Task hierarchies

User/task matrices

Detailed task descriptions from

procedural analysis

Task flowcharts

Interface design methods

Qualitative usability goals

Objects/actions

Metaphors

Use scenarios

Use sequences

Use flow diagrams

Use workflows

Use hierarchies

Storyboards

Rough interface sketches

Video dramatizations

Etc.

(Hackos, 1998)

30

Cognitive Information Displays Design

Cognitive Interface An optimally designed interface based on CSE principles

Cognitively oriented displays and controls considering work domain (functional) constraints, users and environmental constraints through Work Domain Analysis(WDA)

Design methodologies for cognitive information displays

IRD(Information Rich Design)

EID(Ecological Interface Design)

31/48

Information Rich Display Design Information Rich Display – Braseth et al. 2003, 2004

Present information as much as it can be displayed within users’ cognitive limitation

IRD design principles Dull Screen Principle

Normalization/Integrated Trends

Macro Representation

Used a complimentary design tool for EID

Loviisa NPP conventional display IRD applied display

32/48

Ecological Interface Display Design EID –Vicente & Rasmussen, 1992.

Visualize the abstracted information

Describe the functional structure of work domain

Design a cognitive interface using two strategies: representation of system constraints

use the concept of abstraction hierarchy.

Improve performance of situation awareness

33/48

EID Display

34/48

Generic EID Design Process

EID Process (Burns 2004)

• Reflect DM process to move abstraction level • Cognitive continuum theory: intuition analysis

Cognitive Task Analysis

35/48

A NPP Research Background

Difficult to apply cognitive interface for designing MMIS of NPP NO design guidelines for cognitive interface

Crews spend much time to learn, adapt, and reluctant to use redesigned interface

Too much additional cost for a small change of design

Research Objectives Provide a framework and feasible methodology for

displaying cognitive information

Develop design guideline for cognitively oriented displays and controls suitable for the digitalized MCR of NPP

Proposed feasible example of the cognitive interface

36/48

Define the System

Main Feed Water System

37/48

Applied EID Design Process

12th IFAC/IFIP/IFORS/IEA Symposium on Analysis,

Design, and

Evaluation of Human-Machine Systems

38/48

Performed Analysis - WDA

Abstraction Hierarchy of SG

Part-Whole Decomposition of SG

39/48

Performed Design: Variables

Single variable displays Multiple variable displays

40/48

EID Design Example (SG Feed Water Control Display)

FWP

75%

AUTO

MANUAL

▲▼

4.0K PV

4.5K

4.2K SP

AUTO

MANUAL

▲▼

4.0K PV

4.5K

4.2K SP

AUTO

MANUAL

▲▼

4.0K PV

4.2K SP

4.5K

Master FD

FWP1

FWP2

FWP3

AUTO

MANUAL

▲▼

0K PV

0K

60% SP SP

FWP Speed(RPM)

SG1

SG2

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

75%

80.0 T/h

10%

40%

50.0 T/h

75%

DC Valve

EC Valve

Feed Water Flow

SteamFlow

SG 2 Level

Tref 297Tc 295

Th 305

Tavg 300

RCS 2Temp (˚C)

-2 (min) -1 0 +1

20%

34%

54%

44%

85% (NR)

47%

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

75%

80.0 T/h

10%

40%

50.0 T/h

75%

DC Valve

EC Valve

Feed Water Flow

SteamFlow

SG 1 Level

Tref 297Tc 295

Th 305

Tavg 300

RCS 1Temp (˚C)

-2 (min) -1 0 +1

20%

34%

54%

44%

85% (NR)

47%

41/48

EID Design Example (Information Flow)

FWP

75%

AUTO

MANUAL

▲▼

4.0K PV

4.5K

4.2K SP

AUTO

MANUAL

▲▼

4.0K PV

4.5K

4.2K SP

AUTO

MANUAL

▲▼

4.0K PV

4.2K SP

4.5K

Master FD

FWP1

FWP2

FWP3

AUTO

MANUAL

▲▼

0K PV

0K

60% SP SP

FWP Speed(RPM)

SG1

SG2

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

75%

80.0 T/h

10%

40%

50.0 T/h

75%

DC Valve

EC Valve

Feed Water Flow

SteamFlow

SG 2 Level

Tref 297Tc 295

Th 305

Tavg 300

RCS 2Temp (˚C)

-2 (min) -1 0 +1

20%

34%

54%

44%

85% (NR)

47%

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

75%

80.0 T/h

10%

40%

50.0 T/h

75%

DC Valve

EC Valve

Feed Water Flow

SteamFlow

SG 1 Level

Tref 297Tc 295

Th 305

Tavg 300

RCS 1Temp (˚C)

-2 (min) -1 0 +1

20%

34%

54%

44%

85% (NR)

47%

Main FW Pump SG1

SG 2

Pump Velocity Control

FW REQ Flow DC & EC valve control

DC & EC valve Control

Compare FW & Steam flow

Compare FW & Steam Flow

SG1 flow level

SG2 flow level

RCS

tem

p

RCS

tem

p

To Higher Abstraction Level

SG Feed Water Flow

42/48

EID Design Example (Represent AH)

FWP

75%

AUTO

MANUAL

▲▼

4.0K PV

4.5K

4.2K SP

AUTO

MANUAL

▲▼

4.0K PV

4.5K

4.2K SP

AUTO

MANUAL

▲▼

4.0K PV

4.2K SP

4.5K

Master FD

FWP1

FWP2

FWP3

AUTO

MANUAL

▲▼

0K PV

0K

60% SP SP

FWP Speed(RPM)

SG1

SG2

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

75%

80.0 T/h

10%

40%

50.0 T/h

75%

DC Valve

EC Valve

Feed Water Flow

SteamFlow

SG 2 Level

Tref 297Tc 295

Th 305

Tavg 300

RCS 2Temp (˚C)

-2 (min) -1 0 +1

20%

34%

54%

44%

85% (NR)

47%

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

AUTO

MANUAL

▲

▼

50% PV

75%

60%SP

75%

80.0 T/h

10%

40%

50.0 T/h

75%

DC Valve

EC Valve

Feed Water Flow

SteamFlow

SG 1 Level

Tref 297Tc 295

Th 305

Tavg 300

RCS 1Temp (˚C)

-2 (min) -1 0 +1

20%

34%

54%

44%

85% (NR)

47%

To Higher Abstraction Level

FP GF PFn / PF

Downcoma valve open

rate

Economizer Valve open

rate

Main FW

pump

Steam Flow

SG Flow level

RCS temp

FW Flow

43/48

A Conventional Display of SG

44/48

Proposed Example of EID for SG process

45/48

Evaluations

Perform the empirical test for the suitability Only feasibility test at this moment due to much cost.

Full V&V will be performed with the persuasive outcome of the proposed cognitive interface design

Efforts to persuade the cognitive interface design Design the alternatives of cognitive interface according to

EID principle and guideline

FGI with operators and Delphi feedback for suitable design Explain why the abstract information should be visualized

Compare with existing interface for its usability

Refer to other EID researches with better performance NOVA chemical plant, HAMBO project..

Reduce # and times of tasks, lower human errors..

46/48

Discussion

Current outcomes from the NPP application of EID method Collective documents of various researches with

effectiveness of EID design methodology

Information Requirement and CTA SG & pressurizer control process of digitalized MCR of NPP

Empirical design guidelines for cognitive interface Style guideline for design element based on EID principle

Feasibility analysis of the proposed cognitive interface

Look for the usefulness of the proposed interface Not in the main displays but may work for the supportive

aiding display for the tasks demanding cognitive workload

47/48

Future Research with EID

Nuclear Power System @ KNGR

Develop design standard and guideline for cognitively

oriented information displays

Develop design template for the cognitive interface

Increase design fidelity of cognitive interface by which can

be used on the real environment of digitalized MCR

Medical system @ OSU

Design study (EID, Burns & Hajdukiewicz, CRC, 2004)

Oxygenation Monitoring in the national ICU

Patient monitoring in the operating room

Diabetes management system

Working on HTK design

48/48