1

Human Factors in the Coming Age of

Driverless Vehicle

Jibo He, Ph.D., Associate Professor

Department of Psychology

Investment Partner, iBeeHub Incubator

Jibo.He@Wichita.edu

22

3

About Jibo He

44

5

• Eye-trackers

• Tobii, SMI eye-tracker, and SR Research Eyelink-eye tracker

• Advanced driving simulator

• Advanced flight simulator

• Microsoft HoloLens

• Smartphones & smartwatches

• Google Glass

• NeuroSky EEG sensors

About Human Automation Interaction Lab

6

7

Driving Pleasure and Survival Needs

8

Driving Pains

9

Driving Difficulty

Telescopes Low Vision Driving

Drunk Driving Distracted Driving

Drowsy Driving

10

“to err is human ”

11

Driving Casualty

23

2219

66

3 3 2 11

Top 10 global causes of liability loss by total value of claims

(2011-2016)

Human Error

Defective product/work

Collision/crash

12

Driverless Vehicle

“ A robotic vehicle that is

designed to travel between

destinations without a human

operator ”

13

Sensors in Driverless Vehicle

14

Sensors in Driverless Vehicle

15

Brands of driverless vehicle

❖ General Motors

❖ Ford

❖Mercedes Benz

❖ Volkswagen

❖ Chang An

❖ Tesla

❖ Baidu

❖ Google

❖ Audi

❖ Nissan

❖ BMW

❖ Volvo

❖ Didi

❖ Uber

❖ Toyota

16

Automation levels of driverless vehicles

17

“ to err is machine ”

18

To err is machine,e.g. driverless vehicle

“ Telsa explained that the

vehicle's sensors, which help

to steer the car by identifying

obstructions, had failed to

recognize the white side of

the tractor trailer against a

brightly lit sky.”

Tesla driver killed in first fatal crash using Autopilot

19

To err is machine,e.g. driverless vehicle

Google’s Self-Driving Car Caused Its First Crash

20

Human Factors Issues for Driverless Vehicles

Situational Awareness

➢ Computer Vision Algorithms lack Situational Awareness (Level 3): project

the future actions of the elements in the environment

21

Human Factors Issues for Driverless Vehicles

Trust & Complacency

22

Human Factors Issues for Driverless Vehicles

Insurance and Legal Issues

➢ Federal Automated Vehicles Policy

❖Who must carry motor vehicle insurance ?

❖How to allocate liability when a crash occurs ?

➢ Insurance Information Institute

❖Liability laws might evolve to ensure autonomous vehicle

technology advances are not brought to a halt.

23

Human Factors Issues for Driverless Vehicles

➢ An Insurance Information Institute Pulse survey (2016)

❖ 55 percent of consumers: “would not ride in an autonomous

vehicle. ”

❖ 50 percent: “manufacturer should bear responsibility for an

accident”

❖ Only 25 percent : “willing to pay more for a driverless car to

cover the manufacturer’s liability in case of an accident.”

Customers Acceptance

24

Human Factors Issues for Driverless Vehicles

“The hackers can take control

of the brakes, engine or other

components of a person's car

remotely.”

The Guardian (2016)

Security and Privacy

25

Human Factors Issues for Driverless Vehicles

Control Take-Over

26

Human Sensing Technologies

Fatigue Detection

27

Human Sensing Technologies

✓Face recognition

✓Head tracking

✓Gaze tracking

✓Lip reading

Nvidia’s AI Co-Pilot at CES’2017

28

Take-Home Message: Driverless Vehicle

“ A robotic vehicle that is

designed to travel between

destinations by integrating

human factors & technology ”

29

References

➢ He, J., Choi, W., Yang, Y., Lu, J., Wu, X., & Peng, K. (2017). Detection of driver drowsiness using wearable

devices: A feasibility study of the proximity sensor. Applied Ergonomics.

➢ He, J., Roberson, S., Fields, B., Peng, J., Cielocha, S., & Coltea, J. (2013). Fatigue detection using

smartphones. Journal of Ergonomics, 3(03), 1-7.

➢ Ren, Z., Wang, C., & He, J. (2013, June). Vehicle detection using Android smartphones. In Proceedings of

the Seventh International Driving Symposium on Human Factors in Driver Assessment, Training, and

Vehicle Design, Bolton Landing New York.

➢ Fields, B. M., He, J., Nepomuceno, J. A., Roberson, S., Plummer, B. A., Houdek, K. C., & Jain, N. (2014). U.S.

Patent No. 8,876,535. Washington, DC: U.S. Patent and Trademark Office.

➢ Seppelt, B. D., & Lee, J. D. (2007). Making adaptive cruise control (ACC) limits visible. International

journal of human-computer studies, 65(3), 192-205.