Space Robotics: Enabling Autonomy in Challenging...

37
Robotics Enabling Autonomy in Challenging Environments Ioannis Rekleitis Computer Science and Engineering, University of South Carolina CSCE 190 21 Oct. 2014 Ioannis Rekleitis 1

Transcript of Space Robotics: Enabling Autonomy in Challenging...

Page 1: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

RoboticsEnabling Autonomy in Challenging

Environments

Ioannis Rekleitis

Computer Science and Engineering,

University of South Carolina

CSCE 19021 Oct. 2014

Ioannis Rekleitis 1

Page 2: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Why Robotics?

Driverless CarTED talk: S. Thrun

Underwater exploration, BarbadosMars exploration rover (MER) animation

Roomba® vacuuming robot in action Ioannis Rekleitis 2

Page 3: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Present Everywhere

• At home

• On the road

• In the sky (drones)

• In the fields

(agricultural robotics)

• In resource utilization

(ROV in the oil industry)

• Along power lines

• EducationI. Rekleitis McGill University

Page 4: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Robotics becomes affordable

I. Rekleitis McGill University

AR.DRONE Kinect

IMU

GPS

Raspberry Pi

Lego Mindstorm

TurtleBot 2

Page 5: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Ioannis Rekleitis 5

Page 6: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Robotic System

Ioannis Rekleitis 6

Sensors Actuators

World

?

Page 7: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Robotic System

Ioannis Rekleitis 7

Sense ActWorld

Plan

Page 8: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Sensors

Ioannis Rekleitis 8

• Proprioceptive Sensors(monitor state of robot)

– Battery Voltage

– IMU (accels & gyros)

– Wheel encoders

– Doppler radar

– GPS …

• Exteroceptive Sensors(monitor environment)

– Cameras (single, stereo, omni, FLIR, RGB-d, …)

– Laser scanner

– MW radar

– Sonar

– Tactile

– Chemical

– Olfactory…

Page 9: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Perception

Sensing the world

versus

Understanding the world

Ioannis Rekleitis 9

Page 10: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Three Main Challenges in Robotics

• How to Go From A to B ? (Path Planning)• What does the world looks like? (mapping)

– sense from various positions– integrate measurements to produce map– assumes perfect knowledge of position

• Where am I in the world? (localization)– Sense– relate sensor readings to a world model– compute location relative to model– assumes a perfect world model

• Together, the above two are called SLAM(Simultaneous Localization and Mapping)

10Ioannis Rekleitis

Page 11: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Robot Map

World

11Ioannis Rekleitis

Stage, Actor, and Representation

Page 12: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Robot Map

World

12Ioannis Rekleitis

Stage, Actor, and Representation

•Indoor/Outdoor•2D/2.5D/3D•Static/Dynamic•Known/Unknown•Abstract (web)

Page 13: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Robot Map

World

13Ioannis Rekleitis

Stage, Actor, and Representation

•MobileIndoor/OutdoorWalking/Flying/Swimming

•Manipulator•Humanoid•Abstract (web-bot)

Page 14: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Robot Map

World

14Ioannis Rekleitis

Stage, Actor, and Representation

•Topological•Metric•Feature Based•1D,2D,2.5D,3D

Page 15: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Robot Map

World

15Ioannis Rekleitis

Stage, Actor, and Representation

•Indoor/Outdoor•2D/2.5D/3D•Static/Dynamic•Known/Unknown•Abstract (web)

•Topological•Metric•Feature Based•1D,2D,2.5D,3D

•MobileIndoor/OutdoorWalking/Flying/Swimming

•Manipulator•Humanoid•Abstract (web bot)

Page 16: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Mapping• What the world looks like?

• Knowledge representation

– Robotics, AI, Vision

• Who is the end-user?

– Human or Machine

• Ease of Path Planning

• Uncertainty!

16

3D Laser point clouds

Occupancy Grid

Appearance basedIoannis Rekleitis

Page 17: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Appearance based Mapping

• 1000Km Trajectories

Ioannis Rekleitis

Mark Cummins and Paul Newman. ``Appearance-only SLAM at Large Scale with FAB-MAP 2.0”. The International Journal of Robotics Research. November 2010

17

Page 18: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Appearance based Mapping

Ioannis Rekleitis

Successful Loop Closures False Loop Closures

18

Page 19: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Where am I?Localization

• Tracking: Known initial position

• Global Localization: Unknown initial position

• Re-Localization: Incorrect known position

– (kidnapped robot problem)

19Ioannis Rekleitis

Page 20: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Localization

Initial statedetects nothing:

Moves and detects landmark:

Moves and detects nothing:

Moves and detects landmark:

20Ioannis Rekleitis

Page 21: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Motion Planning• The ability to go from A to B

– Known map – Off-line planning

– Unknown Environment –Online planning

– Static/Dynamic Environment

Ioannis Rekleitis 21

qgoalqinit

qgoal

qgoalqinit

qinit

Page 22: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Bug StrategyInsect-inspired “bug”

algorithms

Ioannis Rekleitis 22

“Bug 1” algorithm

• known direction to goal

• otherwise only local sensing

walls/obstacles encoders

1. head toward goal

2. if an obstacle is encountered, circumnavigate it and remember how close you get to the goal

3. return to that closest point (by wall-following) and continue

Page 23: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

More Complex Path Planning

Ioannis Rekleitis 23

Page 24: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Historical Overview

• Factory automation

– (1950-now)

Ioannis Rekleitis 24

Page 25: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Historical Overview

• Factory automation

• Indoor environments

– 1990-2005

Ioannis Rekleitis 25

Page 26: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Historical Overview

• Factory automation

• Indoor environments

• Field Robotics

– 2005-future

Ioannis Rekleitis 26

Page 27: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Highlights: Mapping the Titanic

Ioannis Rekleitis 27

Ryan Eustice, Hanumant Singh, John Leonard, Matthew Walter and Robert Ballard, Visually navigating the RMS Titanic with SLAM information filters. In Proceedings of the Robotics: Science & Systems Conference, pages 57-64, June 2005.

Page 28: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Highlights: Many Quadrotors

Ioannis Rekleitis 28

V. Kumar, GRASP Lab,University of Pennsylvania

Page 29: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Highlights: Legged Locomotion

Ioannis Rekleitis 29

Page 30: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Highlights: DARPA Grand Challenge

• 2004: Mojave Desert USA, 240 km– CMU Sandstorm traveled

the farthest distance, completing 11.78 km

• 2005: Mojave Desert USA, 240 km– Stanford’s Stanley, first

place 6h54m

– CMU’s Sandstorm, second place 7h05m

Ioannis Rekleitis 30

Page 31: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Highlights: DARPA Urban Challenge 2007

• George Air Force Base, California. 96 km urban area course

Ioannis Rekleitis 31

CMU’s BOS,first place 4h10m

Stanford’s Junior, second place 4h29m

Page 32: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Driverless Car

• Safer

• More efficient

• Enable people

Ioannis Rekleitis 32

• The Nevada law went into effect on March1, 2012, and the Nevada Department ofMotor Vehicles issued the first license for aself-driven car in May 2012. The licensewas issued to a Toyota Prius modifiedwith Google's experimental driverlesstechnology.

• Google driverless car, with a test fleet ofautonomous vehicles that as of May 2012has driven 282,000 km.

Page 33: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Another trendMobile Manipulation

The robots have only interpreted the world, in various ways; the point is to change it1.

Ioannis Rekleitis 331Paraphrasing a philosopher of the 19th century.

http://pr.cs.cornell.edu/videos.php

Page 34: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Human-Robot Interaction

Ioannis Rekleitis 34

Page 35: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Conclusions• It has been an exciting learning/working experience

– "My robot is misbehaving today!"

• I like what I am doing

• Computer Science– New and Dynamic Science

– Combines Theory and Practice

– Results are visible

– Changes the way we live (Robotic Technology everywhere)

• More Intelligence and Autonomy required– In Space

– In Production

– At Home

– On the road Ioannis Rekleitis 35

Page 36: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

CSCE Courses in Robotics

• CSCE 274

• CSCE 574

• CSCE 774

Ioannis Rekleitis 36

Page 37: Space Robotics: Enabling Autonomy in Challenging Environmentsmgv/csce190f17/notes/190_8_Rekleitis... · 2014. 10. 22. · Title: Space Robotics: Enabling Autonomy in Challenging Environments

Questions?

Ioannis Rekleitis 37

Halifax, Nova Scotia, Canada Fisherman’s Reef, Barbados