Noordam Advocatuur - Arnoud Noordam: Dutch Employment & Dismissal Law
Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and...
Transcript of Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and...
![Page 1: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/1.jpg)
Realistic simulations of advanced robot control algorithms
Arnoud Visser
Universiteit van AmsterdamIntelligent Systems Laboratory
Mediterranean Open Workshop on RoboCup
Research, Universita
di
Roma, "La Sapienza", Roma, Italy, March 15th, 2011.
University of OxfordComputing Laboratory
In close cooperation with
Technical Committee
Simulation League
![Page 2: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/2.jpg)
Realistic Testbeds
At the Intelligent System Laboratory Amsterdam we prefer to study scientific problems based on real data. Our groups are active in:
•
TRECvideo
competition•
IMMIX query –
answer text competitions
•
Reinforcement Learning competition•
Indoor
Micro Air Vehicle
Flight
Competition
•
RoboCup
competition
![Page 3: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/3.jpg)
RoboCup
Universiteit van Amsterdam has been active since 1998 in both Soccer and Rescue League
![Page 4: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/4.jpg)
RoboCup Rescue Competitions
•
Rescue Agent simulation–
Distributed decision making
–
Cooperation–
Simulations of:
•
Building collapses•
Road Blockages
•
Spreading fire•
Traffic
•
Real Robots–
Single collapsed structure
–
Autonomous navigation–
Victim location and assessment
![Page 5: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/5.jpg)
Virtual Robot Competition
•
Autonomous multi-robot control
•
Human, multi-robot interfaces
•
3D mapping and exploration by fusing information from multiple robots
•
Development of novel mobility modes and sensor processing skills
•
Lower entry barriers for developers
•
Competition based upon a realistic simulation
![Page 6: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/6.jpg)
A wide variety of simulated worlds
![Page 7: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/7.jpg)
A wide variety of Robotic platforms
![Page 8: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/8.jpg)
Amsterdam Oxford Joint Rescue Forces
• Using the Kenaf-robot
•
Camera is used to learn
victims and landmarks
• Can control many robots (Matilda, Element, Talon, AirRobot, ATRVJr, Zerg. Etc.)
• Graph based map, which can be easily shared and corrected
• Smooth transition from teleoperated to fully autonomous behavior
• Landmarks stay in view
•
Camera is used to build
visual maps
www.jointrescueforces.eu
Innovations in 2009 (i.e.)
Other assets:
![Page 9: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/9.jpg)
Transfer between real and simulated leagues.
Major Features:•
Heterogeneous Multi-
Robot Mapping and Exploration
•
Adjustable Autonomy•
Semantic Mapping
•
Sensor Fusion
Jacobs Virtual Rescue
Max Pfingsthorn, Ravi Rathnam,Todor
Styanov,
Yashodhan
Nevatia, Rares
Ambrus
![Page 10: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/10.jpg)
UPM UPM -- SPQRSPQR Spain -
Italy
Autonomous exploration and navigation
Heterogeneous team Multi-Robot 3D Interface
3D point cloud segmentation
![Page 11: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/11.jpg)
Teamleader: Patrick SturmTeam members:Emanuel Plochberger, Leonhard Pfeiffer-Vogl
Main Features:
High modularity
Well documented
Implemented in Java :)
Simple Userinterface
Multi Robot Mapping and Exploration
Autonomous movement
npsolvers.wootstube.de
![Page 12: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/12.jpg)
Amsterdam Oxford Joint Rescue Forces
• Local sonar maps
• Kenaf
model
•
Victim detection based on shape
www.jointrescueforces.eu
Innovations in 2010 (i.e.)
Infrastructure contributions:
•
Confidence selection inside maps
•Victim behaviour• Lasers sensitive for smoke
![Page 13: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/13.jpg)
Virtual Rescue LeagueSimultaneously:•
Traverse Rough Terrain
(Mobility)•
Where am I? (Localization)
•
Where have I been? (Mapping)
•
Find the victims (Exploration)
•
Share this information and coordinate behaviors with others robots (Distributed Decision making)
![Page 14: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/14.jpg)
Mobility challenge: Machine Learning for Automated
Robot Navigation in Rough Terrain
Radoslaw Sobolewski
and Julian de Hoog
University of OxfordComputing Laboratory
![Page 15: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/15.jpg)
Traversal of Rough Terrain
•
Kenaf, designed by the University of Tohoku, is the winner of the 2007 Mobility Challenge
![Page 16: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/16.jpg)
USARSim
as design tool
See Shogo Okamoto, Kensuke Kurose, Satoshi Saga, Kazunori Ohno
and Satoshi Tadokoro “Validation of simulated robots with realistically modeled dimensions and mass in usarsim”. In Proceedings of the 2008 IEEE International Workshop on Safety, Security and Rescue Robotics (SSRR'08).
•
Comparing behavior of real and simulated Kenaf
![Page 17: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/17.jpg)
Controlling a Kenaf
•
2 cameras, 2 range scanners 2 tracks, 4 flippers
![Page 18: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/18.jpg)
Machine Learning approach
•
Neural Network with one hidden layer
![Page 19: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/19.jpg)
Training versus Testing
Completion time
Network controller
Human controller
Training course 41.2 s 46.5 s
Testing course 79.8 s 91.3 s
![Page 20: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/20.jpg)
Validation
•
Comparing flipper control for real and simulated Kenaf
![Page 21: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/21.jpg)
Mobility challenge: Result
•
Advanced Machine Learning techniques can be applied to robot control
•
Training sessions can be used in several terrains
•
Real and simulated results are compared
See Radoslaw
Sobolewski, "Machine Learning for Automated Robot Navigation in Rough Terrain", MSc
Thesis, Oxford University, September 2009.
![Page 22: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/22.jpg)
Navigation Challenge: A Color Based Rangefinder
for an Omnidirectional
Camera
Gideon Emile Maillette
de Buy Wenniger, Quang
Nguyen, Tijn
Schmits
and Arnoud Visser
Universiteit van AmsterdamInformatica
Instituut
![Page 23: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/23.jpg)
–
Mirror based design (robust and cheap)
–
Widely used in robotic research–
Available for validation at Amsterdam
•
DragonFly®
camera
•
PanoramaEye®
mirror
–
Robotics:NavigationSelf localisation VisualSLAM
Omnidirectional camera
![Page 24: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/24.jpg)
Single Viewpoint Constraint
•
Omnidirectional images can be translated into other perspectives
![Page 25: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/25.jpg)
Simulation Model Development -
camera cube -
•
Architecture:–
5 virtual cameras
–
90 degree FOV–
90 degree angles
–
Cube mapping of the environment
![Page 26: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/26.jpg)
Simulation Model Development -
mirror surface -
•
Architecture:–
UV texture mapping
![Page 27: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/27.jpg)
Simulation Model Development -
camera body -
Tijn
Schmits
and Arnoud Visser, "An Omnidirectional Camera Simulation for the USARSim
World", in RoboCup
2008: Robot Soccer World Cup XII", LNAI 5339, p. 296-307, Springer, June 2009.
![Page 28: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/28.jpg)
Research Question
Can the omnidirectional camera be used effectively in navigation, equivalent to a rangescanner?
Sonar ring
SICK laser scanner
![Page 29: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/29.jpg)
Free space Pixel Classification
-
Calculate probability of a color in the histogram
-
Probability must be higher than a threshold to classify
“free space”
-
Classification can also be done with a Mixture of Gaussians
G.E Maillette
de Buy Wenniger
et al, "Identifying Free Space in a Robot Bird-Eye View", Proceedings of the 4th European Conference on Mobile Robots (ECMR 2009), p. 13-18, Croatia, September 2009
![Page 30: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/30.jpg)
Free Space Detection Results
•
Image processing can be used to verify the traversability
of the surroundings.
![Page 31: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/31.jpg)
Reliability
•
In simulation a F-measure of 90% was reached.•
For real data a F-measure of 75% was reached.
![Page 32: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/32.jpg)
Polar Scanning in omnidirectional image
•
360 scan lines with 1o
angular resolution•
Minimum range 0.2m, maximum range 3.8m
![Page 33: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/33.jpg)
Range estimateFalse positive filter
False negative filter
•
At least K non-free pixels behind hitpoint
X•
At most N free pixels inside sequence K
K = 20N = 2
![Page 34: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/34.jpg)
Mirror Equation
))cos(1()sin(
horizonrr )tan(hd
)()()( 24122
222
kkck
rc
z
with k=11.546 and
c = 2.321
![Page 35: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/35.jpg)
Experiments
GrassMaze
Factory
![Page 36: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/36.jpg)
Robot
•
OmniP2DX / OmniP2AT
•
Omnidirectional camera•
SICK 200 LMS
![Page 37: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/37.jpg)
Grassmaze: Mapping
•
Deadreckoning
on ground-truth
![Page 38: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/38.jpg)
Factory: Mapping
•
Deadreckoning
on ground-truth
![Page 39: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/39.jpg)
Other means of detection
•
Omnicam
rangefinder found the cabinet
![Page 40: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/40.jpg)
Navigation Challenge: Result
•
An omnidirectional camera can be used effectively as a rangefinder
•
Accuracy is less than a laser scanner, but better than sonar.
•
The omnidirectional camera is an independent mean to detect obstacles.
•
Results in simulation can be exploited
in real applications
![Page 41: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/41.jpg)
Virtual Robot Competition
•
Autonomous multi-robot control
•
Human, multi-robot interfaces
•
3D mapping and exploration by fusing information from multiple robots
•
Development of novel mobility modes and sensor processing skills
•
Lower entry barriers for developers
•
Competition based upon a realistic simulation
![Page 42: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/42.jpg)
Virtual Robot Competition
±
Autonomous multi-robot control
±
Human, multi-robot interfaces
±
3D mapping and exploration by fusing information from multiple robots
Development of novel mobility modes and sensor processing skills
Lower entry barriers for developers
Competition based upon a realistic simulation
![Page 43: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/43.jpg)
Multi-robot research is costly
Julian de Hoog, Stephen Cameron and Arnoud
Visser, "Autonomous Multi-
Robot Exploration in Communication-Limited Environments", Proceedings of the 11th Conference Towards Autonomous Robotic Systems (Taros 2010), Augustus/September 2010
![Page 44: Realistic simulations of advanced robot control algorithms...Julian de Hoog, Stephen Cameron and Arnoud Visser, "Autonomous Multi-Robot Exploration in Communication-Limited Environments",](https://reader033.fdocuments.net/reader033/viewer/2022043008/5f974fb90434da53ca1cec76/html5/thumbnails/44.jpg)
Conclusion
The Virtual Robot competition allows:
•
Researchers rapid prototyping tools.
•
Extensive training possibilities for Machine Learning applications
•
Students quick access to robotic testbeds
2nd
place
4th
place 3rd
place1st
placeBRAZIL OPEN
3rd place Development price
Iran Open 2010