Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two...
Transcript of Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two...
![Page 1: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/1.jpg)
Chapter 3, Debugging and Visualization
Plot that changes over time with incoming messages
The rxplot /accel/x:y:z plot
![Page 2: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/2.jpg)
The rxplot /accel/x /accel/y /accel/z plot
Disparity images
![Page 3: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/3.jpg)
The rviz graphical interface
Setting the frame_id of the marker, that is frame_marker, in the fixed frame
Setting the fixed frame to frame_pc
![Page 4: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/4.jpg)
Two frames of each turtle are shown with respect to the /world frame
Chapter 4, Using Sensors and Actuators with ROS
Laser sending in the data in ROS
![Page 5: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/5.jpg)
The rviz screen with the two-lasers contour. The green contour is the new data.
Using the depth sensor
![Page 6: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/6.jpg)
Add a new PointCloud2 data visualization for 3D
Resolution is less than the original data
![Page 7: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/7.jpg)
Low-cost IMU – 10 degrees of freedom
Chapter 6, Computer Vision
Configuration in Coriander
![Page 8: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/8.jpg)
Configuration in Coriander with better exposure
RAW image of the USB camera, which is in color
![Page 9: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/9.jpg)
Visualization of the camera images with image_view
Calibrating the camera
![Page 10: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/10.jpg)
Calibrating the camera
The calibration process in the GUI, identical to the one with FireWire cameras
![Page 11: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/11.jpg)
The end of the calibration process
Stereo Calibration
![Page 12: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/12.jpg)
Using disparity parameters, which can be set with reconfigure_gui
The left, right, and disparity images, and the reconfigure_gui interface used to configure the disparity algorithm
![Page 13: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/13.jpg)
A map drawn in rviz
A closer view
![Page 14: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/14.jpg)
3D reconstruction using the visual odometry
A visual odometry system running for our low-cost stereo camera
![Page 15: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/15.jpg)
Chapter 7, Navigation Stack – Robot Setups
The Gazebo simulator showing robot properties and data
The robot moving over red arrows (grid) as you published a new tf frame transform
![Page 16: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/16.jpg)
Chapter 8, Navigation Stack – Beyond Setups
$ roslaunch chapter8_tutorials move_base.launch
Use of initialpose
![Page 17: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/17.jpg)
Use of /move_base_simple/goal
A static map
![Page 18: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/18.jpg)
A particle cloud
Robot footprint
![Page 19: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/19.jpg)
Obstacles
Inflated obstacles
![Page 20: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/20.jpg)
Global Plan
Local Plan
![Page 21: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/21.jpg)
Planner Plan
Current Goal
![Page 22: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/22.jpg)
Avoiding obstacles
Sending Goals
![Page 23: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/23.jpg)
Chapter 9, Combining Everything – Learn by Doing
The R2 in the Gazebo empty world
Controlling the R2 arms
![Page 24: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/24.jpg)
Controlling the robot easily with interactive markers
The R2 IVA climbing legs of a real Robonaut model
![Page 25: Chapter 3, Debugging and Visualization - Packt · Chapter 3, Debugging and Visualization ... Two frames of each turtle are shown with respect to the /world ... The end of the calibration](https://reader034.fdocuments.net/reader034/viewer/2022051407/5ade52bc7f8b9aeb668e26dc/html5/thumbnails/25.jpg)
The R2 on the pedestal inside of the ISS world loaded in Gazebo
The R2 with the Task Board