ONLINE CHALLENGE 2020 RoboCup@Home...

RoboCup@Home EducationONLINE CHALLENGE 2020

Online Classroom Standard Platform

02 Pepper and Software Installation

RoboCup@Home Education | 2020.04.23

RoboCup@Home Education | www.RoboCupatHomeEDU.org


Speaker: Luca Iocchi, Jeffrey Tan, SoftBank Robotics

Time: Apr 23, 2020 (Thu) 19:00 - 20:00 (GMT+8)

Zoom: https://cernet.zoom.com.cn/j/65880450305 (ID: 658 8045 0305) | PW: robocup

Facebook Live: https://www.facebook.com/robocupathomeedu/live/

Web: https://www.robocupathomeedu.org/challenges/robocuphome-education-online-challenge-2020

Online Classroom: https://www.robocupathomeedu.org/learn/online-classroom/online-challenge-2020

** Privacy reminder: Video will be recorded and published online.

Online Challenge 2020: Online Classroom SP

2

https://cernet.zoom.com.cn/j/65880450305

https://www.facebook.com/robocupathomeedu/live/

https://www.robocupathomeedu.org/challenges/robocuphome-education-online-challenge-2020


https://www.robocupathomeedu.org/learn/online-classroom/online-challenge-2020


Pepper the humanoid robot

https://www.softbankrobotics.com/us/pepper

Humanoid robotdesigned for social interaction

Better user experience

Educational platform

3

https://www.softbankrobotics.com/us/pepper


Pepper

https://youtu.be/3_iEO8r-Rc4 4

http://www.youtube.com/watch?v=3_iEO8r-Rc4


RoboCup@Home Social SPL

https://youtu.be/Uk5mZjkEsIg 5

http://www.youtube.com/watch?v=Uk5mZjkEsIg


RoboCup@Home Social SPL

https://youtu.be/KzwHOufMT_A 6

http://www.youtube.com/watch?v=KzwHOufMT_A


Technical specifications

● Motherboard○ Processor: Intel Atom E3845,

Quad core, 1.91GHz○ RAM: 4GB DDR3

● Connectivity○ Ethernet○ Wifi - IEEE 802.11 a/b/g/n

● Operating system○ Linux

● Software development○ NAOqi / Android SDK

7


Proximity sensors

Laser

45 points distributed in 3 sectors

Sonar

front/back 5 m range

8


Vision sensors

RGB cameras Depth camera

9


HRI devices

● Tablet

● Microphones

● Loudspeakers

● LEDs - Eyes, ears and shoulders

● Tactile sensors

10


Computation - Head

● Running NAOqi OS (based on Linux)

● CPU: 1.91 GHz quad-core Atom E3845

● Wi-Fi

OS

11


Computation - Tablet

● Android Marshmallow● Certified GMS (CTS)● CPU 1.3 GHz quad-core ARM ● Wi-Fi, Bluetooth● DDR3 SDRAM: 1GB● 15GB ● Size: 10" Type: IPS

Resolution: 1280x800 ● Multitouch

12


Audio output

Using Pepper speakers

13


Audio Input

Using Pepper microphones

14


Postures

Rest: safe posture

- Head down- Knee and hip bent

Used when:- Motors are off- Rest mode- Pepper is off

Standing: working posture

- Standing, arms along the body

- Pepper is awakeand ready to use

15


Android Studio Pepper SDK

https://developer.softbankrobotics.com/pepper-qisdk

16

https://developer.softbankrobotics.com/pepper-qisdk


Android Studio Installation

17

Installation steps

1. Downloadhttps://developer.android.com/studio

2. Install(follow specific instructions for your OS)

Android Studio version 3.6.1Gradle version 5.6.4Android SDK Platform 29.4Android SDK Tools 29.0.6


Pepper SDK

Plugin

18

Version 1.3.15


Pepper SDK

19


Pepper SDK

20


Plugin - API 6

21


Run Pepper emulator

22

Click on the emulator buttonorTools -> Pepper SDK -> Emulator


Run Pepper emulator

Windows OS

Problem: Error Qemu-system-i386.exe has stopped working

SolutionDowngrade Android studio emulator to version 29.0.11

Download archive https://dl.google.com/android/repository/emulator-windows-5598178.zip

Go to repository C:\Users\<username>\AppData\Local\Android\Sdk\

Replace emulator folder with the emulator in the archive

23

https://dl.google.com/android/repository/emulator-windows-5598178.zip


Run Pepper emulator

Ubuntu 18.04

Problem: Emulator not starting

SolutionInstall additional packages and relink librariesas described inhttps://developer.softbankrobotics.com/blog/ubuntu-18-and-pepper-qisdk-emulator-troubleshooting

24

https://developer.softbankrobotics.com/blog/ubuntu-18-and-pepper-qisdk-emulator-troubleshooting

https://developer.softbankrobotics.com/blog/ubuntu-18-and-pepper-qisdk-emulator-troubleshooting


Android Studio Pepper SDK

https://youtu.be/dsVkBXR0TRc25

http://www.youtube.com/watch?v=dsVkBXR0TRc


Virtual robot + Android virtual device

26


Animation Editor

27


Animation library

28


Qi Chat Editor

29


Trajectory Editor

30


Programming Languages

Java 6, 7 or 8https://developer.android.com/studio/write/java8-support

Kotlin

https://developer.android.com/kotlin/

https://kotlinlang.org/docs/reference/

31

https://developer.android.com/studio/write/java8-support

https://developer.android.com/kotlin/

https://kotlinlang.org/docs/reference/


HelloHuman App

Test Android Studio + Pepper SDK with this simple app

HelloHuman

https://github.com/robocupathomeedu/rc-home-edu-learn-pepper/

blob/master/test_activities/

32

https://github.com/robocupathomeedu/rc-home-edu-learn-pepper/blob/master/test_activities

https://github.com/robocupathomeedu/rc-home-edu-learn-pepper/blob/master/test_activities


Code and documentation repositories

https://github.com/robocupathomeedu/rc-home-edu-learn-pepper

https://github.com/aldebaran/qisdk-tutorials

Code examples

Documentation

Issues (Q&A)

33

https://github.com/robocupathomeedu/rc-home-edu-learn-pepper

https://github.com/aldebaran/qisdk-tutorials


Assignments

1. Install Android Studio and Pepper SDK

2. Run the HelloHuman app

34


Next lectures

01 Introduction


03 Apps Programming

04 Dialogues

05 Examples

06 Advanced Programming

35

Web: https://www.robocupathomeedu.org/challenges/robocuphome-education-online-challenge-2020Online Classroom: https://www.robocupathomeedu.org/learn/online-classroom/online-challenge-2020Online Entry Form: https://forms.gle/UBREeC1xTCVQ9wr78Online Entry Form (backup): https://www.wjx.cn/jq/72082120.aspxContact: [email protected]

RoboCup@Home EducationONLINE CHALLENGE 2020

Online Classroom Standard Platform


https://www.robocupathomeedu.org/learn/online-classroom/online-challenge-2020

https://forms.gle/UBREeC1xTCVQ9wr78

https://www.wjx.cn/jq/72082120.aspx

mailto:[email protected]

ONLINE CHALLENGE 2020 RoboCup@Home...

Documents

Transcript of ONLINE CHALLENGE 2020 RoboCup@Home...