ONLINE CHALLENGE 2020 RoboCup@Home...

Post on 07-Sep-2020

5 views 0 download

Transcript of ONLINE CHALLENGE 2020 RoboCup@Home...

RoboCup@Home EducationONLINE CHALLENGE 2020

Online Classroom Standard Platform

02 Pepper and Software Installation

RoboCup@Home Education | 2020.04.23

RoboCup@Home Education | www.RoboCupatHomeEDU.org

02 Pepper and Software Installation

Speaker: Luca Iocchi, Jeffrey Tan, SoftBank Robotics

Time: Apr 23, 2020 (Thu) 19:00 - 20:00 (GMT+8)

Zoom: https://cernet.zoom.com.cn/j/65880450305 (ID: 658 8045 0305) | PW: robocup

Facebook Live: https://www.facebook.com/robocupathomeedu/live/

Web: https://www.robocupathomeedu.org/challenges/robocuphome-education-online-challenge-2020

Online Classroom: https://www.robocupathomeedu.org/learn/online-classroom/online-challenge-2020

** Privacy reminder: Video will be recorded and published online.

Online Challenge 2020: Online Classroom SP

2

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Pepper the humanoid robot

https://www.softbankrobotics.com/us/pepper

Humanoid robotdesigned for social interaction

Better user experience

Educational platform

3

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Pepper

https://youtu.be/3_iEO8r-Rc4 4

RoboCup@Home Education | www.RoboCupatHomeEDU.org

RoboCup@Home Social SPL

https://youtu.be/Uk5mZjkEsIg 5

RoboCup@Home Education | www.RoboCupatHomeEDU.org

RoboCup@Home Social SPL

https://youtu.be/KzwHOufMT_A 6

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Technical specifications

● Motherboard○ Processor: Intel Atom E3845,

Quad core, 1.91GHz○ RAM: 4GB DDR3

● Connectivity○ Ethernet○ Wifi - IEEE 802.11 a/b/g/n

● Operating system○ Linux

● Software development○ NAOqi / Android SDK

7

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Proximity sensors

Laser

45 points distributed in 3 sectors

Sonar

front/back 5 m range

8

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Vision sensors

RGB cameras Depth camera

9

RoboCup@Home Education | www.RoboCupatHomeEDU.org

HRI devices

● Tablet

● Microphones

● Loudspeakers

● LEDs - Eyes, ears and shoulders

● Tactile sensors

10

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Computation - Head

● Running NAOqi OS (based on Linux)

● CPU: 1.91 GHz quad-core Atom E3845

● Wi-Fi

OS

11

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Computation - Tablet

● Android Marshmallow● Certified GMS (CTS)● CPU 1.3 GHz quad-core ARM ● Wi-Fi, Bluetooth● DDR3 SDRAM: 1GB● 15GB ● Size: 10" Type: IPS

Resolution: 1280x800 ● Multitouch

12

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Audio output

Using Pepper speakers

13

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Audio Input

Using Pepper microphones

14

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Postures

Rest: safe posture

- Head down- Knee and hip bent

Used when:- Motors are off- Rest mode- Pepper is off

Standing: working posture

- Standing, arms along the body

- Pepper is awakeand ready to use

15

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Android Studio Pepper SDK

https://developer.softbankrobotics.com/pepper-qisdk

16

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Android Studio Installation

17

Installation steps

1. Downloadhttps://developer.android.com/studio

2. Install(follow specific instructions for your OS)

Android Studio version 3.6.1Gradle version 5.6.4Android SDK Platform 29.4Android SDK Tools 29.0.6

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Pepper SDK

Plugin

18

Version 1.3.15

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Pepper SDK

19

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Pepper SDK

20

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Plugin - API 6

21

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Run Pepper emulator

22

Click on the emulator buttonorTools -> Pepper SDK -> Emulator

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Run Pepper emulator

Windows OS

Problem: Error Qemu-system-i386.exe has stopped working

SolutionDowngrade Android studio emulator to version 29.0.11

Download archive https://dl.google.com/android/repository/emulator-windows-5598178.zip

Go to repository C:\Users\<username>\AppData\Local\Android\Sdk\

Replace emulator folder with the emulator in the archive

23

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Run Pepper emulator

Ubuntu 18.04

Problem: Emulator not starting

SolutionInstall additional packages and relink librariesas described inhttps://developer.softbankrobotics.com/blog/ubuntu-18-and-pepper-qisdk-emulator-troubleshooting

24

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Android Studio Pepper SDK

https://youtu.be/dsVkBXR0TRc25

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Virtual robot + Android virtual device

26

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Animation Editor

27

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Animation library

28

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Qi Chat Editor

29

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Trajectory Editor

30

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Programming Languages

Java 6, 7 or 8https://developer.android.com/studio/write/java8-support

Kotlin

https://developer.android.com/kotlin/

https://kotlinlang.org/docs/reference/

31

RoboCup@Home Education | www.RoboCupatHomeEDU.org

HelloHuman App

Test Android Studio + Pepper SDK with this simple app

HelloHuman

https://github.com/robocupathomeedu/rc-home-edu-learn-pepper/

blob/master/test_activities/

32

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Code and documentation repositories

https://github.com/robocupathomeedu/rc-home-edu-learn-pepper

https://github.com/aldebaran/qisdk-tutorials

Code examples

Documentation

Issues (Q&A)

33

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Assignments

1. Install Android Studio and Pepper SDK

2. Run the HelloHuman app

34

RoboCup@Home Education | www.RoboCupatHomeEDU.org

Next lectures

01 Introduction

02 Pepper and Software Installation

03 Apps Programming

04 Dialogues

05 Examples

06 Advanced Programming

35

Web: https://www.robocupathomeedu.org/challenges/robocuphome-education-online-challenge-2020Online Classroom: https://www.robocupathomeedu.org/learn/online-classroom/online-challenge-2020Online Entry Form: https://forms.gle/UBREeC1xTCVQ9wr78Online Entry Form (backup): https://www.wjx.cn/jq/72082120.aspxContact: oc@robocupathomeedu.org

RoboCup@Home EducationONLINE CHALLENGE 2020

Online Classroom Standard Platform