Human robot interaction based on gesture identification
-
Upload
restin-s-edackattil -
Category
Education
-
view
4.092 -
download
0
Transcript of Human robot interaction based on gesture identification
![Page 1: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/1.jpg)
HUMAN-ROBOT INTERACTION BASED ON GESTURE IDENTIFICATION
Guided By: Ms. Anuja George Submitted By, Anoop V Nair Restin S Edackattil Nithin Sebastian Toji Sebastian 1
![Page 2: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/2.jpg)
CONTENTS
• INTRODUCTION• BLOCK DIAGRAM• HARDWARE• SOFTWARE• CONCLUSION
2
![Page 3: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/3.jpg)
INTRODUCTION3
![Page 4: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/4.jpg)
HRI USING GESTURE IDENTIFICATION(APING AUTOBOT)
• It apes our movements• The interaction is done by transferring our
hand movements to robot• And the difficulty arises when how we make
robot understand our movements• The robot can act as a mirror image
4
![Page 5: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/5.jpg)
ZIGBEE PROTOCOL
• It is a device which transmits and receives digital signals
• It is comprised of a transmitter module and receiver module
• It acts as a transmission media between human and robot
• Main advantage is that it is a wireless communication
5
![Page 6: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/6.jpg)
GESTURE IDENTIFICATION
• The robot understands digital voltage signals only
• There should be a compiler between human movements and robot’s movements
• There comes the ACCELEROMETER
6
![Page 7: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/7.jpg)
ACCELEROMETER
• Produces signals according to the movements
• The signals are produced based on the variations on x-y-z variations
• Types-digital and analog• Sampling/resolutions is adjustable so that we
can adjust our robot sensitivity by adjusting sampling rate
• A small module so that we can fix it anywhere in the body 7
![Page 8: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/8.jpg)
Autobot
• We present a autobot• It is three wheeled autobot which is able
move in any direction• A separate module which is controlled by
PIC18F4550• Moves according to the signals received by
zigbee receiver
8
![Page 9: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/9.jpg)
BLOCK DIAGRAM & DESCRIPTION
9
![Page 10: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/10.jpg)
TRANSMITTER SECTION
10
![Page 11: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/11.jpg)
TRANSMITTER SECTION
• The accelerometer which is fixed to the hand produces signals according to the hand movements
• The signals are given to a processing & encoding unit which produces sequences of binary digits according to the signals
• The binary signals are so as to control dc motor
• Then the zigbee recieves this signals and transmits it to to the autobot module 11
![Page 12: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/12.jpg)
RECEIVER SECTION
12
![Page 13: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/13.jpg)
RECEIVER SECTION
• The zigbee receiver receives the encoded signals and gives it to the decoding IC
• The processing IC(PIC18F4550) directs these binary signals to motor terminals
• The dc motor rotates according to the signals given to it
• In effect,the autobot moves according to the binary signals
13
![Page 14: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/14.jpg)
HARDWARE14
![Page 15: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/15.jpg)
CONTENTS
• CIRCUIT DIAGRAM• XBEE• ADXL335• PIC18F4550• PIC16F876A• AT89C2051
15
![Page 16: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/16.jpg)
CIRCUIT DIAGRAM(Autobot)
16
![Page 17: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/17.jpg)
CIRCUIT DIAGRAM(Transmitter)
17
![Page 18: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/18.jpg)
CIRCUIT DIAGRAM(Receiver)
18
![Page 19: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/19.jpg)
XBEE
19
![Page 20: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/20.jpg)
FEATURES
• Range-133ft(40m)• Serial data rate-1200bps to 1mbps• Interface-USRT serial data communication• Frequency band-2.4GHz • Supply voltage-2.1 to 3.6 v(dc)• Temperature ratings- -40 t0 85 deg.cls• Low power sleep modes
20
![Page 21: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/21.jpg)
ADXL335
21
![Page 22: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/22.jpg)
FEATURES
• 3-axis sensing• Supply requirements-1.8 to 3.6v,350 uA• Full scale range of +/-3g• Measures static accelerations due to tilt and
dynamic accelerations due to motion , shock or vibration
• Bandwidth-0.5 to 1500Hz(x&y axes),0.5 to 550Hz(z-axis)
22
![Page 23: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/23.jpg)
AT89C2051
23
![Page 24: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/24.jpg)
FEATURES
• 8bit microcontroller• 2.7 to 6v voltage• 128*8bit RAM• 15 programmable i/o lines• Two 16 bit Timer/Counter
24
![Page 25: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/25.jpg)
PIC18F4550(FEATURES)
• 8bit microcontroller• Operating voltage-2 to 5v• 40 pin package• USB V2.0 with speed 1.5Mb/s to 12Mb/s• C compiler Optimized architecture with optional Extended
Instruction Set• 100,000 Erase/Write cycle Enhanced Flash Program
Memory• 1,000,000 Erase/Write cycle Data EEPROM memory• Flash/Data EEPROM Retention > 40 years
25
![Page 26: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/26.jpg)
PIC16F876A(FEATURES)
• 28pin package
• High performance CPU• Up to 8Kb Internal FLASH Program Memory• Up to 368 x 8 bytes of Data Memory (RAM)• Up to 256 x 8 bytes of EEPROM Data Memory• Wide operating voltage range: 2.0V to 5.5V• Synchronous Serial Port (SSP) with SPI (Master
mode) and I2C (Master/Slave)
26
![Page 27: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/27.jpg)
ADDRESSABLE UNIVERSAL SYNCHRONOUS ASYNCHRONOUS RECEIVER TRANSMITTER (USART)• The Universal Synchronous Asynchronous Receiver
Transmitter (USART) module is one of the two serial I/O modules
• The USART can be configured in the following modes:
• Asynchronous (full duplex)
• Synchronous - Master (half duplex)
• Synchronous - Slave (half duplex)
USART
27
![Page 28: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/28.jpg)
SOFTWARE28
![Page 29: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/29.jpg)
PROGRAMMING
• BASIC INTRODUCTION• FLOW CHART• INTERFACES
29
![Page 30: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/30.jpg)
BASIC INTRO
• Coding has been done with assembly and c• PIC IC with C • 89C2051 with assembly• Communication used is serial
communication
30
![Page 31: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/31.jpg)
FLOWCHART31
![Page 32: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/32.jpg)
Transmitter Section
32
![Page 33: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/33.jpg)
Receiver Section
33
![Page 34: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/34.jpg)
ADVANTAGES
• Ease of controlling• Fast response• The module can be made into various forms
as per the area of application• User friendly- One need not to know about
the robot, as they can control by hand movement
34
![Page 35: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/35.jpg)
FUTURE SCOPE
• HIR is going to be an important military application in future.
• SPY work. • Giant machinery vehicles can be controlled
by body movements.
35
![Page 36: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/36.jpg)
GIANT MACHINERIES
36
![Page 37: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/37.jpg)
CONCLUSION
• This is an easy way to interact with robots without any special training . By proper implementation ,this concept will be a stepping stone in the robotic technology .
37
![Page 38: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/38.jpg)
REFERENCES
• D. Grollman and O. Jenkins. Learning elements of robot soccer from demonstration. In Proceedings of the International Conference on Development and Learning (ICDL),London, England, Jul 2007.• www.edaboard.com• www.microchip.com• www.mikroelectronica.com
38
![Page 39: Human robot interaction based on gesture identification](https://reader036.fdocuments.net/reader036/viewer/2022062406/558d4e2dd8b42aa15e8b4601/html5/thumbnails/39.jpg)
THANK YOU…39