Hex Pistols Key

22
Kinects in Unity Product Demonstration Team Hex Pistols UCSB Computer Science Capstone 2013

description

Unity 3D

Transcript of Hex Pistols Key

  • Kinects in UnityProduct Demonstration

    Team Hex Pistols

    UCSB Computer Science Capstone 2013

  • Alex

    Sea

    KevinAnthony

    JerryTeam Lead:The Hex Pistols

    coming to space centers near youpresenting

  • The Problem

  • Mars Pictures

  • Tech Talk

  • Microsoft Visual Studio 2012 GitHub Version Control

    Microsoft Kinect for Windows SDK Unity3D Rendering Engine

  • Necessary Components

    x 2

    x 3

    x 2x 3x 4

    x 3x 4x 5x 5

  • Microsoft Kinect

    RGB Camera Infrared Depth Sensor

    Data Streams:SkeletonColor Depth

    Infrared Emitter

  • Data Flow Process

    Network Connection

    USB

    Stage 1: Stage 2:

    HDMI or VGA

    Stage 3:

  • Kinect Data Processor (C#)

    Kinect Sensor Kinect Sensor

    Large Format Display Large Format Display

    ...

    ...System Overview

    Unity 3D Rendering Engine (C#)

  • Kinect Master ComputerMulti Kinect Data Processor (C#)

    Skeleton Tracking

    I O

    Calibration Offset and Data Consolidation

    Calibration &Placement(one-time)

    101100111010101

    101100111010101

    101100111010101

    101100111010101

    30fps

  • Kinect Data Processor (C#)

    Unity 3D Rendering Engine (C#)

    Kinect Sensor Kinect Sensor

    Large Format Display Large Format Display

    ...

    ...

    101100111010101

    101100111010101

    System Overview

    via TCP/UDP

  • Inter-module CommunicationUnity 3D Rendering

    Engine (C#)

    Kinect Data Processor

    (C#)

    Control

    Data Stream

    Calibration*DataStart/StopSignals

    Acknowledgements

    Camera*PositionData

    TCP

    TCP

    01000101011011100111010001100101011100100010000001111001011011110111010101110010001000000111010001100101011110000111010000100000011101000110111100100000011000100110010100100000011011110110001001100110011101010111001101100011011000010111010001100101011001000010000001101001011011100111010001101111001000000110001001101001011011100110000101110010011110010010000001100011011011110110010001100101001000000110111101110010001000000110010001100101011000110110111101100100011001010110010000100000011001100111001001101111011011010010000001100010011010010110111001100001011100100111100100100000011000110110111101100100011001010010000001100010011000010110001101101011001000000110100101101110011101000110111100100000011101000110010101111000011101000010111000001010010101000110010101110011011101000010000001100010011110010010000001100011011011000110100101100011011010110010000001110100011010000110010100100000001000100101010001100101011110000111010000100000011101000110111100100000010000100110100101101110011000010111001001111001001000100010000001100010011101010111010001110100011011110110111000100000011000010110111001100100001000000111011101100001011101000110001101101000001000000111010001101000011010010111001100100000011101000110010101111000011101000010000001100010011001010010000001100011011011110110111001110110011001010111001001110100011001010110010000100000011010010110111001110100011011110010000001100010011010010001010110111001110100011001010111001000100000011110010110111101110101011100100010000001110100011001010111100001110100001000000111010001101111001000000110001001100101001000000110111101100010011001100111010101110011011000110110000101110100011001010110010000100000011010010110111001110100011011110010000001100010011010010110111001100001011100100111100100100000011000110110111101100100011001010010000001101111011100100010000001100100011001010110001101101111011001000110010101100100001000000110011001110010011011110110110100100000011000100110100101101110011000010111001001111001001000000110001101101111011001000110010100100000011000100110000101100011011010110010000001101001011011100111010001101111001000000111010001100101011110000111010000101110000010100101010001100101011100110111010000100000011000100111100100100000011000110110110001101001011000110110101100100000011101000110100001100101001000000010001001010100011001010111100001110100001000000111010001101111001000000100001001101001011011100110000101110010011110010010001000100000011000100111010101110100011101000110111101101110001000000110000101101110011001000010000001110111011000010111010001100011011010000010000001110100011010000110100101110011001000000111010001100101011110000111010000100000011000100110010100100000011000110110111101101110011101100110010101110010011101000110010101100100001000000110100101101110011101000110111100100000011000100110100101101110011000010111001001111001001000000110001101101111011001000110010100101110000010100101010001101000UDP

    UDP

    UDP

  • Initial ConnectionCalibrationData Steaming

  • Kinect Data Processor (C#)

    Unity 3D Rendering Engine (C#)

    Kinect Sensor Kinect Sensor

    Large Format Display Large Format Display

    ...

    ...

    101100111010101

    101100111010101

    System Overview

    via TCP/UDP

  • Unity Slave ComputersUnity3D Rendering Engine (C#)

    Parse XML Data

    Calculate Projection Matrix

    I O

    Render Scene

    101100111010101

    DisplayPlacement

    101100111010101

  • Multi Kinect Data Processor (C#)

    Unity3D Rendering Engine (C#)

    Large Format Display Large Format Display

    Unity 3D Rendering Engine (C#)

    Kinect Data Processor (C#)

    System Overview

    Kinect Sensor Kinect Sensor ...

    ...

    101100111010101

    101100111010101

  • DEMO

  • Questions?

  • Kinects in UnityProject Demonstration

    Team Hex Pistols

    UCSB Computer Science Capstone 2013