Slide 1

I.H.L.A MEDIA Christopher Fuller, Nicholas Johns, Ashley Kaufman, Brandon McCauley, Matthew Pachol, Christopher Suever

Slide 2

Wish to examine what it takes to create a seamless experience between an individual and technology Through the use of interactive mirrors, our objective is to get the observer to interact with a pre-designed interface and allow them to have control over the outcome that would create a memorable experience Applications for our proposed design would be through its use in advertising and entertainment purposes. PROBLEM STATEMENT

Slide 3

It is predicted that spending on digital ads will surpass the combined total of ad spending on newspapers and magazines ads in 2015 One of the biggest problems with digital advertising is a large varying demographic of customers Form of art that involves the spectator in a way that allows the art to achieve its purpose Immersive Environment: Real-time image processing and manipulation, biometric feedback and be aesthetically pleasing. PROBLEM BACKGROUND

Slide 4

Raspberry Pi Single board computer CPU, GPU, USB AND HDMI Raspberry Pi camera module 5 mega-pixel for images 1080p, 30 frames/sec for video HD monitors LCD/LED monitors 720p or higher resolution HDMI compatible MAJOR TECHNOLOGIES

Slide 5

HARDWARE SPECIFICATIONS Micro-USB Power Port: 700mA (3.5W) HDMI 2.0: Up to 18 Gbits/s USB 2.0: Up to 480 Mbits/s Ethernet RJ45:10/100Mbits/s High Bit Rate SD Cards: 95 MB/s Raspberry Pi Camera: 1080p Monitor Display: At least 720p

Slide 6

ARCHITECTURE OF SYSTEM

Slide 7

LEVEL 0 Module Raspberry Pi: Model B, Raspbian OS Inputs Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection, > 15 Mbits/s Micro USB Power Port: 700 mA, 3.5 W, 5V DC Outputs HDMI Video Output: 1080p, 30 fps, Up to 15 Gbits/s FunctionalityAcquire and manipulate the camera input to produce HD video output.

Slide 8

LEVEL 1 Module Camera Serial Interface Inputs Raspberry Pi Camera: 5 MP (images), 1080p (video), 15-pin ribbon connection, > 15 Mbits/s Power: > 250 mA OutputsRPi Camera Image: 5 MP resolution FunctionalityServes as the connection port between the Raspberry Pi and the Raspberry Pi camera to enable image acquisition.

Slide 9

LEVEL 1 Module System on a Chip (SOC): Broadcom BCM2835, (CPU, GPU, DSP, SDRAM, USB port) Inputs RPi Camera Image: 5 MP resolution Power: 700 mA OutputsManipulated RPi Camera Image: 5 MP resolution FunctionalityIntegrates all components of the RPi module into a single chip. Serves as the medium between image acquisition and video output to manipulate the RPi camera image. Module High-Definition Multimedia Interface Inputs Manipulated RPi Camera Image: 5 MP resolution Power: 700 mA OutputsVideo Output: 1080p, 30 fps, up to 15Gbits/s FunctionalityInterface for transferring the manipulated RPi camera image data from the HDMI-capable RPi camera to a compatible computer monitor in order to display the HD video output.

Slide 10

LEVEL 2

Slide 11

Module Central Processing Unit: 700 MHz, ARM1176JZF-S core Inputs RPi Camera Image: 5 MP resolution Power: 700 mA OutputsManipulated RPi Camera Image: 5 MP resolution FunctionalityResponsible for the pre-processing (resizing) of the acquired image data as well as performing image edge detection and contour finding. LEVEL 2 Module Graphics Processing Unit: Broadcom VideoCore IV @ 250 MHz, OpenGL ES 2.0 (24 GFLOPS), 1080p30 h.264 high-profile decoder and encoder 1080p Inputs RPi Camera Image: 5 MP resolution Power: 700 mA OutputsManipulated RPi Camera Image: 5 MP resolution FunctionalityProvides openGL ES 2.0, hardware accelerated openVG, and 1080p30 h.264 high profile decoder and encoder. This controls the image data manipulation by use of algorithms including Shaders, Particles, and Grey-Scott Reaction Diffusion.

Slide 12

High-level open source toolkit C++, object oriented Allows for direct calls to native system libraries MIT licensed: freedom of use in commercial or non- commercial applications. Cross platform C++ interface to graphics, audio, video, networking and access to many libraries OPENFRAMEWORKS

Slide 13

Header file Blue print or empty structure with no implementation detail Cpp file Definition of functions and program. Setup() Allows for setting of program specifics prior to running the program (setting the windows size, frame rate, etc.) Update() Use for continuously updating the state of the program Draw() Allows for the interaction of the system. STRUCTURE OF OPENFRAMEWORKS

Slide 14

Particle SystemGray Scott Diagram OUTCOMES

Slide 15

REACTION DIFFUSION EXAMPLE

Slide 16

CONTEXT DIAGRAMS

Slide 17

USE CASES

Slide 18

SEQUENCE DIAGRAMS StandbyImage Acquisition

Slide 19

SEQUENCE DIAGRAMS OutputImage MeshingImage Processing

Slide 20

OBJECTIVE TREE

Slide 21

TaskDescriptionMembers Hardware Integration Make sure hardware applications are compatible as well as work as a cohesive unit Fuller, Johns, Kaufman, McCauley, Pachol, Suever Software Integration Making sure the programming languages and image modification algorithms are compatible. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Algorithm Design Create software algorithms to modify a users image in various ways. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Algorithm Implementation Test to determine whether the algorithms designed are functional and work to display the output. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Software and Hardware Integration Ensure that the hardware as well as software is compatible and work to display the output. Fuller, Johns, Kaufman, McCauley, Pachol, Suever Completed Prototype of SystemCreate a working prototype that combines all prior tasks and works properly. Fuller, Johns, Kaufman, McCauley, Pachol, Suever EXPECTED OUTCOMES

Slide 22

PROJECT PLAN

Slide 23

Integrating all technologies cohesively Designing multiple innovative unique display options Creating the system to work in real-time. Allowing the user with a free range of interactive possibilities Create a system at a low cost. Develop the system that has minimal power concerns. CHALLENGES AND UNCERTAINTIES

Slide 24

ActivityFailureCauseSolutions Power Loss System experiences an external power loss. Over-heating of the system as well as the over consumption of power due to a single component. Allow for the system to be in an environment that allows for proper heating of the system as well as monitor the systems power consumption. Software Failure Code or software does not function properly. Code has bugs or other failures within or the software used is not compatible. Determine if the code is bug and confirm that the software is functioning properly. Hardware Failure Hardware does not work properly. Over-heating of the system or the connections between the components are not ideal. Test connections between the components to determine if they are connected. Also to monitor the systems power consumption. Environmental Issues Lighting of the environment causes an issue within the system. Too much or too little lighting for the system. The space in which the system is in is not large enough for proper image retrieval. Allow for the system to be placed in an environment that is ideal for image retrieval as well as image output. A well lit room as well as a room that is large enough for image retrieval that does not compromise the system. System over- heating System over-heats causing a failure within the system. Power consumption of the Raspberry Pi or other components is too high. Monitor the systems power consumption. Image outputThe image output quality is not ideal or does not work at all. The image manipulation does not yield a output image that is ideal. Software, code or Raspberry Pi does not work properly. Test the output of the system onto the monitor and determine if its both in as close real time as possible as well in the quality that is ideal. FAILURE ANALYSIS

Slide 25

Raspberry Pi Purchased from distributor HD Monitors Utilizing monitors that we have in our possession Camera Raspberry Pi Camera module purchased from distributor Openframeworks Obtained from Openframework website Visual Studio Obtained from Dreamspark website. COMPONENT PROCUREMENT PLANS

Slide 26

Digital interactive art is a growing art form that incorporates science and technology. Immersive environment consists of human-computer interface which promotes social engagement from users. Complex algorithms combined with the level of interactivity leads to memorable and unique aesthetics. Incorporates STEM aspects into the market world. CREATIVE AND INNOVATIVE ASPECTS

Slide 27

Project is meant to be intuitive and aesthetically pleasing. Multiple uses such as advertising, art or just fun entertainment. Main goal: provide a memorable, unique and interactive experience for the user. CONCLUSION

Slide 28

QUESTIONS?