Kinect Hacks: Beyond Just Games

58
Hacks - Beyond Just Games

description

Kinect is moving from a gaming device to a new way to interact with our digital world. While touch has taken a disproportional amount of our attention, we're seeing a flood of devices that use sensors to collect feedback from the world around us. And the Kinect is the mother of all sensors with a high visual resolution, audio, and advances in areas like face detection - how would our would look if we focused on gesture and sensor designs?

Transcript of Kinect Hacks: Beyond Just Games

Page 1: Kinect Hacks: Beyond Just Games

Hacks - Beyond Just Games

Page 2: Kinect Hacks: Beyond Just Games

JEREMY JOHNSON

Page 3: Kinect Hacks: Beyond Just Games

DESIGNERUX

Page 4: Kinect Hacks: Beyond Just Games

DIRECTORof user experience

Page 5: Kinect Hacks: Beyond Just Games

GAMER

Page 7: Kinect Hacks: Beyond Just Games

2009

Page 9: Kinect Hacks: Beyond Just Games

Microsoft's motion-sensor Kinect came out of the company's research lab in Beijing, away from the company's day-to-day business, she notes. "There was a steel umbrella put over it, to keep out the rest of the organization. Then Microsoft Research threw Kinect over the wall to the Xbox group, which created their own steel umbrella to shield it. They added some scaffolding, but this was an innovation that was mostly done in-house. It can happen in a big company. Of course, this is entirely the reverse of the way Office/Windows development happens."boyd argues that the best place "to create steel walls is in businesses outside your core cash cows. The role of a big company is to keep the cash cow rolling, and then build the new."

http://www.fastcompany.com/magazine/162/generation-flux-danah-boyd

Page 10: Kinect Hacks: Beyond Just Games
Page 11: Kinect Hacks: Beyond Just Games

“Kinect, which launched slightly over a year ago, has sold an impressive 18 million units worldwide. (At this rate, Kinect will outsell the original Xbox by next year.)”http://www.shacknews.com/article/71904/xbox-360-reaches-66-million-sales-kinect-at-18-million

18 Million

Page 12: Kinect Hacks: Beyond Just Games

GAMES

Page 13: Kinect Hacks: Beyond Just Games
Page 15: Kinect Hacks: Beyond Just Games

“There’s a lot to learn from games. There are 30 years of design lessons and thousands of products on the market. Games have more concrete lessons to teach application designers about learning, feedback, user motivation and social systems than almost any field of study.”

- Danc

http://www.lostgarden.com/2010/05/wordcamp-2010-why-we-turned-microsoft.html

http://www.officelabs.com/projects/ribbonhero2/Pages/default.aspx

http://www.lostgarden.com/2011/04/what-heck-happened-to-clippy-ribbon.html

Page 17: Kinect Hacks: Beyond Just Games

“Kinect Hacks”

Page 18: Kinect Hacks: Beyond Just Games

http://www.kinecthacks.com/

Page 20: Kinect Hacks: Beyond Just Games

http://www.joystiq.com/2012/01/09/kinect-for-windows-leers-at-february-1-launch-date/

“Microsoft chief Steve Ballmer narrowed down the "early 2012" launch window for Kinect on the Windows PC during Microsoft's CES 2012 keynote today: February 1, 2012.”

Page 23: Kinect Hacks: Beyond Just Games

DESIGNERUX

Page 24: Kinect Hacks: Beyond Just Games

information architectureinteraction designvisual designusability testing

Page 25: Kinect Hacks: Beyond Just Games

web appsdesktop apps RIAs

mobile apps touch apps ??

Page 26: Kinect Hacks: Beyond Just Games

User interaction with technology is going above the glass. You no longer need an explicit tool or even direct manipulation to drive a user interface. With the ability of technology, like the Microsoft Kinect, to see users’ movements in space, gestures are being added to traditional methods in new layers of interaction. Designing for this new layer of interaction requires new thinking about dexterity, ergonomics, and whether someone might feel silly or offensive with certain gestures. We are so involved in this space right now, that we’ve had to move our design technologists’ desks to create enough room for all the hand waving design.http://designmind.frogdesign.com/blog/frogs-2012-technology-trend-predictions.html

Interaction Choreographyby Senior Principal Design Technologist Jared Ficklin

Page 27: Kinect Hacks: Beyond Just Games
Page 28: Kinect Hacks: Beyond Just Games

vs

Page 30: Kinect Hacks: Beyond Just Games
Page 32: Kinect Hacks: Beyond Just Games
Page 33: Kinect Hacks: Beyond Just Games
Page 34: Kinect Hacks: Beyond Just Games

“The innovation here is the fluidity of experience and focus on the data, without using traditional user interface conventions of windows and frames. Data becomes the visual elements and controls. Simple gestures and transitions guide the user deeper into content. A truly elegant and unique experience.”http://en.wikipedia.org/wiki/Metro_(design_language)

Page 35: Kinect Hacks: Beyond Just Games
Page 36: Kinect Hacks: Beyond Just Games

HACKSKINECT

Page 38: Kinect Hacks: Beyond Just Games
Page 41: Kinect Hacks: Beyond Just Games
Page 49: Kinect Hacks: Beyond Just Games

Solar powered house saves energy with Kinect

http://dvice.com/archives/2012/01/solar-powered-h.php

Now, in the name of conserving energy that vision could come true with a solar house designed to use an Xbox Kinect to switch off energy consuming devices with simple movements.

Page 51: Kinect Hacks: Beyond Just Games

What now?

Page 52: Kinect Hacks: Beyond Just Games

“Don’t try to figured out how to cram Kinect into an existing UI paradigm, instead design a UI paradigm that’s from the ground-up intended to exploit the Kinect’s functionality.”

http://www.teehanlax.com/labs/insights-into-kinect-ui/

Page 54: Kinect Hacks: Beyond Just Games

That there are no universal standards for gestural interactions yet is a problem in its own right, because the UI cannot rely on learned behavior. The Kinect has a few system-wide standards, however, which do help users.http://www.useit.com/alertbox/kinect-gesture-ux.html

Page 55: Kinect Hacks: Beyond Just Games

http://www.microsoft.com/download/en/details.aspx?id=27978

Explain what the player can do.

Represent what they are doing.

Make it fun to match the two.

Test your implementation.

THE RULES Of KINECT

Page 56: Kinect Hacks: Beyond Just Games

Things to Think About...Distance and EnvironmentHow far do they need to stand? How far do they think they need to stand? Environment design of the area. Eyesight, size of the UI.

ErgonomicsIs it comfortable? Age? People with disabilities? Common movements vs. uncommon. How long will they interact?

FashionDo they look silly? Will someone of a certain age/race/gender use this? What’s acceptable for an Avatar?

UI PatternsWhat do they know from click and touch interfaces? Is there something more natural? Try and unlearn, and imagine.

3D SpaceIs it close or far away? What do we infer from spatial positioning? Can you get people to interact in 3D space on a 2D screen?

Page 57: Kinect Hacks: Beyond Just Games

Things to Think About...Screen ResolutionWhat’s the maximum amount of objects you can fit on a screen? What’s the minimum size of an object need to be on the screen?

PrivacyCan you tailor to age? Race? Gender? What is helpful and what is potentially scary? Can you keep a snapshot for marketing purposes?