Ken Hinckley Koji Yatani Pen + Touch = New Tools.
-
Upload
octavia-norton -
Category
Documents
-
view
225 -
download
0
Transcript of Ken Hinckley Koji Yatani Pen + Touch = New Tools.
![Page 1: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/1.jpg)
Ken Hinckley Koji Yatani
Pen + Touch = New Tools
![Page 2: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/2.jpg)
• Handhelds• Slates• Drafting Boards• Tabletops• Wall Displays
• Touch• or Pen…
DIRECT INPUT A SHIFT TO
![Page 3: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/3.jpg)
ISN’T THE FUTURE ABOUT TOUCH?
WHY THE PEN?
![Page 4: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/4.jpg)
To help explain, let me introduce my nemesis.
![Page 5: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/5.jpg)
MR. I.M.A. BIGBODY, CORPORATE DENIZEN,THIRD RATE INC.
![Page 6: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/6.jpg)
“I CAN TYPE FASTERTHAN I CAN WRITE.”
![Page 7: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/7.jpg)
![Page 8: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/8.jpg)
TYPETHIS.
![Page 9: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/9.jpg)
OR THIS.
![Page 10: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/10.jpg)
OR MAYBETHIS.
![Page 11: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/11.jpg)
YOU CAN’T TYPE THE SOUL OFA NEW IDEA.
![Page 12: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/12.jpg)
BUT IT’S NOT ALL ABOUTTHE PEN.
![Page 13: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/13.jpg)
FIRST YOU NEED TO GRAB THE NAPKIN.
![Page 14: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/14.jpg)
“JUST TELL ME WHICH IS BEST, TOUCH OR PEN.”
![Page 15: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/15.jpg)
![Page 16: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/16.jpg)
OF HANDSAND
HANDEDNESS
![Page 17: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/17.jpg)
PAPER NOTEBOOK OBSERVATIONS
B1: Tuck the pen, interleave stylus and fingers
B2: Hold Clippings while Writing
B3: Specific Roles for Pen and Fingers
B4: Two-handed actions
![Page 18: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/18.jpg)
B5: Drawing along Edges
B6: Hold Page while Flipping
PAPER NOTEBOOK OBSERVATIONS
![Page 19: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/19.jpg)
BE EVOCATIVE OF PAPER WITHOUT BEING BEHOLDEN TO IT.
![Page 20: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/20.jpg)
Q: Which hand do you write with, Right or Left?
![Page 21: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/21.jpg)
A: Both!
• Guiard, 1987: NPH defines frame of reference.• Right vs. Left is the wrong question to ask.
![Page 22: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/22.jpg)
What is the logic of the division of labor
between pen and touch in interface design?
![Page 23: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/23.jpg)
• Video– search on
“manual deskterity”
![Page 24: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/24.jpg)
• Users easily interleaved pen & touch – obvious• Staple, Xacto Cut, and Peel off Copy
particularly resonated with users• The particular tools were not always of interest• Some example comments:
REACTIONS FROM USERS
“The way it works is just like the way I already work in my notebook.”
“I wouldn’t have guessed the gestures worked that way, but once I tried it, it felt pretty natural.”
![Page 25: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/25.jpg)
![Page 26: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/26.jpg)
DESIGNPROPERTIES
OF PEN + TOUCH
![Page 27: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/27.jpg)
27
![Page 28: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/28.jpg)
![Page 29: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/29.jpg)
• Pen + Touch: distinct interaction states• Touch + Touch ambiguous : pinch• Zero-force, incidental Contact is an
inherent property of (soft) Touch– GREAT! Just touch it to do something.– TERRIBLE! Just touch it, and it might do
something.
WHY NOT ALL MULTITOUCH?
![Page 30: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/30.jpg)
• Minimal on-screen UI, widgets, & buttons.• Holding touch integrates (1) Object
Selection with (2) Pen Mode Switching.• And also…
• (3) provides salient feedback of temporary state. • (4) unambiguously phrases together
multiple elementary pen and touch inputs.
SOME INTRIGUING PROPERTIES…
![Page 31: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/31.jpg)
• Differentiated vs. Interchangeable– E.g. Common controls
• Mobile vs. Stationary – Hand-held use vs. on-desk use, with graceful
degradation between the two– One-handed interactions for core actions– Two-handed interactions to take full
advantage of expressiveness of pen + touch
DESIGN DIMENSIONS
![Page 32: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/32.jpg)
• Interleaved vs. Simultaneous – Pen + touch has the most novelty– Touch-pen-touch has tremendous value
• Elementary Inputs vs. Phrases – Not just assign device/hand to individual
interactions – – Workflow across multiple subtasks…
DESIGN DIMENSIONS
![Page 33: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/33.jpg)
SUMMARY
![Page 34: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/34.jpg)
IF WE’RE ONLY THINKING ABOUT TOUCH, WE’RE BLOWING IT.
![Page 35: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/35.jpg)
EXPERIENCES TO STAND OUT…
IF WE WANT OUR
![Page 36: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/36.jpg)
Not pen. Not touch.
Not pen OR touch.Pen AND Touch,
designed in concert
![Page 37: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/37.jpg)
“TOUCH OR PEN ARE JUST NEWWAYS TO CONTROL THE MOUSE,
SO WHAT’S THE BIG DEAL?”
![Page 38: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/38.jpg)
YOU’RE FIRED!
YOU’RE FIRED!
YOU’RE FIRED!
YOU’RE FIRED!
YOU’RE FIRED!
“TOUCH OR PEN ARE JUST NEWWAYS TO CONTROL THE MOUSE,
SO WHAT’S THE BIG DEAL?”
![Page 39: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/39.jpg)
![Page 40: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/40.jpg)
![Page 41: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/41.jpg)
Pen WritesTouch Manipulates
![Page 42: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/42.jpg)
Pen + Touch Yields New Tools
![Page 43: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/43.jpg)
PEN + TOUCH GESTURES
staple
straightedge stamp
Xacto cut
brush
peel off copy
![Page 44: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/44.jpg)
![Page 45: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/45.jpg)
![Page 46: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/46.jpg)
![Page 47: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/47.jpg)
![Page 48: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/48.jpg)
Pen WritesTouch Manipulates
![Page 49: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/49.jpg)
fluidity of annotation + manipulation navigation zooming object creation
![Page 50: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/50.jpg)
Pen + Touch Yields New Tools
![Page 51: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/51.jpg)
PROPERTIES SHARED BY
PEN AND TOUCH
![Page 52: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/52.jpg)
PEN IS BEST!
Mechanical intermediary: familiar tool, lever arm, affords precision!
![Page 53: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/53.jpg)
TOUCH IS BEST!
No mechanical intermediary!
Nothing to lose!
No time to unsheathe!
![Page 54: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/54.jpg)
PEN IS BEST!
Point at a specific spot on the coin
![Page 55: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/55.jpg)
TOUCH IS BEST!
Grab the whole coin
![Page 56: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/56.jpg)
EVERY COIN HAS TWO SIDES.
![Page 57: Ken Hinckley Koji Yatani Pen + Touch = New Tools.](https://reader036.fdocuments.net/reader036/viewer/2022062305/5697bf821a28abf838c8593f/html5/thumbnails/57.jpg)