MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and...

35
CONFIDENTIAL © 2016 MIPI Alliance, Inc. All rights reserved. MIPI Display Working Group Presented by Dale Stolitzka, Samsung Display Co. & Display WG Chair MIPI Touch: Getting in Touch with Your Phone 10 November 2016 Originally presented by David Johnson, Qualcomm Technologies, Inc. MIPI Developers Conference, 14-15 September 2016

Transcript of MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and...

Page 1: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

MIPI Display Working GroupPresented by Dale Stolitzka, Samsung

Display Co. & Display WG Chair

MIPI Touch: Getting in Touch with Your Phone

10 November 2016

Originally presented by David Johnson, Qualcomm Technologies, Inc.MIPI Developers Conference, 14-15 September 2016

Page 2: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Legal disclaimer

Page 1

The material contained herein is not a license, either expressly or impliedly, to any IPR owned or controlled by any of the authors or developers of this material or MIPI®. The material contained herein is provided on an “AS IS” basis and to the maximum extent permitted by applicable law, this material is provided AS IS AND WITH ALL FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions, either express, implied or statutory, including, but not limited to, any (if any) implied warranties, duties or conditions of merchantability, of fitness for a particular purpose, of accuracy or completeness of responses, of results, of workmanlike effort, of lack of viruses, and of lack of negligence. ALSO, THERE IS NO WARRANTY OR CONDITION OF TITLE, QUIET ENJOYMENT, QUIET POSSESSION, CORRESPONDENCE TO DESCRIPTION OR NON-INFRINGEMENT WITH REGARD TO THIS MATERIAL.

All materials contained herein are protected by copyright laws, and may not be reproduced, republished, distributed, transmitted, displayed, broadcast or otherwise exploited in any manner without the express prior written permission of MIPI Alliance. MIPI, MIPI Alliance and the dotted rainbow arch and all related trademarks, tradenames, and other intellectual property are the exclusive property of MIPI Alliance and cannot be used without its express prior written permission.

IN NO EVENT WILL ANY AUTHOR OR DEVELOPER OF THIS MATERIAL OR MIPI BE LIABLE TO ANY OTHER PARTY FOR THE COST OF PROCURING SUBSTITUTE GOODS OR SERVICES, LOST PROFITS, LOSS OF USE, LOSS OF DATA, OR ANY INCIDENTAL, CONSEQUENTIAL, DIRECT, INDIRECT, OR SPECIAL DAMAGES WHETHER UNDER CONTRACT, TORT, WARRANTY, OR OTHERWISE, ARISING IN ANY WAY OUT OF THIS OR ANY OTHER AGREEMENT RELATING TO THIS MATERIAL, WHETHER OR NOT SUCH PARTY HAD ADVANCE NOTICE OF THE POSSIBILITY OF SUCH DAMAGES.

Page 3: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Agenda

• MIPI Overview• MIPI Touch Architecture• Q & A

Page 2

Page 4: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Peter LefkinMIPI Alliance

Managing Director

MIPI Overview

10 November 2016

Page 5: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

About MIPI AllianceWe are a global, collaborative organization comprised of over 280 member companies spanning the mobile and mobile-influenced ecosystems.

MIPI Alliance is leading innovation in mobile interface technology.

Page 4

Page 6: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

MIPI Alliance Member Ecosystem

Page 5

Page 7: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Active Technical Working Groups

Camera Debug Display Low Latency Interface

Low Speed Multipoint

LinkPHY (C/D/M) Reduced

Input Output RF Front End

Sensor / I3CSM Software Test UniProSM

Page 6

Page 8: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

MIPI Display Working GroupPresented by Dale Stolitzka, Samsung

Display Co. & Display WG Chair

MIPI Touch: Getting in Touch with Your Phone

10 November 2016

Originally presented by David Johnson, Qualcomm Technologies, Inc.MIPI Developers Conference, 14-15 September 2016

Page 9: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Announcing a MIPI Touch

Interface architecture

New

Page 8

Page 10: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Motivation for MIPI TouchLeveraging MIPI Specifications

Page 9

Page 11: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Current industry touch status

• Non-standard software or commands• Multiple interfaces use a non-standard protocol– SPI– I2C-bus

• Not optimized– low-power mobile performance– low-cost pin-count interfaces

• Require more touch bandwidth

10Page 10

Page 12: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Standardizing touch

11

MIPI identified multiple usages forstandard touch and stylus

Build MIPI Touch from within

the MIPI ecosystem

Page 11

Page 13: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Multi-touch

12Page 12

Page 14: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Stylus

13Page 13

Page 15: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Automotive

14Page 14

Page 16: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Requirements

Page 15

Page 17: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Requirements1

• Usages: Phones, tablets, automotive, appliances• < 50 cm trace length• FCC compliancy• Improve time to market• OS-agnostic approach• Standard software• PHY-agnostic approach• Plus…

Page 16

1. All members Call for Proposals (2016)

Page 18: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Higher speed technologies

I2C

I3C

MIPI Touch bandwidth

• Lowest power• Transports sufficient data• Effective latency • Low protocol burden

SPI

Busspeed

> 40 Mb/s Higher speed technologies

< 40 Mb/s MIPI I3C< 10 Mb/s I3C | SPI< 1 Mb/s I2C-bus

Page 17

Page 19: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Power vs. bit rate requirement

18

0.001

0.01

0.1

1

1 10

Standby Active

nJ/bit

1 Mb/s 10 Mb/s

5uW 5uW

Page 18

Page 20: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

System topology

Page 19

Page 21: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

AP

OS Apps

Touch data

Touch data’

Commands

Instructions

TC/AFE

MIPI Touch interface

MIPI Touch software

MIPI Touch / topology

Page 20

Page 22: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Topology inside the module

• Point-to-point or• Multi-drop

21Page 21

Page 23: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Solution architecture

Page 22

Page 24: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

MIPI Touch architecture

Page 23

Touch commands

MIPI I3C

I3Cprofile

OS Touch Driver Stack

Touch specific2016

I3C drivers2017

Page 23

Page 25: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

MIPI Touch architecture keys

• Standardized command set– OS agnostic and OS independent– Reduced effort for software development

• A two-way street for sensing and feedback• To support touch or pen data• MIPI Touch uses the new MIPI I3CSM

24Page 24

Page 26: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

MIPI Touch leverages MIPI I3C

• Optimized for speed and power• Pin-optimized using in-band interrupt

eliminated GPIO interrupts• Robust protocols for bus management• Improved bandwidth

25Page 25

Page 27: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Example touch commands

Class Example commandsPower S/W Reset, Configure Normal / Idle / Sleep Diagnostics Activate self-test, calibrate, Get diagnosticsRAW touch data Get/set RAW tixel coordinate mapping

Read proprietary raw | processed formatsGet/set other commands

Processed touch data

Get/set processed tixel coordinate mappingRead standard processed touch reportsGet/set other commands

Mapping for proprietary registers

Get/set vendor specific information or data

Page 26

Page 28: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Cross-functional support for MIPI Touch

Software WG Drivers and OS compatibility

Sensor WG I3C Specification

USI (Universal StylusInitiative)

Liaisons on active stylus and touch data commands

OS vendors and published information

OS compatibility and analysis of touch data structures

Page 27

Page 29: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Planning

Page 28

Page 30: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Execution plan / schedule

29

2016AUG SEPT OCT NOV DEC 2017

Drafts 0.2 to 0.4

Draft 0.5 Draft 0.7 Final Specification

Page 29

Page 31: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Conclusions and call

Page 30

Page 32: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Conclusions

• Standard open software • Touch profiles simplifies design for touch• Standard commands speed TTM• MIPI I3C is optimized for speed/power• MIPI I3C has in-band interrupts

no extra “IRQ” pins

Page 31

Page 33: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Next steps

• If not a member, join the MIPI Alliance• Join the MIPI Display Working Group to engage

with experts on touch specifications• Start implementations of MIPI I3C• Refer to the MIPI I3C webinar and white paper

for more information (www.mipi.org)

Page 32

Page 34: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Acknowledgements

The authors wish to thank the Display Working Group Touch team and in particular the following contributors and reviewers of this presentation’s content, Robert Gough and Nobu Suzuki, Intel Corporation, Peter Lefkin and Laura Nixon, MIPI Alliance, Paul Kimmelman, NXP, James Goel, and Radu Pitogoi-Aron, Qualcomm Technologies, Inc., Dale Stolitzka, Samsung Display Co., Jeff Lukanc, Synaptics, Inc.

33Page 33

Page 35: MIPI Touch: Getting in Touch with Your Phone...2016/11/10  · FAULTS, and the authors and developers of this material and MIPI hereby disclaim all other warranties and conditions,

CONF ID ENT I A L © 2016 MIPI Alliance, Inc. All rights reserved.

Q&A

Thank you!

Page 34