Submission Doc.: IEEE a Slide 1 Project: IEEE Working Group for Wireless Personal Area Networks (WPANs) Submission Title: Invisible data embedded Display Tx schemes for OCC Date Submitted: 10 January, 2016 Source: Jaesang Cha[SNUST], Junghoon Lee [ Dong Seoul Univ.] and Vinayagam Mariappan [SNUST] Address : Seoul National University of Science & Technology [SNUST], Seoul, Korea Voice: , FAX: , Re: Response to Call For IEEE r1 Proposal on November 2015 Abstract: Variable invisible data embedded Display Tx schemes for OCC are proposed. Variable modulation Scheme, Distance adaptive, Angle Free, Asynchronous, Rx Distance and Frame rate adaptive OCC communication schemes are proposed. Purpose: To submit a Proposal IEEE r1 Notice:This document has been prepared to assist the IEEE It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein. Release:The contributor acknowledges and accepts that this contribution becomes the property of IEEE and may be made publicly available by IEEE Jaesang Cha SNUST January 2016 Submission Doc.: IEEE a Slide 2 Jaesang Cha SNUST January 2016 Jaesang Cha [SNUST] Vinayagam Mariappan [SNUST] Junghoon Lee [ Dong Seoul University] SNUST r1 Proposal for Invisible data embedded Display Tx schemes for OCC Submission Doc.: IEEE a Slide 3 Contents Introduction Proposal Descriptions Network Device Architecture MAC Layer PHY Layer Device Management Entity Simulation Analysis Conclusion January 2016 Jaesang Cha SNUST Submission Doc.: IEEE a Slide 4 Jaesang Cha SNUST January 2016 Introduction Submission Doc.: IEEE a Slide 5 Introduction (1) Information need to transfer is encoded into a visual frame Any camera equipped device can turn to the Display screen scene and decode the information January 2016 Jaesang Cha SNUST Advantages -Operating on the Visible Light Spectrum Band -Electromagnetic Interference Free Communication -Promising out-of-band communication for Short Range information acquisition Display Screens Smart Device Submission Doc.: IEEE a Slide 6 Introduction (2) Display Screen Smart Device Tx & Rx Data Flow Issues -Displays Visible Coded Images -Uses QR Code, 2D Barcode, Color Code Patterns -Unpleasant View Experience -Camera receiver to be closer to the screen -Low Data Rate -Need addition Synchronization Block January 2016 Jaesang Cha SNUST Submission Doc.: IEEE a Slide 7 Introduction (3) Proposing Invisible Data Embedded on Display Screen Smart Device Communication Mode -Unobtrusive to the human HVS -Decodable by Camera Eyes Design Goal -Unobtrusive to Screen Viewer -Works on dynamic visual Scene -Angle and Distance Free Communication -Rx Distance Adaptive Communication by Screen with interactive Camera -Asynchronous Communication -Rx Frame Rate Support independent Transmission January 2016 Jaesang Cha SNUST Tx Rx Data Received Submission Doc.: IEEE a Slide 8 Jaesang Cha SNUST January 2016 Proposal Descriptions Submission Doc.: IEEE a Slide 9 Characteristics of Proposal Characteristics -Invisible Data Embedding -Works on dynamic visual Scene -Angle Free and Distance Adaptive Communication -Receiver Distance Adaptive Data Rate Control by Screen with interactive Camera -Asynchronous Communication -Receiver Frame Rate Support independent Transmission -Uses Spread Spectrum based M-PSK, M-FSK, Hybrid-M-PSK-FSK, Sequential Scalable 2D Codes -Multi-Display Model for Transmission January 2016 Jaesang Cha SNUST Submission Display Tx Process Block VIDEO FRAMING OWC DATA FUSION M-FSK / M-PSK/ 2D CODE Unipolar to Bipolar A bps B bps C bps Spread c ode Gen erator SS cps Bipolar to Unipolar SS cps CODED PAYLOAD GRID FRAMING January 2016 OWC Data Fusion -Uses Blending / Watermarking -Alpha Blending OWCFusionDisplayFRAME = . grid + (1- ) Data2D Where -> 0 to 1 and = 0 < % Invisible Jaesang Cha SNUST SS Doc.: IEEE a Submission SS Modulation Parameters Data Rate(bps) Parameter UnitsConsiderations Tx data size204080bitsPayload size Frame duration20 ms SS chip rate222McpsSpreading chip rate Spreading Factor842 Processing Gain842 Number of chips per frame chips Grid Allocation8*416*832*16 The numbers of rows and columns of screen January 2016 Jaesang Cha SNUST Study Case Doc.: IEEE a Submission M-PSK January PSK Jaesang Cha SNUST 4-PSK 1) 0 2) 1 1) 00 3) 10 2) 01 4) 11 Doc.: IEEE a Submission M-FSK January 2016 Jaesang Cha SNUST 2-FSK 4-FSK 1) 0 2) 1 f1f1 f2f2 1) 00 2) 01 f1f1 f2f2 3) 01 4) 10 f3f3 f4f4 Doc.: IEEE a Submission Hybrid (M-PSK-FSK) January 2016 M-PSK and M-FSK - Data bits can be sent via frequency & phase combination Jaesang Cha SNUST 2) 01 1) 00 3) 10 4) 11 Phase Frequency f1f1 f2f2 f1f1 f2f2 Doc.: IEEE a Submission Sequential Scalable 2D Codes January 2016 Jaesang Cha SNUST Use 2D Codes QR Code Color Code Use Invisible Watermarking Scheme for Embedding Propose the Sequential Scalable 2D Code to support distance adaptive data rate Sequential Scalable QR Code Sequential Scalable Color Code Doc.: IEEE a Submission Code set 1 : (zero offset) Code set 2 : (8chip offset) Code set 3 : (16chip offset) Code set 4 : (24chip offset) Gold- sequence January 2016 SS Code Sequence Study Case Spreading Code(Gold Sequence) -Gold sequence was chosen as a spreading code -Shifter register length is 5 -Code length is 31(=2 5 -1) -4 family code set was generated via offset 8*n chips of code set 1. Jaesang Cha SNUST Any Special Orthogonal Spreading Code Sequence with good process gain is adoptive for implementation Doc.: IEEE a Submission Video Frame#1, SC#1(Spread code #1) Video Frame#2, SC#2 Video Frame#3, SC#3 Video Frame#4, SC#4 Video Frame#5, SC#1 January 2016 SS Code Sequence Assignment Each code sets repeated for spreading data according to spreading factor Each spreading code set 1, 2, 3, 4 are assigned for successive 4 frames as below Jaesang Cha SNUST Doc.: IEEE a Submission Rx Process Block FFT M-FSK / M-PSK Detector Unipolar to Bipolar Spread code Generator SS cps Bipolar to Unipolar SS cps A bps B bps C bps January 2016 Jaesang Cha SNUST QR Code Detector Smart Device Camera Capture Visual Frame from Screen Extract the ROI of Screen Visual Area Apply the Sequential Scalable 2D Code or M-FSK or M-QPSK detector based on Mapping Scheme Applied Recover the Decoded data after applying SS SS Doc.: IEEE a Submission Asynchronous Communication Method Video Frame#1, SC#1(Spread code #1) Video Frame#2, SC#2 Video Frame#3, SC#3 Video Frame#4, SC#4 Video Frame#5, SC#1 January 2016 When transmitting data, different spreading code is used per video frame. On receiver side spreading code already known. If camera CMOS received same frame, for example #1 video frame receive twice, then receiver will despread video frames using SC#1, SC#2. When processing using SC#2, dominant value will not appear so the video frame will be discarded. Jaesang Cha SNUST Doc.: IEEE a Submission Variable Spreading Factor based on Client Distance from Display Assigned with SS Short Code Assigned with SS Long Code January 2016 Jaesang Cha SNUST Tx Camera Estimate the Rxs Distance from Tx If Receiver is near SF Value is small so Short Sequence Code Assigned otherwise SF values high so Long Sequence Code Assigned Doc.: IEEE a Submission Doc.: IEEE a Slide 21 January 2016 Jaesang Cha SNUST Scalable Bitrate Controller for Frame Rate Adaptive Transmission To achieve robust communication, the scalable data transmission mode is proposed Screen is divided into Multiple region and each region different frame rate controlled data transmission is enabled Doc.: IEEE a Submission Doc.: IEEE a Slide 22 Positioning Service Invisible ID-Tag(2D code Tag) and Display Pattern transmit ID and Payload information to support the position based service or indoor positioning system Transferred data is assigned pointer of Big-data(URL link etc.) January 2016 Jaesang Cha SNUST Submission Doc.: IEEE a Slide 23 Authentication Service Authentication using Display with Camera for Authentication Service Display Tx Camera will capture the user information from Smart Device by Display Pattern or Flash and Provide user Authentication January 2016 LED Light Smart Device (LBS) Smart Device Gateway (Display - Camera) Submission Doc.: IEEE a Slide 24 Jaesang Cha SNUST Network Device Architecture January 2016 Submission Doc.: IEEE a Slide 25 Network Device Architecture Layers January 2016 Jaesang Cha SNUST -SNUST IEEE r1 Layer Architecture proposes simplified model from IEEE802 Reference Model IEEE The Specifications are updated on respective section Layer Specification -Device Management Entity (DME) uses Interactive Camera to provide Receiver distance dependent data rate control Used Topologies -Broadcast, Peer-to-Peer, Point-to-Multipoint Submission Doc.: IEEE a Slide 26 Network Device Topologies January 2016 Jaesang Cha SNUST SNUST IEEE r1 proposes to follow three topologies -Broadcast, Peer-to-Peer (P2P), Point-to-Multipoint(P2MP) Broadcast Topology -Tx a signal to other devices without forming a network -Uni-directional so the destination address is not required P2P Topology -Tx a signal to other devices with or without forming a network -Uni/Bi-directional and the destination address is need for Bi-directional case P2MP Topology -Tx a signal to other devices with forming a network so both need to built with Camera and Display -Bi-directional and the destination address is required Submission Doc.: IEEE a Slide 27 Jaesang Cha SNUST MAC Layer January 2016 Submission Doc.: IEEE a Slide 28 MAC Frame Format The Proposed MAC Frame Format Broadcast and P2P (Uni-Directional) is does not use Source and Destination Address (Its Optional) P2MP and P2P (Bi-Directional) uses Source and Destination Address The Field Check Sequence (FCS) can be optional for future Extension. Not used now Jaesang Cha SNUST January 2016 Submission Doc.: IEEE a Slide 29 MAC Protocol Setup Method The Beacon Message periodically transmitted to establish the communication between Display Screen Transmitter and Smart Media Device Receiver about Network Information. The Minimum periodicity is one sec. The periodicity configuration interval is [1 60] sec. Jaesang Cha SNUST January 2016 Submission Doc.: IEEE a Slide 30 Peer Indicator Negotiation Message Jaesang Cha SNUST January 2016 The Peer Indicator Negotiation Message is Transmitter periodically after Beacon Message according to the Beacon Message Periodicity Configuration on Display Screen OCC transmitter Submission Doc.: IEEE a Slide 31 Device Status Indicator Negotiation Message Jaesang Cha SNUST January 2016 Transferred file size or remained file size with our eyes by using Device Information packet Submission Doc.: IEEE a Slide 32 MAC State Description for P2P / Broadcast Topology Jaesang Cha SNUST January 2016 To communicate device to device, device can transfer coarse link adaptation information to peer device by using Beacon Message and Indication Negotiation Message MAC States consist of IDLE State, Connection State, Data Exchange State Submission Doc.: IEEE a Slide 33 Jaesang Cha SNUST January 2016 MAC State Description for P2MP Topology To communicate device to device, device can transfer coarse link adaptation information to peer device by using Beacon Message, Device Information and Indication Negotiation Message. MAC States consist of IDLE state, Connection state, Data Exchange state. Submission Doc.: IEEE a Slide 34 Jaesang Cha SNUST PHY Layer January 2016 Submission Doc.: IEEE a Slide 35 PHY Frame Structure IEEE r1 PHY is supports following activities: -The preamble is replaced with a Start Frame Delimiter -Optional Fields define PHY Specific Information is Optional and defined in future -PSDU holds the data packet January 2016 Jaesang Cha SNUST Submission Doc.: IEEE a Slide 36 PHY FRAME Jaesang Cha SNUST PHY frame includes Frame Generation SS, Modulation Scheme, Embedded Message on Image, Display driver and Display Screen January 2016 Submission Doc.: IEEE a Slide 37 Data Rate Performance S.No SSModulationEmbedding MethodData Rate (Max) 1M-PSKAlpha Blend 2M-FSKAlpha Blend 3HYBRIDAlpha Blend 4QR CODEWatermark 5COLOR CODEWatermark Jaesang Cha SNUST January 2016 TBD Further materials Are Under Review And May be Updated Submission Doc.: IEEE a Slide 38 Jaesang Cha SNUST Device Management Entity January 2016 Submission Doc.: IEEE a Slide 39 DME Tx Camera Enable [1 Byte] -[Bit 0] Represent Tx Camera Enable Bit -Check and Set the Status of Tx Enable Bit 1 -1/0 -> Tx Camera Connected / Tx Camera not connected Rx Distance [ 1 Byte] -Shows the Rx Distance from Tx Application Mode [ 3 Bit] -ID Mode [Bit 0]: 1/0 Enable / Not Used -Authentication Mode [Bit 1]: 1/0 Enable / Not Used -Data Mode [Bit 2]: 1/0 Enable / Not Used Application Packet Length [2 Byte] -Used to specify the length of a data packet ID Length [1 Byte] -Used to specify the length of a ID Authentication Data Length [2 Byte] -Used to specify the length of a Authentication Data January 2016 Jaesang Cha SNUST Submission Doc.: IEEE a Slide 40 DME (2) The DME information Shared to -Application Layer -MAC -PAHY January 2016 Jaesang Cha SNUST Submission Doc.: IEEE a Slide 41 Jaesang Cha SNUST Simulation Analysis January 2016 Submission Doc.: IEEE a Slide 42 System Simulation Block Diagram January 2016 Jaesang Cha SNUST Submission Simulation Results - M-PSK January 2016 Scenario Constellation Diagram SER Graph Jaesang Cha SNUST TBD Further materials Are Under Review And May be Updated Doc.: IEEE a Submission Simulation Results - M-FSK January 2016 Jaesang Cha SNUST Scenario Constellation Diagram SER Graph TBD Further materials Are Under Review And May be Updated Doc.: IEEE a Submission Simulation Results - Hybrid (M-PSK-FSK) January 2016 Jaesang Cha SNUST Scenario Constellation Diagram SER Graph TBD Further materials Are Under Review And May be Updated Doc.: IEEE a Submission Simulation Results 2D Code January 2016 Jaesang Cha SNUST Scenario SER Graph TBD Further materials Are Under Review And May be Updated Doc.: IEEE a Submission Doc.: IEEE a Slide 47 TBD Further materials Are Under Review And May be Updated January 2016 Submission Doc.: IEEE a Slide 48 Conclusion Jaesang Cha SNUST January 2016 Variable Invisible data embedded Display Tx schemes for OCC are proposed and had many advantages -Data is Unobtrusive to User -Works on dynamic visual Scene -Angle Free and Distance Adaptive Communication -Rx Distance Adaptive Data Rate Control by Display with interactive Camera -Asynchronous Communication -Rx Frame Rate Support independent Transmission -Uses variable modulation and multiplexing methods. -Multi-Display Model for Transmission -Supports Indoor/outdoor Positioning, Authentication, Data Transmission