Renesas Electronics America Inc. Renesas Electronics CONFIDENTIAL; NDA Required HD video solution...

Renesas Electronics America Inc.

Renesas Electronics CONFIDENTIAL; NDA Required

HD video solution for Embedded device - Low Power IP Video Solution utilizing the SH4A/7724 -

Consumer & Industrial BU

00000-A

Renesas Electronics CONFIDENTIAL; NDA Required2

Key Takeaways

By the end of this presentation you will understand:

1. Roadmap updates for SH-Mobile

2. Activity updates

3. The ecosystem supporting on SH7724

4. Qualification and engagement


Roadmap Updates


32nm process32nm process45nm process45nm process 65nm process65nm process 90nm90nm

20102008

SH-Mobile Product Roadmap

2009

SH-MobileSH-Mobile

L3GL3G

2011

SH-MobileSH-MobileG3G3 Platform Platform SH-MobileSH-MobileG4G4 Platform Platform

SH-MobileSH-MobileG5G5 PlatformPlatform

Full HD1080p30 Full HD1080p30

SH-MobileSH-Mobile

HD1HD1

OpenOS APEOpenOS APE

Multimedia CCMultimedia CC

PlatformPlatform

SH-MobileSH-Mobile

R2R2

Now Available

ES: Q409, MP: 2Q10SH4A: 500 MHzVPU5H: 1080p EncodeJPEG: HWSound DSPDDR2: 64-bit

SH-MobileSH-Mobile

MT1MT1Now Available

Now Available

SH-MobileSH-Mobile

R2RR2R

SH-MobileSH-Mobile

R3R3

ES: Q411, MP: 2Q12CPU : Cortex A9 & SH4AVPU5H: 1080p Enc/DecVPU5F: 720p Enc/Dec3D:SGX540JPEG: HWSound DSPDDR2/3

HD1 is EOL in Q4 2011

No longer available for new opportunity


SH7724(SH-Mobile R2R) Delivers HD Video for Portables

Enabling 1280x720 @ 30 fps HD Video Encode &

Decode

Low power consumption – 250mW for 720p @30fps

900 MIPS Host CPU

5MPixel camera input x 2 ch

Rich I/O peripherals for flexibility 10/100 Ethernet MAC, SD x 2ch, USB HS with Phy x 2ch,

ATAPI

Visual Engines for Enhanced Images at HD

2DG accelerator for Rich Graphical User Interface

Design

Sound DSP Processing


SH-4A(Super H RISC Engine) with FPU Operation frequency

CPU Clock ： 500MHz Bus Clock ： 166 MHz

Embedded memory ILRAM ： 16Kbyte Cache ： I=32Kbyte, D= 32Kbyte L2 Cache : 256kbyte 　

Bus Interface SDRAM-DDR2 16/32bit Local bus 8/16/32bit

Peripheral 32bit Timer : 3ch Watch dog timer : 1ch 10/100Ether MAC : 1ch I2C bus interface : 2ch DMA Controller : 6ch SCIF : 6ch MMC/NAND Flash Interface :1ch USB2.0 Host/Function : 2ch SD IO (max 50MHz) ; : 2ch LCDC/Digital RGB 24bit VPU H.264 encode/decode D1@60fps 2D Graphic Accelerator Blending Engine : 2ch Video manipulation Engine : 2ch Camera capture Engine : 2ch KeyScan GPIO with interrupt H-UDI (User Debug Interface )

Package 　 :BGA449

SH7724(SH-Mobile R2R) Block Diagram

I-CacheI-Cache32KB32KB

D-CacheD-Cache32KB32KB

L2 CacheL2 Cache256KB256KB

WDTWDT

USB-HS USB-HS Host or Host or Device Device w/PHYw/PHY

x2x2

CPGCPGDMACDMACx6x6

UBCUBC

H-UDIH-UDI

MMUMMU

500MHz500MHz900900 MIPSMIPS

FPUFPUFPUFPU MACMACMACMAC

TMUTMUx3x3

TIMERTIMERMEMORYMEMORY ANALOGANALOGCPUCPU I/OI/OTIMERTIMERMEMORYMEMORY ANALOGANALOGCPUCPU I/OI/OMultimedia

OthersOthers

SPUSPU24bit DSP24bit DSP

JPEGJPEG

INTCINTC

BSCBSC(ROM/SRAM)(ROM/SRAM)

DDR2DDR232/16bit32/16bit

MMC MMC NANDNAND

KeyScanKeyScan

IrDAIrDA

ATAPIATAPI

SCIFSCIFx6x6

GPIOGPIO

LCDCLCDC

VOUVOU2DG2DG

I2CI2Cx2x2

SDIOSDIOx2x2

10/100 10/100 Ethernet Ethernet

MAC MAC w/DMAw/DMA

VPU5FVPU5FH.264 [email protected] D1@60fps

720p@30720p@30

Video Processing Unit

(VPU)

MPEG4 and H.264Video Codec

Encode & DecodeUp to 720p

30 fps

CEU CEU x2x2(Camera I/F)(Camera I/F)

BEUBEU x2x2

(Blend)(Blend)VEUVEU x2x2

(Scaling)(Scaling)

Video I/O units

•Camera Input•Color format conversion•Rotate, Scale, Filter•Blend Layers with alpha

CEU: Capturing Engine Unit VEU: Video Engine Unit BEU: Blending Engine Unit


Video Process Flow

PMU

LCD

KeypadDebugDebugUartUartJtagJtag

I2CI2CPCMPCM

VPUH.264

DEC

ENC

VIO5MegPix

VOU

TV out

LCDC

TVNTSC/PALNTSC/PAL

CEU BEU VEU

ScalingRotatingBlendingOverlay

I2CI2C AudioAD-DAC

SH-4A

SIUDRAMControl

NAND Flash

Up to XGAUp to XGA

System Memory

Ethernet RJ-45

Encode Stream

Decode Stream


Standard Pricing for SH7724

The prices are Disti cost This pricing is intended to enable initial discussions to

progress through the qualification stage and into traction/interest

Official quotation need to be approved by the Sales portal SH7724 is NOT in DDD program

Unit :USD

Part NumberVolume

Kunit/year 10K 10S 11K 11S

R8A77240D500BG#U0(SH7724) 10 14.50 14.00 13.70 13.40

100 13.00 12.70 12.30 11.90

500 11.70 11.40 11.00 10.70


SH-Mobile R3 (Tentative spec)

Full HD 1080p @ 30 fps Video Encode & Decode plus HD

720p @ 30 fps Video Encode & Decode

Cortex A9 & SH4A

3D/2D by SGX540

Encryption Engine (AES, DES, 3DES)

Rich I/O peripherals for Flexibles 10/100/1000 Ethernet MAC, SD x 2ch, USB HS with Phy x

2ch, ATAPI

Visual Engines for Enhanced Images at HD

Sound DSP Processing Tentative Schedule ES: Q4/2011, MP: Q2/2012


Promotion Updates with SH7724


Primary target applications in IP Video segment

IP Camera Camera + Video encoder + Stream server, all in one Out put would be on wired or wireless IP network

IP Encoder/Streamer Attached module/box for analog camera Accepts analog video in, digitize & encode video image, and

stream out via wired or wireless IP network Video Recorder

Accepts multiple analog coaxial cable video inputs, digitize & encode each video input and store to attached storage device. Usually HDD.

Less Competition with Encoding application

Lower Power consumption oriented


Activities around SH7724

Available in Distribution! (MS7724 Development Kit)

Great feedback from Arrow SH7724 will be on Arrow EDGE vol. 2

We will have several sessions for SH7724 in DevCon Two Linux hands on Labs – Introduction and Advanced Linux solution by MPC Data Future Roadmap beyond SH7724 Android support HMI solution by Crank Software

Redpine WiFi driver is in progress


Development Kit


MS7724 Hardware Features

Main Board SH-Mobile R2R(SH7724) - SH4A 500MHz DDR2-SDRAM - 256MBytes (Max.512MB) NOR FLASH - 64MBytes 100BT Ethernet - SH7724 on chip IP PoE(IEEE802.3af) class3 DVI out NTSC/PAL in/out Camera I/F x 2ch AUDIO - Mic In, Line out USB Host/Function x 2 ch - SH7724 on chip IP SD card slot - SH7724 on chip IP SD/eMMC card slot - SH7724 on chip IP E-10A Serial port

Option boards1. WVGA LCD panel with touch panel2. 3.2M pixel auto focus HD camera

【 Target Application 】- IP Camera (Network Camera ）- Video Conference System- Multimedia Mobile Equipment- PDA- PND- Automotive Event Recorder

- Renesas Multimedia Solution -


MS7724 ComponentsMain board : R0P7724LC0021RL

WVGA Panel board : R0P7724LE0011RL

HD Camera board : R0P7724LE0021RL (Tripod is not included)


MS7724 Package

The system is composed of the main board and the parts, listed below. R0P7724LC0021RL is the Main CPU board. As option, R0P7724LE0011RL (Wide-VGA LCD Extension Board) and

R0P7724LE0021RL (HD(720p) Camera Module Extension Board) are prepared

P/N Item Description Standard Price(Disty Resale)

R0P7724LC0021RL CPU Board MS7724 main CPU board$734

AC Adapter DC5V/4A

CD-ROM Users Manual

U-boot

Linux BSP

Tool chain

Sample code

USB memory Bootable Linux binaries, Kernel and root file system

R0P7724LE0011RL LCD Panel Board Wide VGA(7inch) LCD with touch panel $522

R0P7724LE0021RL Camera Board HD(1280x720p) CMOS camera board $226


MS7724 - GOOBE Platform

SH7724Development

Board

Linux BSP

Peripheral drivers

Standard MW Product Libraries

Middleware codec‘s• Standard product by Renesas• Royalty is included in the device price• Patent licenses to be paid by the customer/system manufacturer

Linux / Drivers• Free of Charge• Linux Kernel as GPL (no support)• Special drivers supported by Renesas which are not under GPL

i.e. SDHI

Hardware / LSI• Standard MCU/MPU Terms & Conditions

Application SW• Free of Charge• Only sample code (no support)

Application SW

Currently defined MW Library

- MPEG4. H.263, H.264 Video decoder / encoder

- MP3, AAC audio decoder

Licensing of SW

Good Out of Box Experience package Linux Kernel & Device Drivers Defined Package of Middleware Codecs Sample Applications for quick start


MS7724 Linux BSP Features U-Boot Bootloader

Boot device option, NOR flash, USB, eMMC/SD or Network Linux 2.6.33 Kernel port using GCC 4.3.4 Tool Chain SCIF & SIOF Serial device drivers Ethernet device driver USB Host and Function device drivers SIU device driver with ALSA Audio Driver API 2DG device driver with Direct FB 1.3.0 Display (LCD,NTSC,DVI) device driver SD Card device driver eMMC device driver Touch Panel device driver Video for Linux 2 (V4L2) driver

Camera Capture DirectFB API libshcodec(VPU library)

Pre-integrated video codec support for MPEG4 and H.264 encoding and decoding

libshjpu (JPEG library) libshveu (VEU library) Sample code

camera capture, sighttpd (HTTP server)


Software Development Environment

MS7724

Host Linux PC (Dabian)Compile & debug an application program

USB cable

Ethernet

Windows PC or Linux PC• Use Hyper Terminal as Console to operate the board.

Debug for Linux application can be done by software base GDB server.

E-10A may be used for hardware level debug when customer make their own board


Linux Development


MS7724 Software Platform

Open Source Linux Platform “Distribution” is from Renesas In-house tools, kernel, BSP Pre-configured for MS7724

Advantages Renesas maintains the SuperH tree of the Linux kernel Renesas participates in the Linux Kernel Summit Renesas’ Linux approach is well aligned with Linux community development which results in

– Professionally reviewed code– Abstracted, fully portable code– Code integration with standard Linux kernels

Support All platform code is available under GPL (GNU Public License) ‘as-is’ Baseline support is for customers to either have in-house Linux integration capability or willing

to work with 3rd Party Large deals (> 250k units minimum per year) will be reviewed for Renesas-direct support.

Review with Marketing

Middleware Video middleware is proprietary to the Video Processing Unit (VPU) on the SH-Mobile Runtime costs are integral to the device pricing Source code is not made available to customers – it is a user-space binary only Renesas and/or 3rd party will help customers with video integration


Linux Customer Support Scheme

Linux development community upstream master code

①

②④

③SystemIntegrator

embeddedLinux

Distributor

Customerproject

Renesas supports customer’s development partnersRenesas supports customer’s development partners

Renesas Renesas Electronics Electronics

CorpCorp

Renesas Renesas Electronics Electronics

CorpCorp

1. Renesas provides sample BSP + demo. Renesas uploads all code to the upstream Linux community to become openly available

2. Linux Distributor can pull the Open Source code and develop a project for a customer

3. A Linux System Integrator can take the Renesas BSP Package and modify, combine with other components and deliver to a customer

4. A customer with significant Linux integration resources can leverage the community code and complete their project

Free evaluation BSPfor startupFree evaluation BSPfor startup


Demo Description


2D Graphics accelerator Demos

Direct FB( included in BSP) is fully ported with 2D Graphics accelerator DirectFB is a thin library that provides hardware graphics acceleration,

input device handling and abstraction, integrated windowing system with support for translucent windows and multiple display layers, not only on top of the Linux Framebuffer Device. It is a complete hardware abstraction layer with software fallbacks for every graphics operation that is not supported by the underlying hardware. DirectFB adds graphical power to embedded systems and sets a new standard for graphics under Linux.

Included in BSP


HD Video Playback

H.264 HD Video clip playback 720p (1280x720) @ 30 fps CPU usage is less than 5% during the playback

Included in BSP


IP Camera streaming demonstration

Captured image 1280 x 720 Encode with H.264 real-time at 30 fps Stream with HTTP CPU usage is less than 5% during the streaming

Included in BSP


Crank Storyboard Suite

Storyboard is a suite of UI development optimization solutions for developers of consumer electronics, automotive head units, and industrial devices that require an embedded dynamic graphical display.

Crank Storyboard Designer Enables UI designers to leverage their core expertise to easily

prototype the look and feel of a UI, run simulations of the interface to validate the designs, and then move the prototype directly to the embedded device for deployment.

Crank Storyboard Embedded Engine The runtime component of the suite,

Embedded Engine drives the content developed in Designer on embedded devices.


GUI demonstration by Crank Storyboard

Media Player UI Digital Picture Frame, Slide show Climate Control UI Lighting Control UI


Conclusion


Qualifying an Opportunity for SH-Mobile What is the application ? What are the video encoding/decoding requirements ?

Resolution and frame rate Codec standards

What peripherals are required ? What CPU performance is needed ? Is power consumption a criteria ? What is the software operating environment ?

Is Embedded Linux acceptable ? Who will build software for the target ? Who will build the application software ? Are there any software API requirements for multimedia ? What does the customer expect to receive from Renesas ?

Customer experience, quantity and support expectations 250K/y we can provide “hand holding”; <100K/y no support


Summary SH7724 is the focus product, packaged & ready

Start Disti promotion program with SH7724 R3 is in roadmap, though later next year. Low-cost SH4A are also under consideration HD1 is EOL in 2011 (do not promote)

– MT1 is the successor– “Black Box” low power 1080p encode– Single function video Co-processor

MS7724 Dev Kit is available Buy through Disti, with support constraints Demo and Loan can be discussed with Marketing

Solutions with SH7724 are ready Many sample codes and demos are in the DVD 3rd parties can add application specialized software Recognition in Linux Community, with growing Ecosystem

Renesas Electronics America Inc.Renesas Electronics CONFIDENTIAL; NDA Required

Renesas Electronics America Inc. Renesas Electronics CONFIDENTIAL; NDA Required HD video solution...

Documents

Transcript of Renesas Electronics America Inc. Renesas Electronics CONFIDENTIAL; NDA Required HD video solution...