Post on 26-Jul-2015
Embedded Android Real-Time Streaming Optimization
Background
Android Multimedia Framework Optimization
Real-Time Streaming & Playback Optimization
Usage Scenarios
Courtroom Surveillance System
Courtroom
Background
Android Multimedia Framework Optimization
Multimedia vs Streaming Media
AwesomePlayer Framework
NuPlayer Framework
Streaming Media Challenges
Multimedia vs Streaming Media
Multimedia is the integration of multiple forms of media. This includes text, graphics, audio, video
Streaming media is video or audio content sent in compressed form over the Internet and played immediately, rather than being saved to the hard drive.
DemuxerSource
Video Decoder
Audio Decoder
Video Output
Audio Output
Decoder Output
Multimedia Decoding Process
Android Multimedia Framework
awesomeplayer
OMXCODEC
EMPTY_BUFFER_DONE
drainInputBuffer
FILL_BUFFER_DONE
fillOutputBuffer
OMX.Video.Decoder
read
OMX_EmptyThisBuffer OMX_FillThisBuffer
AwesomePlayer Framework
A
B
Message
1. post message1
2. call B.fun1() 3. post reply
4. call A.func2()
Acodec::onOMXEmptyBufferDone
OMX_EmptyThisBuffer
Message
1. post ACodec::kWhatFillThisBuffer
Nuplayer::feedDecoderInputData
2. call 3. post rely kWhatInputBufferFilled
Acodec::onInputBufferFilled
4. call
5. call
NuPlayer Framework
Only supports RTSP and HTTP (No RTP/UDP support） Processing Time (Start to Initial Playback) Immediacy Instantaneity Clock drift Fault tolerance Poor Performance (multi-channel surveillance preview) Android Multimedia Player only supports preview/play
(snapshot, record, reply not supported)
Real-Time Streaming & Playback Challenges
Storage Introduction
Processing Time
Streaming Framework
Fault tolerance
Clock Drift
Immediacy
High Performance
Background
Android Multimedia Framework Optimization
Real-Time Streaming & Playback Optimization
RTSP Data SourceRTSP Media
Extrator
RTSP Storage
OMXCodec Output
Awesomeplayer
Streaming Framework
Record
Snapshot
SnapMovie (Real-time monitoring, playback)
Storage Introduction
Revised OMXCodec operating mode, quick creation of media player clock
Improve RTSP connection procedure
Processing Time
High speed! It's simple to understand. It is how fast a request can be processed!
Immediacy
Enhance errors at the receiving end of data, decoder, display side of the fault-tolerant processing
Fault Tolerance
NTP server
Streaming - Sound Synchronization
Clock Drift
Streaming - No Sound Synchronization
Cloud Server
PC LED Clock Router
Exchange
Data Server
GPS Antenna
GPS Satellite
Clock Server
High performance RTSP media Completely disable Stagefright
4 frame 720p preview + 8 frame 1080p storage
High Performance I
8 frame 360p preview + 8 frame 1080p storage
7 frame 270p preview + 1 frame 1080p preview
+ 8 frame 1080p storage
High Performance II
Background
Android Multimedia Framework Optimization
Real-Time Streaming & Playback Optimization
Usage Scenarios
Usage Scenarios
VIA
Strong hardware
capabilities
Powerful
software
development
Customization
Ability to meet customers
detailed requests
Conclusion
© 2014 VIA Technologies, Inc All Rights Reserved. • VIA reserves the right to make changes in its products without notice in order to improve design or performance characteristics. • This publication neither states nor implies any representations or warranties of any kind, including but not limited to any implied warranty of merchantability or fitness for a particular
purpose. No license, express or implied, to any intellectual property rights is granted by this document. • VIA makes no representations or warranties with respect to the accuracy or completeness of the contents of this publication or the information contained herein, and reserves the right
to make changes at any time, without notice. VIA disclaims responsibility for any consequences resulting from the use of the information included herein. • VIA C7®, VIA C7®-D, VIA C7®-M, and VIA Eden® are trademarks of VIA Technologies, Inc.