Lec01, Overview, v1.05.ppt -...
Transcript of Lec01, Overview, v1.05.ppt -...
Multimedia Systems
Overview of the Course
Mahdi Amiri
September 2015
Sharif University of Technology
Course Presentation
Page 1 Multimedia Systems, Overview
Course Syllabus
http://ce.sharif.edu/courses/94-95/1/ce342-1/
Website
Page 2 Multimedia Systems, Overview
Course Syllabus
Mahdi Amiri
E-mail 1: m_amiri [-at-] ce.sharif.edu
E-mail 2: yashil1 [-at-] yahoo.com
URL: ce.sharif.edu/~m_amiri
Tel.: (+98 21) 6616 5169-74, ext. 109
Cell Phone: +98 9
Current Address:Sharif University of Technology, No 3, Golestan Alley, Salehi St.,
Akbari Blvd., Azadi Ave., Tehran, Iran.
Instructor, Contact Info.
Page 3 Multimedia Systems, Overview
Course Syllabus
Z-N. Li, M.S. Drew, and J. Liu,
Fundamentals of Multimedia, 2nd
Ed., Springer, Switzerland, 2014.*
* We will mostly use class handouts
and lectures. Therefore, text books
could be used as a reference.
Textbook
https://www.springer.com/gp/book/9783319052892
Simon Fraser University, Vancouver, BC, Canada.
Page 4 Multimedia Systems, Overview
Course Syllabus
P. Havaldar, G. Medioni, Multimedia Systems:
Algorithms, Standards, and Industry Practices,
Cengage Learning, 2010.
R. Steinmetz and K. Nahrstedt, Multimedia
Fundamentals: Media Coding and Content
Processing, Prentice Hall, 2002.
K. R. Rao, Z. S. Bojkovic and D. A. Milanovic,
Multimedia Communication Systems, Prentice Hall,
2002.
Other Reference Books
… and Wikipedia
http://books.google.com/books/about/Multimedia_Systems.html?id=k83m5inkjXwC
Page 5 Multimedia Systems, Overview
Course Syllabus
Quiz: Saturday, Lowest quiz will be dropped.
HW: Monday, Due: 2 Weeks, Req. MATLAB or Octave.
Grading Policy
Page 6 Multimedia Systems, Overview
Course Syllabus
Examples:
Traffic control using mobile phones,
Multimedia systems in schools,
Human computer interfacing,
Video chat over LAN network,
Intelligent transportation systems,
Web application development tools (Horde, …),
Telemedicine, TeleCollaboration, etc.
* We will review the examples in a session.
Report structure
Literature survey.
Pros. and Cons. of the existing methods.
Definition of new proposals.
Critical Reading
Page 7 Multimedia Systems, Overview
Course Syllabus
TA(s) and session time
See the course website.
Integral component of the course
Tools:
MATLAB
GNU Octave
Problem Solving Classes
www.gnu.org/software/octave/
www.mathworks.com/products/matlab/
Page 8 Multimedia Systems, Overview
Course Outline
What is Multimedia?
Components of Multimedia
Multimedia Research Topics and Projects
Processing: e.g. content-based retrievalGeneration, Representation, Storage, Search and retrieval.
Networking: e.g. QoSTransmission, Delivery.
End-Systems: e.g. User Interfaces
Interaction: e.g. “ubiquity“ devices
Introduction to Multimedia
Page 9 Multimedia Systems, Overview
Course Outline
What is “signal”!?
Discrete-time signals and systems
Sampling theorem
Quantization (Scalar Q., Vector Q.)
Transform domain analysis
FFT, STFT, Wavelet
Review of Signals and Systems
Page 10 Multimedia Systems, Overview
Course Outline
Audio representations
Formats and standards
Frequency Masking vs. Temporal Masking
Speech processing
Synthesis, recognition, …
Audio Compression
DPCM, ADPCM, LPC, CELP
Audio
Page 11 Multimedia Systems, Overview
Course Outline
Data storage
Data redundancyLossy and lossless compression
Entropy encoder
Predictive coding
Huffman Coding
Lempel-Ziv-Welch
Arithmatic Coding
Entropy Coding
Page 12 Multimedia Systems, Overview
Course Outline
Physics of Color
Human Eye
Additive and subtractive color mixing
Color space Models
YUV, RGB, HSV, …
Gamma correction
Image, Color Space
Page 13 Multimedia Systems, Overview
Course Outline
Color Depth
Palette, Halftone
Image Resolution
Histogram, Contrast
High-Dynamic-Range (HDR)
Bracketing
Image, Acquisition and Representation
Page 14 Multimedia Systems, Overview
Course Outline
Image Noise
Gaussian Smoothing
Mean and Median Filter
Sharpening
Edge Detection
Despeckle
Image, Enhancement
Page 15 Multimedia Systems, Overview
Course Outline
JPEG
Encoder Diagram
Decoder Diagram
Color Space Transformation
Subsampling in color space
Discrete Cosine Transform (DCT)
Quantization Matrix
Compression Ratio
Blocking Artifact
Image, Compression
Page 16 Multimedia Systems, Overview
Course Outline
Video Display
Progressive, Interlaced
Analog Broadcast TV Systems
NTSC, PAL
Analog Color Video
Composite video, S-Video, Component video
Digital Video (HDTV)
DVI, HDMI, DisplayPort
Video, Analog and Digital Video
Page 17 Multimedia Systems, Overview
Course Outline
Interframe and intraframe coding
Motion Estimation and Motion Compensation
(MEMC)
Picture Types
I-frames, B-frames, P-frames
Video Codecs
MPEG-1, MPEG-2, MPEG-4
, h.261, h.263
, h.264, h.265 (HEVC), …
Video Coding
Page 18 Multimedia Systems, Overview
Course Outline
Standalone vs. Networked
Live vs. Orchestrated
Multimedia system building blocks
Real-time multimedia system
architecture
Multimedia (Networking) Systems
Page 19 Multimedia Systems, Overview
Course Outline
Quality of Service (QoS)
Error concealment
Prioritized Encoding
Overlay networks
Packet-loss, Congestion
Unicasting and Multicasting
Streaming protocols
Multimedia Networking
Page 20 Multimedia Systems, Overview
Course Outline
DVB
Interactive TV, Internet-TV, IPTV
E-Learning
Human Computer Interface
Multimedia Home Platform (MHP)
Multimedia Information Retrieval System
3D Technologies
Multimedia Applications
Page 21 Multimedia Systems, Overview
Thank You
1. http://ce.sharif.edu/~m_amiri/
2. http://www.aictc.ir/
FIND OUT MORE AT...
Multimedia Systems
Overview of the Course
Next Session: Introduction to Multimedia Systems