Presentation Transcript
IPTV : Etat de l’art et perspectives : IPTV : Etat de l’art et perspectives CGTeC
Commission Générale « Télécommunications et communications électroniques » Normalisation
Travaux de l’ISO/IEC JTC 1/SC 29
Daniel LECOMTE
Chronology of International Video Coding Standards: 1990 1996 2002 1992 1994 1998 2000 H.263 (1995-2000+) MPEG-4 Visual (1998-2001+) MPEG-1 (1993) ISO/IEC ITU-T H.120 (1984-1988) H.261 (1990+) H.262 / MPEG-2 (1994/95-1998+) H.264 / MPEG-4 AVC (2003-20…) Chronology of International Video Coding Standards 2004 JPEG 2000
Slide3: The Scope of Picture and Video Coding Standardization Only the Syntax and Decoder are standardized:
Permits optimization beyond the obvious
Permits complexity reduction for implementability
Provides no guarantees of Quality Pre-Processing Encoding Source Destination Post-Processing
& Error Recovery Decoding Scope of Standard
MPEG Video Coding Standards: MPEG Video Coding Standards MPEG is the most well-known established organization for general-purpose video coding standardization world-wide.
MPEG = “Moving Picture Experts Group” (ISO/IEC JTC 1/SC 29/WG 11 = International Standardization Organization and International Electrotechnical Commission, Joint Technical Committee Number 1, Subcommittee 29, Working Group 11)
MPEG video coding standards are closely related, organizationally and technically, with standards produced by VCEG
VCEG = “Video Coding Experts Group” (ITU-T SG16/Q6 = International Telecommunications Union – Telecommunications Standardization Sector (ITU-T, a United Nations Organization, formerly CCITT), Study Group 16, Question 6)
Recently, SMPTE (Society for Motion Picture and Television Engineers) has also standardized “VC-1”, based on Microsoft’s WMV 9.
A Basic Building Block of Video Coding: Interframe Motion Prediction: A Basic Building Block of Video Coding: Interframe Motion Prediction Large areas of images stay the same from frame to frame, changing mostly due to motion
Conditional Replenishment: Can signal to leave a block area of the image unchanged, or replace it with new data
Interframe Difference Coding: Could encode a refinement to the value of an area
Displaced Frame Difference Coding: Can predict an image area by copying some nearby part of the previous image (motion compensation) and optionally adding some refinement
P-Picture Predictive Coding: P-Picture Predictive Coding
MPEG-1: The first video coding standard for entertainment-quality applications: MPEG-1: The first video coding standard for entertainment-quality applications Formally ISO/IEC 11172-2 (‘93), developed by ISO/IEC JTC1 SC29 WG11 (MPEG) – use is fairly widespread (esp. Video CD in Asia), but mostly overtaken by MPEG-2
Can provide approximately VHS quality between 1-2 Mbps using SIF 352x240/288 resolution
Technical features inherited from ITU-T’s H.261 predecessor
16x16 macroblocks
16x16 motion compensation,
8x8 DCT,
scalar quantization,
zig-zag scan, and
run-length
variable-length coding
Technical features added:
Bi-directional motion prediction
Half-pixel motion
Slice-structured coding
DC-only “D” pictures
Quantization weighting matrices
MPEG-2 : The Standard for DVD and Digital TV: MPEG-2 : The Standard for DVD and Digital TV Formally ISO/IEC 13818-2 & ITU-T H.262, developed (‘94) jointly by ITU-T and ISO/IEC SC29 WG11 (MPEG) – Now in very wide use for DVD and standard and high-definition DTV (the most commonly used video coding standard)
Primary new technical features:
Support for interlaced-scan pictures
Increased DC quantization precision
Also
Various forms of scalability (SNR, Spatial, breakpoint)
I-picture concealment motion vectors
Essentially the same as MPEG-1 for progressive-scan pictures, and MPEG-1 forward compatibility required
Range of use :
normally 2-5 Mbps SDTV broadcast, 6-8 DVD, 20 HDTV
Not especially useful below 2-3 Mbps
Essentially fixed frame rate
Predictive Coding with B Pictures: Predictive Coding with B Pictures
Slide10: The Advanced Video Coding Project
AVC = ITU-T H.264 / MPEG-4 part 10 History: ITU-T Q.6/SG16 (VCEG - Video Coding Experts Group) “H.26L” standardization activity (where the “L” stood for “long-term”)
Aug 1999: 1st test model (TML-1)
July 2001: MPEG open call for technology: H.26L
Dec 2001: Formation of the Joint Video Team (JVT) between VCEG and MPEG to finalize H.26L as a new joint project (similar to MPEG-2/H.262)
July 2002: Final Committee Draft status in MPEG
Dec ‘02 technical freeze, FCD ballot approved
May ’03 completed in both organisations
July ’04 Fidelity Range Extensions (FRExt) completed
MPEG-4 “Visual”: Baseline H.263 and Many Creative Extras: MPEG-4 “Visual”: Baseline H.263 and Many Creative Extras MPEG-4 part 2 (v1: early 1999), formally ISO/IEC 14496-2
Contains the baseline design from ITU-T H.263 (which improved upon MPEG-1 for motion prediction and entropy coding)
Adds some coding efficiency enhancements (esp. at low rates)
Adds many creative new extras:
error resilience / packet loss enhancements
segmented coding of shapes
zero-tree wavelet coding of still textures
coding of synthetic and semi-synthetic content,
10 & 12-bit sampling,
more
v2 (early 2000) & v3 (early 2001) & …
MPEG-4 AVC Video : MPEG-4 AVC Video Enhance of Video Coding
Standardized in 2004, MPEG-4 – AVC will offer by 2007/2008 (with dedicated electronic components):
High Definition at 1080i for 6 Mbps
High Definition at 720p for 4 Mbps
Standard Definition at 1,7 Mbps
VGA Definition at 0,3 Mbps
[This is for Video Only; audio has to be added]
MPEG-4 AVC Audio: MPEG-4 AVC Audio Enhance of Audio Coding
The MPEG-4 AVC Audio proposes an enhancement and a set of AAC codec family.
Stereo sound at 64 kbps (instead of 128 kbps)
« Surround » sound (5.1) at 128 kbps (instead of 256 kps)
However, AAC codecs are not compatible with existing libraries.
Slide14: Comparison to MPEG-2, H.263, MPEG-4 (Video only) 27 28 29 30 31 32 33 34 35 36 37 38 39 0 50 100 150 200 250 Bit-rate [kbit/s] Foreman QCIF 10Hz Quality
Y-PSNR [dB] MPEG-2 H.263 (+) MPEG-4 Visual ASP MPEG-4 AVC/H.264
MPEG-4 File Format: MPEG-4 File Format ISO Base Media File Format (14496 - 12) ISO Base Media File Format (14496 - 12) Motion JPEG2000 File Format (15444 - 3) (.mj2) Motion JPEG2000 File Format (15444 - 3) (.mj2) MPEG - 4 File Format (14496 - 14) MPEG - 4 File Format (14496 - 14) AVC File Format (14496 - 15) AVC File Format (14496 - 15) *.mp4 files Apple’s QuickTime (QT) File Format (*. mov ) Apple’s QuickTime (QT) File Format (*. mov ) ISO File Format is based on QT architecture. Original Design 3GPP & 3GPP2 File Format (.3gp & .3g2) 3GPP & 3GPP2 File Format (.3gp & .3g2) MPEG - 21 File Format (21000 - 9) MPEG - 21 File Format (21000 - 9) ISO Base Media File Format (14496 - 12) ISO Base Media File Format (14496 - 12) Motion JPEG2000 File Format (15444 - 3) (.mj2) Motion JPEG2000 File Format (15444 - 3) (.mj2) MPEG - 4 File Format (14496 - 14) MPEG - 4 File Format (14496 - 14) AVC File Format (14496 - 15) AVC File Format (14496 - 15) *.mp4 files Apple’s QuickTime (QT) File Format (*. mov ) Apple’s QuickTime (QT) File Format (*. mov ) ISO File Format is based on QT architecture. Original Design 3GPP & 3GPP2 File Format (.3gp & .3g2) 3GPP & 3GPP2 File Format (.3gp & .3g2) MPEG - 21 File Format (21000 - 9) MPEG - 21 File Format (21000 - 9)
What will be the future for Video Coding ?: What will be the future for Video Coding ? MPEG-4 SVC
Scalable Video Coding
MPEG-4 LASeR
Light Application Scene Representation
The Standard for Rich Media Services
MPEG Application Formats (MAF) Developed in Systems
Musical Slide Show, Portable Video Player and DMB MAF
M3W : MPEG Multimedia Middleware Anticipation of future needs
SVC : New Scalable Video Coding Profiles Part of MPEG-4 AVC : Scalable Baseline Baseline High Scalable High Scalable High Intra Spatial scalability (dyadic, 3/2) Coarse-grain scalability Spatial scalability (arbitrary up to 2) Coarse-grain scalability SVC : New Scalable Video Coding Profiles Part of MPEG-4 AVC - Standard TV set : VGA Quality
- Flat Screen : WXGA Quality For one video program to be broadcasted
LASeR : The Standard for Rich Media Services: LASeR : The Standard for Rich Media Services Objectives:
Standard format for Interactive RichMedia services
Standardized as MPEG-4 Part 20
LASeR : Lightweight Application Scene Representation
SAF : Simple Aggregation Format
Roadmap
Final technical V1 spec. October 2005
Final technical V2 spec. April 2007
Promotion in OMA, 3GPP, DVB, 3GPP2, FLO, DMB, …
Expert on building IP Strategy: Expert on building IP Strategy TypicMedia
157 rue de la Pompe
75116 Paris
France
Tel : +33 1 56 26 55 28
Fax : +33 1 56 26 55 29
www.typicmedia.com
info@typicmedia.com Daniel LECOMTE