• Author / Uploaded
• Indyman Sun

Citation preview

HEVC, The Next Big Thing? Cyrille Berson, Director of Product Management June 2013

Agenda • What is HEVC? • HEVC comparison with AVC • Benefits and challenges of HEVC  1080i content with HEVC  What is the optimal architecture ?

• HEVC new market opportunities  Extending HD video delivery

• Market timeline • Envivio’s approach • VOD demo: 1080p30 at 3.0Mbps 2

HEVC | What is it? • High Efficiency Video Codec, aka H.265 • Jointly developed by ISO/IEC MPEG and ITU-T VCEG group (JCT-VC) • Primary goal: 50% better compression than H.264 x2 • Resolutions up to 8,192 x 4320 (8K) • 2013, January: ITU-T H.265, ISO/IEC 23008-2 • Royalties pending x2 • Next

H.265/HEVC (DVD Video, Blu-ray, Digital Video Broadcasting, SVCD)

H.264/MPEG-4 Part 10 (DVD Video, Blu-ray, Digital Video Broadcasting, SVCD)

 Scalable HEVC  HEVC-3D

H.263 (Visio-conf)

MPEG-4 Part 2 (Video on Internet )

H.262/MPEG-2 Part 2 (DVD Video, Blu-ray, Digital Video Broadcasting, SVCD) H.261 (Visio-conf)

1990

MPEG-1 Part 2 (Video-CD)

1993

1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013

3

HEVC comparison with AVC • Classical hybrid video coding scheme • Some features from H.264/MPEG-4 AVC • • • • • •

High level syntax Multiple references Flexible GOP structure Weighted prediction Quantization Binary arithmetic coding engine

• Many new features

HEVC comparison with AVC Functionality

H.264/MPEG-4 AVC

HEVC

Block partitioning

Square, symmetric

Square, symmetric, asymmetric

• CU is either inter or intra • CU divided into PU • •

Predefined set of partitions Square only in intra

HEVC comparison with AVC Functionality

H.264/MPEG-4 AVC

HEVC

Intra prediction

9 modes

35 modes

Intra mode prediction

1 MPM

3 MPMs 18

19

20

21

22

23

24

25

26

27

28

29

30

31

17 16 15 14 13 12 11 10 9 8

0 : Intra_Planar 1 : Intra_DC

32

33

34

7 6 5 4 3 2

HEVC comparison with AVC HEVC

AVC

Intra prediction

33 modes Prediction depending on PU size

8 modes

Motion prediction

Based on multiple candidate vectors Motion merge mode Improved skip mode

Based on 1 vector

Inter prediction

Blocks up to 64x64 Based on DCT interpolation (DCT-IF)

Blocks up to 16x16 Bilinear interpolation

Transform and quantization

TU from 4x4 to 32x32 Better integer transform Quantization at CU level depending on CU size

4x4 and 8x8

Entropy coding

CABAC only

CABAC + CAVLC

Loop filters

Deblocking filter Adaptive loop filter Sample adaptive offset

Deblocking filter

Interlaced modes

Progressive tools only

Interlaced and progressive tools 7

HEVC | Technical Challenges • No interlaced support as in AVC • HEVC increases encoding complexity  Requires more horsepower (2 to 3 times more)  No encoding chipsets available, SW is the only solution

• Players  Hardware: STB chipsets in development  not mature yet  Software: Decoders developed for PC, tablets and smartphones − 720p30 decoding on tablets

8

HEVC | Process 1080i content with HEVC? • HEVC designed for progressive material encoding •

All targeted displays are progressive

• •

Legacy SD contents 15 years of 1080i contents (still counting)

• •

Picture Adaptive Frame Field (PAFF) Macroblock Adaptive Frame Field (MBAFF)

• Broadcast world still massively using interlaced video content • H.264/MPEG-4 AVC

• Concerns about efficiency of HEVC on interlaced material? • Syntax is available •

Field or Frame coding signaling possible through VUI/SEI − Signaling constrained to Coded Video Sequence (CVS) − Adaptive Frame/Field switching possible on IDR only using SEI − SEI message not mandatory for decoder conformance

HEVC | Interlacing in HEVC Frame only coding HEVC Frame Coding

Interlaced source

Interlaced encoded frame

Field only coding Separate fields

Interlace

HEVC Field Coding Fields

Encoded fields

Interlaced source

Interlaced encoded frame

Sequence adaptive field frame coding (SAFF) Separate fields

Interlace HEVC Field Coding

GOP Decision Field/Frame?

Fields

Interlaced source

Encoded fields

HEVC Frame Coding

Interlaced frame

Interlaced encoded frame

Encoded interlaced frame

HEVC | Interlacing in HEVC - Reference: AVC with PAFF+MBAFF - Sequences set: interlaced

HEVC frame

HEVC field

HEVC SAFF

~Bit rate savings* (YUV)

-3%

-29%

-33%

- Reference: AVC - Sequences set: progressive ~Bit rate savings* (YUV)

HEVC frame

- Reference: AVC with PAFF+MBAFF - Sequences set: interlaced

HEVC field

-34%

~Bit rate savings* (YUV)

-29%

*sources: JCTVC-K0250, JCTVC-K0331

HEVC | Interlacing in HEVC • HEVC is handling efficiently interlaced video contents • •

Field coding is satisfactory Additional gain is possible with SAFF, provided − A good frame field switching decision at the encoder − A decoder compliant with SAFF SEI message

• Creation of the Interlace AhG • •

103th MPEG meeting, January 2013 No evidence showing additional interlace coding tools are needed

HEVC | Encoding Architecture • Requirements • •

Implement existing and new codec Consider pre-processing depending on use cases − field splitting, de-interlacing, inverse telecine − Multiple resolutions (Mobile)

• And also appropriate inputs and outputs

SPTS over IP

ASI SDI

A/V Extract

Video Analysis

RTP,… Processing

Codecs

Wrap

DASH, HLS, HDS, HSS… OTT Files

Files

RC Targets

Complexities

VBV info

StatMux Allocator

Multiplexer

MPTS

HEVC | Encoding Architecture • Software solution • Easy reconfiguration • • •

1 to N (Mobile) 1 to 1 (4k HEVC) N to N (Broadcast)

•

Abstraction to platform (OS)

•

Benefits from HEVC encoding technology performance progression

SW

OS

• Easy hardware upgrade

• Easy software upgrade

… HW …

HEVC | Extending HD video delivery •

New broadcast networks •

Terrestrial (DVB-T2) − 40 Mbps

• •

•

• •

Satellite (DVB-S2) 30 to 60 % bandwidth increase

Current demand •

Extension of HDTV channels

New demand • • •

4K/UHD announced TV displays starting to be available 4K/UHD contents already produced for a few years (TV series)

HEVC particularly efficient on very high resolutions. •

SD

51 to 74% reported subjective gains

HD

4K

HEVC | Extending HD video delivery • Telecom access network (telco) •

100Mbps for 4G (from 3Mbps for 3G)

•

Unicast video delivery

• Demand

− Bandwidth divided by users number

•

New generation of mobile terminals − Smartphone and tablets − Supporting HDTV or even higher resolution

• •

Expected growth for mobile video in the coming years: 75% Telcos are already under pressure

• HEVC allows encoding 720p for small screens at 1 Mbps

HEVC | Consumer Market Potential

17

HEVC | Target Client Devices • First targets  PCs, tablets and  Yearly updates  Software decoders  Decoding chipsets will be ready in 2013

• HEVC decoding in consumer devices

Installed base in millions

smartphones

5000

4500

4000

3500

Smartphones

3000

Tablets 2500

Set Top boxes 2000

Digital TV sets 1500

1000

500

0

2011

2012

2013

2014

2015

2016

Devices HEVC decode capable (Source MRG)

18

HEVC | Market Timeline First HEVC deployments for OTT (VOD then Live) HEVC standard validation

HEVC encoding HD 1080p

H1 2013

First HEVC Decoders (1080p)

H2 2013

HEVC Lab trials

HEVC encoding 4K VOD

H1 2014

H2 2014

FIFA World cup 4K broadcast (Japan)

HEVC encoding 4K Live

H1 2015

H2 2015

First commercial services in 4K

19

HEVC | Benefits • Telcos  Same quality at lower bitrate  Increase IPTV eligibility  HD over 4G networks − Bring HD to nomad viewers

• OTT  cut CDN costs in half • Cable/DTT/DTH  Launch 4K services  Higher resolutions within the same bandwidth

20

Envivio’s Advantages • 4Caster G4 is built to support HEVC  Future proof platform

• Early Time To Market  Own software codec, designed from ground up  Unlike HW vendor, not dependent on 3rd party encoding chipsets

• HEVC is just a software update  Add HEVC support to Envivio installed base

• HEVC work will help enhance H.264 and MPEG-2 performance 21

HEVC | Envivio Split-Screen Demo • HEVC vs. AVC •

Use case: same objective video quality • Source video content: 1080P@30 fps • Encodings: HEVC @ 3Mbps & AVC @ 6Mbps • HEVC stream generated with the HM (offline encoding)

YUV source

HEVC encoding

HEVC decoding

AVC encoding

AVC decoding

YUV

HEVC & AVC Side by side 22

Thank You