Digital Video and HDTV

Algorithms and Interfaces

by Charles Poynton,
(San Francisco: Morgan Kaufmann Publishers, 2003)
[hardcover, 736 pages, USD 59.94].
to be available from the publisher on or about December 2, 2002

Contents

Foreword by Jim Blinn

Foreword by Mark Schubin

List of figures

List of tables

Preface

Acknowledgements

Part 1 - Introduction

1 - Raster images

• Imaging
• Aspect ratio
• Digitization
• Pixel array
• Visual acuity
• Viewing distance and angle
• Spatiotemporal domains
• Lightness terminology
• Nonlinear image coding
• Linear and nonlinear
• Luma and color difference components
• SDTV/HDTV

2 - Quantization

• Decibels
• Noise, signal, sensitivity
• Quantization error
• Linearity
• Perceptual uniformity
• Headroom and footroom

3 - Brightness and contrast controls

• Brightness and contrast controls in desktop graphics

4 - Raster images in computing

• Symbolic image description
• Raster images
• Conversion among types
• Display modes
• Image files
"Resolution" in computer graphics

5 - Image structure

• Image reconstruction
• Sampling aperture
• Spot profile
• Box distribution
• Gaussian distribution

6 - Raster scanning

• Flicker, refresh rate, and frame rate
• Introduction to scanning
• Scanning parameters
• Interlaced scanning
• Twitter
• Interlace in analog systems
• Interlace and progressive
• Scanning notation
• Interlace artifacts
• Motion portrayal
• Segmented frame (24PsF)
• Video system taxonomy
• Conversion among systems

7 - Resolution

• Magnitude frequency response and bandwidth
• Kell effect
• Resolution
• Resolution in video
• Viewing distance
• Interlace revisited

8 - Constant luminance

• The principle of constant luminance
• Compensating the CRT
• Departure from constant luminance
• "Leakage" of luminance into chroma

9 - Rendering intent

• Surround effect
• Tone scale alteration
• Incorporation of rendering intent
• Rendering intent in desktop computing

10 - Introduction to luma and chroma

• Luma
• Sloppy use of the term luminance
• Color difference coding (chroma)
• Chroma subsampling
• Chroma subsampling notation
• Chroma subsampling filters
• Chroma in composite NTSC and PAL

11 - Introduction to component SDTV

• Scanning standards
• Widescreen (16:9) SDTV
• Progressive SDTV (480p/483p)
• Square and nonsquare sampling
• Resampling

12 - Introduction to composite NTSC and PAL

• NTSC and PAL encoding
• NTSC and PAL decoding
• S-video interface
• Frequency interleaving
• Composite digital SDTV (4f_SC)
• Composite analog SDTV

13 - Introduction to HDTV

• Comparison of aspect ratios
• HDTV scanning
• The 1035i (1125/60) system
• Color coding for Rec. 709 HDTV

14 - Introduction to video compression

• Data compression
• Image compression
• Lossy compression
• JPEG
• Motion-JPEG
• MPEG
• Picture coding types (I, P, B)
• Reordering
• MPEG-1
• MPEG-2

15 - Digital video interfaces

• Component digital SDTV interface (Rec. 601, "4:2:2")
• Composite digital SDTV (4f_SC) interface
• Serial digital interface (SDI)
• Component digital HDTV HD-SDI
• Interfaces for compressed video
• SDTI
• DVB ASI and SMPTE SSI
• IEEE 1394 (FireWire, i.LINK)
• Switching and mixing
• Timing in analog facilities
• Timing in composite analog NTSC and PAL
• Timing in digital facilities

Part 2 - Principles

16 - Filtering and sampling

• Sampling theorem
• Sampling at exactly 0.5f_S
• Magnitude frequency response
• Magnitude frequency response of a boxcar
• The sinc weighting function
• Frequency response of point sampling
• Fourier transform pairs
• Analog filters
• Digital filters
• Impulse response
• Finite impulse response (FIR) filters
• Physical realizability of a filter
• Phase response (group delay)
• Infinite impulse response (IIR) filters
• Lowpass filter
• Digital filter design
• Reconstruction
• Reconstruction close to 0.5f_S
• (sin x)/x correction
• Further reading

17 - Resampling, interpolation, and decimation

• 2:1 downsampling
• Oversampling
• Interpolation
• Lagrange interpolation
• Lagrange interpolation as filtering
• Polyphase interpolators
• Polyphase taps and phases
• Implementing polyphase interpolators
• Decimation
• Lowpass filtering in decimation

18 - Image digitization and reconstruction

• Spatial frequency domain
• Comb filtering
• Spatial filtering
• Image presampling filters
• Image reconstruction filters
• Spatial (2-D) oversampling

19 - Perception and visual acuity

• Retina
• Adaptation
• Contrast ratio
• Contrast sensitivity
• Contrast sensitivity function (CSF)

20 - Luminance and lightness

• Radiance, intensity
• Luminance
• Relative luminance
• Luminance from red, green, and blue
• Lightness (CIE L*)

21 - The CIE system of colorimetry

• Fundamentals of vision
• Definitions
• Spectral power distribution (SPD) and tristimulus
• Scanner spectral constraints
• CIE XYZ tristimulus
• CIE [x, y] chromaticity
• Blackbody radiation
• Color temperature
• White
• Perceptually uniform color spaces
• CIE L*u*v*
• CIE L*a*b*
• CIE L*u*v* and CIE L*a*b* summary
• Color specification
• Color image coding
• Further reading

22 - Color science for video

• Additive reproduction (RGB)
• Characterization of RGB primaries
• CIE RGB primaries
• NTSC primaries (obsolete)
• EBU Tech. 3213 primaries
• SMPTE RP 145 primaries
• Rec. 709/sRGB primaries
• CMFs and SPDs
• Luminance coefficients
• Transformations between RGB and CIE XYZ
• Noise due to matrixing
• Transforms among RGB systems
• Camera white reference
• Monitor white reference
• Gamut
• Wide-gamut reproduction
• Further reading

23 - Gamma

• Gamma in CRT physics
• The amazing coincidence !
• Gamma in video
• Optoelectronic transfer functions (OETFs)
• Rec. 709 transfer function
• SMPTE 240M transfer function
• Rec. 1361 transfer function
• sRGB transfer function
• Transfer functions in SDTV
• Bit depth requirements
• Gamma in emerging display devices
• CRT transfer function details
• Gamma in video, CGI, SGI, and Macintosh
• Gamma in computer graphics
• Gamma in pseudocolor
• Limitations of 8-bit linear coding
• Linear and nonlinear coding in CGI

24 - Luma and color differences

• Color acuity
• RGB and R'G'B' color cubes
• Conventional luma/color difference coding
• Luminance and luma notation
• Nonlinear red, green, blue (R'G'B')
• Rec. 601 luma
• Rec. 709 luma
• SMPTE 240M-1988 luma
• Chroma subsampling, revisited
• Luma/color difference summary
• SDTV and HDTV luma chaos
• Luma/color difference component sets

25 - Component video color coding for SDTV

• B'-Y', R'-Y' components for SDTV
• P_BP_R components for SDTV
• C_BC_R components for SDTV
• Y'C_BC_R from studio RGB
• Y'C_BC_R from computer RGB
• "Full-range" Y'C_BC_R
• Y'UV, Y'IQ confusion

26 - Component video color coding for HDTV

• B'-Y', R'-Y' components for Rec. 709 HDTV
• P_BP_R components for Rec. 709 HDTV
• components for Rec. 709 HDTV
• C_BC_R components for Rec. 1361 HDTV
• Y'C_BC_R from studio RGB
• Y'C_BC_R from computer RGB
• Conversions between HDTV and SDTV
• SMPTE 240M-1988 luma
• Color coding standards

27 - Video signal processing

• Transition samples
• Edge treatment
• Picture lines
• Choice of S_AL and S_PW parameters
• Video levels
• Setup (pedestal)
• Rec. 601 to computing
• Enhancement
• Median filtering
• Coring
• Chroma transition improvement (CTI)
• Scan-velocity modulation (SVM)
• Mixing and keying

28 - NTSC and PAL chroma modulation

• UV components
• NTSC chroma modulation
• NTSC chroma demodulation
• PAL chroma modulation
• Subcarrier regeneration
• S-video interface
• Decoder controls

29 - NTSC and PAL frequency interleaving

• Notch filtering
• Frequency interleaving in NTSC
• Cross-luma and cross-color
• Frequency interleaving in PAL
• Spatial frequency spectra of NTSC
• Spatial frequency spectra of PAL
• One-dimensional frequency spectrum of NTSC
• One-dimensional frequency spectrum of PAL

30 - NTSC Y'IQ system

• Narrowband Q
• IQ components
• Y'IQ encoding

31 - Frame, field, line, and sample rates

• Field rate
• Line rate
• Sound subcarrier
• Addition of composite color
• NTSC color subcarrier
• 576i PAL color subcarrier
• 4f_SC sampling
• Common sampling rate
• Numerology of HDTV scanning
• Audio rates

32 - Timecode

• Introduction
• Dropframe timecode
• Editing
• Linear timecode (LTC)
• Vertical interval timecode (VITC)
• Timecode structure
• Further reading

33 - Digital sync, TRS, ancillary data, and interface

• TRS in 4:2:2 component SDTV
• TRS in HD-SDI
• TRS-ID in 4f_SC composite video
• Digital to analog timing relationships
• Ancillary data
• SDI coding
• HD-SDI coding
• Summary

34 - Analog SDTV sync, genlock, and interface

• Analog sync
• Odd/even, first/second, top/bottom
• Sync distribution
• Genlock
• Analog horizontal blanking interval
• Sync separation
• Component analog levels
• Composite analog levels
• Analog electrical interface
• Analog mechanical interface
• S-video electrical and mechanical interface

35 - Videotape recording

• Playback in shuttle
• Recording
• Playback
• Editing
• Digital VTRs
• Timebase error
• Channel coding
• Analog VTR signal processing
• Analog videotape formats
• Digital VTR signal processing
• Digital videotape formats
• DV family
• DV recording
• Studio adaptation of DV technology
• HDTV videotape formats
• Consumer bitstream recording - DV ATV, DV DVB
• Further reading

36 - 2-3 pulldown

• Conversion of film to different frame rates
• Native 24 Hz coding
• Conversion to other rates

37 - Deinterlacing

• Spatial domain
• Vertical-temporal domain
• Motion adaptivity

Part 3 - Video compression

38 - JPEG and motion-JPEG (M-JPEG) compression

• JPEG blocks and MCUs
• JPEG block diagram
• Level-shifting
• Discrete cosine transform (DCT)
• JPEG encoding example
• JPEG decoding
• Compression ratio control
• JPEG/JFIF
• Motion-JPEG (M-JPEG)
• Further reading

39 - DV compression

• DV chroma subsampling
• DV frame/field modes
• Picture-in-shuttle in DV
• DV overflow scheme
• DV quantization
• Consumer DV variants - SD, LP, SDL, HD
• Professional DV variants
• DV digital interface (DIF)
• Sony Digital Betacam compression
• Sony Betacam SX compression
• D-5 HD compression
• D-11 (HDCAM) compression

40 - MPEG-2 video compression

• MPEG-2 profiles and levels
• Picture structure
• Frame rate and 2-3 pulldown in MPEG
• Luma and chroma sampling structures
• Macroblocks
• Picture coding types - I, P, B
• Prediction
• Motion vectors (MVs)
• Coding of a block
• Frame and field DCT types
• Zigzag and VLE
• Refresh
• Motion estimation
• Rate control and buffer management
• Bitstream syntax
• Transport
• Further reading

Part 4 - Studio standards

41 - 480i component video

• Frame rate
• Interlace
• Line sync
• Field/frame sync
• RGB primary components
• Nonlinear transfer function
• Luma (Y')
• Picture center, aspect ratio, and blanking
• Halfline blanking
• Component digital 4:2:2 interface
• Component analog R'G'B' interface
• Component analog Y'P_BP_R interface, EBU N10
• Component analog Y'P_BP_R interface, industry standard

42 - 480i NTSC composite video

• Subcarrier
• NTSC two-frame sequence
• NTSC burst
• Color differences (U, V)
• Color difference filtering
• Chroma (C)
• Setup
• S-video-525 (Y'/C3.58)
• Composite NTSC encoding
• Composite digital NTSC interface (4f_SC)
• Composite analog NTSC interface

43 - 576 i component video

• Frame rate
• Interlace
• Line sync
• Analog field/frame sync
• RGB primary components
• Nonlinear transfer function
• Luma (Y')
• Picture center, aspect ratio, and blanking
• Component digital 4:2:2 interface
• Component analog R'G'B' interface
• Component analog Y'P_BP_R interface

44 - 576i PAL composite video

• Subcarrier
• PAL four-frame sequence
• PAL burst
• Color difference components (U, V)
• Color difference filtering
• Chroma (C)
• S-video-625 (Y'/C4.43)
• Composite PAL encoding
• Composite digital PAL interface (4f_SC)
• Composite analog PAL interface

45 - SDTV test signals

• Colorbars
• Colorbar notation
• Frequency response
• Differential gain (DG)
• Differential phase (DP)
• Pulse signals
• Modulated 12.5T, 20T pulses

46 - 1280 x 720 HDTV

• Scanning
• Analog sync
• Picture center, aspect ratio, and blanking
• RGB primary components
• Nonlinear transfer function
• Luma (Y')
• Component digital 4:2:2 interface
• Component analog R'G'B' interface
• Component analog Y'P_BP_R interface
• Pre- and postfiltering characteristics

47 - 1920 x 1080 HDTV

• Scanning
• Analog sync
• Picture center, aspect ratio, and blanking
• Relationship to SMPTE 240M (1035i) scanning
• RGB primary components
• Nonlinear transfer function
• Luma (Y' )
• Component digital 4:2:2 interface
• Component analog R'G'B' interface
• Component analog Y'P_BP_R interface
• Pre- and postfiltering characteristics

Part 5 - Broadcast and consumer standards

48 - Analog NTSC and PAL broadcast standards

• ITU-R (former CCIR)
• ITU-R scanning nomenclature
• M/NTSC (NTSC)
• Audio in NTSC
• B,G,H,I/PAL (PAL)
• Audio in PAL
• PAL-M, PAL-N
• SECAM
• Multiplexed analog components (MAC)
• Summary of parameters

49 - Consumer analog NTSC and PAL

• Multistandard consumer equipment
• Degenerate analog NTSC and PAL
• Coherent subcarrier
• Incoherent subcarrier
• Nonstandard scanning
• SCART interface
• Heterodyne (color-under) recording
• VHS trick mode playback
• Timebase correction (TBC)

50 - Digital television broadcast standards

• Japan
• United States
• ATSC modulation
• Europe
• Further reading

Appendices

A - YUV and luminance considered harmful

• Cement vs. concrete
• True CIE luminance
• The misinterpretation of luminance
• The enshrining of luma
• Color difference scale factors
• Conclusion: A plea

B - Introduction to radiometry and photometry

• Radiometry
• Photometry
• Image science
• Units
• Further reading

Glossary of video signal terms

Index