What is SMPTE ST 2110

Presenters : Andreas Hildebrand - ALC NetworX

Year : 2019

dlp_document_download : What is SMPTE ST2110? Andreas Hildebrand RAVENNA Evangelist 2019 -02 -06 ISE Amsterdam SMPTE ST2110 – Professional Media over Managed IP Networks The SMPTE ST 2110 standards suite specifies • the transport, synchronization and description of • separate elementary essence streams (video, audio, ancillary data) • over managed IP networks (at any speed, from 1GbE to 100 GbE and beyond) • for real -time production, playout and other professional media applications. SMPTE ST2110 • Bundled (Audio, Video, Metadata together) • Audio/Video/Metadata/Sync travel coherently • Requires extra work to "unpack" separate essences • Essence -based (Audio, Video, Metadata separate) • Ideal for Studio/Production workflows • Individual essence kept in sync using PTP timing Two Fundamental Approaches to IP Transport The Bundled Approach: SMPTE ST 2022 - 6 Published beginning in 2012 The Essence - based Approach: SMPTE ST 2110 .. The approach is extensible Published beginning in 2017 ST 2022 -6 ST 2110 Bundled vs. Essence - based Approach ST2110 Sender ST2110 Receiver 1 ST2110 Receiver 2 SDI The Essence Based Approach: SMPTE ST 2110 Document structure (published ): • 2110 -10: System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -20: Uncompressed Active Video  defines payload format for raw video (RFC4175, RTP, SDP, constraints) • 2110 -21: Traffic Shaping and Delivery Timing for Uncompressed Active Video  defines timing model for senders and receivers (traffic shaping requirements) The SMPTE ST 2110 Suite of Standards Document structure (published ): • 2110 -30: PCM Digital Audio  defines payload format for linear audio (AES67, constraints) • 2110 -31: AES3 Transparent Transport  defines payload format for non -linear audio (RAVENNA AM824) • 2110 -40: Transport of SMPTE Ancillary Data  defines RTP payload format for SDI ancillary data (new IETF draft) The SMPTE ST 2110 Suite of Standards Document structure (in development) : • 2110 -22: Constant Bit -rate Compressed Video  defines payload format for CBR compressed video and a SMPTE registry for various payload formats (codecs) • 2110 -23 : Single Video Essence Transport over Multiple 2110 -20 Streams  defines how to split high -bandwidth signals into several lower -bandwidth 2110 -20 tributary streams (constraints, grouping, addressing, RTP timestamps, SDP …) • 2110 -41 : Extensible Fast Metadata Transport  defines how to transport extensible, dynamic meta data in ST2110 context (including synchronization) The SMPTE ST 2110 Suite of Standards P recision T ime P rotocol (IEEE 1588 -2008) • A method for distributing precise, GPS -referenced time over an IP network • Proven technology used in multiple industries • Used for synchronization and alignment of devices and media signals Synchronization and Alignment in ST 2110 Both AES67 and SMPTE ST 2110 use PTP R eal -time T ransport P rotocol (RFC 3550) • A format -agnostic transport protocol for real -time media data • Includes time information for precise media alignment Media Transport in ST 2110 Application Presentation Session Transport Network Data Link Physical OSI Layer RTP UDP IP Ethernet Copper / Fiber (up tp 1440 bytes ) S ession D escription P rotocol (RFC 4566 ) • Required to describe stream formatting, synchronization and connection information • Provided by a sender (or management instance) for each stream • Human -readable text: Signalization in ST 2110 v=0 o=1 0 IN IP4 192.168.1.100 s=RAVENNA demo stream t=0 0 a= ts -refclk:ptp =IEEE1588 -2008:00 -60 -6e -ff -fe -7c -23 -0f:0 a= mediaclk:direct =0 m=audio 5004 RTP/AVP 98 a=rtpmap:98 L24/48000/2 c=IN IP4 239.3.14.142 a= recvonly a=ptime:1 Specifies the payload format for uncompressed active video essence • Raster size independent 4 up to 32K x 32K pixels • Agnostic to: 4 Colour sampling: 4:1:1 to 4:4:4+ 4 Bit depth: 8 to 16 -Bit+ 4 Frame -rate: 23.98 to 120 fps+ • Support for HDR 4 PQ & HLG • Significant bandwidth efficiency, i.e. 1080p50: 4 ST 2022 -6 = 3,074Gbps 4 ST 2110 -20 = 2,143Gbps SMPTE ST 2110 - 20 Video - Uncompressed  30% bandwidth saving ! SMPTE ST 2110 - 21 Video – Traffic Shaping and Delivery Timing Problem Overview • Video flows require fairly high data rates • Multiples flows are concurrently traversing the network • Network switches (and receivers) have limited buffer capacity • Constant data flow will not overload the buffers as long as total used bandwidth stays below maximum bandwidth Inflow Data out Buffer Drain Data in SMPTE ST 2110 - 21 Video – Traffic Shaping and Delivery Timing Problem Overview • Random and unregulated traffic patterns may temporarily overflow buffers, even if average bandwidth is not exceeded Bursty inflow Larger buffer required Constant drain Constant data out Bursty data in Bucket may overflow ! Packets may get dropped ! SMPTE ST 2110 - 21 Video – Traffic Shaping and Delivery Timing Solution • Define sender drain behaviour (packet egress pacing and spacing) and (receiver) buffer requirements • 3 models for sender traffic shaping: 4 Narrow -linear (NL) – packet are drained evenly distributed across frame period 4 Narrow (N) – packet drain closely follows SDI signal timing (no packets during VBI and VANC) 4 Wide (W) – allows increased burstiness (accommodates SW -based senders) SMPTE ST 2110 - 21 Video – Traffic Shaping and Delivery Timing Solution • Define sender drain behaviour (packet egress pacing and spacing) • 3 models: 4 Narrow -linear 4 Narrow 4 Wide SMPTE ST 2110 - 21 Video – Traffic Shaping and Delivery Timing Solution • Define sender drain behaviour (packet egress pacing and spacing) • 3 models: 4 Narrow (N) – packet drain closely follows SDI signal timing (no packets during VBI and VANC) 4 Narrow -linear (NL) – packet are drained evenly distributed across frame period 4 Wide (W) – allows increased burstiness (accommodates SW -based senders) • Sender behaviour is signalled in the SDP in the a= fmtp : line: 4 TP=2110TPN 4 TP=2110TPNL 4 TP=2110TPW • Has impact on buffer requirements of network switches and receiver devices and sender / receiver compatibility SMPTE ST 2110 - 22 Video - Compressed Specifies the payload format for constant bit -rate compressed video formats • Raster size independent 4 up to 32K x 32K pixels • Agnostic to: 4 Colour sampling: 4:1:1 to 4:4:4+ 4 Bit depth: 8 to 16 -Bit+ 4 Frame -rate: 23.98 to 120 fps+ • Support for HDR 4 PQ & HLG • Constant bit -rate: 4 no specific codec / compression technology defined 4 codecs registered / enumerated in SMPTE registry, i.e. Generic -VC2 , HT -J2K, … Specifies the payload format for PCM digital audio streams • Uncompressed Linear PCM Audio only • Based on AES67 • Relatively flexible: 4 48kHz and 96kHz sampling 4 16 and 24 -bit depth 4 Variable packet timing - 125us to 1ms 4 Channel -count based on packet timing - 8 channels @ 1ms up to 64 channels @ 125us (conformance levels A / B / C) • Low -bandwidth consumption, i.e. 4 8 channels x 24 bits x 48,000 samples = 9.9Mbits/sec (incl. packet overhead) SMPTE ST 2110 - 30 Audio – Linear PCM AES67 AES67 What was the original goal? • "Provide a method to connect disparate Audio -over -IP systems to achieve workaround -free networked audio interoperability" What is AES67? • Interoperability Standard for high performance Audio -over -IP networks • Based on existing protocols and trusted IT standards • This ensures compatibility with existing network infrastructure • Allows coexistence with other IT data • High adoption rate by all major solution providers AES67 AES67 Problem Statement • Audio -over -IP (aka Networked Audio) provides simpler and better connection between audio equipment • Coupled with many advantages, one clear challenge presented itself: Compatibility • While each Audio -over -IP solution offered in - system connectivity, there was no standard to provide inter -system connectivity AES67 IP RAVENNA Livewire Q -LAN WheatNet Dante X X X X AES67 AES67 IP RAVENNA Livewire Q -LAN WheatNet Dante X X X X AES67 AES67 AES67 AES67 AES67 AES67 technology components Synchronisation Media Clock Transport QoS Encoding Session Description Connection Management Discovery Not specified (NMOS IS -04/05) IEEE 1588 -2008 (PTPv2) 48 kHz RTP / UDP / IP, unicast & multicast Differentiated Services ( DiffServ w/ 3 CoS ) L16/L24, 1..8 ch , 48 samples SDP (RFC4566, RFC7273) SIP ( unicast ), IGMP ( multicast ) ST2110 and AES67 Compatibility AES67 ST2110 -30 Constraints !  AES -R16 -2016 PTP configuration  option to operate device in PTP slave -only mode  a= mediaclk:direct =0 ST2110 and AES67 Compatibility Specifies the payload format for transparent transport of AES3 audio data • Can transport any format which can be encapsulated in AES3: 4 L24 PCM w/ AES3 subframe meta data (PCUV bits) 4 non -PCM audio and data formats as defined by SMPTE ST 337 / 338 (i.e. Dolby®E etc.) • Builds on RAVENNA’s AM824 (IEC 61883 -6) payload definition: 4 retains AES67 definitions for synchronization and RTP usage 4 uses 3 bytes for PCM24 + 1 byte for AES3 meta data 4 RTP payload format signaled in SDP: a= rtpmap :< pt > AM824 /48000/< nchan > 4 retains all other SDP parms SMPTE ST 2110 - 31 Audio - AES3 Audio Data 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |0|0| B|F| PCUV | DATA24 | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ SMPTE ST 2110 - 40 Data – Transport of Ancillary Data Specifies the method of transporting (SDI) ancillary data via RTP • Covers a ncillary data as specified in SMPTE ST 291 -1, i.e.: 4 Timecode 4 Closed captions 4 Subtitles 4 Active format descriptions • Not intended for the carriage of audio data (  SMPTE ST 2110 -31) or EDH (error , detection and handling) • Receivers creating SDI output which contains Ancillary Data Packets shall meet the requirements of SMPTE ST 291 -1 when constructing the HANC and VANC • Senders of ANC Data packets may use the " Line_Number " and " Horizontal_Offset " fields to indicate the proposed SDI location information for the ANC Data Packet • Seamless Protection Switching: SMPTE ST 2022 -7 • Discovery & Registration: AMWA IS -04 • Connection Management: AMWA IS -05 • Network Control: AMWA IS -06 • Event & Tally: AMWA IS -07 • Audio Channel Bundling: AMWA IS -08 • Flow Grouping, ID & Timing, Scalability, Security & more AMWA IS -xy • "Full stack" JT -NM TR -1001 -1 Other Key Standards/Specifications Standards ! AES/ IEEE / SMPTE Standard Description Status AES67 -2018 High -performance streaming audio -over -IP interoperability Approved IEEE1588 -2008 Precision Time Protocol Approved SMPTE ST 2022 - 6 High Bit -rate Media Transport (SDI over IP) Approved SMPTE ST 2022 - 7 Seamless Protection Switching (RTP streams) Approved SMPTE ST 2022 - 8 Timing of ST 2022 -6 streams in ST 2110 -10 systems In Progress SMPTE ST 2059 - 1 Generation of PTP Signals (including definition of Epoch) Approved SMPTE ST 2059 - 2 SMPTE Profile for IEEE1588 -2008 (operating parameters) Approved Standards ! SMPTE ST 2110 Suite Standard Description Status SMPTE ST 2110 - 10 System – PTP, RTP and SDP Approved SMPTE ST 2110 - 20 Video - Uncompressed Approved SMPTE ST 2110 - 21 Video – Traffic Shaping (packet pacing , bursts and gaps ) Approved SMPTE ST 2110 - 22 Video – Compressed (CBR) In Progress SMPTE ST 2110 - 30 Audio - Uncompressed (PCM) Approved SMPTE ST 2110 - 31 Audio - Compressed (AES3, non -PCM) Approved SMPTE ST 2110 - 40 Data - Ancillary (SDI) Approved Standards ? Technical Recommendations Standard Description AMWA NMOS IS - 04 Device Discovery and Registration AMWA NMOS IS - 05 Connection Management AMWA NMOS IS - 06 Network Control AMWA NMOS IS - 07 Event & Tally AMWA NMOS IS - 08 Audio Channel Bundling AMWA NMOS IS - xy Flow Grouping, ID & Timing, Scalability, Security & more SMPTE ST RDD 34 Sony LLVC compression SMPTE ST RDD 35 IntoPIX TICO compression JT -NM TR -1001 -1 System Environment and Device Behaviors for SMPTE ST 2110 Media Nodes in Engineered Networks ) AIMS Role and The Power of Collaboration VSF TR -03 VSF TR -04 User Requirements IEEE 1588 SMPTE ST 2059 IETF RFC 4175 AES67 JT -NM Market -based Advocacy & Feedback . AMWA IS -04/05 SMPTE ST 2110 Reference Architecture Summary and capable of handling future resolutions, frame rates, color sampling and bit depths. SMPTE ST 2110 is a growing and comprehensive suite of standards enabling carriage, synchronization and alignment of audio, video and metadata over IP for professional media applications and applicable range of use cases, even to low latency applications such as live production , Thank you! Andreas Hildebrand ALC NetworX RAVENNA@alcnetworx.de