AES67/ST 2110/NMOS – Overview on SDO Activities

Presenters : Andreas Hildebrand - ALC NetworX

Year : 2019

dlp_document_download : # 1 - Andreas Hildebrand – RAVENNA Technology Evangelist ALC NetworX, Munich Overview on current SDO Activities # 2 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Andreas Hildebrand , RAVENNA Technology Evangelist • more than 25 years in the professional audio / broadcasting industry • graduate diploma in computer science • R&D, project & product management experience • member of AES67 TG and ST2110 DG ALC NetworX GmbH , Munich / Germany • established 2008 • R&D center • developing & promoting RAVENNA • Partnerships with > 40 manufacturers RAVENNA • IP media networking technology • designed to meet requirements of professional audio / broadcasting applications • open technology approach , license -free • fully AES67/ST2110 -compliant ( built -in ) # 3 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019  AES67 − defines high -performance AoIP interoperability  SMPTE ST 2110 (SMPTE ST 2059) − defines elementary essence data transport on managed IP networks  AMWA NMOS − defines upper layer operational & management functionalities  AES70 − defines device control & connection management  AES X242 − defines real -time audio meta data transport over IP Relevant Standards # 4 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 What was the original goal? • "Provide a method to connect disparate Audio -over -IP systems to achieve workaround -free networked audio interoperability" What is AES67? • Interoperability Standard for high performance Audio -over -IP networks • Based on existing protocols and trusted IT standards • This ensures compatibility with existing network infrastructure • Allows coexistence with other IT data • High adoption rate by all major solution providers AES67 AES67 # 5 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AES67 Problem Statement • Audio -over -IP (aka Networked Audio) provides simpler and better connection between audio equipment • Coupled with many advantages, one clear challenge presented itself: Compatibility • While each Audio -over -IP solution offered in - system connectivity, there was no standard to provide inter -system connectivity AES67 # 6 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 IP RAVENNA Livewire Q -LAN WheatNet Dante X X X AES67 # 7 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 IP RAVENNA Livewire Q -LAN WheatNet Dante X X X X AES67 AES67 # 9 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 2013 – initial publication • 3 years of work • 100+ participants (manufacturers, consultants, system integrators, end users) 2015 – first revision • Corrigendum & clarifications • Backward compatibility (no new requirements) 2018 – second revision • Further clarifications • Backward compatibility (no new requirements) • PICS added Current status • Task Group is working on further topics (multicast addressing, SDP, homologation w/ ST 2110 etc.) • Interested parties are invited to join SC -02 -12 -M (Thu, 1p) AES67 AES67 - Status # 10 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AES70 – Open Control Architecture • Initially published in 2017 • AES70 -2018 – improvements + additions (i.e. CM3, web sockets / UDP support, Task mechanism etc.) • Current work: further improvements, AES70 for AES67 Connection Management, NMOS convergence X238 – Requirements for Media Network Directories and Directory Services • setting forth technical recommendations for media network directories and directory -related services • Covering: Registration, query, and administration protocols; security mechanisms; directory data model; query language and related semantics; scalability strategies X242 – Streaming audio metadata over IP • Defining a transport mechanism for real -time audio meta data associated with an AES67 audio stream • Synchronization, RTP payload format (but agnostic to actual payload data), association & alignment w/ AES67 streams • Seeking alignment / coordination w/ SMPTE ST 2110 -41 ("Transport of Extensible Fast Metadata") Further Work in AES Task Groups # 11 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE ST 2110 – Professional Media over Managed IP Networks The SMPTE ST 2110 standards suite specifies • the transport, synchronization and description of • separate elementary essence streams (video, audio, ancillary data) • over managed IP networks (at any speed, from 1GbE to 100 GbE and beyond) • for real -time production, playout and other professional media applications. # 12 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 • Bundled (Audio, Video, Metadata together) • Audio/Video/Metadata/Sync travel coherently • Requires extra work to "unpack" separate essences • Essence -based (Audio, Video, Metadata separate) • Ideal for Studio/Production workflows • Individual essence kept in sync using PTP timing Two Fundamental Approaches to IP Transport # 13 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 The Bundled Approach: SMPTE ST 2022 - 6 Published beginning in 2012 # 14 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 The Essence - based Approach: SMPTE ST 2110 Published in 2017 # 15 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 ST 2022 -6 ST 2110 Bundled vs. Essence - based Approach # 18 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Document structure (published ): • 2110 -10: System Timing & Definitions − defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -20: Uncompressed Active Video − defines payload format for raw video (RFC4175, RTP, SDP, constraints) • 2110 -21: Traffic Shaping and Delivery Timing for Uncompressed Active Video − defines timing model for senders and receivers (traffic shaping requirements) The SMPTE ST 2110 Suite of Standards # 19 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Document structure (published ): • 2110 -30: PCM Digital Audio − defines payload format for linear audio (AES67, constraints) • 2110 -31: AES3 Transparent Transport − defines payload format for non -linear audio (RAVENNA AM824) • 2110 -40: Transport of SMPTE Ancillary Data − defines RTP payload format for SDI ancillary data (new IETF draft) The SMPTE ST 2110 Suite of Standards # 35 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Specifies the payload format for PCM digital audio streams • Uncompressed Linear PCM Audio only • Based on AES67 • Relatively flexible: 4 48kHz and 96kHz sampling 4 16 and 24 -bit depth 4 Variable packet timing - 125us to 1ms 4 Channel -count based on packet timing - 8 channels @ 1ms up to 64 channels @ 125us (conformance levels A / B / C) • Low -bandwidth consumption, i.e. 4 8 channels x 24 bits x 48,000 samples = 9.9Mbits/sec (incl. packet overhead) SMPTE ST 2110 - 30 Linear PCM Audio AES67 # 36 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE ST 2110 - 30 and AES67 Compatibility AES67 # 37 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AES67 ST2110 -30 Constraints ! − AES -R16 -2016 PTP configuration − option to operate device in PTP slave -only mode − a= mediaclk:direct =0 SMPTE ST 2110 - 30 and AES67 Compatibility AES67 # 38 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Specifies the payload format for transparent transport of AES3 audio data • Can transport any format which can be encapsulated in AES3: 4 L24 PCM w/ AES3 subframe meta data (PCUV bits) 4 non -PCM audio and data formats as defined by SMPTE ST 337 / 338 (i.e. Dolby®E etc.) • Builds on RAVENNA’s AM824 (IEC 61883 -6) payload definition: 4 retains AES67 definitions for synchronization and RTP usage 4 uses 3 bytes for PCM24 + 1 byte for AES3 meta data 4 RTP payload format signaled in SDP: a= rtpmap :< pt > AM824 /48000/< nchan > 4 retains all other SDP parms SMPTE ST 2110 - 31 AES3 Audio Data 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |0|0| B|F| PCUV | DATA24 | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ # 39 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE ST 2110 - 31 and AES67 Compatibility ST2110 -30 ST2110 -31 AES67 # 43 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Document structure (in development) : • 2110 -22: Constant Bit -rate Compressed Video − defines payload format for CBR compressed video and a SMPTE registry for various payload formats (codecs) • 2110 -23: Single Video Essence Transport over Multiple 2110 -20 Streams − defines how to split high -bandwidth signals into several lower -bandwidth 2110 -20 tributary streams (constraints, grouping, addressing, RTP timestamps, SDP …) • 2110 -41: Extensible Fast Metadata Transport − defines how to transport extensible, dynamic meta data in ST2110 context (including synchronization) The SMPTE ST 2110 Suite of Standards # 44 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 ST 2110 • 1-year review of: -10 / -20 / -21 / -40 • New work: -24 (SDO Definitions) • PICS (analog to AES67 -2018) ST 2059 • 1-year review of: -1 & -2 • ST 2059 Security • PTP Monitoring Related : VSF • ST 2110 -over -WAN, ST 2110 format enumeration IEEE1588 -2020 (PTPv2.1) • Improvements and extensions, fully backwards -compatible Further Work in SMPTE DGs # 45 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 # 47 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 0. CURRENT SDI II. ELEMENTARY FLOWS More flexible and efficient workflows New formats support ed like UHD and mezzanine compression III. NETWORK & RESOURCE MANAGEMENT Automated resource management for more flexible and sharable infrastructure at scale I. SDI OVER IP CURRENT AND MATURE TECHNOLOGY IV. DEMATERIALIZED FACILITIES CLOUD FIT Open, secure, public/private cloud solutions NON MEDIA -SPECIFIC IT Self -service open APIs suitable for virtualization JT -NM Roadmap ST2022 -6 ST2110 # 48 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 # 49 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 What are the Networked Media Open Specifications (NMOS)? • NMOS is a growing family of specifications <…> to support the development of products and services which work within an open industry framework. • The Specifications are being developed using Internet standards or Internet -friendly techniques. • They are complementary to and co -exist with industry specifications; for example, SMPTE ST2110 and AES67. Motivation for NMOS • Lack of interoperability in a growing and diversifying IP media landscape. Goals • To deliver interoperability among products across a wide range of suppliers. • Open to all media companies and industry suppliers # 50 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Scope of NMOS work • Follows the definitions of the JT -NM reference architecture (JT -NM RA -1.0) − Identity − Timing & Synchronization − Discovery & Registration − Connection Management − Routing & Grouping − Event Control − Authorization & Security − System & Parameter Definitions − … # 51 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 # 51 # 52 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 JT -NM TR -1001 -1:2018 v1.0 # 53 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Standards: AES/ IEEE / SMPTE Standard Description Status AES67 -2018 High -performance streaming audio -over -IP interoperability Approved IEEE1588 -2008 Precision Time Protocol Approved SMPTE ST 2022 - 6 High Bit -rate Media Transport (SDI over IP) Approved SMPTE ST 2022 - 7 Seamless Protection Switching (RTP streams) Approved SMPTE ST 2022 - 8 Timing of ST 2022 -6 streams in ST 2110 -10 systems In Progress SMPTE ST 2059 - 1 Generation of PTP Signals (including definition of Epoch) Approved SMPTE ST 2059 - 2 SMPTE Profile for IEEE1588 -2008 (operating parameters) Approved # 54 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Standards: SMPTE ST 2110 Suite Standard Description Status SMPTE ST 2110 - 10 System - PTP, RTP and SDP Approved SMPTE ST 2110 - 20 Video - Uncompressed Approved SMPTE ST 2110 - 21 Video - Traffic Shaping (packet pacing, bursts and gaps) Approved SMPTE ST 2110 - 22 Video - Compressed (CBR) In Progress SMPTE ST 2110 - 23 Video – Multistream (high -bw stream as separate low -bw streams) In Progress SMPTE ST 2110 - 30 Audio - Uncompressed (PCM) Approved SMPTE ST 2110 - 31 Audio - Compressed (AES3, non -PCM) Approved SMPTE ST 2110 - 40 Data - Ancillary (SDI) Approved SMPTE ST 2110 - 41 Data - Fast Meta Data In Progress # 55 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Standards ? Technical Recommendations Standard Description AMWA NMOS IS - 04 Device Discovery and Registration AMWA NMOS IS - 05 Connection Management AMWA NMOS IS - 06 Network Control AMWA NMOS IS - 07 Event & Tally AMWA NMOS IS - 08 Audio Channel Bundling AMWA NMOS IS - xy Flow Grouping, ID & Timing, Scalability, Security & more SMPTE ST RDD 34 Sony LLVC compression SMPTE ST RDD 35 IntoPIX TICO compression JT -NM TR -1001 -1 System Environment and Device Behavior # 57 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 The Power of Collaboration VSF TR -03 VSF TR -04 User Requirements IEEE 1588 SMPTE ST 2059 IETF RFC 4175 AES67 JT -NM Market -based Advocacy & Feedback . AMWA IS -04/05 SMPTE ST 2110 Reference Architecture # 59 Overview on current SDO Activities Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Andreas Hildebrand Technology Evangelist Contact information : ALC NetworX GmbH Am Loferfeld 58 81249 Munich Germany ravenna@alcnetworx.de www.ravenna -network.com