NMOS IS-08: Audio Transport & Routing

Presenters : Andreas Hildebrand - ALC NetworX

Year : 2019

dlp_document_download : # 1 - Andreas Hildebrand – RAVENNA Technology Evangelist ALC NetworX, Munich ST2110 Technical: Audio Transport & Routing (NMOS IS -08) # 2 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Andreas Hildebrand , RAVENNA Technology Evangelist • more than 25 years in the professional audio / broadcasting industry • graduate diploma in computer science • R&D, project & product management experience • member of AES67 TG and ST2110 DG ALC NetworX GmbH , Munich / Germany • established 2008 • R&D center • developing & promoting RAVENNA • Partnerships with > 40 manufacturers RAVENNA • IP media networking technology • designed to meet requirements of professional audio / broadcasting applications • open technology approach , license -free • fully AES67 -compliant ( built -in ) # 3 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 • Defines transport and synchronization of elementary essence streams (video, audio, ancillary data) • Primarily targeting at live production applications • References / builds on existing standards: − Timing: SMPTE 2059 (SMPTE PTP Profile) − Video: RFC 4175 (RTP Payload Format for Uncompressed Video) − Audio: AES67 & RAVENNA − Ancillary data: RFC 8331 (RTP Payload for SMPTE ST 291 -1 Ancillary Data) SMPTE 2110 - Professional Media over Managed IP Networks # 4 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SDI SMPTE 2110 ST2110 Sender ST2110 Receiver 1 ST2110 Receiver 2 # 6 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -10: System Timing & Definitions − defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -20: Uncompressed Active Video − defines payload format for raw video (RFC4175, RTP, SDP, constraints) • 2110 -21: Traffic Shaping and Delivery Timing for Uncompressed Active Video − defines timing model for senders and receivers (traffic shaping requirements) # 7 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -30: PCM Digital Audio − defines payload format for linear audio (AES67, constraints) • 2110 -31: AES3 Transparent Transport − defines payload format for non -linear audio (RAVENNA AM824) • 2110 -40: Transport of SMPTE Ancillary Data − defines RTP payload format for SDI ancillary data (new IETF draft) # 8 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE 2110 - Professional Media over Managed IP Networks Document structure (audio): • 2110 -10 : System Timing & Definitions − defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30 : PCM Digital Audio − defines payload format for linear audio (AES67, constraints) • 2110 -31 : AES3 Transparent Transport − defines payload format for non -linear audio (RAVENNA AM824) # 9 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE 2110 - Professional Media over Managed IP Networks Document structure (linear PCM audio): • 2110 -10 : System Timing & Definitions − defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30 : PCM Digital Audio − defines payload format for linear audio (AES67, constraints) AES67 # 10 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AES67 - 2015 Standard for Audio Applications of Networks: AES67 High - performance Streaming Audio - over - IP Interoperability published on September, 11th, 2013 # 11 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Scope: • Interoperability guidelines for professional, low‐latency audio over campus and local area IP networks using existing protocols wherever possible . • Excludes: − Non‐IP networking − Low‐bandwidth media − Data compression − Low‐performance WANs and public Internet − Video (should provide good basis for follow‐on video project) using existing protocols wherever possible . Interoperability guidelines Goal: • Technology providers may choose to implement interoperability as a special mode, or transition to it as their native mode # 12 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 IP RAVENNA Livewire Q -LAN WheatNet Dante X X X # 13 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 IP RAVENNA Livewire Q -LAN WheatNet Dante X X X X AES67 # 15 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AES67 technology components Synchronisation Media Clock Transport QoS Encoding Session Description Connection Management Discovery Not specified (NMOS IS -04/05) IEEE 1588 -2008 (PTPv2) 48 kHz RTP / UDP / IP, unicast & multicast Differentiated Services ( DiffServ w/ 3 CoS ) L16/L24, 1..8 ch , 48 samples SDP (RFC4566, RFC7273) SIP ( unicast ), IGMP ( multicast ) # 16 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -10: System Timing & Definitions − defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30: PCM Digital Audio − defines payload format for linear audio (AES67, constraints) AES67  AIMS WP on AES67 / ST2110 Commonalities & Constraints # 27 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE 2110 - Professional Media over Managed IP Networks 2110 -31 – transparent transport of AES3 audio data • Can transport any format which can be encapsulated in AES3 − L24 PCM w/ AES3 subframe meta data (PCUV bits) − non -PCM audio and data formats as defined by SMPTE ST 337 / 338 (i.e. Dolby®E etc.) # 28 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE 2110 - Professional Media over Managed IP Networks 2110 -31 – transparent transport of AES3 audio data • Builds on RAVENNA’s AM824 (IEC 61883 -6) payload definition: − retains AES67 definitions for synchronization and RTP usage − uses 3 bytes for PCM24 + 1 byte for AES3 meta data − RTP payload format signaled in SDP: a= rtpmap :< pt > AM824/48000/< nchan > -with <nchan > always being an equal number (stereo channels) − retains all other SDP parms 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |0|0| B|F| PCUV | DATA24 | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ # 30 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019  Demo @ RAVENNA booth #8.F57 # 35 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 SMPTE 2110 - Professional Media over Managed IP Networks What else is required for a working system ?  Establishing connections! − Not covered by SMPTE 2110  − AMWA: Advanced Media Workflow Association − NMOS: "A growing family of specifications […] which are complementary to and co -exist with industry specifications like ST2110 and AES67" # 38 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AMWA NMOS - Networked Media Open Specifications NMOS specifications : • IS -04: Discovery & Registration − enumeration and registration of available system resources • IS -05: Connection Management − connecting receivers to available streams • IS -08: Audio Channel Mapping − patching flow channels to inputs / outputs # 39 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Key elements AMWA NMOS - Networked Media Open Specifications # 40 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Node Device Receiver Sender 256E5638 -0EB2 -4E70 - B45B -3B24BEB6A478 83 C42DF8 -284E -4351 - 8349 -E50DA22AC419 6C46C3F0 -97F0 -4852 - 9D85 -8D4B0325A488 A38548F4 -99EE -40CF - 9582 -94A51B1BCAC1 Source Flow 60752 B84 -F055 -4E32 - 9D7F -9619DA31406A 23F85482 -7AE1 -4366 - 9DD3 -BD8483957A91 Identity AMWA NMOS - Networked Media Open Specifications # 41 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 IS - 04 Discovery & Registration Ensure that parts of a networked media system can find each other AMWA NMOS - Networked Media Open Specifications # 42 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Node Device Source Flow Receiver Sender Registry Registration Query AMWA NMOS - Networked Media Open Specifications 256E5638 -0EB2 -4E70 - B45B -3B24BEB6A478 83 C42DF8 -284E -4351 - 8349 -E50DA22AC419 6C46C3F0 -97F0 -4852 - 9D85 -8D4B0325A488 A38548F4 -99EE -40CF - 9582 -94A51B1BCAC1 60752 B84 -F055 -4E32 - 9D7F -9619DA31406A 23F85482 -7AE1 -4366 - 9DD3 -BD8483957A91 # 43 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 IS - 05 Connection Management Make it simple for applications to (dis)connect flows AMWA NMOS - Networked Media Open Specifications # 44 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Node Device Sender Node Device Receiver Application Logic IS -04 Registry Registration any format / protocol Create Connection stream AMWA NMOS - Networked Media Open Specifications # 46 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AMWA NMOS - Networked Media Open Specifications Challenge: 6 channel surround audio # 47 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AMWA NMOS - Networked Media Open Specifications Challenge: # 48 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AMWA NMOS - Networked Media Open Specifications Challenge: R L LFE RS C R L LFE LS RS 6 unicast streams with individual channels Option 1:  not very efficient LS C # 49 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 6 AMWA NMOS - Networked Media Open Specifications Challenge: 6 6 6 6 6 6 1 multicast stream w/ all 6 channels Option 2: # 50 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 LS C R L LFE RS AMWA NMOS - Networked Media Open Specifications Challenge: 1 multicast stream w/ all 6 channels # 51 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 IS - 08 Audio Channel Mapping Map flow channels (tracks) to device I/O channels AMWA NMOS - Networked Media Open Specifications # 52 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 NMOS IS -08 AMWA NMOS IS -08 - Audio Channel Mapping Sources Input1 2ch Output1 Sinks Device Map 2ch # 53 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AMWA NMOS IS -08 - Audio Channel Mapping • Interaction with NMOS IS -05 – connecting incoming stream channels to device output channels # 55 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 X -nmos / channelmapping /v1.0/ io AMWA NMOS IS -08 - Audio Channel Mapping # 56 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AMWA NMOS IS -08 - Audio Channel Mapping # 58 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 AMWA NMOS IS -08 - Audio Channel Mapping IP -SDI Gateway # 59 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 More information on NMOS wiki on Github : https://github.com/AMWA - TV/nmos/wiki AMWA NMOS - Networked Media Open Specifications # 60 ST2110 Technical: Audio Transport & Routing (NMOS -IS08) Andreas Hildebrand, AIMS / AES AVoIP Theatre @ AES 147 th, Oct . 2019 Andreas Hildebrand Technology Evangelist Contact information : ALC NetworX GmbH Am Loferfeld 58 81249 Munich Germany ravenna@alcnetworx.de www.ravenna -network.com