ST 2110 and NMOS IS-08: Audio Transport and Routing

Presenters : Andreas Hildebrand - ALC NetworX

Year : 2019

dlp_document_download : C U R A T E D B Y # 1 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SMPTE ST2110 & NMOS IS - 08: Audio Transport and Routing - Andreas Hildebrand – RAVENNA Technology Evangelist ALC NetworX, Munich C U R A T E D B Y # 2 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Andreas Hildebrand , RAVENNA Technology Evangelist • more than 25 years in the professional audio / broadcasting industry • graduate diploma in computer science • R&D, project & product management experience • member of AES67 TG and ST2110 DG A LC NetworX GmbH , Munich / Germany • established 2008 • R&D center • developing & promoting RAVENNA • Partnerships with > 40 manufacturers RAVENNA • IP media networking technology • designed to meet requirements of professional audio / broadcasting applications • open technology approach , license -free • fully AES67 -compliant ( built -in ) C U R A T E D B Y # 3 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 • Defines transport and synchronization of elementary essence streams (video, audio, ancillary data) • Primarily targeting at live production applications • References / builds on existing standards:  Timing: SMPTE 2059 (SMPTE PTP Profile)  Video: RFC 4175 (RTP Payload Format for Uncompressed Video)  Audio: AES67 & RAVENNA  Ancillary data: RFC 8331 (RTP Payload for SMPTE ST 291 -1 Ancillary Data) SMPTE 2110 - Professional Media over Managed IP Networks C U R A T E D B Y # 4 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SDI SMPTE 2110 ST2110 Sender ST2110 Receiver 1 ST2110 Receiver 2 C U R A T E D B Y # 6 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -10: System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -20: Uncompressed Active Video  defines payload format for raw video (RFC4175, RTP, SDP, constraints) • 2110 -21: Traffic Shaping and Delivery Timing for Uncompressed Active Video  defines timing model for senders and receivers (traffic shaping requirements) C U R A T E D B Y # 7 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -30: PCM Digital Audio  defines payload format for linear audio (AES67, constraints) • 2110 -31: AES3 Transparent Transport  defines payload format for non -linear audio (RAVENNA AM824) • 2110 -40: Transport of SMPTE Ancillary Data  defines RTP payload format for SDI ancillary data (new IETF draft) C U R A T E D B Y # 8 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SMPTE 2110 - Professional Media over Managed IP Networks Document structure (audio): • 2110 -10 : System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30 : PCM Digital Audio  defines payload format for linear audio (AES67, constraints) • 2110 -31 : AES3 Transparent Transport  defines payload format for non -linear audio (RAVENNA AM824 ) C U R A T E D B Y # 9 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SMPTE 2110 - Professional Media over Managed IP Networks Document structure (linear PCM audio): • 2110 -10 : System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30 : PCM Digital Audio  defines payload format for linear audio (AES67, constraints ) AES67 C U R A T E D B Y # 10 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AES67 - 2015 Standard for Audio Applications of Networks: AES67 High - performance Streaming Audio - over - IP Interoperability published on September, 11th, 2013 C U R A T E D B Y # 12 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 IP RAVENNA Livewire Q -LAN WheatNet Dante X X X X AES67 C U R A T E D B Y # 14 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AES67 technology components Synchronisation Media Clock Transport QoS Encoding Session Description Connection Management Discovery Not specified (NMOS IS -04/05) IEEE 1588 -2008 (PTPv2) 48 kHz RTP / UDP / IP, unicast & multicast Differentiated Services ( DiffServ w/ 3 CoS ) L16/L24, 1..8 ch , 48 samples SDP (RFC4566, RFC7273) SIP ( unicast ), IGMP ( multicast ) C U R A T E D B Y # 15 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -10: System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30: PCM Digital Audio  defines payload format for linear audio (AES67, constraints ) AES67  AIMS WP on AES67 / ST2110 Commonalities & Constraints C U R A T E D B Y # 19 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SMPTE 2110 - Professional Media over Managed IP Networks Constraints of 2110 -10 & -30 w/ respect to AES67 • 6 conformance levels (packet setup): C U R A T E D B Y # 20 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Level Supported by the Receiver A (mandatory) Reception of 48 kHz streams with 1 to 8 audio channels at packet times of 1 ms SMPTE 2110 - Professional Media over Managed IP Networks Constraints of 2110 -10 & -30 w/ respect to AES67 • 6 conformance levels (packet setup): C U R A T E D B Y # 22 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Level Supported by the Receiver A (mandatory) Reception of 48 kHz streams with 1 to 8 audio channels at packet times of 1 ms B Level A + 1 to 8 channels at packet times of 125 µs C Level A + 1 to 64 channels at packet times of 125 µs SMPTE 2110 - Professional Media over Managed IP Networks Constraints of 2110 -10 & -30 w/ respect to AES67 • 6 conformance levels (packet setup): C U R A T E D B Y # 23 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Level Supported by the Receiver A X Level A (  48 kHz) + Reception of 96 kHz streams with 1 to 4 audio channels at packet times of 1 ms B X Level B + AX + 1 to 8 channels at packet times of 125 µs C X Level C + AX + 1 to 32 channels at packet times of 125 µs SMPTE 2110 - Professional Media over Managed IP Networks Constraints of 2110 -10 & -30 w/ respect to AES67 • 6 conformance levels (packet setup): C U R A T E D B Y # 31 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 SMPTE 2110 - Professional Media over Managed IP Networks What else is required for a working system ?  Establishing connections!  Not covered by SMPTE 2110   AMWA: Advanced Media Workflow Association  NMOS: "A growing family of specifications […] which are complementary to and co -exist with industry specifications like ST2110 and AES67" C U R A T E D B Y # 32 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AMWA NMOS - Networked Media Open Specifications NMOS specifications : • IS -04: Discovery & Registration  enumeration and registration of available system resources • IS -05: Connection Management  connecting receivers to available streams • IS -06: Network Control  controlling network resources (configuring routing tables) C U R A T E D B Y # 33 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AMWA NMOS - Networked Media Open Specifications NMOS specifications : • IS -07: Event & Tally Specification  communicate current states and state changes • IS -08: Audio Channel Mapping  how to match flow channels with inputs / outputs • BCP -002 -01: Grouping of NMOS Resources  identifying which flows are related to each other • … more in the works… C U R A T E D B Y # 34 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Key elements AMWA NMOS - Networked Media Open Specifications C U R A T E D B Y # 35 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Node Device Receiver Sender 256E5638 -0EB2 -4E70 - B45B -3B24BEB6A478 83 C42DF8 -284E -4351 - 8349 -E50DA22AC419 6C46C3F0 -97F0 -4852 - 9D85 -8D4B0325A488 A38548F4 -99EE -40CF - 9582 -94A51B1BCAC1 Source Flow 60752 B84 -F055 -4E32 - 9D7F -9619DA31406A 23F85482 -7AE1 -4366 - 9DD3 -BD8483957A91 Identity AMWA NMOS - Networked Media Open Specifications C U R A T E D B Y # 36 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 IS - 04 Discovery & Registration Ensure that parts of a networked media system can find each other AMWA NMOS - Networked Media Open Specifications C U R A T E D B Y # 37 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Node Device Source Flow Receiver Sender Registry Registration Query AMWA NMOS - Networked Media Open Specifications 256E5638 -0EB2 -4E70 - B45B -3B24BEB6A478 83 C42DF8 -284E -4351 - 8349 -E50DA22AC419 6C46C3F0 -97F0 -4852 - 9D85 -8D4B0325A488 A38548F4 -99EE -40CF - 9582 -94A51B1BCAC1 60752 B84 -F055 -4E32 - 9D7F -9619DA31406A 23F85482 -7AE1 -4366 - 9DD3 -BD8483957A91 C U R A T E D B Y # 38 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 IS - 05 Connection Management Make it simple for applications to (dis)connect flows AMWA NMOS - Networked Media Open Specifications C U R A T E D B Y # 39 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Node Device Sender Node Device Receiver Application Logic IS -04 Registry Registration any format / protocol Create Connection stream AMWA NMOS - Networked Media Open Specifications C U R A T E D B Y # 40 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AMWA NMOS - Networked Media Open Specifications Challenge: 6 channel surround audio C U R A T E D B Y # 41 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AMWA NMOS - Networked Media Open Specifications Challenge: C U R A T E D B Y # 42 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AMWA NMOS - Networked Media Open Specifications Challenge: R L LFE RS C R L LFE LS RS 6 unicast streams with individual channels Option 1:  not very efficient LS C C U R A T E D B Y # 43 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 6 AMWA NMOS - Networked Media Open Specifications Challenge: 6 6 6 6 6 6 1 multicast stream w/ all 6 channels Option 2: C U R A T E D B Y # 44 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 LS C R L LFE RS AMWA NMOS - Networked Media Open Specifications Challenge: 1 multicast stream w/ all 6 channels C U R A T E D B Y # 45 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 IS - 08 Audio Channel Mapping Map flow channels (tracks) to device I/O channels AMWA NMOS - Networked Media Open Specifications C U R A T E D B Y # 46 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 NMOS IS -08 AMWA NMOS IS -08 - Audio Channel Mapping Sources Input1 2ch Output1 Sinks Device Map 2ch C U R A T E D B Y # 48 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AMWA NMOS IS -08 - Audio Channel Mapping • Interaction with NMOS IS -05 – connecting incoming stream channels to device output channels C U R A T E D B Y # 49 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 X -nmos / channelmapping /v1.0/ io AMWA NMOS IS -08 - Audio Channel Mapping C U R A T E D B Y # 51 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AMWA NMOS IS -08 - Audio Channel Mapping NMOS IS -05 NMOS IS -08 Controller C U R A T E D B Y # 52 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 AMWA NMOS IS -08 - Audio Channel Mapping A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 IP -SDI Gateway C U R A T E D B Y # 53 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 More information on NMOS wiki on Github : https://github.com/AMWA - TV/nmos/wiki AMWA NMOS - Networked Media Open Specifications C U R A T E D B Y # 54 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O W C A S E T H E AT R E AT N A B – A P R . 8 -11 , 2 01 9 Andreas Hildebrand Technology Evangelist Contact information : ALC NetworX GmbH Am Loferfeld 58 81249 Munich Germany ravenna@alcnetworx.de www.ravenna -network.com