This presentation explains how audio essence is transported with ST 2110 in general and further explains how individual input channels are bundled into an audio stream and how they can be assigned to dedicated outputs on a receiving device utilizing NMOS IS-08.

View
File Type: pdf
Categories: Audio, Control and NMOS
Presenters : Andreas Hildebrand - ALC NetworX
Year : 2019
dlp_document_download : AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 1 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 1 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE ST2110 & NMOS IS -08: Audio Transport and Routing - Andreas Hildebrand – RAVENNA Technology Evangelist ALC NetworX, Munich I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 2 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y Andreas Hildebrand , RAVENNA Technology Evangelist •more than 25 years in the professional audio / broadcasting industry •graduate diploma in computer science •R&D, project & product management experience •member of AES67 TG and ST2110 DG ALC NetworX GmbH , Munich / Germany •established 2008 •R&D center •developing & promoting RAVENNA •Partnerships with > 40 manufacturers RAVENNA •IP media networking technology •designed to meet requirements of professional audio / broadcasting applications •open technology approach , license -free •fully AES67 -compliant ( built -in) AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 2 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 3 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y •Defines transport and synchronization of elementary essence streams (video, audio, ancillary data) •Primarily targeting at live production applications •References / builds on existing standards:  Timing: SMPTE 2059 (SMPTE PTP Profile)  Video: RFC 4175 (RTP Payload Format for Uncompressed Video)  Audio: AES67 & RAVENNA  Ancillary data: RFC 8331 (RTP Payload for SMPTE ST 291 -1 Ancillary Data) SMPTE 2110 - Professional Media over Managed IP Networks I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 5 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y ST2110 Sender ST2110 Receiver 1 ST2110 Receiver 2 SDI SMPTE 2110 AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 3 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 6 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -10: System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -20: Uncompressed Active Video  defines payload format for raw video (RFC4175, RTP, SDP, constraints) • 2110 -21: Traffic Shaping and Delivery Timing for Uncompressed Active Video  defines timing model for senders and receivers (traffic shaping requirements) I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 7 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -30: PCM Digital Audio  defines payload format for linear audio (AES67, constraints) • 2110 -31: AES3 Transparent Transport  defines payload format for non -linear audio (RAVENNA AM824) • 2110 -40: Transport of SMPTE Ancillary Data  defines RTP payload format for SDI ancillary data (new IETF draft) • … more in the works … AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 4 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 8 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE 2110 - Professional Media over Managed IP Networks Document structure (audio): • 2110 -10 : System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30 : PCM Digital Audio  defines payload format for linear audio (AES67, constraints) • 2110 -31 : AES3 Transparent Transport  defines payload format for non -linear audio (RAVENNA AM824) I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 9 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE 2110 - Professional Media over Managed IP Networks Document structure (linear PCM audio): • 2110 -10 : System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30 : PCM Digital Audio  defines payload format for linear audio (AES67, constraints) AES67 AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 5 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 10 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AES67 -2015 Standard for Audio Applications of Networks: AES67 High -performance Streaming Audio - over -IP Interoperability published on September, 11th, 2013 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 12 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y IP RAVENNA Livewire Q -LAN WheatNet Dante X X X X AES67 AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 6 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 14 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AES67 technology components Synchronisation Media Clock Transport QoS Encoding Session Description Connection Management Discovery Not specified (NMOS IS -04/05) IEEE 1588 -2008 (PTPv2) 48 kHz RTP / UDP / IP, unicast & multicast Differentiated Services ( DiffServ w/ 3 CoS ) L16/L24, 1..8 ch, 48 samples SDP (RFC4566, RFC7273) SIP ( unicast ), IGMP ( multicast ) I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 15 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE 2110 - Professional Media over Managed IP Networks Document structure : • 2110 -10: System Timing & Definitions  defines transport layer and synchronization (SMPTE2059, clocks, RTP, SDP etc.) • 2110 -30: PCM Digital Audio  defines payload format for linear audio (AES67, constraints) AES67  AIMS WP on AES67 / ST2110 Commonalities & Constraints AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 7 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 26 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE 2110 - Professional Media over Managed IP Networks 2110 -31 – transparent transport of AES3 audio data • Can transport any format which can be encapsulated in AES3  L24 PCM w/ AES3 subframe meta data (PCUV bits)  non -PCM audio and data formats as defined by SMPTE ST 337 / 338 (i.e. Dolby®E etc.) I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 27 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE 2110 - Professional Media over Managed IP Networks 2110 -31 – transparent transport of AES3 audio data • Builds on RAVENNA’s AM824 (IEC 61883 -6) payload definition:  retains AES67 definitions for synchronization and RTP usage  uses 3 bytes for PCM24 + 1 byte for AES3 meta data  RTP payload format signaled in SDP: a=rtpmap :<pt> AM824/48000/< nchan > - with <nchan > always being an equal number (stereo channels)  retains all other SDP parms 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ |0|0| B|F| PCUV | DATA24 | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 8 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 28 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y  Demo @ RAVENNA booth #8.F57 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 33 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y SMPTE 2110 - Professional Media over Managed IP Networks What else is required for a working system ?  Establishing connections!  Not covered by SMPTE 2110   AMWA: Advanced Media Workflow Association  NMOS: "A growing family of specifications […] which are complementary to and co -exist with industry specifications like ST2110 and AES67" AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 9 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 36 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AMWA NMOS - Networked Media Open Specifications NMOS specifications : • IS-04: Discovery & Registration  enumeration and registration of available system resources • IS-05: Connection Management  connecting receivers to available streams • IS-08: Audio Channel Mapping  patching flow channels to inputs / outputs I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 37 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y Key elements AMWA NMOS - Networked Media Open Specifications AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 10 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 38 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y Node Device Receiver Sender 256E5638 -0EB2 -4E70 - B45B -3B24BEB6A478 83C42DF8 -284E -4351 - 8349 -E50DA22AC419 6C46C3F0 -97F0-4852- 9D85-8D4B0325A488 A38548F4 -99EE-40CF- 9582-94A51B1BCAC1 Source Flow 60752 B84-F055-4E32- 9D7F-9619DA31406A 23F85482 -7AE1-4366- 9DD3-BD8483957A91 Identity AMWA NMOS - Networked Media Open Specifications I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 39 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y IS - 04 Discovery & Registration Ensure that parts of a networked media system can find each other AMWA NMOS - Networked Media Open Specifications AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 11 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 40 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y Node Device Source Flow Receiver Sender Registry Registration Query AMWA NMOS - Networked Media Open Specifications 256E5638 -0EB2 -4E70 - B45B -3B24BEB6A478 83C42DF8 -284E -4351 - 8349 -E50DA22AC419 6C46C3F0 -97F0-4852- 9D85-8D4B0325A488 A38548F4 -99EE-40CF- 9582-94A51B1BCAC1 60752 B84-F055-4E32- 9D7F-9619DA31406A 23F85482 -7AE1-4366- 9DD3-BD8483957A91 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 41 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y IS - 05 Connection Management Make it simple for applications to (dis)connect flows AMWA NMOS - Networked Media Open Specifications AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 12 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 42 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y Node Device Sender Node Device Receiver Application Logic IS-04 Registry Registration any format / protocol Create Connection stream AMWA NMOS - Networked Media Open Specifications I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 43 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AMWA NMOS - Networked Media Open Specifications Challenge: 6 channel surround audio AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 13 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 44 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AMWA NMOS - Networked Media Open Specifications Challenge: I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 45 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AMWA NMOS - Networked Media Open Specifications Challenge: R L LFE RS C R L LFE LS RS 6 unicast streams with individual channels Option 1:  not very efficient LS C AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 14 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 46 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y 6 AMWA NMOS - Networked Media Open Specifications Challenge: 6 6 6 6 6 6 1 multicast stream w/ all 6 channels Option 2: I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 47 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y LS C R L LFE RS AMWA NMOS - Networked Media Open Specifications Challenge: 1 multicast stream w/ all 6 channels AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 15 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 48 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y IS - 08 Audio Channel Mapping Map flow channels (tracks) to device I/O channels AMWA NMOS - Networked Media Open Specifications I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 49 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y NMOS IS -08 AMWA NMOS IS -08 - Audio Channel Mapping Sources Input1 2ch Output1 Sinks Device Map 2ch AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 16 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 51 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AMWA NMOS IS -08 - Audio Channel Mapping •Interaction with NMOS IS -05 – connecting incoming stream channels to device output channelV I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 52 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y X-nmos /channelmapping /v1.0/ io AMWA NMOS IS -08 - Audio Channel Mapping AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 17 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 54 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AMWA NMOS IS -08 - Audio Channel Mapping NMOS IS -05 NMOS IS -08 Controller I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 55 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y AMWA NMOS IS -08 - Audio Channel Mapping A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing I P S H O WCA S E T H E AT R E AT N A B – A P R . 8 -1 1 , 2 01 9 IP-SDI Gateway AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 18 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 56 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing C U R A T E D B Y More information on NMOS wiki on Github : https://github.com/AMWA -TV/nmos/wiki AMWA NMOS - Networked Media Open Specifications I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 # 57 A. Hildebrand: SMPTE ST2110 & NMOS IS -08 – Audio Transport & Routing Thank you to our Media Partners Andreas Hildebrand Technology Evangelist Contact information : ALC NetworX GmbH Am Loferfeld 58 81249 Munich Germany ravenna@alcnetworx.de www.ravenna -network.com
Downloads: 9