Live Closed Captioning and Subtitling in SMPTE 2110

Presenters : Bill McLaughlin - EEG

Year : 2019

dlp_document_download : C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Live Closed Captioning and Subtitling in SMPTE 2110 2110 -40 VANC standards, How -To, and Progress Report Speaker Introduction EEG has been the leading U.S. brand in closed captioning insertion products and remote transcription technologies for over 30 years. Today, the company provides a global customer base with captioning and subtitling solutions focused on live video workflows. Bill McLaughlin is VP of Product Development at EEG and has been with the company in various technical roles since 2007. Bill is the architect of iCap™, a secure networking system for live caption transmission that manages over 1 million hours of programming annually and was honored with a Technology Emmy® award in 2015. Goals of this Talk 1. How does the 2110 -40 ancillary data standard work? 2. Understand how live captioning in 2110 -40 is (and isn’t) different from SDI 3. What improvements does 2110 -40 present for ancillary data chains? 4. What do I need to understand to implement live captioning as part of a facility wide IP transition ? 5. What is the status of industry adoption on 2110 -40? C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 2110 Media Flows  Video, audio, and data are three separate RTP multicasts  Streams are synchronized with PTP timestamps in each packet VIDEO ( -20) AUDIO ( -30) ANC ( -40) PTP C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Ancillary Data in 2110 - 40 RTP Header including PTP -derived timestamp Zero or more SMPTE 291 VANC packets associated with one field of video 2110 -40 Header Information RTP Packet – at least one is sent for each field of video VIDEO ( -20) AUDIO ( -30) ANC ( -40) PTP C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Ancillary Data in 2110 - 40 Live subtitling still carried in same "Inner" formats as in SDI VANC • USA/NTSC: SMPTE 334 VANC packet, CEA -708 payload • EU/UK/PAL: OP -47 VANC packet, Teletext payload • Japan/Brazil/ARIB: ARIB B37 VANC packet, or SMPTE 334 Conversion between SDI and IP is simple and does not require generic gateways to have deep subtitle format knowledge. C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Transitional IP ANC Workflow Existing SDI VANC caption encoding equipment CAN be used with IP Gateways IP Router IP Gateway IP Gateway 2110 -20,30,40 2110 -20,30,40 SDI Caption Encoder C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Native 2110 Caption Generation Offers simplification and dramatic reduction in bandwidth IP Router 2110 -30 (Audio) 2110 -40 (ANC only) Software Driven IP Caption Encoder C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 SDI CC Insertion 2110 CC Insertion Virtualization Friendly? No Yes External Hardware 2 IP Gateways None Bandwidth Per Port Up to 10 Gb/s, more for UHD Less than 1 Mb/s, all standards Density 1-2 unique video channels per 1 RU 100 or more video channels per 1 RU Advantages of Native 2110 Caption Generation vs. SDI Insertion C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 How do Live Captions Enter the 2110 media system? • A stenographer or ASR system receives audio reference • Text data is returned to the caption encoder in real -time • Return data is synchronized back to 2110 -40 frames with PTP C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Combining Recorded and Live Captions Prerecorded Program (Captioned) Prerecorded Program (Captioned) Live Bulletin (Blank / No Captions) 239.40.2.1 Desired Output: Continuous Valid Subtitles mixing Live & non -live Air Schedule and Playout IP Caption Encoder Passes through upstream captions and generates captions for blank segments Simple Receiver 239.40.1.1 Valid subtitles during pre -recorded shows, blank during live C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Caption/ANC Routing is simpler with 2110 A Single 2110 -40 multicast can be associated with multiple videos using NMOS Connection Management Video: 239.20. 101 .1 Audio: 239.30. 101 .1 Ancillary: 239.40. 101 .1 Video: 239.20. 201 .1 Audio: 239.30. 201 .1 Ancillary: 239.40. 101 .1 C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 2110 - 40 Sender/Receiver Architectures 239.40.1.1 6101 Captions 239.40.2.1 6060 Time Code 239.40.3.1 4107 SCTE104 DPI 239.40.4.1 410C HDR Must listen to and synchronize several 2110 -40 multicasts. Simple Transmitters Complex Receiver 239.40.1.1 6101 Captions 239.40.1.2 6060 + 6101 239.40.1.3 6060 + 6101 + 4107 239.40.1.4 6060 + 6101 + 4107 + 410C Sees one multicast with several data types Complex Transmitters Simple Receiver Parallel Approach Serial Approach C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 2110 - 40 Sender/Receiver Architectures Receiving Device sees one multicast with several data types. 239.40.1.1 6101 Captions 239.40.2.1 6060 Time Code 239.40.3.1 4107 SCTE104 DPI 239.40.4.1 410C HDR 6101+6060+4107+ 410C HDR Side Chain Keyer : A 2110 -40 virtual device that consolidates parallel sources as necessary to simplify receiver task Side Chain Keyer Simple Transmitters Simple Receiver C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 2110 - 40 Adoption Overview • Standard finalized March 2018 • Good : Most implementing vendors show good Tx /Rx compatibility • Most commonly observed problem: field flag & marker use across progressive versus interlaced standards • Good : Most available SDI/IP gateways support 2110 -40 (buyer beware: still ask!) • Good : Prominent IP multi viewers support North America captioning from 2110 -40, though European OP -47 support less common • Mixed : Test and measurement equipment improving, but native -40 support lags SDI VANC analysis C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Continued Adoption of 2110 - 40 Provides  Continuity in all major global captioning and subtitling production standards  Higher density, and lower switch bandwidth utilization for live subtitling and any other standalone expert ANC processing systems  Continued momentum towards virtualization and IT security when dealing with remote live subtitling  New routing options for live subtitles and other ancillary data C U R A T E D B Y I P S H O W C A S E T H E AT E R AT N A B – A P R I L 8 -11 , 2 01 9 Thank You! Bill McLaughlin, EEG billm@eegent.com