Timing Planes in IP Production

Presenters : Andy Rayner - Nevion

Year : 2022

dlp_document_download : Timing planes in IP productionAndy Rayner Chief Technologist, Nevionarayner@nevion.com +44 7711 196609 SMPTE 2021 ATC: WHERE MEDIA & ENTERTAINMENT COME TOGETHERAndy Rayner, Chief Technologist, Nevionarayner@nevion.com+44 7711 196609Timing planes in IP production Come and catch up on the Sony stand C10901 in the Central Hall Timing planes in IP production The relevant standards journeysRFC 3550RTPRFC 4175Uncompressedvideo mappingAES67IP audioVSF TR-03ES media over IPSMPTE ST 2210RFC 768UDPSMPTEST 292MHD-SDISMPTEST 424M3G-SDIIEEE 1588PTPSMPTEST 2059use of PTPtime SYSTEM -10AUDIO -30VIDEO -20COMPRESSEDVIDEO -22AES3-32 bitAUDIO -31TIMING -212022-8COMPOSITEANCILLARYDATA -40MULTI-PART VIDEO -23FAST METADATA -41FMX -42SD VIDEO -24IS-04Discovery and RegistrationIS-05Connection ManagementIS-08Audio Channel MappingIS-07Event and TallyIS-09SystemBCP-003-0xSecurity suiteThe ST2110 suite & NMOS5 The broadcast end gameTime-aware media processing chain AcquisitionConsumptionProduction= real time& time aligned Reconciling media essence timingsProcessing timeProcessing timeProcessing timeOrigination timeUse timelink timelink timelink timelink timelink time SYSTEM -10AUDIO -30VIDEO -20COMPRESSEDVIDEO -22AES3-32 bitAUDIO -31TIMING -212022-8COMPOSITEANCILLARYDATA -40MULTI-PART VIDEO -23FAST METADATA -41FMX -42SD VIDEO -24IS-04Discovery and RegistrationIS-05Connection ManagementIS-08Audio Channel MappingIS-07Event and TallyIS-09SystemBCP-003-0xSecurity suiteThe ST2110 suite & NMOS -revisions8 Timing propagation through system –ST 2110 revisionsRTP mode: NEWT0RTP mode: PRESERVEEgress time point = t0+taRTP mode: PRESERVEEgress time point = t0+ta+tbRTP mode: NEWEgress time point = t0+ta+tb+tcTime plane is T1Ta= time from egress of previous device to time of egressing this deviceT1-T0 = TNEWRTP-TRTP Tbtc VisionMixerAudioMixerHost ProductionReplayISOTo F i l eCamVisionMixerPackageGraphics(match clock)Program Pres(unilateral)VisionMixerCamStudioChannelPresentationVisionAndAudioMixerMicAudioMixerAudioMixerMicMicSSMCameraPlayoutCommentaryFilePackageFileDataStatsCameraExample drawing by PrinBoon, PhabrixExample of production timing planes Sources that cross timing planest0EventProductionswitcherPresentationswitcherISO feeds also used directly Multiple production timing planest0FinalChannelplayoutRemotecontrol surfacesRemotecommentaryEventProductionswitcherPresentationswitcherRemote/RadioCameras!ProfanitydelayAR/VRsettime Specific real-world use-case in 2021VR system200ms Software procession execution time Same principles apply in virtualized worldProcessing timeProcessing timeProcessing timeOrigination timeUse timelink timelink timelink timelink timelink time AES67 link timing 17VPF1VPF3VPF4VPF5VPF2Concatenated virtual processing functions, each with defined (max) execution timet1t2t3t4t5Time orchestration Media Source timings t0LocalPTP-lockedsources RemotePTP-lockedsources Tra n s i t d e l ay –phase shiftt0Asynchronous‘rogue’ remote sources Proxy remote production timing reconciliationCompressed lower resolution proxy images + audio (t=x)Edit, mix, tally control data (t=y)delay = transit time plus any compression etct+0t+x Audio-video Iipsync ~5msCoherent audio sync ~20usAbsolute time delivery ~20msTiming requirement examples Hybrid timing reconciliationProcessing timeProcessing timeProcessing timeOrigination timeUse timelink timelink timelink timelink timelink timeSome chain timing preservationControlsystemProvidestime coord What is needed to make this workControl systemprovidestime coordinationAll media processing devices throughout chain providenecessary information and acceptrequired configurations In-flight SMPTE RP/EG: ST2110-11Draft an Recommended Practice document that defines a workable ecosystem to provide ‘automatic’ reconciliation of media essence timing at any point along a production chain. Do consider getting involved§Send a ‘user story’ for requirements§Send in any ‘gotchas’§Join the team! Join me again later, Monday and TuesdayIP media cloud connectivityIP showcase Sunday 24thApril -15:00Facility federationIP showcase Monday 25thApril -12:305G for live productionIP showcase Tu e s d ay 2 6thApril -11:30 Thank you!Andy Rayner Chief Technologist arayner@nevion.com+44 7711 196609Come and catch up on the Sony stand C10901 in the Central Hall Any Questions?Andy Rayner Chief Technologist, Nevionarayner@nevion.com +44 7711 196609