Studies of ST 2110 and NMOS in an On–Premise Cloud

Presenters : Peter Brightwell - BBC

Year : 2019

dlp_document_download : AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 1 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 C U R A T E D B Y BBC Studies of ST 2110 and NMOS for an On -Premise Cloud Peter Brightwell BBC I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Overview •Why cloud? Why on -premise? •BBC Cloud -Fit Production project •Our R&D cloud environment •Experiments •Challenges for 2110 •Relationship with NMOS •What next? 2 AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 2 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Why migrate to IP? •Future proofing for new content formats •Support new ways of working •Enable dynamic assignment of resources •Scale facilities more easily •Support multi -site and multi -tenant workflows •Benefit from adopting COTS hardware on generic platform I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 A survey at NTS 2019… What innovative way of working would bring the biggest benefit to your organisation ? AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 3 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Broadcast Centre Public and on -premise Edit Public cloud availability zone Studio Playout On-prem cloud I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 On -premise cloud Current cost models for public cloud not realistic for many productions Potential to minimise power consumption Need for specialisation •Low latencies •Fast access to huge amounts of local content •High bandwidths •"Non -typical" equipment You know where your data is …in practice both on -premise and public cloud will be likely AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 4 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 BBC Cloud -Fit Production Highly parallel approach for use with on -premise or public clouds Computing, network and storage are abstracted as resources, deployed through services: • Distributed • User -defined • Highly -available • API -based www.bbc.co.uk/rd/projects/cloud -fit-production I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Media Object Store (Squirrel) •Parallelised storage of streams •Dividing into objects and load balancing allow scalability •Database allows easy access •S3 API supported by most cloud frameworks AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 5 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Media File Ingest (Magpie) •Chunker breaks up source file •Reader queues chunks into Media Store •Grain Headers provide IDs and timestamps I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 10 Stream Packaging Service (Otter) •Fetcher gets objects from Media Store •Dispatcher turns them into streams ‒First work has used FFMpeg ‒2110 -based Dispatcher in development AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 6 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 BBC R&D’s prototype cloud Allows us to deploy wherever is required •Isolated networking and compute •Multi -tenanted •Containerised applications Automated and repeatable •Wipe and rebuild in minutes 11 Learn from data centre architectures •Leaf -and -spine •Multi -chassis LAG •BGP -EVPN / VXLAN overlay Avoid lock -in •Open source tooling •Non -proprietary networking •COTS hardware I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 OpenStack Open source framework often used to self -provide clouds Created in 2010 by NASA and Rackspace Used by: CERN, telcos , Adobe, Blizzard, Oath… APIs provide infrastructure as a service ("IaaS") Not (necessarily) an all -in-one solution •Can be used with third party components, e.g. Ceph object storage, vmware hypervisor AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 7 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 8 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Automation with Ansible 16 AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 9 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Salford London I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 •Uncompressed capture and stream through BBC’s IP Studio network •Gateway with kernel bypass ( netmap ) •Local Ceph cluster with 30 nodes •1080/i25 video frames www.bbc.co.uk/rd/blog/ 2019 -03-live -video -ingest -aws -openstack -cloud 18 Experiments with our on -premise cloud AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 10 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 19 Ceph Dashboard I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 20 We are here… …should we, can we, get here? ST 2110 environm en t Gat ewa y On- pr em ise cl oud PTP AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 11 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Challenges observed with virtualising ST 2110 endpoints •Available compute performance varies over time and with host loading •Virtualised NIC performance too poor to meet -21 constraints •Directly attached NIC performs better but lacks flexibility •Bridged network provides a compromise by did not work well with VXLAN •SR -IOV differences between NICs affects virtual function performance Effect is to make 2110 -21 compliant working on virtualised platforms difficult 21 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Improving the performance Use SR -IOV Bypass the kernel ( netmap , DPKD) Off -load functionality onto the NIC •Packet pacing •Kernel bypass •Packet aggregation •VXLAN overlay These come at the cost of increasing complexity and may restrict choice of vendors 22 AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 12 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Further challenges Broadcast live IP combines several requirements that aren’t typical in many cloud scenarios •IGMP multicast •PTP based timing •2022 -7 resilience patterns •Minimal latency •Dedicated resourcing 23 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 What about NMOS? NMOS could be confined to the ST 2110 environment… •Gateway is a Node …or could extend into the cloud •Which would need an IS -04 Registry •This could be in switch or compute Within the cloud, other service discovery frameworks may become more relevant In any case, hooking into wider orchestration will become important 24 NMOS NMOS ST 2110 environm en t Gat ewa y On- pr em ise cl oud PTP AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 13 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 What are we doing next? •Building the London cloud •Learning from vendor deployment frameworks •Integrating aspects of these into our OpenStack cloud •2110 output with Stream Packaging Service •Building and trialling more cloud -fit components •Considering the service discovery question •(With EBU) Broadcaster requirements for automation and orchestration 25 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Thank you Thank you to our Media Partners Peter Brightwell, BBC peter.brightwell@bbc.co.uk www.bbc.co.uk /rd 26