Transition to Microservices-based Media Processing

Presenters : Arnaud Caron - MediaKind

Year : 2019

dlp_document_download : AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 1 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 C U R A T E D B Y The transition to microservices based media processing architecture Arnaud Caron, Head of Portfolio Core Mediakind Monday, September 16 from 2:30 – 3:00pm I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Welcome to MediaKind… 2 What We Offer Global leader - media processing, delivery, and TV service platforms for Broadcasters and Cable, Satellite, Telco, and OTT TV operators Technology investor - Approximately 1,000 HC in R&D Innovation driver – Media is our passion, Consumer experience drives us Media Platforms –75+ Telco & Cable Operators with 19M subscribers Media Processing ‒2,000+ Broadcasters, Pay TV & OTT operators Media Delivery ‒60+ Cable & Telco Pay TV operators Product Delivery & Support Services Media Delivery Cloud DVR & Timeshift TV Optimized AV Additional value Content Mgmt. Sys. (CMS) Advertising & Content Rights Distribution Support and Services Media Platforms MediaFirst Mediaroom Media Processing H/W Compression S/W Compression Who We Are Segments We Serve Global footprint, diverse customer base USA UK Israel France India China Key R+D Locations AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 2 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 C U R A T E D B Y Agenda • Why are we here today? • When Video Services become Micro… I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 C U R A T E D B Y Why are we here today? AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 3 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Where the Media industry is coming from… Performance Processing Performance was judged by individual codec bandwidth savings • More channels on same network (e.g. satellite…) • Better quality of services Flexibility was a trade -off against performance Performance vs Flexibility I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 6 Media Landscape is changing … https://www.nabshow.com/thought -gallery -Tech-Talk/quality -control -monitoring -ott-workflow https://blog.technavio.com/blog/top -13-companies -in-the-over-the-top-ott-market AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 4 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Broadcast Challenges •Industry -specific interfaces ‒Impedes ability to scale and grow operation efficiently ‒Maintaining broadcast specificities: latency, reliability and uptime •Separate Broadcast & IT infrastructures ‒Increases opex and inhibits flexibility ‒Removing technical and cost barriers for scaling and evolving •New entrants able to offer compelling services, faster to market ‒How to leverage virtualization and other agile processes? ‒Enabling larger variety of commercial models 7 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 The answer: Media moving IP Cloud Native Infrastructure Operations Finance AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 5 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 The Value of Cloud Solutions 9 Up to 40% capex and opex saving opportunities Revenue growth opportunities Leverage Network and Infrastructure Infrastructure Agnostic Hardware cost reduction Streamline Services & enable Cloud Operations Full Automation Fast Time to Market Develop Business Best Customer Experience Embrace Innovation I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 10 What is so specific for Media? Transactional Flow -oriented All TV and mobile User Interfaces available in the public cloud Content and Subscriber management Personalized experience Storage -based 12GBps / live stream with few ms latency "five nines": 5.26min downtime per year! Peak traffic: 72 Tbps (~10 million DVDs per hour) – Akamai 2018 100s of PBs of storage for TV show private copy Stored "in the Cloud" & accessible from anywhere at anytime All these workloads have to work together! AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 6 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 C U R A T E D B Y When Video Services become Micro… I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Cloud – a fog of terminology 12 Microservices Containers Docker Kubernetes Virtual Machines Hypervisors Openstack Serverless AWS Azure GCP IaaS PaaS Orchestration Hypervisor Elastic Compute Unikernel Cluster Private Cloud Public Cloud Hybrid Cloud Virtual Private Cloud SDN NFV AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 7 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Appliance vs VM vs Orchestrated Containers 13 Hardware OS, Base image COTS Appliance Simple! Fixed & silo Difficult to scale HW + SW link Application Virtualized Virtualization Hypervisor OS App 1 OS App 2 Hardware COTS Decouple HW & SW Scripted deployment Easy to replicate Challenge to scale Loss of performance Inefficient deployment App 3 ??? OS ??? OS, Base image Hardware COTS App 1 App 2 Orchestration Application Registry Orchestrated (Pods of) Containers Built to scale Complete flexibility Zero loss of performance Infrastructure agnostic Virtualization optional New & unfamiliar App 3 ??? Kubelet Cont. runtime I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 14 Maintaining a Cluster September 19 14 Source: https://cloud.google.com/kubernetes -engine/kubernetes -comic/ AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 8 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Microservice applications = Separated SW components as deployable units Contrast microservices with monolithic applications •Design philosophy: Break application into a series of smaller, separately deployable units Offer natively, enables flexibility, fast technology deployment & up -to-date media operations… •More options for solution scalability •More options for service implementation •More options for containing failures and improving operational resilience •More options for incremental development and deployment Source: Forester Monolith vs Micro -service > "Micro" means as small as it should be but no smaller I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Container = Self -contained Microservices SW packaging isolated from host •Container is an operating -system -level virtualization method for running multiple isolated systems / applications (containers) on a single control host •Characteristic •Light weight (vs Hypervisor overhead) •Shared Kernel and libraries •Isolation •Self contained •Challenges •How to run and manage it at scale •Security level for isolation Virtual Machines Docker Container AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 9 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Kubernetes = deploy - scale – failover of containers Dynamic Orchestration of containers on infrastructure resources •Schedules, runs, and manages containers on virtual and physical machines •Supports "Planet Scale" without increasing your ops team •Supports more container runtimes than just Docker •100% Open source, written in Go language •Inspired and informed by Google’s experiences and internal large scale cluster system (Borg) The name is from Greek for "Helmsman" or "Pilot"; Nickname "K8s" Kubernetes is an open -source system for automating deployment, scaling, and management of containerized applications It dynamically manages resources availability, container allocation and scheduling ensuring reliability. I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 apiVersion : extensions/v1beta1 kind: Deployment metadata: name: deployment -myname spec: replicas: 2 template: metadata: labels: app: app2 location: sou annotations: prometheus.io/scrape: "true" prometheus.io/port: "9102" spec: nodeSelector : location: sou containers: - name: some -name image: busybox:1.28.1 command: [' sh', ' -c', ‘./ busybox -f /var/ tmp/dcc/component -config.yaml -pre encoder'] ports: - containerPort : 80 volumeMounts : - name: config -volume mountPath : /var/ tmp/dcc resources: requests: cpu: "500m" volumes: - name: config -volume configMap : name: cfg -RELEASE -NAME -sou-0 18 Everything as code NODE3 Node2 NODE1 Pod App2 Pod app2 Pod app1 Pod app4 Pod app 5 Pod app1 spec defines contents of each pod replicas sets the number desired each container def starts with its name image, version and resources needed ports exposed by the container labels allow matching app2.yml AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 10 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 19 Containers shipping, not a 1 -container ship • Application executable and files • Requires OS libraries • Nothing else • Minimal storage • Fast deployment •Built the right way • Application executable and files • All OS libraries • Bloat makes it large and slow to deploy •Built the wrong way I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 20 Cloud Native Architecture Analytics and Monitoring Application Management Pods of Containers Media µService Media µService Pods of Containers Media µService Media µService Container Runtime Container Runtime Bare metal Micro -services, Containers and Networking Application Management & Monitoring High -Level Management Infrastructure Kubernetes Services Kubernetes Services Open, Standard Tools Wherever Possible AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 11 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 az_1 21 Example of resilient Live OTT on Kubernetes Input sources Controller Encoding Packaging Origin Server Content Delivery Network az_2 Controller Encoding Packaging 1+1 Sync 1+1 Sync Controller pods Encoding pods Packaging pods I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 •Cloud is one key concept BUT multiple ways to enable it •IT flexibility is required BUT with Media & Broadcast attributes •Operational excellence blended with Best quality & Innovation is the new standard •Select carefully PARTNERS in this journey! •Transformation journey is not only on vendors or technologies but also on Operators mindset and organization 23 Journey? There is More Than One Way © MediaKind 2019 AIMS IP Showcase IBC 2019 September 2019 Curated by Video Services Forum vsf.tv 12 I P S H O W C A S E T H E AT R E AT I B C 2 0 1 9 : 1 3 –1 7 S E P T 2 0 1 9 Thank you Thank you to our Media Partners Arnaud Caron, Mediakind Arnaud.caron@mediakind.com 24