At the recent JT-NM Tested event, automated testing of controllers for NMOS compliance took place for the first time. This talk will describe the need for controller testing and how this was added to the NMOS Testing Tool to allow it to be used at the JT-NM Tested event. Controllers on professional media networks use the AMWA NMOS protocols to perform operations such as discovering media devices on the network (IS-04) and making connections between them (IS-05), allowing media flows to be set up between different devices. The NMOS Testing Tool is a freely available open-source software development. It has been developed by AMWA members to ensure that equipment that supports NMOS conforms to the specifications correctly. It allows vendors, systems integrators, and end users to self-test their equipment and has been extremely valuable in the drive to better interoperability between different vendors’ equipment. This includes being used at JT-NM Tested events, which allow vendors to obtain a JT-NM Tested badge and an entry in a publicly available catalog describing which parts of the NMOS specifications their equipment supports. However, until recently the Testing Tool was limited to testing only NMOS nodes and registries. At the previous JT-NM Tested event, controllers were tested but this was done manually, a very time-consuming and expensive process. To address this, Sony proposed and led an AMWA activity to add controller testing to the NMOS Testing Tool. This required a different approach to node and registry testing, involving a semi-automated framework that guides the user to perform a set of steps using their controller interface and then verifies the results automatically. The new controller test suite was successfully trialled at an AMWA workshop earlier this year, allowing it to be officially introduced as part of the recent JT-NM Tested event. The new controller test suites currently test only some key IS-04 and IS-05 functionality for controllers. To clearly define what else controllers should be able to do, another AMWA activity was launched to provide better guidance for implementers. This “NMOS Controller Specification” activity resulted in the addition of clearly worded controller sections to the IS-04, IS-05 and BCP-003-01 (transport layer security) specifications and the creation of a new implementation guide for controllers, INFO-005. These documents will be used as the basis to provide further additions to the controller test suites in future. This talk describes how the new test framework was created and how to use it. It also introduces the new controller sections in the NMOS specifications and discusses how these can be used to provide further additions to the Testing Tool in future, leading to better interoperability for everyone.

View
File Type: pptx
Categories: Control and NMOS
Presenters : Rob Porter - Sony
Year : 2022
dlp_document_download : Testing Controllers for NMOS Compliance Rob Porter Sony Europe B.V. JT-NM Tested event in August 2022 used automated controller testing for the first time How did we get to this point? What is NMOS? What do we mean by a controller? What NMOS features should a controller support? What is the NMOS Testing Tool? How was automated controller testing added to the NMOS Testing Tool? How can I run the tests myself? How was it used at JT-NM Tested? What’s next for controller testing? Overview Networked Media Open Specifications Set of open APIs for managing devices on professional media networks Allow interoperability between different manufacturers’ devices Use standard RESTful APIs using HTTP GET, PUT, PATCH, DELETE with JSON payloads and WebSocket for notifications of updates What is NMOS? IS-04 – Discovery and Registration IS-05 – Connection Management IS-06 – Network Control IS-07 – Event and Tally IS-08 – Audio Channel Mapping IS-09 – System IS-10 – Authorisation BCP-002 – Grouping BCP-003 – Security BCP-004 – Receiver Capabilities What do we mean by a controller? Controller Node Node Media endpoint on the network Registry D atabase of Nodes on the network Controller Allow users to view available Nodes and make connections Registry Node style.visibility style.visibility style.visibility What NMOS features should a controller support? Controller Node Node IS-04 Registration API IS-04 Query API Registry IS-04 Registration API IS-04 Discovery & Registration style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility What NMOS features should a controller support? Controller Node Node IS-05 Connection API 1 IS-05 Connection API 2 Registry IS-05 Connection Management style.visibility style.visibility Open source software Freely available from AMWA GitHub site Developed collaboratively by AMWA members Ensures that professional media equipment conforms to the NMOS specifications correctly Allows vendors, systems integrators and end users to self-test their equipment Used at JT-NM Tested events Key tool in the drive to better interoperability What is the NMOS Testing Tool? What is the NMOS Testing Tool? IS-04 Node API IS-05 Connection API IS-04 Registration API Operator NMOS Node under Test Mock Registries Node Testing Configure Configure NMOS Testing Tool style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility How was automated controller testing added to the NMOS Testing Tool? Q&A protocol IS-04 Query API IS-05 Connection API Mock Registry and Nodes Operator NMOS Controller under Test Configure and operate Configure Answer questions Controller Testing NMOS Testing Tool NMOS Controller Testing Façade style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility style.visibility https://www.youtube.com/watch?v=cfVSSD9hQO4 (Search: NMOS Test Tool Tutorial on YouTube) How can I run the tests myself? https://specs.amwa.tv/nmos-testing/ (Search: AMWA NMOS Test Tool on Google) There have now been four JT-NM Tested events Controller testing was introduced at the third event but was a manual process Automated controller testing was introduced at this year’s event How was it used at JT-NM Tested? {5C22544A-7EE6-4342-B048-85BDC9FD1C3A} JT-NM Tested Event NMOS Node testing NMOS Registry testing NMOS Controller testing March 2019 No No No August 2019 Yes No No March 2020 (Virtual) Yes Yes Yes (Manual) August 2022 Yes Yes Yes What’s next for controller testing? September 2021 March 2022 August 2022 Controller testing roadmap September 2022 What’s next for controller testing? Controller implementation guide New Controller sections in specifications IS-04 IS-05 BCP-003-01 INFO-005 https://specs.amwa.tv Any Questions?
Downloads: 4