Enabling a Different Piece of Hardware, a Story

The Xilinx Zynq UltraScale+ MPSoC is a uniquely flexible yet powerful chip due to the combination of an FPGA fabric with hardened blocks such as ARM Cortex-A53 and Mali-400 MP2 cores as well as high performance H.264/H.265 codec. We'll explain the different challenges we faced at Collabora to integrate GStreamer on the Zynq and achieve high end performances pipelines: multi-streams 4k60 transcoding, sub-frame latency encoding and decoding, etc. This talk will also explain how we implemented new hardware specific features like scene change detection using GStreamer and existing frameworks (video4linux, OMX). Guillaume has been working for more than 10 years at Collabora and been involved in various parts of the GNOME project. He's now part of Collabora's multimedia team and has gained great interest in the Rust language, hoping it will save him from having to use C for the upcoming next 10 years.