Description
Open Space
This talk will take the usual bird's eye look at what's been happening in and around GStreamer in the last release cycle(s), current challenges and look forward at what's next in the pipeline.
As the GStreamer framework continues to be a leading tool for building complex video analytic pipelines, the need for seamless interoperability across vendor components is more critical than ever. While the GstAnalytics library, introduced in GStreamer 1.24, provides a flexible foundation for representing AI-driven metadata, its very flexibility has resulted in slight differences between...
Modern devices come with multiple different hardware components that can be used for inference workflows: CPU, NPU, iGPU, dGPU, etc. The APIs to access them differ not only between the individual components and hardware vendors, but also between different platforms. To complicate the situation further, multiple hardware vendors provide extension libraries on top of GStreamer for accessing...
Abstract:
Live video streaming has become part of our daily lives. Apart from entertainment and surveillance, it is used across industries as part of perception systems for both human and non-human operators. Most commercial camera products are not designed for safety critical environments and may pose hazards that make them unfit for use in railway. We present our way to the world's first...
The webrtcbin element was first proposed upstream a little less than a decode ago and presented 9 years ago at the GStreamer conference. In that past decade, every* web browser has grown support for WebRTC and thus has the functionality for real-time audio/video streaming.
We will look at some of the existing challenges the current webrtcbin design has faced and discuss some potential...
In this talk, we will share our experience enabling production-grade Edge AI solutions on top of GStreamer. The discussion goes beyond building working video analytics pipelines and focuses on what it takes to turn them into enterprise-ready systems that can be deployed, operated, monitored, and extended reliably at the edge. We will address this through two complementary dimensions:...
In video conferencing, network conditions and how they are handled can directly impact the perceived quality at the receiving end. To measure this degradation, the correspondence between reference and presented frames must be tracked across hosts in various configurations. Rather than relying on in-band visual markers, which can be fragile under poor channel conditions, we present a...
At Pexip, we run a custom GstTracer in production as an always-on profiler that measures per-element CPU to drive our capacity planning. This talk covers why we chose the Tracing API over pad probes, and how we made the hooks light enough to leave on in production.
In this talk we'll go over the struggles of maintaining a "complicated" GStreamer application and dealing with the hangs and crashes that come with large deployments. This year we built an automated pipeline that captures crash and hang dumps from our clients' machines, resolves them against the exact GStreamer build they were running, and uses commercially available AI models to point our...
A follow up to last year's mpeg-ts talk, explaining the investigation and implementation of writing a mpeg-ts crate and demuxer in rust
The challenges and lessons learnt from using GStreamer in a highly-scalable streaming application.
The goal of real-time media processing is to minimise latency. It's the enemy, and hides in many places.
Where? Well, let's investigate, and see what tools we have to fight it with. We'll kill it with fire, or just maybe... learn to be friends?
We developed streaming infrastructure for Remote Train Operation (RTO) based on our SIL2 camera system. Cameras are installed in the cabin of a train and safely stream to a wayside driver desk where trains are controlled remotely. In the process, we encountered challenges in providing reliable streaming over lossy local and wireless (5G) networks. Finally, we overcame several challenges of...
At Spiideo, we work with sports clubs and leagues to help them analyze and broadcast games. We install cameras at their venues and process the video to add object detection and autofollow capabilities, ingesting 4K H.264/H.265 video over SRT.
We do not control the network infrastructure at these sites, and we're not going to ask sports clubs to open all "ephemeral outgoing UDP ports" on...
In the last months, there has been a lot of reporting on LLM-based tooling easily finding dozens of security vulnerabilities in open source software. Projects like the Linux kernel or curl are well known to have been hit by this heavily, with many discussions about the usefulness and validity of these reports and how this flood of reports can be handled. As GStreamer is used in many safety...
