Speakers
Description
As the GStreamer framework continues to be a leading tool for building complex video analytic pipelines, the need for seamless interoperability across vendor components is more critical than ever. While the GstAnalytics library, introduced in GStreamer 1.24, provides a flexible foundation for representing AI-driven metadata, its very flexibility has resulted in slight differences between various implementations, hindering the creation of truly plug-and-play analytics pipelines.
This talk presents a collaborative effort by Intel, Collabora, and Milestone Systems to develop a unified convention for GstAnalytics metadata, ensuring consistent interpretation and consumption across the ecosystem. We will introduce a comprehensive set of guidelines that standardize the use of GstAnalytics relations for linking object detections, classifications, keypoints, and segmentation data.
Daniel Morin will present key challenge in this effort: striking the right balance between specificity and generality, where the convention needed to be concrete enough to guarantee interoperability between independently developed component, yet general enough to avoid over-fitting to a specific industry use-cases.
To demonstrate the power of this standardized approach, we will cover two significant industry adoptions:
1. Intel's DL Streamer: We will showcase how Intel has transitioned its DL Streamer framework from custom metadata formats to this new GstAnalytics convention, enabling broader compatibility with the GStreamer ecosystem.
2. Milestone Systems' License Plate Recognition Integration Case Study: We will present a practical development use case exploring the challenges and lessons learned while integrating analytics components from multiple vendors. By combining components from Intel DL Streamer and Milestone within the same container, we will discuss the requirements and design decisions involved in enabling analytics metadata produced by one vendor to be consumed by another.
Through a demonstration (recorded video) of a complete License Plate Recognition (LPR) solution using the pipeline vmssrc → gvamotiondetect → vmslpr → gvatrack → vmsmetadataexpose, we will show how GstAnalytics metadata serves as a common language between elements.
Attendees will leave with a clear understanding of the new GstAnalytics proposed conventions, the integration challenges encountered, and see firsthand how industry leaders are building the next generation of seamless, cross-vendor video analytics workflows.
Speaker Bio
Oskar Fiedot: AI Software Engineer working at Intel Corporation on Intel Deep Learning Streamer (DLStreamer) and upstream GStreamer development, building computer vision and AI inference solutions powered by OpenVINO. My work includes multimedia pipelines, analytical metadata systems, and integrating AI workloads into high-performance multimedia frameworks.
Pep Cots is a Principal Software Engineer at Milestone Systems, where he works on high-performance edge video analytics and large-scale video surveillance solutions. He began his career in video game development before expanding into robotics, industrial automation, and manufacturing systems. Today, he focuses on designing scalable analytics platforms, leveraging technologies such as GStreamer to deliver real-time video analytics for enterprise and critical infrastructure deployments worldwide.
Daniel Morin is a Senior Software Engineer at Collabora
He's been working on multimedia systems and video analytics for more then 10 years. In 2022, he joined the multimedia team at Collabora as a senior software developer and leads the efforts on adding machine learning and analytics support to GStreamer.
| Duration of the talk |
|---|
