Speaker
Description
At GStreamer Conference 2024 I proposed GStreamer as the ideal nervous system for feeding AI brains with data. As Python is the dominant language in AI, a new Python framework, gst-python-ml, was introduced to easily connect PyTorch models with GStreamer pipelines, with support for object detection, tracking, local speech to text and local text to speech.
This talk covers the many new features that have arrived since then, including segmentation, depth and pose estimation, OCR, optical flow, vision-language captioning, Whisper, and LLMs local and remote. PyTorch is now just one of fifteen different inference backends including ONNX, OpenVINO, LIteRT and MIGraphX, allowing us to support every conceivable ML model with ease. The framework is in active use, powering many of Collabora’s ML demos.
Along the way, we will view live demos of new vision and language features, all running on a humble consumer GPU, with a focus on sport analytics.
Speaker Bio
Aaron is a mathematician and developer who enjoys the simple pleasures of squeezing every last ounce of performance from both hardware and software. He works for Collabora and is based in Toronto, Canada.
| Duration of the talk |
|---|
