Speaker
Description
Game engines serve a broad community of creators, but multimedia needs can outgrow the capabilities and extensibility of their built-in players. As part of an independent exploration of how GStreamer could help, and following earlier community efforts in this area, I have been developing experimental plugins for Unity, Godot, and Unreal Engine to explore both the opportunities and the practical barriers.
After a brief overview of how game engines prepare and deliver media across target platforms, this talk shares progress from that investigation, using cross-platform hardware-accelerated VP9 playback and video with transparency as concrete targets. Selected examples from Android and Apple platforms will illustrate graphics interoperability challenges and the improvements they motivated in GStreamer. I will also share lessons about runtime integration and authoring workflows, with brief examples of audio integration and timed text in Unreal as a step toward accessibility.
The talk will close with the work needed for dependable adoption: extending automated testing to mobile platforms with Remote Check, and remaining questions about runtime overhead and compact builds tailored to a game’s needs. The aim is to share findings and invite collaboration toward media support that game creators can extend and depend on.
Speaker Bio
I spent 10 years on Unity’s audio/video team, preceded by 18 years at Autodesk developing tools for film production. I then set out to independently explore GStreamer as a multimedia backend for game engines, initially giving myself a year. My work focuses on the capabilities, integration, and reliability needed to make media support more open and extensible for game creators.
| Duration of the talk |
|---|
