24-26 September 2023
Palexco
Europe/Madrid timezone

Developing Low latency Video Telephony solutions using GStreamer

26 Sep 2023, 12:05
30m
Room 1 (Palexco)

Room 1

Palexco

Speaker

Devarsh Thakkar

Description

GStreamer provides a powerful and flexible way to develop streaming media applications for use-cases such as Video Telephony, Live Audio/Video streaming, Video Conferencing e.t.c, by supporting plugins which utilize both hardware accelerated media components present in SoC and also supporting software based processing entities.

To ensure good overall user experience on such streaming media applications, there are various quality factors to ensure both at user-space and kernel-space level such as those related to maintaining Audio/Video Sync, Latency optimization & Performance fine-tuning, Detecting and avoiding Video Frame Skip, Audio distortion & Clipping, maintaining Audio/Video Quality and Error recovery e.t.c to ensure good overall user experience. The talk will go through above design considerations and also cover how to prototype, debug and optimize such low latency audio/video streaming application.

Taking a TI K3 based SoC as a reference example for prototyping the video telephony use-case, the talk will go through the basic building blocks of the video telephony use-case covering relevant concepts involved for each component from GStreamer and underlying Linux kernel frameworks perspective.

Lastly it will cover tools & techniques for testing, debugging, stabilizing and optimizing such solutions.

Speaker bio Devarsh Thakkar works as an Embedded Linux developer at Texas Instruments. He has been working on Linux media infrastructure involving Audio/Video based device drivers and multimedia frameworks such as Gstreamer since 2014 and has contributed to open source projects such as Linux kernel, Gstreamer, libdrm and Yocto.

Primary author

Presentation Materials

2024 Platinum Sponsor
Collabora
2024 Gold Sponsors
Arm
Google
Microsoft
NVIDIA
2024 Silver Sponsors
AMD
FEX-Emu
Igalia
Qualcomm
The Linux Foundation
2024 Bronze Sponsors
CodeWeavers
Khronos Group
Libre Computer