6-10 October 2024
Concordia University Conference Centre
America/New_York timezone

Seeking Perfection: Challenges and Solution attempts in Implementing HLS Stream Seeking with RTP Synchronization Using GStreamer.

7 Oct 2024, 18:20
5m
Concordia University Conference Centre

Concordia University Conference Centre

1450 Guy St., Montreal, Quebec, Canada H3H 0A1

Speaker

Tokunbo Quaye

Description

At IPS, we offer product development services, with one of our specialties being mulitmedia streaming services. We are attempting to add a “seek” feature for an existing non-realtime HLS streaming service, with RTP Synchronization of 2 stream listeners
We will discuss the challenge of having the “seek” operation succeed in the Sender Pipeline but receiver pipelines stall due to RTP Jitter buffer errors. We will discuss the work-around solution that we created with Gstreamer and some of the challenges that we’re still encountering.

Challenge:
Failed utilization of RTSP - causes QOS errors in video decoder - thus receiver playback gets stalled until QOS dropped.

Attempted Solution :
Introduced a 3rd pipeline that precedes a sender pipeline that does 2 seeks. Seek is successful, except if within 10 secs of previous playback location

Suggestions for Improvement :
Make Seek feature in RTSP send a flush message to the receiver pipeline. Currently in the 1.18 version, the reset message gets dropped out of the udpsink of the sender pipeline and never processed in the RTP receiver pipeline.

Duration of the talk
Speaker bio Tokunbo Quaye and Michael Yackavage are both Principal Engineers at Intelligent Product Solutions (IPS) in Hauppauge, NY. At IPS, we offer product development services, with one of our specialties being mulitmedia streaming services. Both engineers have worked together on several streaming-related features using Gstreamer.

Primary authors

Presentation Materials

2024 Platinum Sponsor
Collabora
2024 Gold Sponsors
Arm
Google
Microsoft
NVIDIA
2024 Silver Sponsors
AMD
FEX-Emu
Igalia
Qualcomm
The Linux Foundation
2024 Bronze Sponsors
CodeWeavers
Khronos Group
Libre Computer