5-6 October 2022
University of St Thomas Opus Hall
US/Central timezone
IN-PERSON ATTENDEES AND SPEAKERS, RE-READ "ATTENDING FOSSXR" CAREFULLY AS WE UPDATED THE INDICATIONS TO GET THERE

Visual-inertial tracking for Monado

6 Oct 2022, 15:50
45m
Schulze Hall ( University of St Thomas Opus Hall)

Schulze Hall

University of St Thomas Opus Hall

46 S 11th St, Minneapolis, MN 55403, USA
Main Track Afternoon session

Speaker

Mateo de Mayo (Collabora)

Description

Tracking the pose of an XR device in space is a core feature of any XR stack. Visual-inertial methods have become very popular in the hardware of recent years. These methods are applied on devices with one or more cameras and an IMU, they have revolutionized VR and AR by making it possible to abandon the usage of external sensors for tracking completely. Unfortunately, the systems used in production for the main hardware and software platforms are closed source. In this talk, we will present the work made on top of Monado, the open-source OpenXR runtime, to build a solid foundation for visual-inertial tracking for XR. The talk will cover the integration effort of different open-source SLAM/VIO systems from academia, like Basalt, into Monado and the devices that can now use it. We will cover the fundamental theoretical and practical problems these kinds of systems face, with a focus on the specific issues the XR domain brings to the table. A broad overview of the open tools, metrics, and datasets developed alongside this effort will be presented as well as our future plans to keep improving and expanding on this.

Presentation Materials

2023 Platinum Sponsor
Igalia
2023 Gold Sponsors
Google
Collabora
Arm
Microsoft
2023 Silver Sponsors
FEX-Emu
The Linux Foundation
AMD
2023 Bronze Sponsors
Khronos Group
CodeWeavers
2023 Supporters
A Coruña Turismo
GPUL
Raspberry Pi