The goal of this talk is to summarize the recent year of xrdesktop development and showcase capabilities for the upcoming 0.16 release.
A part of that will be our stand alone VR Wayland compositor wxrd, the virtual 3DUI keyboard with localization support and a focus on the industry standard OpenXR API.
I will show the ability of xrdesktop to display virtual environments and run on embedded...
Hand tracking will be as important for XR as the touchscreen is for mobile. It adds to the illusion of presence and provides the primary user input method. Ultraleap is a proud supporter of the FOSS movement, from providing FOSS plugins for Unity and Unreal to open sourcing the North Star headset. In this session we will cover the latest developments in Ultraleap's hand tracking, including how...
Monado-based demo of a Hand-tracking + SLAM setup running on the northstar
LÖVR is an open source Lua framework for creating VR games and applications. This will be a demo of a VR time travel debugger and text editor, built with LÖVR.
I'm a contributor to the Libre-SOC project, which aims to build a chip with lots of peripherals. And it's a VPU. And it's a 3D GPU powered by Vulkan so it could run Monado. By contrast mobile HMDs such as the Meta Quest use nonlibre SOCs such as the Qualcomm Snapdragon XR2. A VR headset and its controllers also need tracking, in the case of the Valve Index this is implemented using a...
While Open Source software is generally straightforward to setup without capital, it's much more difficult to do so for hardware. There are a number of limitations that make large scale open source XR hardware challenging, like Minimum Order Quantities, NDA agreements for chip and component definitions, and the upfront cost of manufacturing, testing and shipping the finished products.
Led...
Monado-based demo of a Hand-tracking + SLAM setup running on the northstar
LÖVR is an open source Lua framework for creating VR games and applications. This will be a demo of a VR time travel debugger and text editor, built with LÖVR.
This talk will go through the current state of the FOSS XR, covering the general state and focusing on the Monado project.
This talk will go through the lifetime for a OpenXR application frame, then delving deeper into how a OpenXR runtime interacts with the display system. The talk is meant to provide food for thought in terms of designing app frame timing and pacing for windowing system. It will also go through the current APIs for display content on screen.
Project North Star is an open source AR headset that sits at the center of a community of enthusiasts building and improving on it. This talk interviews a number of members of that community in order to celebrate their work and understand how it affected their lives.
Monado-based demo of a Hand-tracking + SLAM setup running on the northstar
LÖVR is an open source Lua framework for creating VR games and applications. This will be a demo of a VR time travel debugger and text editor, built with LÖVR.
As AR and VR have matured, optical hand tracking has emerged as the default human-computer interaction method - it's simple, intuitive, and requires no extra hardware. However, it is complicated to implement and had required proprietary hardware and software. As a part of Monado, the open-source OpenXR runtime, Collabora has developed a fully open-source optical hand tracking pipeline that's...
We will present an XR testbed called ILLIXR (Illinois Extended Reality testbed), an open-source end-to-end XR system. ILLIXR supports XR perception, visual, and audio subsystems, consisting of state-of-the-art sensors and components (e.g., visual inertial odometry, scene reconstruction, asynchronous reprojection, and 3D spatial audio encoding and decoding), all orchestrated through a flexible...
Is there anything you can do if there's a VR device you've always wanted to try but can't afford, since it's enterprise-only? One option is to just build it yourself.
This talk explores the viability of DIY alternatives for inaccessible VR technologies, through the story of the LucidGloves project. A project for open-source VR haptic gloves, with finger tracking and force feedback that can...
Over the past 3 years, I have been working on implementing positional tracking for Oculus Rift headsets. This talk will go through the Rift constellation system, and the differences between the older DK2/CV1 devices and the newer Rift S. It will touch on reverse engineering an unknown headset protocol, and what we understand of talking to Rift devices. Finally, I'll talk about progress on the...
Monado-based demo of a Hand-tracking + SLAM setup running on the northstar
LÖVR is an open source Lua framework for creating VR games and applications. This will be a demo of a VR time travel debugger and text editor, built with LÖVR.
Opengloves was previously a Windows only, OpenVR driver for DIY VR gloves. During my GSoC internship working on Monado, I ported the driver to Linux, making it compatible with OpenXR. Combined with hand tracking, the gloves also support force feedback, presenting unique challenges with implementing interfaces to handle new technologies.
Opengloves only handles controllers; presenting...
xrdesktop aims to provide an XR desktop experience not just on typical "VR ready" PCs but also on smaller systems.
What does it take to run xrdesktop's wxrd standalone client, or xrdesktop's gnome-shell, or kwin integration on a Nvidia Jetson board? On a Raspberry Pi?
After an overview over how xrdesktop implements taking windows into XR, this talk will present the solved and still open...
Following FOSSXR 2019 both XR and the Web evolved. The latest buzzword introduced in late 2021 seems like an intangible abstraction. What actually is the metaverse and why does the Web is the perfect place for it to start?
This talk will clarify what changed since 2019, both technically, software and hardware with a specific on FLOSS efforts, from all teams.
The goal is to highlight gaps...
presentation : context : in Europe, GDPR is in place since 2016, with enforcement since 2018 (cool down period of 2 year)
EUCJ has issued in 2020 arrest that scrapped the "safe harbor" treaty challenging the use of US tech services in the countries of the union.
In this context, and in the probable incoming of other privacy protecting laws in the US and elsewhere, the development of VR...
StereoKit is a lightweight, code-first, open-source library for building Mixed Reality experiences using C#/C++ and OpenXR! It provides easy APIs to address some of the most common and challenging aspects of development including UI, inputs, interactions, physics, shaders/material systems, working with text, asset loading, and much more. StereoKit is designed to work on Windows/Linux/Android,...
How to open source XR interactions, despite the prevailing pedantic paper paradigm, for the inclusion of more human potential and expression in the world. This will be demonstrated through computing towards an interaction design concept. Proving things out with turing-tested first principles engineering, employing the abstract mechanics of vector and quaternion math and exporting the...
This year the Khronos OpenXR Working Group has finalized several important parts of the OpenXR ecosystem for Android-based devices, both all-in-one headsets and runtimes that work on already-released phones. There are several parts that make this work, and they are all open source and maintained in a community fashion. In this talk, I will present the basic parts of the OpenXR on Android...
Current XR interactions are usually only accessible in specific positions, making them difficult to be used while relaxed and often inaccessible to people with disabilities. This is the case despite 3D tracking technology allowing the creation of new comfortable ways to interface with a system. In this talk, I will explain how we can use tracked body parts to create accessible user interfaces...
Monado-based demo of a Hand-tracking + SLAM setup running on the northstar
LÖVR is an open source Lua framework for creating VR games and applications. This will be a demo of a VR time travel debugger and text editor, built with LÖVR.
Tracking the pose of an XR device in space is a core feature of any XR stack. Visual-inertial methods have become very popular in the hardware of recent years. These methods are applied on devices with one or more cameras and an IMU, they have revolutionized VR and AR by making it possible to abandon the usage of external sensors for tracking completely. Unfortunately, the systems used in...
Godot Engine is one of the fastest growing fully open source (MIT License) game engines. With Godot 4.0 now in beta, a Vulkan-native OpenXR capable ecosystem is finally here, bringing XR content creation tools rivaling the industry incumbents Unreal and Unity.
"Godot provides a huge set of common tools, so you can just focus on making your game without reinventing the wheel. Godot is...
Scientific visualization has long benefited from the use of immersive technologies (XR), going back to when XR hardware was expensive, and usually found only in research labs. The eruption of lower-cost, consumer XR technology benefits not only the gaming community, but has also increased the potential benefits to science and other "serious" pursuits.
ParaView, a popular open-source...
