So far, most people have not been able to use XR for significant periods of time, to replace our phones or computers, or just to allow us to do our work in a more ergonomic and intuitive fashion wherever we are. A massive roadblock is that we have not had a display server that is built around the constraints and freedoms XR brings, while providing better interaction with all the software you already run in 2D. 2D display servers are not perfect either, XR offers opportunities to fix some of the issues they contain. This talk will introduce Stardust XR, a display server that is being developed to make interactions with your computer through XR useful, account for more accessibility needs than existing desktops and display servers, and let you customize in a much more intuitive manner. It supports 2D apps through Wayland, and will support better interaction of 3D applications through OpenXR.