Open XR support

[Aggror]

We have an OpenCollective Project for OpenXR. But we need some more details on what, how, why.

• What needs to be done to support/improve OpenXR?
• What are the bare minimum functionalities?
• What issues are developers currently experiencing?
• Documentation (could be a separate bounty/project)

[tebjan]

Just some thoughts:

As we started integrating OpenXR into Stride, our primary focus was on DX11, with Vulkan functioning at approximately 90% completion. A minor issue involving the Silk wrapper was encountered towards the end of the project, which should be relatively straightforward to resolve.

Our progress hit constraints related to time and budget, which led to the incomplete state of the Vulkan and no D12 backend. To advance this integration, we should prioritize addressing these remaining issues.

Regarding the bare minimum functionalities for OpenXR support, it would be particularly interesting to look at compatibility with mobile platforms, android and iOS.

Furthermore, it would be good if Happenstance could articulate their specific requirements, use cases, and expectations. This would aid in aligning the development efforts with the needs of the community.

[Keepsie]

The OpenXR support in Stride has some functionality, but there are issues. Crashes and "not implemented" tags will probably become bigger headaches as more people start experimenting. It needs to be polished and tested properly.

Vulkan is a must-have, especially since it's key for desktop, Android, and the emerging iOS XR scene. I don't know about the benefits of DX12 with VR.

The VR documentation on the site has been pretty decent for me. However:
I can't get the camera to rotate, so I cannot do any snap or smooth turning which is basically a critical bug.

I took a break from it for a bit, focusing on our current project. But I'll be diving back in during my free time each week.

I see Stride as the top VR choice outside of Unity. Super excited about its potential. Once our current project wraps up, I'm looking to jump into the next one with Stride, which is why I'm trying to get everything squared away now.

Overall, I need to dive into the backend more. I’m too ignorant about how things work so, I can only help so much on that front.

[tebjan]

Yes, good points:

• Fix Vulkan
• DX12 not necessary
• Check VR workflow with OpenXR and mobile

[Starkium]

Agreed with above about vulkan for mobile. Another big need is going to be occlusion culling. In this case it'll need to be a software occlusion method since mobile will be very gpu constrained already. These were the biggest things that were affecting UE5 devs for a while.

There's plenty of other features that go a long way for XR, but I think the above are likely the bare minimum to get started. I'll update my post if something else comes to mind.

[Aggror]

Hi @MaximilianEmel, Thank you for your interst in this topic. I did reach out to @tamamutu for this topic 1 month ago (3rd october) and he was interested in taking a look as well. However, I didn't hear from him since then. I send him a reminder on the 31st of oct, but no response on that either.
Would it be possible for you to wait 1 more day before you start working on it? It would be such a shame if there is actually some work done on it already. I just send them a message for confirmation.

[Aggror]

@MaximilianEmel You are good to go. I will now reserve this topic on your name.

[Eideren]

Hiding this comment as Maximilian is no longer working on this from what we could gather, if anyone wants to take over feel free !

[Starkium]

checking in, any news on progress?

[Starkium]

uh, hello?