[Webkit-unassigned] [Bug 229752] New: [WebXR] Support Raw Camera Access in WebXR

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=229752

            Bug ID: 229752
           Summary: [WebXR] Support Raw Camera Access in WebXR
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: WebXR
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: andj2223 at gmail.com

Raw camera access is important for many XR usecases. The quoted text and source links below explain further.
Though this is currently a draft spec, it would be great to get the ball rolling sooner than later on supporting this in Webkit.

> Granting the camera access to the application could allow the applications to:
>
> * Take a snapshot of the AR experience along with application-rendered content. This is mostly relevant for scenarios where the camera image serves as the background for application's content (for example handheld AR).
> * Allow the application to overlay some render effects over the entire scene.
> * Provide feedback to the user about the environment they are located in. This may be particularly useful for VR headsets with available cameras (for example WMR headsets and the Flashlight feature). Note: this use case is not addressed by the current proposal - see Immersive Web CG discussions section.
> * Run custom computer vision algorithms on the data obtained from the camera texture. It may for example enable applications to semantically annotate regions of the image, for example to provide features related to accessibility.
> * Remote (server side) rendering where there is a need to sync a remotely rendered result to the camera output.

Sources:
Spec: https://immersive-web.github.io/raw-camera-access/
Explainer: https://github.com/immersive-web/raw-camera-access/blob/main/explainer.md
A github issue outlining some usecases for raw camera access: https://github.com/immersive-web/raw-camera-access/issues/7

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20210901/ea78ae9e/attachment.htm>