[Webkit-unassigned] [Bug 160685] New: Video tags can not be used for input to Canvas/WebGL on iOS

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=160685

            Bug ID: 160685
           Summary: Video tags can not be used for input to Canvas/WebGL
                    on iOS
    Classification: Unclassified
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: iOS
                OS: iOS 9.3
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Media Elements
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: gman at chromium.org

At some point it seems like Safari on iOS made it so video playback always happens fullscreen.

This is a problem for apps that are trying to use the video a source to a canvas or a webgl texture.

I don't know what problem was trying to be solved here. Maybe it was trying to make sure videos have a nice UX. Unfortunately it seems to have broken apps that use video as an input source like p5.js does often.

Is there any chance this can be fixed? Maybe check if the video is `display: none` and then let it play in the background? Or some new attribute that tells iOS Safari the video will be used for processing and not for direct on screen playback?

Note: people have found one hacky workaround which is as follows

make both a video and audio tag. Set both to the same source. Play the audio tag. Every rAF do `video.currentTime = audio.currentTime`. This magically works but seems very fragile and hacky.

Example http://webglsamples.org/video/video.html

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.webkit.org/pipermail/webkit-unassigned/attachments/20160809/2e7cdf85/attachment.html>