[webkit-changes] [WebKit/WebKit] 184286: [WebCodecs] AudioDecoder and AudioData support

[Philippe Normand]

  Branch: refs/heads/main
  Home:   https://github.com/WebKit/WebKit
  Commit: 1842861b125b97a693e2f4aa6bcd70e02b0b5bce
      https://github.com/WebKit/WebKit/commit/1842861b125b97a693e2f4aa6bcd70e02b0b5bce
  Author: Philippe Normand <philn at igalia.com>
  Date:   2023-08-25 (Fri, 25 Aug 2023)

  Changed paths:
    M LayoutTests/TestExpectations
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-data-serialization.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-data.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-data.any.worker-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-data.crossOriginIsolated.https.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-decoder.crossOriginIsolated.https.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-decoder.crossOriginIsolated.https.any.worker-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-decoder.https.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-decoder.https.any.worker-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audio-encoder.https.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any.worker_adts_aac-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any.worker_mp3-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any.worker_mp4_aac-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any.worker_opus-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any.worker_pcm_alaw-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any.worker_pcm_mulaw-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any_adts_aac-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any_mp3-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any_mp4_aac-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any_opus-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any_pcm_alaw-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/audioDecoder-codec-specific.https.any_pcm_mulaw-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/chunk-serialization.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/encoded-audio-chunk.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/encoded-audio-chunk.any.worker-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/encoded-audio-chunk.crossOriginIsolated.https.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/encoded-audio-chunk.crossOriginIsolated.https.any.worker-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/idlharness.https.any-expected.txt
    M LayoutTests/imported/w3c/web-platform-tests/webcodecs/idlharness.https.any.worker-expected.txt
    M LayoutTests/platform/glib/TestExpectations
    A LayoutTests/platform/glib/imported/w3c/web-platform-tests/webcodecs/audio-data.any-expected.txt
    A LayoutTests/platform/glib/imported/w3c/web-platform-tests/webcodecs/audio-data.any.worker-expected.txt
    M Source/WTF/Scripts/Preferences/UnifiedWebPreferences.yaml
    M Source/WebCore/CMakeLists.txt
    M Source/WebCore/DerivedSources.make
    M Source/WebCore/Headers.cmake
    A Source/WebCore/Modules/webcodecs/AudioSampleFormat.idl
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioData.cpp
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioData.h
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioData.idl
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDataAlgorithms.cpp
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDataAlgorithms.h
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDataOutputCallback.h
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDataOutputCallback.idl
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDecoder.cpp
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDecoder.h
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDecoder.idl
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDecoderConfig.h
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDecoderConfig.idl
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDecoderSupport.h
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioDecoderSupport.idl
    A Source/WebCore/Modules/webcodecs/WebCodecsAudioInternalData.h
    A Source/WebCore/Modules/webcodecs/WebCodecsEncodedAudioChunk.cpp
    A Source/WebCore/Modules/webcodecs/WebCodecsEncodedAudioChunk.h
    A Source/WebCore/Modules/webcodecs/WebCodecsEncodedAudioChunk.idl
    A Source/WebCore/Modules/webcodecs/WebCodecsEncodedAudioChunkData.h
    A Source/WebCore/Modules/webcodecs/WebCodecsEncodedAudioChunkType.h
    A Source/WebCore/Modules/webcodecs/WebCodecsEncodedAudioChunkType.idl
    M Source/WebCore/Modules/webcodecs/WebCodecsEncodedVideoChunk.idl
    M Source/WebCore/Modules/webcodecs/WebCodecsVideoDecoder.idl
    M Source/WebCore/Modules/webcodecs/WebCodecsVideoEncoder.idl
    M Source/WebCore/Modules/webcodecs/WebCodecsVideoFrame.idl
    M Source/WebCore/Sources.txt
    M Source/WebCore/WebCore.xcodeproj/project.pbxproj
    M Source/WebCore/bindings/js/SerializedScriptValue.cpp
    M Source/WebCore/bindings/js/SerializedScriptValue.h
    M Source/WebCore/bindings/js/WebCoreBuiltinNames.h
    M Source/WebCore/dom/EventTargetFactory.in
    A Source/WebCore/platform/AudioDecoder.cpp
    A Source/WebCore/platform/AudioDecoder.h
    A Source/WebCore/platform/AudioSampleFormat.h
    M Source/WebCore/platform/SourcesGStreamer.txt
    A Source/WebCore/platform/audio/PlatformRawAudioData.cpp
    A Source/WebCore/platform/audio/PlatformRawAudioData.h
    A Source/WebCore/platform/audio/gstreamer/AudioDecoderGStreamer.cpp
    A Source/WebCore/platform/audio/gstreamer/AudioDecoderGStreamer.h
    A Source/WebCore/platform/audio/gstreamer/PlatformRawAudioDataGStreamer.cpp
    A Source/WebCore/platform/audio/gstreamer/PlatformRawAudioDataGStreamer.h
    M Source/WebCore/platform/graphics/displaylists/DisplayListReplayer.h
    M Source/WebCore/platform/graphics/gstreamer/GStreamerCommon.cpp
    M Source/WebCore/platform/graphics/gstreamer/GStreamerCommon.h
    M Source/WebCore/platform/graphics/gstreamer/GStreamerRegistryScanner.cpp
    M Source/WebCore/platform/graphics/gstreamer/GUniquePtrGStreamer.h
    M Source/WebCore/platform/sql/SQLiteFileSystem.cpp
    M Source/WebKit/Shared/WebCoreArgumentCoders.serialization.in
    M Source/WebKit/WebProcess/WebPage/WebPage.cpp

  Log Message:
  -----------
  [WebCodecs] AudioDecoder and AudioData support
https://bugs.webkit.org/show_bug.cgi?id=259874
<rdar://problem/113823411>

Reviewed by Youenn Fablet.

This patch provides an initial implementation of the AudioDecoder and AudioData objects as defined
by the WebCodecs spec. Platform implementations are provided for the GStreamer ports.

The WebCodecsEnabled setting was renamed to WebCodecsVideoEnabled and a new WebCodecsAudioEnabled
setting was added, on by default for GStreamer ports.

Canonical link: https://commits.webkit.org/267278@main