[webkit-dev] Hosting precompiled `jsc` binaries for Linux

[Lucas Forschler]

Hi Mathias,

Apple does not maintain the linux buildbot infrastructure. We already have all necessary support for hosting these archives on s3 (through the WebKit Build Archives). The plumbing exists and is functional. It would be up to the port maintainers to change their infrastructure to use them. The GTK bots currently do extra work to AVOID putting their archives on build.webkit.org <http://build.webkit.org/> and S3.  Carlos might be able to speak more to this.

Lucas


> On Dec 8, 2017, at 9:30 AM, Mathias Bynens <mths at google.com> wrote:
> 
> Would Apple be open to providing these downloads directly? Between Igalia, Bocoup, and this thread, there seems to be some demand for it
> 
> On Fri, Dec 8, 2017 at 6:23 PM, Konstantin Tokarev <annulen at yandex.ru <mailto:annulen at yandex.ru>> wrote:
>  
> 08.12.2017, 20:18, "JF Bastien" <jfb at chromium.org <mailto:jfb at chromium.org>>:
>> Also, as we discussed on the github bug the JSC binary is available as part of the WebAssembly waterfall that Google maintains at wasm-stat.us <http://wasm-stat.us/>
>>  
>> The build is pretty straightforward:
>> https://github.com/WebAssembly/waterfall/blob/7cda260b8ea5264900624a4cdc45df2c9e2de010/src/build.py#L943 <https://github.com/WebAssembly/waterfall/blob/7cda260b8ea5264900624a4cdc45df2c9e2de010/src/build.py#L943>
> 
> FWIW, it's easy to extend this script to work for Windows and Linux too by replacing -DPORT=Mac with -DPORT=JSCOnly
>  
>>  
>>  
>> I understand that you've got a policy of only taking "official" binaries. The GTK team would be the official maintainer of the Linux port? There's an official jsc binary is available on MacOS :-)
>>  
>>  
>> On Fri, Dec 8, 2017 at 9:07 AM, Lucas Forschler <lforschler at apple.com <mailto:lforschler at apple.com>> wrote:
>> Hi Mathias,
>>  
>> The Linux archives could be exposed on the build-archives page. In fact, we already store the output of the builders in S3. However, the igalia team only uploads a small file with a pointer to their internal builds. If I recall, they have limited bandwidth, and prefer to store their builds behind their firewall to save on external traffic to buildbot/s3.
>>  
>> If you look here <https://build.webkit.org/builders/GTK%20Linux%2064-bit%20Release%20(Build)/builds/7832> you will see a ‘transfer-to-s3’ build step.
>> The archive the builder creates is uploaded, here is a sample <https://s3-us-west-2.amazonaws.com/archives.webkit.org/gtk-x86_64-release/225678.zip>.
>>  
>> Opening that up shows the location where the archive is stored:
>> Built product is available here:
>> http://webkitgtk-release.igalia.com/built-products/release_r225678_b7832.zip <http://webkitgtk-release.igalia.com/built-products/release_r225678_b7832.zip>
>>  
>> I cannot reach that link, so I would assume it’s behind the igalia firewall. If the GTK team wanted to support making these accessible, they have everything they need. They could either choose to open up their firewall so external folks could access them. Or, they could put full archives on build.webkit.org <http://build.webkit.org/> (which would be transferred to s3/webkit build archives).
>>  
>> Maybe someone over there would be willing to take on this work if it is in their budget. (Both time and bandwidth)
>>  
>> Lucas
>>  
>>  
>>  
>>> On Dec 8, 2017, at 12:44 AM, Mathias Bynens <mths at google.com <mailto:mths at google.com>> wrote:
>>>  
>>> Dear WebKit friends,
>>>  
>>> Please consider hosting precompiled `jsc` binaries for Linux somewhere official. Perhaps https://webkit.org/build-archives/ <https://webkit.org/build-archives/>? The build bots already generate those binaries anyway — all that’s missing is an additional build step that archives and uploads them.
>>>  
>>> Doing so would make it easier for developers to test JSC directly, or to include JSC when running benchmarks such as the Web Tooling Benchmark (ref. https://github.com/v8/web-tooling-benchmark/pull/29#discussion_r155587697 <https://github.com/v8/web-tooling-benchmark/pull/29#discussion_r155587697>).
>>>  
>>> I recently built a tool that automates the process of installing precompiled binaries for various JS engines: https://github.com/GoogleChromeLabs/jsvu <https://github.com/GoogleChromeLabs/jsvu> It’d be great to be able to support JavaScriptCore on linux32 and linux64 as well!
>>>  
>>> Prior discussion: https://bugs.webkit.org/show_bug.cgi?id=179945#c11 <https://bugs.webkit.org/show_bug.cgi?id=179945#c11>
>>>  
>>> Regards,
>>> Mathias
>>> _______________________________________________
>>> webkit-dev mailing list
>>> webkit-dev at lists.webkit.org <mailto:webkit-dev at lists.webkit.org>
>>> https://lists.webkit.org/mailman/listinfo/webkit-dev <https://lists.webkit.org/mailman/listinfo/webkit-dev>
>> _______________________________________________
>> webkit-dev mailing list
>> webkit-dev at lists.webkit.org <mailto:webkit-dev at lists.webkit.org>
>> https://lists.webkit.org/mailman/listinfo/webkit-dev <https://lists.webkit.org/mailman/listinfo/webkit-dev>
>>  
>> ,
>> _______________________________________________
>> webkit-dev mailing list
>> webkit-dev at lists.webkit.org <mailto:webkit-dev at lists.webkit.org>
>> https://lists.webkit.org/mailman/listinfo/webkit-dev <https://lists.webkit.org/mailman/listinfo/webkit-dev> 
>  
> -- 
> Regards,
> Konstantin
>  
> 
> _______________________________________________
> webkit-dev mailing list
> webkit-dev at lists.webkit.org <mailto:webkit-dev at lists.webkit.org>
> https://lists.webkit.org/mailman/listinfo/webkit-dev <https://lists.webkit.org/mailman/listinfo/webkit-dev>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-dev/attachments/20171208/988053ff/attachment.html>