<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN"
"http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head><meta http-equiv="content-type" content="text/html; charset=utf-8" />
<title>[185676] trunk/Websites/perf.webkit.org</title>
</head>
<body>
<style type="text/css"><!--
#msg dl.meta { border: 1px #006 solid; background: #369; padding: 6px; color: #fff; }
#msg dl.meta dt { float: left; width: 6em; font-weight: bold; }
#msg dt:after { content:':';}
#msg dl, #msg dt, #msg ul, #msg li, #header, #footer, #logmsg { font-family: verdana,arial,helvetica,sans-serif; font-size: 10pt; }
#msg dl a { font-weight: bold}
#msg dl a:link { color:#fc3; }
#msg dl a:active { color:#ff0; }
#msg dl a:visited { color:#cc6; }
h3 { font-family: verdana,arial,helvetica,sans-serif; font-size: 10pt; font-weight: bold; }
#msg pre { overflow: auto; background: #ffc; border: 1px #fa0 solid; padding: 6px; }
#logmsg { background: #ffc; border: 1px #fa0 solid; padding: 1em 1em 0 1em; }
#logmsg p, #logmsg pre, #logmsg blockquote { margin: 0 0 1em 0; }
#logmsg p, #logmsg li, #logmsg dt, #logmsg dd { line-height: 14pt; }
#logmsg h1, #logmsg h2, #logmsg h3, #logmsg h4, #logmsg h5, #logmsg h6 { margin: .5em 0; }
#logmsg h1:first-child, #logmsg h2:first-child, #logmsg h3:first-child, #logmsg h4:first-child, #logmsg h5:first-child, #logmsg h6:first-child { margin-top: 0; }
#logmsg ul, #logmsg ol { padding: 0; list-style-position: inside; margin: 0 0 0 1em; }
#logmsg ul { text-indent: -1em; padding-left: 1em; }#logmsg ol { text-indent: -1.5em; padding-left: 1.5em; }
#logmsg > ul, #logmsg > ol { margin: 0 0 1em 0; }
#logmsg pre { background: #eee; padding: 1em; }
#logmsg blockquote { border: 1px solid #fa0; border-left-width: 10px; padding: 1em 1em 0 1em; background: white;}
#logmsg dl { margin: 0; }
#logmsg dt { font-weight: bold; }
#logmsg dd { margin: 0; padding: 0 0 0.5em 0; }
#logmsg dd:before { content:'\00bb';}
#logmsg table { border-spacing: 0px; border-collapse: collapse; border-top: 4px solid #fa0; border-bottom: 1px solid #fa0; background: #fff; }
#logmsg table th { text-align: left; font-weight: normal; padding: 0.2em 0.5em; border-top: 1px dotted #fa0; }
#logmsg table td { text-align: right; border-top: 1px dotted #fa0; padding: 0.2em 0.5em; }
#logmsg table thead th { text-align: center; border-bottom: 1px solid #fa0; }
#logmsg table th.Corner { text-align: left; }
#logmsg hr { border: none 0; border-top: 2px dashed #fa0; height: 1px; }
#header, #footer { color: #fff; background: #636; border: 1px #300 solid; padding: 6px; }
#patch { width: 100%; }
#patch h4 {font-family: verdana,arial,helvetica,sans-serif;font-size:10pt;padding:8px;background:#369;color:#fff;margin:0;}
#patch .propset h4, #patch .binary h4 {margin:0;}
#patch pre {padding:0;line-height:1.2em;margin:0;}
#patch .diff {width:100%;background:#eee;padding: 0 0 10px 0;overflow:auto;}
#patch .propset .diff, #patch .binary .diff {padding:10px 0;}
#patch span {display:block;padding:0 10px;}
#patch .modfile, #patch .addfile, #patch .delfile, #patch .propset, #patch .binary, #patch .copfile {border:1px solid #ccc;margin:10px 0;}
#patch ins {background:#dfd;text-decoration:none;display:block;padding:0 10px;}
#patch del {background:#fdd;text-decoration:none;display:block;padding:0 10px;}
#patch .lines, .info {color:#888;background:#fff;}
--></style>
<div id="msg">
<dl class="meta">
<dt>Revision</dt> <dd><a href="http://trac.webkit.org/projects/webkit/changeset/185676">185676</a></dd>
<dt>Author</dt> <dd>rniwa@webkit.org</dd>
<dt>Date</dt> <dd>2015-06-17 16:23:51 -0700 (Wed, 17 Jun 2015)</dd>
</dl>
<h3>Log Message</h3>
<pre>Update ReadMe.md and Install.md per database changes
https://bugs.webkit.org/show_bug.cgi?id=146076
Reviewed by Darin Adler.
Updated.
* Install.md:
* ReadMe.md:</pre>
<h3>Modified Paths</h3>
<ul>
<li><a href="#trunkWebsitesperfwebkitorgChangeLog">trunk/Websites/perf.webkit.org/ChangeLog</a></li>
<li><a href="#trunkWebsitesperfwebkitorgInstallmd">trunk/Websites/perf.webkit.org/Install.md</a></li>
<li><a href="#trunkWebsitesperfwebkitorgReadMemd">trunk/Websites/perf.webkit.org/ReadMe.md</a></li>
</ul>
</div>
<div id="patch">
<h3>Diff</h3>
<a id="trunkWebsitesperfwebkitorgChangeLog"></a>
<div class="modfile"><h4>Modified: trunk/Websites/perf.webkit.org/ChangeLog (185675 => 185676)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/Websites/perf.webkit.org/ChangeLog 2015-06-17 23:20:27 UTC (rev 185675)
+++ trunk/Websites/perf.webkit.org/ChangeLog 2015-06-17 23:23:51 UTC (rev 185676)
</span><span class="lines">@@ -1,5 +1,17 @@
</span><span class="cx"> 2015-06-17 Ryosuke Niwa <rniwa@webkit.org>
</span><span class="cx">
</span><ins>+ Update ReadMe.md and Install.md per database changes
+ https://bugs.webkit.org/show_bug.cgi?id=146076
+
+ Reviewed by Darin Adler.
+
+ Updated.
+
+ * Install.md:
+ * ReadMe.md:
+
+2015-06-17 Ryosuke Niwa <rniwa@webkit.org>
+
</ins><span class="cx"> Increase the popup dismissal time from 100ms to 500ms
</span><span class="cx"> https://bugs.webkit.org/show_bug.cgi?id=146077
</span><span class="cx">
</span></span></pre></div>
<a id="trunkWebsitesperfwebkitorgInstallmd"></a>
<div class="modfile"><h4>Modified: trunk/Websites/perf.webkit.org/Install.md (185675 => 185676)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/Websites/perf.webkit.org/Install.md 2015-06-17 23:20:27 UTC (rev 185675)
+++ trunk/Websites/perf.webkit.org/Install.md 2015-06-17 23:23:51 UTC (rev 185676)
</span><span class="lines">@@ -32,7 +32,6 @@
</span><span class="cx">
</span><span class="cx"> 1. Change DocumentRoot to `/Volumes/Data/perf.webkit.org/public/`
</span><span class="cx"> 2. Uncomment `"LoadModule php5_module libexec/apache2/libphp5.so"`
</span><del>- 3. Disable directives for CGI-Executables
</del><span class="cx">
</span><span class="cx"> - In Mavericks and later, copy php.ini to load pdo_pgsql.so pgsql.so.
</span><span class="cx"> `sudo cp /Applications/Server.app/Contents/ServerRoot/etc/php.ini /etc/`
</span><span class="lines">@@ -67,39 +66,39 @@
</span><span class="cx">
</span><span class="cx"> We recommend protection via Digest Auth on https connection.
</span><span class="cx">
</span><del>-Generate a password file via `htdigest -c <path> <realm> <username>`, and then create admin/.htaccess with:
</del><ins>+Generate a password file via `htdigest -c <path> <realm> <username>`, and then create admin/.htaccess with the following directives
+where `<Realm>` is replaced with the realm of your choice, which will be displayed on the username/password input box:
</ins><span class="cx">
</span><del>- AuthType Digest
- AuthName "<Realm>"
- AuthDigestProvider file
- AuthUserFile "<Realm>"
- Require valid-user
</del><ins>+```
+AuthType Digest
+AuthName "<Realm>"
+AuthDigestProvider file
+AuthUserFile "<Realm>"
+Require valid-user
+```
</ins><span class="cx">
</span><del>-where <Realm> is replaced with the realm of your choice, which will be displayed on the username/password input box.
-
-
</del><span class="cx"> # Configuring PostgreSQL
</span><span class="cx">
</span><span class="cx"> 1. Create database: `/Applications/Server.app/Contents/ServerRoot/usr/bin/initdb /Volumes/Data/perf.webkit.org/PostgresSQL`
</span><del>-2. Start database:
- `/Applications/Server.app/Contents/ServerRoot/usr/bin/pg_ctl -D /Volumes/Data/perf.webkit.org/PostgresSQL
- -l logfile -o "-k /Volumes/Data/perf.webkit.org/PostgresSQL" start`
</del><ins>+2. Start database: `/Applications/Server.app/Contents/ServerRoot/usr/bin/pg_ctl -D /Volumes/Data/perf.webkit.org/PostgresSQL -l logfile -o "-k /Volumes/Data/perf.webkit.org/PostgresSQL" start`
</ins><span class="cx">
</span><span class="cx"> ## Creating a Database and a User
</span><span class="cx">
</span><span class="cx"> The binaries located in PostgreSQL's directory, or if you're using Server.app in /Applications/Server.app/Contents/ServerRoot/usr/bin/
</span><span class="cx">
</span><del>-1. Create a database: `createdb webkit-perf-db -h localhost`
-2. Create a user: `createuser -P -S -e webkit-perf-db-user -h localhost`
-3. Connect to database: `psql webkit-perf-db -h localhost`
</del><ins>+1. Create a database: `/Applications/Server.app/Contents/ServerRoot/usr/bin/createdb webkit-perf-db -h localhost`
+2. Create a user: `/Applications/Server.app/Contents/ServerRoot/usr/bin/createuser -P -S -e webkit-perf-db-user -h localhost`
+3. Connect to database: `/Applications/Server.app/Contents/ServerRoot/usr/bin/psql webkit-perf-db -h localhost`
</ins><span class="cx"> 4. Grant all permissions to the new user: `grant all privileges on database "webkit-perf-db" to "webkit-perf-db-user";`
</span><span class="cx"> 5. Update database/config.json.
</span><span class="cx">
</span><span class="cx"> ## Initializing the Database
</span><span class="cx">
</span><span class="cx"> Run `database/init-database.sql` in psql as `webkit-perf-db-user`:
</span><del>-`psql webkit-perf-db -h localhost --username webkit-perf-db-user -f init-database.sql`
</del><ins>+`/Applications/Server.app/Contents/ServerRoot/usr/bin/psql webkit-perf-db -h localhost --username webkit-perf-db-user -f init-database.sql`
</ins><span class="cx">
</span><span class="cx"> ## Making a Backup of the Database
</span><span class="cx">
</span><del>-Run `/Applications/Server.app/Contents/ServerRoot/usr/bin/pg_dump -h localhost --no-owner -f <filepath> safari-perf-db`
</del><ins>+Run `/Applications/Server.app/Contents/ServerRoot/usr/bin/pg_dump -h localhost --no-owner -f <filepath> webkit-perf-db | gzip > backup.gz`
+
+To restore, setup a new database and run `gunzip backup.gz | /Applications/Server.app/Contents/ServerRoot/usr/bin/psql webkit-perf-db -h localhost --username webkit-perf-db-user`
</ins></span></pre></div>
<a id="trunkWebsitesperfwebkitorgReadMemd"></a>
<div class="modfile"><h4>Modified: trunk/Websites/perf.webkit.org/ReadMe.md (185675 => 185676)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/Websites/perf.webkit.org/ReadMe.md 2015-06-17 23:20:27 UTC (rev 185675)
+++ trunk/Websites/perf.webkit.org/ReadMe.md 2015-06-17 23:23:51 UTC (rev 185676)
</span><span class="lines">@@ -84,7 +84,7 @@
</span><span class="cx">
</span><span class="cx"> To submit the results of a new test to an instance of the app, you need the following:
</span><span class="cx">
</span><del>- - A builder already added on `/admin/builders`
</del><ins>+ - A slave on `/admin/slaves`
</ins><span class="cx"> - A script that submits a JSON payload of the supported format via a HTTP/HTTPS request to `/api/report`
</span><span class="cx">
</span><span class="cx"> JSON Format
</span><span class="lines">@@ -93,8 +93,9 @@
</span><span class="cx"> The JSON submitted to `/api/report` should be an array of dictionaries, each of which should
</span><span class="cx"> contain the following key-value pairs representing a single run of tests on a single build:
</span><span class="cx">
</span><del>-- `builderName` - The name of a builder present on `/admin/builders`.
-- `builderPassword` - The password associated with the builder.
</del><ins>+- `builderName` - The name of a builder. A single slave may submit to multiple builders.
+- `slaveName` - The name of a slave present on `/admin/slaves`.
+- `slavePassword` - The password associated with the slave.
</ins><span class="cx"> - `buildNumber` - The string that uniquely identifies a given build on the builder.
</span><span class="cx"> - `buildTime` - The time at which this build started in **UTC** (Use ISO time format such as
</span><span class="cx"> 2013-01-31T22:22:12.121051). This is completely independent of timestamp of repository revisions.
</span><span class="lines">@@ -113,13 +114,18 @@
</span><span class="cx"> in the application.
</span><span class="cx"> - `tests` - A dictionary of tests; the same format as this dictionary.
</span><span class="cx">
</span><del>-A sample JSON:
</del><ins>+In the example below, we have the top-level test named "PageLoadTime". It measures two metrics: `Time` and `FrameRate`.
+`Time` metric is the arithmetic mean of each subtest's `Time` metric (webkit.org and www.w3.org).
+The computed arithmetic means are `[965.6, 981.35, 947.15]` in this case.
+The test also reports `FrameRate` but this metric is measured only for the entire suite not per each subtest.
</ins><span class="cx">
</span><ins>+```json
</ins><span class="cx"> [{
</span><span class="cx"> "buildNumber": "651",
</span><span class="cx"> "buildTime": "2013-01-31T22:22:12.121051",
</span><del>- "builderName": "bot-111",
- "builderPassword": "********",
</del><ins>+ "builderName": "Trunk Mountain Lion Performance Tests",
+ "slaveName": "bot-111",
+ "slavePassword": "somePassword",
</ins><span class="cx"> "platform": "Mountain Lion",
</span><span class="cx"> "revisions": {
</span><span class="cx"> "OS X": {
</span><span class="lines">@@ -131,29 +137,34 @@
</span><span class="cx"> }
</span><span class="cx"> },
</span><span class="cx"> "tests": {
</span><del>- "PageLoadingTest": {
</del><ins>+ "PageLoadTime": {
</ins><span class="cx"> "metrics": {
</span><del>- "Time": [
- "Arithmetic",
- "Geometric"
- ]
- },
</del><ins>+ "Time": ["Arithmetic"],
+ "FrameRate": {
+ "current": [31, 24, 29]
+ }
+ }
</ins><span class="cx"> "tests": {
</span><span class="cx"> "webkit.org": {
</span><span class="cx"> "metrics": {
</span><span class="cx"> "Time": {
</span><del>- "current": [
- 629.1,
- 654.8,
- 598.9
- ]
</del><ins>+ "current": [629.1, 654.8, 598.9]
</ins><span class="cx"> }
</span><del>- }
</del><ins>+ },
+ "url": "https://webkit.org/"
</ins><span class="cx"> },
</span><del>- "url": "http://www.webkit.org/"
- }
- }
</del><ins>+ "www.w3.org": {
+ "metrics": {
+ "Time": {
+ "current": [1302.1, 1307.9, 1295.4]
+ }
+ },
+ "url": "https://www.w3.org/"
+ },
+ },
+ },
</ins><span class="cx"> }
</span><span class="cx"> }]
</span><ins>+```
</ins><span class="cx">
</span><span class="cx"> FIXME: Add a section describing how the application is structured.
</span></span></pre>
</div>
</div>
</body>
</html>