[Webkit-unassigned] [Bug 168467] New: A/B testing

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=168467

            Bug ID: 168467
           Summary: A/B testing
    Classification: Unclassified
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Web Template Framework
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: jfbastien at apple.com
                CC: fpizlo at apple.com, jfbastien at apple.com
            Blocks: 168453

I added a quick A/B test hack in bug #168453. We should do this better: factor it out, make it possible to A/B test other things, automatically create the random value, and prevent correlation between decisions.

I'd do the following: template<typename Int> Int abTest(uint32_t uniqueABTestValue, Int minimum, Int maximum);

This returns a value in [minimum, maximum] based on anonymous UUID, and mixes in the unique A/B test value so that each A/B test yields an independent result per user. This is important because users have their own UUID, but we don't want them to all be in the same side of each A/B test! Mixing in a unique A/B test value ensures that each A/B test skews a different way per UUID.

We need to use a simple hash function, so that from crash logs we can reconstruct which A/B test was set, and to which value.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.webkit.org/pipermail/webkit-unassigned/attachments/20170216/e54e9315/attachment.html>