On Mon, Sep 14, 2015 at 1:12 PM, Erik Bernhardson
<ebernhardson(a)wikimedia.org> wrote:
Last week we started up a new AB test[1] comparing the
existing completion
suggestions against a new completion suggestion API. This very simply puts
1 in 10000 users into the test bucket, and a further 1 in 10000 users into
the control bucket like so:
if ( oneIn( 10000 ) ) {
// test bucket
} else if ( oneIn ( 10000 ) ) {
// sample bucket
} else {
return; // rejected
}
This actually puts 1/10,000 of your users in the test bucket, and
0.9999/10,000 in the control bucket.
What you really want is `else if ( oneIn( 9999 ) ) {` for the second clause.
--scott
--
(
http://cscott.net)