CirrusSearch collects data on 1 in 200 search sessions, sometimes that is
increased to say 1:100 and the extra users are split into buckets as part
of the AB test using this javascript:
On Thu, Sep 8, 2016 at 11:26 AM, James Forrester <jforrester(a)wikimedia.org>
wrote:
On Wed, 7 Sep 2016 at 00:16 Jan Dittrich
<jan.dittrich(a)wikimedia.de>
wrote:
Hello Analytics,
A while ago I asked about the existence of any A/B-Testing Framework. I
got to know (Thanks, Nuria!) that
https://phabricator.wikimedia.
org/T135762 is in preparation. However, I assume, that until this is in
place, we need to use custom solutions which utilize EventLogging.
Event logging itself is pretty clear to me, but not the splitting/cookie
logic.
Could anybody link me some examples for such a self implemented way to
show users their assigned content and, if they are not assigned to a group
yet, to assign users to A/B… bins?
Here's the code for MW-VE to add a proportion of new accounts to have VE
on by default, used when slowly ramping up deployment or for an A/B test:
https://phabricator.wikimedia.org/diffusion/EVED/
browse/master/VisualEditor.hooks.php;7fe96fc2380743b4e63f4bb7c03e2e
bf2b2e1038$964 — hope that helps.
J.
--
James D. Forrester
Lead Product Manager, Editing
Wikimedia Foundation, Inc.
jforrester at
wikimedia.org
<https://lists.wikimedia.org/mailman/listinfo/wikimedia-l> | @jdforrester
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics