Hello Analytics,
Is there any standard implementation for split testing ("AB-Testing") that is used or should be used? I researched a bit on mediawiki.org but could not find any information on this. (Ideally, I'd use a javascript based solution but PHP will be OK, too)
Kind Regards, Jan
Jan:
We do not have a "framework" to do A/B testing but we do have a proposal we in which we have been working together with ops:
https://phabricator.wikimedia.org/T135762
In the absence of a framework product teams instrument code with EventLogging and gather data for the experiment group. Normally experiments are done in small wikis in which you could, for example, enable a feature for 50% of users and use the other 50% as your control.
Thanks,
Nuria
On Mon, Jun 27, 2016 at 4:19 PM, Jan Dittrich jan.dittrich@wikimedia.de wrote:
Hello Analytics,
Is there any standard implementation for split testing ("AB-Testing") that is used or should be used? I researched a bit on mediawiki.org but could not find any information on this. (Ideally, I'd use a javascript based solution but PHP will be OK, too)
Kind Regards, Jan
-- Jan Dittrich UX Design/ User Research
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Phone: +49 (0)30 219 158 26-0 http://wikimedia.de
Imagine a world, in which every single human being can freely share in the sum of all knowledge. That‘s our commitment.
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics