Jan:

We do not have a "framework" to do A/B testing but we do have a proposal we  in which we have been working together with ops:

https://phabricator.wikimedia.org/T135762

In the absence of a framework product teams instrument code with EventLogging and gather data for the experiment group. Normally experiments are done in small wikis in which you could, for example, enable a feature for 50% of users and use the other 50% as your control. 

Thanks,

Nuria




On Mon, Jun 27, 2016 at 4:19 PM, Jan Dittrich <jan.dittrich@wikimedia.de> wrote:
Hello Analytics,

Is there any standard implementation for split testing ("AB-Testing") that is used or should be used?
I researched a bit on mediawiki.org but could not find any information on this. (Ideally, I'd use a javascript based solution but PHP will be OK, too)

Kind Regards,
 Jan

--
Jan Dittrich
UX Design/ User Research

Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Phone: +49 (0)30 219 158 26-0
http://wikimedia.de

Imagine a world, in which every single human being can freely share in the sum of all knowledge. That‘s our commitment.

Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

_______________________________________________
Analytics mailing list
Analytics@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics