We do not have a "framework" to do A/B testing but we do have a proposal we  in which we have been working together with ops:


In the absence of a framework product teams instrument code with EventLogging and gather data for the experiment group. Normally experiments are done in small wikis in which you could, for example, enable a feature for 50% of users and use the other 50% as your control. 



On Mon, Jun 27, 2016 at 4:19 PM, Jan Dittrich <jan.dittrich@wikimedia.de> wrote:
Hello Analytics,

Is there any standard implementation for split testing ("AB-Testing") that is used or should be used?
I researched a bit on mediawiki.org but could not find any information on this. (Ideally, I'd use a javascript based solution but PHP will be OK, too)

Kind Regards,

Jan Dittrich
UX Design/ User Research

Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Phone: +49 (0)30 219 158 26-0

Imagine a world, in which every single human being can freely share in the sum of all knowledge. That‘s our commitment.

Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

Analytics mailing list