Hi everyone,
Last week the Editor Engagement Experiments team deployed a new extension to all wikis, Extension:Campaigns ( http://www.mediawiki.org/wiki/Extension:Campaigns).
The campaigns extension does one thing: if you add "campaign=example" to a link pointing at the account creation form, it logs the campaign name at the time of signup.
This capability has been around a long time in some form or another, but we disabled it so we could get to work on our redesign of account creation and login. Now that's it's finished, we wanted to make it available again.
There's more in the documentation I linked to above, but the general point is that this gives us a low cost, minimally invasive way to figure out how many people are coming to sign up via a particular avenue.
Among our first test cases, my team would really like to know if significant numbers of people are signing up via the links English Wikipedia puts in system messages directed at those viewing semi-protected pages and anonymous editors. I've put up a proposal about this on-wiki at https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(proposals)#Let.27s_fig...
If you have any questions about how campaigns work and how they might be applied elsewhere, please speak up. :)
Steven,
This has provoked much excitement in London! In the words of one of our staff, *"This is absolutely excellent. What we need to do is make sure all volunteer event leads are aware of this (because in my experience, they are the ones pointing people towards account creation on the day), and that there is a standard format for naming event campaigns (for example; if we called one 'editathon' then we could be conflating different event metrics if they were both editathons)"*
I thought I'd share these with this list - it's an excellent project, but we need to plan how to deal with the naming format :-)
Richard Symonds Wikimedia UK 0207 065 0992
Wikimedia UK is a Company Limited by Guarantee registered in England and Wales, Registered No. 6741827. Registered Charity No.1144513. Registered Office 4th Floor, Development House, 56-64 Leonard Street, London EC2A 4LT. United Kingdom. Wikimedia UK is the UK chapter of a global Wikimedia movement. The Wikimedia projects are run by the Wikimedia Foundation (who operate Wikipedia, amongst other projects).
*Wikimedia UK is an independent non-profit charity with no legal control over Wikipedia nor responsibility for its contents.*
On 19 June 2013 02:51, Steven Walling swalling@wikimedia.org wrote:
Hi everyone,
Last week the Editor Engagement Experiments team deployed a new extension to all wikis, Extension:Campaigns ( http://www.mediawiki.org/wiki/Extension:Campaigns).
The campaigns extension does one thing: if you add "campaign=example" to a link pointing at the account creation form, it logs the campaign name at the time of signup.
This capability has been around a long time in some form or another, but we disabled it so we could get to work on our redesign of account creation and login. Now that's it's finished, we wanted to make it available again.
There's more in the documentation I linked to above, but the general point is that this gives us a low cost, minimally invasive way to figure out how many people are coming to sign up via a particular avenue.
Among our first test cases, my team would really like to know if significant numbers of people are signing up via the links English Wikipedia puts in system messages directed at those viewing semi-protected pages and anonymous editors. I've put up a proposal about this on-wiki at https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(proposals)#Let.27s_fig...
If you have any questions about how campaigns work and how they might be applied elsewhere, please speak up. :)
-- Steven Walling https://wikimediafoundation.org/
EE mailing list EE@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ee
On Wed, Jun 19, 2013 at 2:43 AM, Richard Symonds < richard.symonds@wikimedia.org.uk> wrote:
This has provoked much excitement in London! In the words of one of our staff, *"This is absolutely excellent. What we need to do is make sure all volunteer event leads are aware of this (because in my experience, they are the ones pointing people towards account creation on the day), and that there is a standard format for naming event campaigns (for example; if we called one 'editathon' then we could be conflating different event metrics if they were both editathons)"*
I thought I'd share these with this list - it's an excellent project, but we need to plan how to deal with the naming format :-)
Glad to hear it's of use!
Regarding naming: yes, as advised in the Extension:Campaigns documentation, it's key to pick a name that is unique in order to avoid collisions with other campaigns. The only limit is that it can't be longer than 40 characters.
My team is keeping a semblance of a log of current and past campaigns at https://meta.wikimedia.org/wiki/Research:Account_creation_campaigns, if you're looking for examples of other campaign names or want a place to document your own.
On Tue, Jun 18, 2013 at 6:51 PM, Steven Walling swalling@wikimedia.orgwrote:
Among our first test cases, my team would really like to know if significant numbers of people are signing up via the links English Wikipedia puts in system messages directed at those viewing semi-protected pages and anonymous editors. I've put up a proposal about this on-wiki at https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(proposals)#Let.27s_fig...
These two campaigns have been enabled for a little over two days now. For the curious, I've gone ahead and shared preliminary results at https://meta.wikimedia.org/wiki/Research:Account_creation_campaigns/Anonymou...
Obvious caveat here is that a week's worth of data would be most reliable, since it accounts for normal behavioral changes in a working week. But I don't expect there to be a huge change in the proportions overall.
Steven,
This is really great data, esp considering our baseline for 1 ns0 edit within 24 hours is ~25%. This type of data helps push our understanding of how users come into the system.
When Dario gets back, we should take a look at these anon account creators to see what their UMAPI stats are -- I'm expecting their edits in 24 hours would be very high, like maybe 90%.
Howie
On Fri, Jun 21, 2013 at 1:54 PM, Steven Walling swalling@wikimedia.orgwrote:
On Tue, Jun 18, 2013 at 6:51 PM, Steven Walling swalling@wikimedia.orgwrote:
Among our first test cases, my team would really like to know if significant numbers of people are signing up via the links English Wikipedia puts in system messages directed at those viewing semi-protected pages and anonymous editors. I've put up a proposal about this on-wiki at https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(proposals)#Let.27s_fig...
These two campaigns have been enabled for a little over two days now. For the curious, I've gone ahead and shared preliminary results at https://meta.wikimedia.org/wiki/Research:Account_creation_campaigns/Anonymou...
Obvious caveat here is that a week's worth of data would be most reliable, since it accounts for normal behavioral changes in a working week. But I don't expect there to be a huge change in the proportions overall.
-- Steven Walling https://wikimediafoundation.org/
EE mailing list EE@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ee
On Fri, Jun 21, 2013 at 2:13 PM, Howie Fung hfung@wikimedia.org wrote:
Steven,
This is really great data, esp considering our baseline for 1 ns0 edit within 24 hours is ~25%. This type of data helps push our understanding of how users come into the system.
When Dario gets back, we should take a look at these anon account creators to see what their UMAPI stats are -- I'm expecting their edits in 24 hours would be very high, like maybe 90%.
This is a good opportunity for me to play around with uploading cohorts and running metrics on UMAPI, if I can.
In the meantime, I took a look at edit counts as stored in the enwiki user table, so across all namespaces. So far 65% of the signups via the anonymous editor notice have made an edit, and 7% have crossed the 5+ threshold, again all namespaces.
This slightly overestimates compared to what we get from UMAPI, because that is limited to just article edits. It also slightly underestimates, because I haven't given an entire 24 hours after the last signup, like we usually do to give a normalized minimum timespan for every account.
Another quick update: I've gone ahead and added the "anoneditwarning" campaign to the other nine-largest Wikipedias (de, pl, fr, es, pt, zh, ja, it, and ru). Should be interesting to see if we get the same ~10% of accounts coming from this notice.
On Tue, Jun 18, 2013 at 6:51 PM, Steven Walling swalling@wikimedia.orgwrote:
Hi everyone,
Last week the Editor Engagement Experiments team deployed a new extension to all wikis, Extension:Campaigns ( http://www.mediawiki.org/wiki/Extension:Campaigns).
The campaigns extension does one thing: if you add "campaign=example" to a link pointing at the account creation form, it logs the campaign name at the time of signup.
This capability has been around a long time in some form or another, but we disabled it so we could get to work on our redesign of account creation and login. Now that's it's finished, we wanted to make it available again.
There's more in the documentation I linked to above, but the general point is that this gives us a low cost, minimally invasive way to figure out how many people are coming to sign up via a particular avenue.
Among our first test cases, my team would really like to know if significant numbers of people are signing up via the links English Wikipedia puts in system messages directed at those viewing semi-protected pages and anonymous editors. I've put up a proposal about this on-wiki at https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(proposals)#Let.27s_fig...
If you have any questions about how campaigns work and how they might be applied elsewhere, please speak up. :)
-- Steven Walling https://wikimediafoundation.org/
I added a new graph with daily registration counts by campaign on enwiki (currently only displaying "anoneditwarning" and "logincta"):
http://ee-dashboard.wmflabs.org/dashboards/enwiki-metrics
I'll create one for the top 10 wikis next.
Dario
On Jun 25, 2013, at 11:08 PM, Steven Walling swalling@wikimedia.org wrote:
Another quick update: I've gone ahead and added the "anoneditwarning" campaign to the other nine-largest Wikipedias (de, pl, fr, es, pt, zh, ja, it, and ru). Should be interesting to see if we get the same ~10% of accounts coming from this notice.
On Tue, Jun 18, 2013 at 6:51 PM, Steven Walling swalling@wikimedia.org wrote: Hi everyone,
Last week the Editor Engagement Experiments team deployed a new extension to all wikis, Extension:Campaigns (http://www.mediawiki.org/wiki/Extension:Campaigns).
The campaigns extension does one thing: if you add "campaign=example" to a link pointing at the account creation form, it logs the campaign name at the time of signup.
This capability has been around a long time in some form or another, but we disabled it so we could get to work on our redesign of account creation and login. Now that's it's finished, we wanted to make it available again.
There's more in the documentation I linked to above, but the general point is that this gives us a low cost, minimally invasive way to figure out how many people are coming to sign up via a particular avenue.
Among our first test cases, my team would really like to know if significant numbers of people are signing up via the links English Wikipedia puts in system messages directed at those viewing semi-protected pages and anonymous editors. I've put up a proposal about this on-wiki at https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(proposals)#Let.27s_fig...
If you have any questions about how campaigns work and how they might be applied elsewhere, please speak up. :)
-- Steven Walling https://wikimediafoundation.org/
-- Steven Walling https://wikimediafoundation.org/ _______________________________________________ EE mailing list EE@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ee
here they come:
http://ee-dashboard.wmflabs.org/dashboards/top10-metrics
On Jul 1, 2013, at 1:58 PM, Dario Taraborelli dtaraborelli@wikimedia.org wrote:
I added a new graph with daily registration counts by campaign on enwiki (currently only displaying "anoneditwarning" and "logincta"):
http://ee-dashboard.wmflabs.org/dashboards/enwiki-metrics
I'll create one for the top 10 wikis next.
Dario
On Jun 25, 2013, at 11:08 PM, Steven Walling swalling@wikimedia.org wrote:
Another quick update: I've gone ahead and added the "anoneditwarning" campaign to the other nine-largest Wikipedias (de, pl, fr, es, pt, zh, ja, it, and ru). Should be interesting to see if we get the same ~10% of accounts coming from this notice.
On Tue, Jun 18, 2013 at 6:51 PM, Steven Walling swalling@wikimedia.org wrote: Hi everyone,
Last week the Editor Engagement Experiments team deployed a new extension to all wikis, Extension:Campaigns (http://www.mediawiki.org/wiki/Extension:Campaigns).
The campaigns extension does one thing: if you add "campaign=example" to a link pointing at the account creation form, it logs the campaign name at the time of signup.
This capability has been around a long time in some form or another, but we disabled it so we could get to work on our redesign of account creation and login. Now that's it's finished, we wanted to make it available again.
There's more in the documentation I linked to above, but the general point is that this gives us a low cost, minimally invasive way to figure out how many people are coming to sign up via a particular avenue.
Among our first test cases, my team would really like to know if significant numbers of people are signing up via the links English Wikipedia puts in system messages directed at those viewing semi-protected pages and anonymous editors. I've put up a proposal about this on-wiki at https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(proposals)#Let.27s_fig...
If you have any questions about how campaigns work and how they might be applied elsewhere, please speak up. :)
-- Steven Walling https://wikimediafoundation.org/
-- Steven Walling https://wikimediafoundation.org/ _______________________________________________ EE mailing list EE@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ee
On Mon, Jul 1, 2013 at 9:24 AM, Dario Taraborelli < dtaraborelli@wikimedia.org> wrote:
here they come:
*Nice!*
Thanks Dario.
Welcome back, Dario!
Thanks for these informative dashboards, which are much appreciated.
Fabrice
On Jul 1, 2013, at 9:51 AM, Steven Walling wrote:
On Mon, Jul 1, 2013 at 9:24 AM, Dario Taraborelli dtaraborelli@wikimedia.org wrote: here they come:
http://ee-dashboard.wmflabs.org/dashboards/top10-metrics
Nice!
Thanks Dario.
-- Steven Walling https://wikimediafoundation.org/ _______________________________________________ EE mailing list EE@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ee
_______________________________
Fabrice Florin Product Manager, Editor Engagement Wikimedia Foundation
http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)
Donate to keep Wikipedia free: https://donate.wikimedia.org/
Steven,
I'm putting together an internal UK 'how to' document for this extension, that explains how to use it in a non-jargon fashion. However, it appears that there's no way for us to access the data if we as a chapter run a campaign, without chasing down someone with stat1 analytics server credentials.
As soon as I start talking about stat1 analytics servers, most of the people who read the document are going to panic! Bear in mind that only two people here really know how to use bugzilla at all...
Is there a way, therefore, that we can get the reports generated in a relatively simple way? For example, someone we can email, or an auto-generated report?
Sorry to be a pain, but I'm really keen to roll this out for some of our events etc.
Richard Symonds Wikimedia UK 0207 065 0992
Wikimedia UK is a Company Limited by Guarantee registered in England and Wales, Registered No. 6741827. Registered Charity No.1144513. Registered Office 4th Floor, Development House, 56-64 Leonard Street, London EC2A 4LT. United Kingdom. Wikimedia UK is the UK chapter of a global Wikimedia movement. The Wikimedia projects are run by the Wikimedia Foundation (who operate Wikipedia, amongst other projects).
*Wikimedia UK is an independent non-profit charity with no legal control over Wikipedia nor responsibility for its contents.*
On 1 July 2013 18:06, Fabrice Florin fflorin@wikimedia.org wrote:
Welcome back, Dario!
Thanks for these informative dashboards, which are much appreciated.
Fabrice
On Jul 1, 2013, at 9:51 AM, Steven Walling wrote:
On Mon, Jul 1, 2013 at 9:24 AM, Dario Taraborelli < dtaraborelli@wikimedia.org> wrote:
here they come:
*Nice!*
Thanks Dario.
-- Steven Walling https://wikimediafoundation.org/ _______________________________________________ EE mailing list EE@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ee
Fabrice Florin Product Manager, Editor Engagement Wikimedia Foundation
http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)
Donate to keep Wikipedia free: https://donate.wikimedia.org/
EE mailing list EE@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ee
On 07/11/2013 07:21 AM, Richard Symonds wrote:
Steven,
I'm putting together an internal UK 'how to' document for this extension, that explains how to use it in a non-jargon fashion. However, it appears that there's no way for us to access the data if we as a chapter run a campaign, without chasing down someone with stat1 analytics server credentials.
You might want to follow up on the Analytics list (https://lists.wikimedia.org/mailman/listinfo/analytics). They have a public metrics tool (actively being enhanced) called WikiMetrics (https://www.mediawiki.org/wiki/Analytics/Wikimetrics).
They would probably be able to better discuss what they can currently do, and consider your use case for future work.
For reference, the relevant schema is https://meta.wikimedia.org/wiki/Schema:ServerSideAccountCreation
Matt Flaschen