On 23 June 2014 10:41, Tomasz Finc <tfinc@wikimedia.org> wrote:

On Fri, Jun 20, 2014 at 3:29 PM, Maryana Pinchuk <mpinchuk@wikimedia.org> wrote:
I think we'll want to let the changes simmer for another week or two and then dig into a few specific things:

Yes. We really need more data to make future decisions.
 
1) Do the pageview stats hold? e.g., are we still getting relatively few opt-outs?

Do we have this in LIMN ?

Nope, just static reports at the moment. Given the speedy nature of the request (Both figuratively - there was a narrow window to produce it - and literally, because I wrote most of the code while travelling through Oregon at 85 MP/H) I'm not tremendously confident in the ability of the code to indefinitely generate data.
 
2) How has this change impacted new mobile user numbers (registrations, 1st time editors, active editors, etc.)? Early results[1] show a healthy spike in new signups coming from mobile in the past few days, and we need to keep track of these users to make sure they're going through the new and active editor funnels at a reasonable rate.

Great. I tried to find any other metrics on the ee dashboard but I just got a white page. Do you have a better link for us? I looked on the mobile report card and found this which just can't be right

 
3) How does the heatmap of taps look? e.g., how often are people accessing hamburger menu items, language selection, history, etc.

 
Eager to see the write ups of this.

Based on the data from the above, we could do some UX optimization – the designers are very keen to refine the UI for page actions (instead of dumping features like language selection and page history at the top/bottom of the page kind of at random). If the new and active editor conversion rates are low, we'll need to prioritize work on new contribution funnels, but realistically that's probably not something we'll be able to tackle until Q2 of next fiscal.

That makes sense. Great work thus far.

--tomasz



--
Oliver Keyes
Research Analyst
Wikimedia Foundation