Dear Dan,

Thanks so much for your prompt response, much appreciated!

Gilles and/or Mark, what do you recommend we do to update our metrics dashboards quickly, during this critical time?

I also look forward to your thoughts on the research questions below, now that we have lots of pilot data to base our answers on.

-f

On May 1, 2014, at 8:40 AM, Dan Andreescu dandreescu@wikimedia.org wrote:

db1047 (where all the event logging data is being replicated to) is still lagging and we'll update the thread on the analytics list when it's done.

In the meantime, you can switch your queries from s1 to a new box that's caught up already. Here's a similar change I submitted for the mobile web team to consider:

https://gerrit.wikimedia.org/r/#/c/130833/1/mobile/config.yaml

On Thu, May 1, 2014 at 11:37 AM, Fabrice Florin fflorin@wikimedia.org wrote: Hi guys,

Any word from analytics as to when the Media Viewer metrics dashboards will be updated? Is the EventsLogging migration almost done? Now is the time when we need this data. :)

http://multimedia-metrics.wmflabs.org/dashboards/mmv

Also, do we have enough data now to define acceptance performance criteria for Media Viewer and complete card #149?

https://wikimedia.mingle.thoughtworks.com/projects/multimedia/cards/149

Other research questions which we would like to answer based on pilot results include:

• how fast do images load?

I think we now have enough data to make a statement, both on a global and local basis, with breakdowns for warm and cold caches, as well as large images. Want to take a first stab at it, or want me to?

• does performance improve with more users?

It would be great if we could confirm our hypothesis that images load faster when more users are clicking on them.

• any slowdowns during peak hours?

Do we have any data that would show what happens during peak hours? Would this require us to create hourly dashboards in a few pilot sites?

• is the overall performance acceptable?

This question can be answered once we define acceptable performance criteria. It could also be confirmed to some extent by survey responses, particularly if we see a decrease in complaints about the speed.

To that end, I will do another sweep at latest survey results and compile more results tomorrow on this page: https://www.mediawiki.org/wiki/Multimedia/Media_Viewer/Survey

Look forward to discussing these questions together in coming days, based on the data now on hand.

Thanks,

Fabrice

---

Fabrice Florin Product Manager Wikimedia Foundation

http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

_______________________________

Fabrice Florin Product Manager Wikimedia Foundation

http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

Hi Mark,

Thanks so much for applying Dan’s proposed fix so quickly!

As discussed, I am puzzled by the numbers on these updated graphs:

http://multimedia-metrics.wmflabs.org/dashboards/mmv#actions-graphs-tab

Global image views used to be up above 3 million on Sunday 4/27, after the launch to 9 new pilot sites but before the outage (1). However, they now only appear to be 2 million. And the decline is surprising, compared to other pilot launches where image views keep increasing.

Also, local image views on the Polish Wikipedia used to be above 1 million on the same date before the outage, but are now down to 500k for the same date:

http://multimedia-metrics.wmflabs.org/dashboards/mmv_plwiki

Dan, Gilles or others, any ideas what’s going on — and how we can get the metrics back on track? I’m Cc:ing Analytics in case others have some insights that could help us.

We’re launching today on French and Dutch Wikipedias, and would like to have stable metrics to discuss with our communities.

Thanks for any help you can provide. :)

Fabrice

(1) https://www.mediawiki.org/wiki/Multimedia/Media_Viewer/Release_Plan#Pilots

On May 1, 2014, at 9:19 AM, Mark Holmquist mtraceur@member.fsf.org wrote:

On Thu, May 01, 2014 at 11:40:08AM -0400, Dan Andreescu wrote:

...

https://gerrit.wikimedia.org/r/#/c/130833/1/mobile/config.yaml

I've done this on stat1003; we don't have any of yer high-falutin' config files in the multimedia analytics repos.

Thanks for the suggestion :)

-- Mark Holmquist Software Engineer, Multimedia Wikimedia Foundation mtraceur@member.fsf.org https://wikimediafoundation.org/wiki/User:MHolmquist _______________________________________________ Multimedia mailing list Multimedia@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/multimedia

On May 1, 2014, at 8:40 AM, Dan Andreescu dandreescu@wikimedia.org wrote:

db1047 (where all the event logging data is being replicated to) is still lagging and we'll update the thread on the analytics list when it's done.

In the meantime, you can switch your queries from s1 to a new box that's caught up already. Here's a similar change I submitted for the mobile web team to consider:

https://gerrit.wikimedia.org/r/#/c/130833/1/mobile/config.yaml

On Thu, May 1, 2014 at 11:37 AM, Fabrice Florin fflorin@wikimedia.org wrote: Hi guys,

Any word from analytics as to when the Media Viewer metrics dashboards will be updated? Is the EventsLogging migration almost done? Now is the time when we need this data. :)

http://multimedia-metrics.wmflabs.org/dashboards/mmv

Also, do we have enough data now to define acceptance performance criteria for Media Viewer and complete card #149?

https://wikimedia.mingle.thoughtworks.com/projects/multimedia/cards/149

Other research questions which we would like to answer based on pilot results include:

• how fast do images load?

I think we now have enough data to make a statement, both on a global and local basis, with breakdowns for warm and cold caches, as well as large images. Want to take a first stab at it, or want me to?

• does performance improve with more users?

It would be great if we could confirm our hypothesis that images load faster when more users are clicking on them.

• any slowdowns during peak hours?

Do we have any data that would show what happens during peak hours? Would this require us to create hourly dashboards in a few pilot sites?

• is the overall performance acceptable?

This question can be answered once we define acceptable performance criteria. It could also be confirmed to some extent by survey responses, particularly if we see a decrease in complaints about the speed.

To that end, I will do another sweep at latest survey results and compile more results tomorrow on this page: https://www.mediawiki.org/wiki/Multimedia/Media_Viewer/Survey

Look forward to discussing these questions together in coming days, based on the data now on hand.

Thanks,

Fabrice

---

Fabrice Florin Product Manager Wikimedia Foundation

http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

_______________________________

Fabrice Florin Product Manager Wikimedia Foundation

http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

I have cc-ed the eventlogging-alerts list. I think the best path to go forward is to check back your numbers once an alert has been sent to the list saying that replication issues are resolved.

As Dan said most of analytics team should be traveling Monday but ops should be able to send a note to the list once replication issues are mostly resolved.

Thanks,

Nuria

On Thu, May 1, 2014 at 6:51 PM, Dan Andreescu dandreescu@wikimedia.orgwrote:

As discussed, I am puzzled by the numbers on these updated graphs:

...

I wish I had time to look into this more thoroughly but I'm swamped today. Also, most of the analytics team will be in Zurich starting Monday and we'll only be back after May 12th.

The best advice I can offer is to compare data from the two databases for the graphs where you see discrepancies. It's possible that replication lag / problems are still happening. Please report any bugs in bugzilla under the EventLogging component.

---

Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

Fabrice,

Issues with event logging replication were resolved, the data should now accurately reflect your usage.

Thanks,

Nuria

On Sun, May 4, 2014 at 8:49 PM, Fabrice Florin fflorin@wikimedia.orgwrote:

Thanks, Nuria,

Much appreciated.

Look forward to getting notified when replication issues are resolved.

We’re still puzzling over the strange dip shown on this graph, which we cannot explain, after checking with community members in the current pilot sites.

http://multimedia-metrics.wmflabs.org/dashboards/mmv

Last weekend, this graph showed 3 million image views globally, and was growing steadily. Any explanations of why it’s dropped down so much would be much appreciated, as the current data don’t appear to match what we’re hearing from our customers.

Have a safe trip!

Fabrice

On May 4, 2014, at 9:11 AM, Nuria Ruiz nuria@wikimedia.org wrote:

I have cc-ed the eventlogging-alerts list. I think the best path to go forward is to check back your numbers once an alert has been sent to the list saying that replication issues are resolved.

As Dan said most of analytics team should be traveling Monday but ops should be able to send a note to the list once replication issues are mostly resolved.

Thanks,

Nuria

On Thu, May 1, 2014 at 6:51 PM, Dan Andreescu dandreescu@wikimedia.orgwrote:

...

As discussed, I am puzzled by the numbers on these updated graphs:

...

I wish I had time to look into this more thoroughly but I'm swamped today. Also, most of the analytics team will be in Zurich starting Monday and we'll only be back after May 12th.

The best advice I can offer is to compare data from the two databases for the graphs where you see discrepancies. It's possible that replication lag / problems are still happening. Please report any bugs in bugzilla under the EventLogging component.

---

Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

---

Multimedia mailing list Multimedia@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/multimedia

---

Fabrice Florin Product Manager Wikimedia Foundation

http://en.wikipedia.org/wiki/User:Fabrice_Florin_(WMF)

---

Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics