Are the stats reliable though? There is a huge jump a few days ago, even in the file page loading times. Is that when it was switched over to Cloudbees?

Any data on that graph before Match 18th is junk that came from (often partial) runs on my laptop, at times on internet connections of very questionable quality.

March 18th onwards is exclusively run on cloudbees. You can see right away that those cloudbees figures are a lot more stable.

When we have more data in a few days I'll update the SQL query to remove the misleading figures that came from local development. In fact we should make sure to avoid running this test locally against mediawiki.org or any production wiki where EventLogging is turned on from now on, otherwise we'll pollute the stats.


On Mon, Apr 21, 2014 at 3:38 AM, Gergo Tisza <gtisza@wikimedia.org> wrote:
On Sun, Apr 20, 2014 at 3:39 AM, Gilles Dubuc <gilles@wikimedia.org> wrote:
Any practical recommendations for addressing this concern?

Can the users who've been complaining about speed be contacted? That would allow us to verify whether the bad experience is consistent for them, we could measure it directly and even compare it to their general internet speed.

I started a separate thread about that; will also reach out to the users on hu.wiki. Asking for email addresses in the survey would also be good, but we should check if it has legal implications (collecting private data can be, especially in the EU, a painful process).
 
And let's not forget that the status quo (opening the File: page) might be just as slow for those people. They might just not realize it, because most of the time spent loading that page shows you a blank tab. Now that the "versus" test has been running on cloudbees for a couple of days, targeting mediawiki.org, we can see that the file page is slower on average: http://multimedia-metrics.wmflabs.org/dashboards/mmv#media_viewer_vs_file_page-graphs-tab That wasn't the case a couple of weeks back, but we've made a number of improvements since.

According to those stats, MediaViewer with a warm JS cache beats the file page 2 to 1. That's pretty impressive!

Are the stats reliable though? There is a huge jump a few days ago, even in the file page loading times. Is that when it was switched over to Cloudbees?

_______________________________________________
Multimedia mailing list
Multimedia@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/multimedia