Analytics July 2016

analytics@lists.wikimedia.org

29 participants
25 discussions

"Cases" section approved, finishing "Committee" section of Code of Conduct
by Matthew Flaschen 26 Jul '16

26 Jul '16

The community has approved the "Cases" (https://www.mediawiki.org/wiki/Code_of_Conduct/Draft#Page:_Code_of_Conduct.…) section of the draft Code of Conduct. The next section is "Committee". * Section: https://www.mediawiki.org/wiki/Code_of_Conduct/Draft#Page:_Code_of_Conduct.… * Talk: https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft * Alternatively, you can provide anonymous feedback to conduct-discussion at wikimedia.org . This is the best time to make any final necessary changes to the Committee section (and explain why, in edit summaries and/or talk) and discuss it on the talk page. After this last call, I will send out emails seeking approval of this section, organized by sub-section. Thanks, Matt Flaschen

1 0

Browser stats
by Toby Negrin 22 Jul '16

22 Jul '16

Noted analyst Benedict Evans is tweeting the user agent sunbursts: https://twitter.com/benedictevans/status/756586488280690688 Cool! -Toby

2 1

Questions about the replacement for Wikistats
by Pine W 21 Jul '16

21 Jul '16

Hi Analytics, Will the new platform be located on stats.wikimedia.org as well? Do you know what the sitemap for the replacements of Wikistats will be? I would like to be able to refer people to the Wikistats successor from the LearnWiki videos, rather than refer them to links that may be dead by the time that viewers two years from now see the videos. Thanks! Pine

3 3

analytics-store db maintenance on Thursday 21 July
by Jaime Crespo 21 Jul '16

21 Jul '16

After consulting with several people on several departments, we have scheduled a maintenance window (downtime) for dbstore1002 (alias analytics-store, and s2 *to* s7-analytics-slave) for Thursday 21 July between14:00-15:00 UTC [0]. The downtime is expected to be of only 5-10 minutes, but in case something goes wrong, we will reserve the entire hour. During the maintenance, this host will stop replication from eventlogging and the production shards, kill all ongoing queries and stop responding to new ones. User databases on this host will be unavailable, too. The recommendation is to use db1047 / analytics-slave / s1-analytics-slave, which also has an up-to-date version of eventlogging and shards s1 and s2 for the following 3 days to avoid service interruption. I see some crons running on dbstore1002, contact me privately if you want to change them and require help. I will send an update when the maintenance is over to confirm normal work can resume. [0]<url:http://www.timeanddate.com/worldclock/fixedtime.html?msg=analytics-stor…> -- Jaime Crespo <http://wikimedia.org>

1 1

Survey for Wikipedia readers
by Vipul Naik 15 Jul '16

15 Jul '16

Hello Wikimedia analytics mailing list, As part of research into how people read Wikipedia, a friend and I created a short survey. We are interested in seeing how people on this mailing list (not a representative sample of Wikipedia readers for sure!) fill the survey. The survey should take 2 to 10 minutes to complete. https://www.surveymonkey.com/r/QBCCVFY I would also appreciate if any of you have the ability to circulate the survey to a different audience. If you are interested in doing that, please let me know (off-list, if you prefer) and I will give you a separate URL through which to do so for each such audience. The URLs represent different audiences to whom the survey is shared so that it is easier to understand how responses differ based on audience. Any feedback on the survey questions would also be appreciated, on- or off-thread. Thank you very much! Vipul

5 7

Heatmaps of readership and editor populations
by Pine W 13 Jul '16

13 Jul '16

Hi Analytics, Are there heatmaps somewhere that show the geographic distribution of Wikipedia readers and editors by country? I realize that country-specific data can be sensitive for countries with small populations of readers and/or editors, and I don't need fine detail. Incrementing heatmaps in units of hundreds of readers and editors, or readers and editors per thousand population, is probably sufficient. These would be great visualizations to have if they're available. Thanks, Pine

2 1

Wiki Page Views Project
by Manny Manny 13 Jul '16

13 Jul '16

Hello All, I am working on a project the uses page view numbers for wiki articles and I was hoping somebody could help me out. I am using wikipedia redirects to find aliases for query names. Unfortunately there is a lot of noise in the redirects. I was hoping to use the page views as a heuristic to weed out bad redirects. I was looking at the page view files but the ones on stats.grok.se are hourly which is too much to process in a reasonable amount of time. I was wondering if anybody had (or knew where I could access) page view files for a longer amount of time like yearly, monthly, or even daily. I need to able to download the file locally because I will be dealing with a lot of query names. I appreciate any help you can provide. Thanks, Manny

7 7

Ranking Wikimedia projects by sizes or activity levels
by Pine W 12 Jul '16

12 Jul '16

Hi Analytics, Is there an easy way to rank our projects, with languages being consolidated, by (1) size in GB, or (2) number of content pages, or (3) number of active users in the previous month? I imagine that the ordered list would look something like this: Commons, all Wikipedias, all Wiktionaries, all Wikisources, Wikispecies, Wikidata, etc. If there's an easy way to get an ordered list I'd like to include that info in an introductory portion of my LearnWiki video tutorials, but if this question would consume more than a few moments of staff time to research then I can skip it. I'm thinking that the sizes of the databases would be an easy way to measure sizes in GB, but I don't know with certainty if the databases are consolidated or if each language has its own database. Thanks! Pine

4 5

Weigh in on whether to finalize "Cases" section of CoC
by Matthew Flaschen 12 Jul '16

12 Jul '16

Please comment on whether to approve the "Cases" section of the draft Code of conduct for technical spaces (https://www.mediawiki.org/wiki/Code_of_Conduct/Draft#Page:_Code_of_Conduct.…). You can comment at https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#Finalize_.22Cases… . A position and brief comment is fine. You can also send private feedback to conduct-discussion(a)wikimedia.org . Thanks again, Matt Flaschen

1 0

Clickhouse
by Gilles Dubuc 09 Jul '16

09 Jul '16

This might be of interest: https://clickhouse.yandex/ ClickHouse is an open-source column-oriented database management system that allows generating analytical data reports in real time. ClickHouse manages extremely large volumes of data in a stable and sustainable manner. It currently powers Yandex.Metrica, world’s second largest web analytics platform, with over 13 trillion database records and over 20 billion events a day, generating customized reports on-the-fly, directly from non-aggregated data. This system was successfully implemented at CERN’s LHCb experiment to store and process metadata on 10bn events with over 1000 attributes per event registered in 2011.

3 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

Analytics July 2016