Analytics October 2015

analytics@lists.wikimedia.org

40 participants
37 discussions

Page visit request
by Mark H. 09 Oct '15

09 Oct '15

Hello, I am doing a research on Wikipedia Visitor patterns and I could really use your team's help. Is it possible to get a list of the 2,000,000 most visited pages in Wikipedia since January 2015? I just need: Article Title (as used on the Wikipedia website); number of visitors if it is not easy to get the number since January 2015, I am open to a date range if you have a date range that makes the query easy for you. I would really appreciate your team's help. I'll gladly donate something to The Foundation in return for your help. If you have an alternative way/service/suggestion on how I can get this please do let me know. Mark Haans

3 2

Page view breakdown by country
by Hare, James (CDC/NIOSH/OD) (CTR) 09 Oct '15

09 Oct '15

Hello, At CDC/NIOSH we are interested in Wikipedia page view data for the 22 European Union countries. Do you have information on page views (including possibly unique views) for those countries? Thanks, James Hare

3 2

Redis on stat1001
by Andrew Otto 08 Oct '15

08 Oct '15

I may have asked this before, if so, apologies! Anyone know why we have redis running on stat1001? If not, we will uninstall it.

3 5

General framework for updating database reports
by Aaron Halfaker 06 Oct '15

06 Oct '15

Hey folks, I know there was some work in the past on systems to support keeping database reports up to date. I'm looking into this type of work with Jeph Paul now and I realized I don't have any good pointers to this past work. Right now, we're looking at running database reports based on cron jobs and checking the recentchanges table to make sure that replication isn't too lagged. Is there a better way? FWIW, I expect these queries to run daily and have a runtime of up to an hour. -Aaron

3 4

Editor retention in Wikidata
by Emw 04 Oct '15

04 Oct '15

Hi all, Most of you have probably seen Howie Fung's famous graph "Retention vs. Active Editors: English Wikipedia" at https://commons.wikimedia.org/wiki/File:Enwp_retention_vs_active_editors.png. It succinctly conveys important information about Wikipedia's community health, and often comes up in discussions about such. I plan to show an updated version of that graph [1] in a workshop I'll be running at WikiConference USA this coming Saturday [2], to illustrate a problem that Wikidata can ameliorate by centralizing and automating statements found in infoboxes, etc. Does such a "Retention vs. Active Editors" graph exist for Wikidata? I am aware of the following Wikidata analytics graphs: - Wikidata Active Editors: http://wdm.wmflabs.org/wdm/#number_of_active_editors_who_make_5,_100_edits_… - Wikidata Stats: https://tools.wmflabs.org/wikidata-todo/stats.php as well as the ticket tracking work on a Wikidata analytics dashboard [3]. However, after searching there and other usual places [4, 5, 6], I have not found a chart suitable for an "apples-to-apples" comparison between Wikidata and Wikipedia along the lines of Howie's famous graph. The "Wikidata Active Editors" graph linked above seems to be the closest available resource for comparison, but it's missing half the data -- a line showing editor retention over time. Per [1], retention is defined as "the percentage of editors who first edited in the specified month and also went on to make at least one edit 12 months later." Is data on editor retention in Wikidata available? If so, could someone point me to it? Thanks, Eric https://en.wikipedia.org/wiki/User:Emw 1. https://commons.wikimedia.org/wiki/File:Editor_Retention_Update.png 2. http://wikiconferenceusa.org/wiki/Submissions:2015/An_ambitious_Wikidata_tu… 3. https://phabricator.wikimedia.org/T108404 4. https://commons.wikimedia.org/wiki/Category:Wikidata_statistics 5. https://commons.wikimedia.org/w/index.php?search=wikidata+retention&title=S… 6. https://www.google.com/search?q=wikidata+analytics&ie=utf-8&oe=utf-8

2 1

Re: [Analytics] Meeting notes - Identifying Bots
by reguyla＠gmail.com 01 Oct '15

01 Oct '15

I was just wondering if you were referring to bots such as webcrawlers that are merely hitting the site or are you Referring to bots like Yobot and cluebot that are doing actual edits. Also. Do you count edits done using apps like AWB and twinkle as bots? Sent from my T-Mobile 4G LTE device ------ Original message------From: Oliver KeyesDate: Thu, Oct 1, 2015 4:19 PMTo: A mailing list for the Analytics Team at WMF and everybody who has an interest in Wikipedia and analytics.;Subject:Re: [Analytics] Meeting notes - Identifying Bots Does Analytics have any interest in involvement in a rate-limitingproject as a partial solution to this?On 1 October 2015 at 11:21, Nuria Ruiz wrote:> We met briefly to weight the pros and cons of taking up a project to tag bot> traffic.>> TL;DR>> While we see several projects that will benefit from a more precise bot> identification we think that at this time there are workarrounds that we can> do to filter bot traffic in most areas and that we should not expend the> resources and computation effort that a through bot detection system will> require.>> We think is worth spending time in quantifying our TRUE bot traffic so when> management has a question like "How much of our traffic is crawling?" we can> give an estimate by, say, researching bot traffic monthly, weekly and daily> in one given month.>> At this time 15% of our pageview traffic (not requests) are detected bots,> we estimate that the real bot traffic might be quite a big higher.>>> More detailed Notes here:> https://wikitech.wikimedia.org/wiki/Analytics/Bots>> Attendees please modify/correct notes as needed.>> _______________________________________________> Analytics mailing list> Analytics(a)lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/analytics>-- Oliver KeyesCount LogulaWikimedia Foundation_______________________________________________Analytics mailing listAnalytics@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/analytics

1 0

Meeting notes - Identifying Bots
by Nuria Ruiz 01 Oct '15

01 Oct '15

We met briefly to weight the pros and cons of taking up a project to tag bot traffic. TL;DR While we see several projects that will benefit from a more precise bot identification we think that at this time there are workarrounds that we can do to filter bot traffic in most areas and that we should not expend the resources and computation effort that a through bot detection system will require. We think is worth spending time in quantifying our TRUE bot traffic so when management has a question like "How much of our traffic is crawling?" we can give an estimate by, say, researching bot traffic monthly, weekly and daily in one given month. At this time 15% of our pageview traffic (not requests) are detected bots, we estimate that the real bot traffic might be quite a big higher. More detailed Notes here: https://wikitech.wikimedia.org/wiki/Analytics/Bots Attendees please modify/correct notes as needed.

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

Analytics October 2015