Hi all,
with this email we are starting a weekly look at our most important readership metrics.
The main purpose is to raise awareness about how these are developing, call out the impact of any unusual events in the preceding week (e.g. the media promotion for the Android app this time) and facilitate thinking about core metrics in general.
We will iterate on the presentation (e.g. to better take seasonality into account, in particular including year-over-year comparisons) and eventually want to create dashboards for those which are not already available in that form already. Feedback and discussion welcome.
(All numbers below are averages for September 7-13, 2015 unless otherwise noted.)
Pageviews:
Total: 546 million/day
Context (April 2015-September 2015):
[image: Wikimedia daily pageviews, all vs. mobile (April 2015-).png]
After the drop in June, which by now looks not merely seasonal but likely to be at least partially connected to the rollout of HTTPS-only access begun on June 12, overall pageviews are slightly rising again recently. (Notably, the recent drop https://reportcard.wmflabs.org/graphs/unique_visitors in comScore’s numbers - also in their pageview estimates for Wikimedia sites, not reproduced in that report card - is not consistent with our own traffic data; these discrepancies are being looked into.)
Desktop: 58.8%
Mobile web: 39.9%
Apps: 1.2%
Global North ratio: 77.5% of total pageviews
Context (April 2015-September 2015):
[image: Wikimedia pageviews, Global South vs. Global North (April 2015-).png]
Unique app users
Android: 1.136 million /day
Context (January 2015-September 2015):
While this number is slightly higher than in the preceding week, there’s no noticeable effect visible yet from the media promotion for the Android app (blog post https://blog.wikimedia.org/2015/09/10/wikipedia-app-new-navigation-features/ on September 10, media coverage https://meta.wikimedia.org/wiki/Communications_committee/Press_clippings/2015#September on September 10, 11 and 13).
iOS: 290k / day
Context (January 2015-September 2015):
New app installations
Android: 40,168/day (Daily installs per device, from Google Play, September 7-11)
Context (September 2014-September 2015):
Unfortunately, the stats function of the Google Play is having issues currently and data for recent days has been delayed. (They “expect to resolve the issue shortly”, but the September 11 only became available this morning and I’m sending this report out now, a fuller assessment of the impact of the media campaign will need to wait.) The first two days after the blog post went out on September 10 did not yet show a marked increase:
20150911
40648
20150910
39862
20150909
39927
20150908
39981
20150907
40420
iOS: 5,262/day (download numbers from App Annie)
Context (September 2014-September 2015):
We seem to have a slight upwards trend in recent weeks, but it’s still way below the download rate a year ago.
----
For reference, the queries and source links used are listed below (access is needed for each). I’ll also see to upload charts to Commons.
hive (wmf)> SELECT SUM(view_count)/7000000 AS avg_daily_views_millions FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, sum(IF(access_method <> 'desktop', view_count, null)) AS mobileviews, SUM(view_count) AS allviews FROM wmf.projectview_hourly WHERE year=2015 AND agent_type = 'user' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000;
hive (wmf)> SELECT SUM(IF (FIND_IN_SET(country_code, 'AD,AL,AT,AX,BA,BE,BG,CH,CY,CZ,DE,DK,EE,ES,FI,FO,FR,FX,GB,GG,GI,GL,GR,HR,HU,IE,IL,IM,IS,IT,JE,LI,LU,LV,MC,MD,ME,MK,MT,NL,NO,PL,PT,RO,RS,RU,SE,SI,SJ,SK,SM,TR,VA,AU,CA,HK,MO,NZ,JP,SG,KR,TW,US')
0, view_count, 0))/SUM(view_count) FROM wmf.projectview_hourly WHERE
agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT access_method, SUM(view_count)/7 FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13" GROUP BY access_method;
hive (wmf)> SELECT SUM(IF(platform = 'Android',unique_count,0))/7 AS avg_Android_DAU_last_week, SUM(IF(platform = 'iOS',unique_count,0))/7 AS avg_iOS_DAU_last_week FROM wmf.mobile_apps_uniques_daily WHERE CONCAT(year,LPAD(month,2,"0"),LPAD(day,2,"0")) BETWEEN 20150907 AND 20150913;
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'Android';
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'iOS';
https://play.google.com/apps/publish/?dev_acc=18062848292902787645#StatsPlac...
https://www.appannie.com/dashboard/252257/item/324715238/downloads/?breakdow...
Hi Tilman --
Thank you for sending this out! I appreciate the hard work that you put into it and I'm excited to have these metrics close at hand.
-Toby
On Thu, Sep 17, 2015 at 12:44 PM, Tilman Bayer tbayer@wikimedia.org wrote:
Hi all,
with this email we are starting a weekly look at our most important readership metrics.
The main purpose is to raise awareness about how these are developing, call out the impact of any unusual events in the preceding week (e.g. the media promotion for the Android app this time) and facilitate thinking about core metrics in general.
We will iterate on the presentation (e.g. to better take seasonality into account, in particular including year-over-year comparisons) and eventually want to create dashboards for those which are not already available in that form already. Feedback and discussion welcome.
(All numbers below are averages for September 7-13, 2015 unless otherwise noted.)
Pageviews:
Total: 546 million/day
Context (April 2015-September 2015):
[image: Wikimedia daily pageviews, all vs. mobile (April 2015-).png]
After the drop in June, which by now looks not merely seasonal but likely to be at least partially connected to the rollout of HTTPS-only access begun on June 12, overall pageviews are slightly rising again recently. (Notably, the recent drop https://reportcard.wmflabs.org/graphs/unique_visitors in comScore’s numbers - also in their pageview estimates for Wikimedia sites, not reproduced in that report card - is not consistent with our own traffic data; these discrepancies are being looked into.)
Desktop: 58.8%
Mobile web: 39.9%
Apps: 1.2%
Global North ratio: 77.5% of total pageviews
Context (April 2015-September 2015):
[image: Wikimedia pageviews, Global South vs. Global North (April 2015-).png]
Unique app users
Android: 1.136 million /day
Context (January 2015-September 2015):
While this number is slightly higher than in the preceding week, there’s no noticeable effect visible yet from the media promotion for the Android app (blog post https://blog.wikimedia.org/2015/09/10/wikipedia-app-new-navigation-features/ on September 10, media coverage https://meta.wikimedia.org/wiki/Communications_committee/Press_clippings/2015#September on September 10, 11 and 13).
iOS: 290k / day
Context (January 2015-September 2015):
New app installations
Android: 40,168/day (Daily installs per device, from Google Play, September 7-11)
Context (September 2014-September 2015):
Unfortunately, the stats function of the Google Play is having issues currently and data for recent days has been delayed. (They “expect to resolve the issue shortly”, but the September 11 only became available this morning and I’m sending this report out now, a fuller assessment of the impact of the media campaign will need to wait.) The first two days after the blog post went out on September 10 did not yet show a marked increase:
20150911
40648
20150910
39862
20150909
39927
20150908
39981
20150907
40420
iOS: 5,262/day (download numbers from App Annie)
Context (September 2014-September 2015):
We seem to have a slight upwards trend in recent weeks, but it’s still way below the download rate a year ago.
For reference, the queries and source links used are listed below (access is needed for each). I’ll also see to upload charts to Commons.
hive (wmf)> SELECT SUM(view_count)/7000000 AS avg_daily_views_millions FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, sum(IF(access_method <> 'desktop', view_count, null)) AS mobileviews, SUM(view_count) AS allviews FROM wmf.projectview_hourly WHERE year=2015 AND agent_type = 'user' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000;
hive (wmf)> SELECT SUM(IF (FIND_IN_SET(country_code, 'AD,AL,AT,AX,BA,BE,BG,CH,CY,CZ,DE,DK,EE,ES,FI,FO,FR,FX,GB,GG,GI,GL,GR,HR,HU,IE,IL,IM,IS,IT,JE,LI,LU,LV,MC,MD,ME,MK,MT,NL,NO,PL,PT,RO,RS,RU,SE,SI,SJ,SK,SM,TR,VA,AU,CA,HK,MO,NZ,JP,SG,KR,TW,US')
0, view_count, 0))/SUM(view_count) FROM wmf.projectview_hourly WHERE
agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT access_method, SUM(view_count)/7 FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13" GROUP BY access_method;
hive (wmf)> SELECT SUM(IF(platform = 'Android',unique_count,0))/7 AS avg_Android_DAU_last_week, SUM(IF(platform = 'iOS',unique_count,0))/7 AS avg_iOS_DAU_last_week FROM wmf.mobile_apps_uniques_daily WHERE CONCAT(year,LPAD(month,2,"0"),LPAD(day,2,"0")) BETWEEN 20150907 AND 20150913;
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'Android';
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'iOS';
https://play.google.com/apps/publish/?dev_acc=18062848292902787645#StatsPlac...
https://www.appannie.com/dashboard/252257/item/324715238/downloads/?breakdow...
-- Tilman Bayer Senior Analyst Wikimedia Foundation IRC (Freenode): HaeB
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Thanks Tilman. Is it possible for to get ENWP-only stats for August 2015? The last data for ENWP pageviews on stats.wikimedia.org is from July. A breakdown of ENWP stats into mobile and desktop would also be helpful.
Pine
On Thu, Sep 17, 2015 at 12:44 PM, Tilman Bayer tbayer@wikimedia.org wrote:
Hi all,
with this email we are starting a weekly look at our most important readership metrics.
The main purpose is to raise awareness about how these are developing, call out the impact of any unusual events in the preceding week (e.g. the media promotion for the Android app this time) and facilitate thinking about core metrics in general.
We will iterate on the presentation (e.g. to better take seasonality into account, in particular including year-over-year comparisons) and eventually want to create dashboards for those which are not already available in that form already. Feedback and discussion welcome.
(All numbers below are averages for September 7-13, 2015 unless otherwise noted.)
Pageviews:
Total: 546 million/day
Context (April 2015-September 2015):
[image: Wikimedia daily pageviews, all vs. mobile (April 2015-).png]
After the drop in June, which by now looks not merely seasonal but likely to be at least partially connected to the rollout of HTTPS-only access begun on June 12, overall pageviews are slightly rising again recently. (Notably, the recent drop https://reportcard.wmflabs.org/graphs/unique_visitors in comScore’s numbers - also in their pageview estimates for Wikimedia sites, not reproduced in that report card - is not consistent with our own traffic data; these discrepancies are being looked into.)
Desktop: 58.8%
Mobile web: 39.9%
Apps: 1.2%
Global North ratio: 77.5% of total pageviews
Context (April 2015-September 2015):
[image: Wikimedia pageviews, Global South vs. Global North (April 2015-).png]
Unique app users
Android: 1.136 million /day
Context (January 2015-September 2015):
While this number is slightly higher than in the preceding week, there’s no noticeable effect visible yet from the media promotion for the Android app (blog post https://blog.wikimedia.org/2015/09/10/wikipedia-app-new-navigation-features/ on September 10, media coverage https://meta.wikimedia.org/wiki/Communications_committee/Press_clippings/2015#September on September 10, 11 and 13).
iOS: 290k / day
Context (January 2015-September 2015):
New app installations
Android: 40,168/day (Daily installs per device, from Google Play, September 7-11)
Context (September 2014-September 2015):
Unfortunately, the stats function of the Google Play is having issues currently and data for recent days has been delayed. (They “expect to resolve the issue shortly”, but the September 11 only became available this morning and I’m sending this report out now, a fuller assessment of the impact of the media campaign will need to wait.) The first two days after the blog post went out on September 10 did not yet show a marked increase:
20150911
40648
20150910
39862
20150909
39927
20150908
39981
20150907
40420
iOS: 5,262/day (download numbers from App Annie)
Context (September 2014-September 2015):
We seem to have a slight upwards trend in recent weeks, but it’s still way below the download rate a year ago.
For reference, the queries and source links used are listed below (access is needed for each). I’ll also see to upload charts to Commons.
hive (wmf)> SELECT SUM(view_count)/7000000 AS avg_daily_views_millions FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, sum(IF(access_method <> 'desktop', view_count, null)) AS mobileviews, SUM(view_count) AS allviews FROM wmf.projectview_hourly WHERE year=2015 AND agent_type = 'user' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000;
hive (wmf)> SELECT SUM(IF (FIND_IN_SET(country_code, 'AD,AL,AT,AX,BA,BE,BG,CH,CY,CZ,DE,DK,EE,ES,FI,FO,FR,FX,GB,GG,GI,GL,GR,HR,HU,IE,IL,IM,IS,IT,JE,LI,LU,LV,MC,MD,ME,MK,MT,NL,NO,PL,PT,RO,RS,RU,SE,SI,SJ,SK,SM,TR,VA,AU,CA,HK,MO,NZ,JP,SG,KR,TW,US')
0, view_count, 0))/SUM(view_count) FROM wmf.projectview_hourly WHERE
agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT access_method, SUM(view_count)/7 FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13" GROUP BY access_method;
hive (wmf)> SELECT SUM(IF(platform = 'Android',unique_count,0))/7 AS avg_Android_DAU_last_week, SUM(IF(platform = 'iOS',unique_count,0))/7 AS avg_iOS_DAU_last_week FROM wmf.mobile_apps_uniques_daily WHERE CONCAT(year,LPAD(month,2,"0"),LPAD(day,2,"0")) BETWEEN 20150907 AND 20150913;
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'Android';
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'iOS';
https://play.google.com/apps/publish/?dev_acc=18062848292902787645#StatsPlac...
https://www.appannie.com/dashboard/252257/item/324715238/downloads/?breakdow...
-- Tilman Bayer Senior Analyst Wikimedia Foundation IRC (Freenode): HaeB
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Are there going to be regularly updated dashboards for these KPIs? The Discovery team is happy to lend you some support in getting a platform set up, moving forward.
On 17 September 2015 at 15:55, Pine W wiki.pine@gmail.com wrote:
Thanks Tilman. Is it possible for to get ENWP-only stats for August 2015? The last data for ENWP pageviews on stats.wikimedia.org is from July. A breakdown of ENWP stats into mobile and desktop would also be helpful.
Pine
On Thu, Sep 17, 2015 at 12:44 PM, Tilman Bayer tbayer@wikimedia.org wrote:
Hi all,
with this email we are starting a weekly look at our most important readership metrics.
The main purpose is to raise awareness about how these are developing, call out the impact of any unusual events in the preceding week (e.g. the media promotion for the Android app this time) and facilitate thinking about core metrics in general.
We will iterate on the presentation (e.g. to better take seasonality into account, in particular including year-over-year comparisons) and eventually want to create dashboards for those which are not already available in that form already. Feedback and discussion welcome.
(All numbers below are averages for September 7-13, 2015 unless otherwise noted.)
Pageviews:
Total: 546 million/day
Context (April 2015-September 2015):
[image: Wikimedia daily pageviews, all vs. mobile (April 2015-).png]
After the drop in June, which by now looks not merely seasonal but likely to be at least partially connected to the rollout of HTTPS-only access begun on June 12, overall pageviews are slightly rising again recently. (Notably, the recent drop https://reportcard.wmflabs.org/graphs/unique_visitors in comScore’s numbers - also in their pageview estimates for Wikimedia sites, not reproduced in that report card - is not consistent with our own traffic data; these discrepancies are being looked into.)
Desktop: 58.8%
Mobile web: 39.9%
Apps: 1.2%
Global North ratio: 77.5% of total pageviews
Context (April 2015-September 2015):
[image: Wikimedia pageviews, Global South vs. Global North (April 2015-).png]
Unique app users
Android: 1.136 million /day
Context (January 2015-September 2015):
While this number is slightly higher than in the preceding week, there’s no noticeable effect visible yet from the media promotion for the Android app (blog post https://blog.wikimedia.org/2015/09/10/wikipedia-app-new-navigation-features/ on September 10, media coverage https://meta.wikimedia.org/wiki/Communications_committee/Press_clippings/2015#September on September 10, 11 and 13).
iOS: 290k / day
Context (January 2015-September 2015):
New app installations
Android: 40,168/day (Daily installs per device, from Google Play, September 7-11)
Context (September 2014-September 2015):
Unfortunately, the stats function of the Google Play is having issues currently and data for recent days has been delayed. (They “expect to resolve the issue shortly”, but the September 11 only became available this morning and I’m sending this report out now, a fuller assessment of the impact of the media campaign will need to wait.) The first two days after the blog post went out on September 10 did not yet show a marked increase:
20150911
40648
20150910
39862
20150909
39927
20150908
39981
20150907
40420
iOS: 5,262/day (download numbers from App Annie)
Context (September 2014-September 2015):
We seem to have a slight upwards trend in recent weeks, but it’s still way below the download rate a year ago.
For reference, the queries and source links used are listed below (access is needed for each). I’ll also see to upload charts to Commons.
hive (wmf)> SELECT SUM(view_count)/7000000 AS avg_daily_views_millions FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, sum(IF(access_method <> 'desktop', view_count, null)) AS mobileviews, SUM(view_count) AS allviews FROM wmf.projectview_hourly WHERE year=2015 AND agent_type = 'user' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000;
hive (wmf)> SELECT SUM(IF (FIND_IN_SET(country_code, 'AD,AL,AT,AX,BA,BE,BG,CH,CY,CZ,DE,DK,EE,ES,FI,FO,FR,FX,GB,GG,GI,GL,GR,HR,HU,IE,IL,IM,IS,IT,JE,LI,LU,LV,MC,MD,ME,MK,MT,NL,NO,PL,PT,RO,RS,RU,SE,SI,SJ,SK,SM,TR,VA,AU,CA,HK,MO,NZ,JP,SG,KR,TW,US')
0, view_count, 0))/SUM(view_count) FROM wmf.projectview_hourly WHERE
agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT access_method, SUM(view_count)/7 FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13" GROUP BY access_method;
hive (wmf)> SELECT SUM(IF(platform = 'Android',unique_count,0))/7 AS avg_Android_DAU_last_week, SUM(IF(platform = 'iOS',unique_count,0))/7 AS avg_iOS_DAU_last_week FROM wmf.mobile_apps_uniques_daily WHERE CONCAT(year,LPAD(month,2,"0"),LPAD(day,2,"0")) BETWEEN 20150907 AND 20150913;
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'Android';
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'iOS';
https://play.google.com/apps/publish/?dev_acc=18062848292902787645#StatsPlac...
https://www.appannie.com/dashboard/252257/item/324715238/downloads/?breakdow...
-- Tilman Bayer Senior Analyst Wikimedia Foundation IRC (Freenode): HaeB
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Thanks, Tilman! This is a great start.
Oliver, thank you for your offer of support! For now, we are still in an early 'agile' stage of prioritizing features based on stakeholder's feedback (like the one Pine raised). I think dashboard is something we will consider when we are further down the road on this.
On Thu, Sep 17, 2015 at 12:57 PM, Oliver Keyes okeyes@wikimedia.org wrote:
Are there going to be regularly updated dashboards for these KPIs? The Discovery team is happy to lend you some support in getting a platform set up, moving forward.
On 17 September 2015 at 15:55, Pine W wiki.pine@gmail.com wrote:
Thanks Tilman. Is it possible for to get ENWP-only stats for August 2015? The last data for ENWP pageviews on stats.wikimedia.org is from July. A breakdown of ENWP stats into mobile and desktop would also be helpful.
Pine
On Thu, Sep 17, 2015 at 12:44 PM, Tilman Bayer tbayer@wikimedia.org wrote:
Hi all,
with this email we are starting a weekly look at our most important readership metrics.
The main purpose is to raise awareness about how these are developing, call out the impact of any unusual events in the preceding week (e.g. the media promotion for the Android app this time) and facilitate thinking about core metrics in general.
We will iterate on the presentation (e.g. to better take seasonality into account, in particular including year-over-year comparisons) and eventually want to create dashboards for those which are not already available in that form already. Feedback and discussion welcome.
(All numbers below are averages for September 7-13, 2015 unless otherwise noted.)
Pageviews:
Total: 546 million/day
Context (April 2015-September 2015):
[image: Wikimedia daily pageviews, all vs. mobile (April 2015-).png]
After the drop in June, which by now looks not merely seasonal but likely to be at least partially connected to the rollout of HTTPS-only access begun on June 12, overall pageviews are slightly rising again recently. (Notably, the recent drop https://reportcard.wmflabs.org/graphs/unique_visitors in comScore’s numbers - also in their pageview estimates for Wikimedia sites, not reproduced in that report card - is not consistent with our own traffic data; these discrepancies are being looked into.)
Desktop: 58.8%
Mobile web: 39.9%
Apps: 1.2%
Global North ratio: 77.5% of total pageviews
Context (April 2015-September 2015):
[image: Wikimedia pageviews, Global South vs. Global North (April 2015-).png]
Unique app users
Android: 1.136 million /day
Context (January 2015-September 2015):
While this number is slightly higher than in the preceding week, there’s no noticeable effect visible yet from the media promotion for the Android app (blog post https://blog.wikimedia.org/2015/09/10/wikipedia-app-new-navigation-features/ on September 10, media coverage https://meta.wikimedia.org/wiki/Communications_committee/Press_clippings/2015#September on September 10, 11 and 13).
iOS: 290k / day
Context (January 2015-September 2015):
New app installations
Android: 40,168/day (Daily installs per device, from Google Play, September 7-11)
Context (September 2014-September 2015):
Unfortunately, the stats function of the Google Play is having issues currently and data for recent days has been delayed. (They “expect to resolve the issue shortly”, but the September 11 only became available this morning and I’m sending this report out now, a fuller assessment of the impact of the media campaign will need to wait.) The first two days after the blog post went out on September 10 did not yet show a marked increase:
20150911
40648
20150910
39862
20150909
39927
20150908
39981
20150907
40420
iOS: 5,262/day (download numbers from App Annie)
Context (September 2014-September 2015):
We seem to have a slight upwards trend in recent weeks, but it’s still way below the download rate a year ago.
For reference, the queries and source links used are listed below (access is needed for each). I’ll also see to upload charts to Commons.
hive (wmf)> SELECT SUM(view_count)/7000000 AS avg_daily_views_millions FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, sum(IF(access_method <> 'desktop', view_count, null)) AS mobileviews, SUM(view_count) AS allviews FROM wmf.projectview_hourly WHERE year=2015 AND agent_type = 'user' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000;
hive (wmf)> SELECT SUM(IF (FIND_IN_SET(country_code, 'AD,AL,AT,AX,BA,BE,BG,CH,CY,CZ,DE,DK,EE,ES,FI,FO,FR,FX,GB,GG,GI,GL,GR,HR,HU,IE,IL,IM,IS,IT,JE,LI,LU,LV,MC,MD,ME,MK,MT,NL,NO,PL,PT,RO,RS,RU,SE,SI,SJ,SK,SM,TR,VA,AU,CA,HK,MO,NZ,JP,SG,KR,TW,US')
0, view_count, 0))/SUM(view_count) FROM wmf.projectview_hourly WHERE
agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT access_method, SUM(view_count)/7 FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13" GROUP BY access_method;
hive (wmf)> SELECT SUM(IF(platform = 'Android',unique_count,0))/7 AS avg_Android_DAU_last_week, SUM(IF(platform = 'iOS',unique_count,0))/7 AS avg_iOS_DAU_last_week FROM wmf.mobile_apps_uniques_daily WHERE CONCAT(year,LPAD(month,2,"0"),LPAD(day,2,"0")) BETWEEN 20150907 AND 20150913;
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'Android';
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'iOS';
https://play.google.com/apps/publish/?dev_acc=18062848292902787645#StatsPlac...
https://www.appannie.com/dashboard/252257/item/324715238/downloads/?breakdow...
-- Tilman Bayer Senior Analyst Wikimedia Foundation IRC (Freenode): HaeB
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
-- Oliver Keyes Count Logula Wikimedia Foundation
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Sure! You just let us know when you're at the stage where management or stakeholders expect regular and consistent reporting - we've been doing this for a while and hope to be doing it for a while longer, so our expertise in this area isn't gonna go away, and neither is our offer of support :)
On 20 September 2015 at 16:28, Jon Katz jkatz@wikimedia.org wrote:
Thanks, Tilman! This is a great start.
Oliver, thank you for your offer of support! For now, we are still in an early 'agile' stage of prioritizing features based on stakeholder's feedback (like the one Pine raised). I think dashboard is something we will consider when we are further down the road on this.
On Thu, Sep 17, 2015 at 12:57 PM, Oliver Keyes okeyes@wikimedia.org wrote:
Are there going to be regularly updated dashboards for these KPIs? The Discovery team is happy to lend you some support in getting a platform set up, moving forward.
On 17 September 2015 at 15:55, Pine W wiki.pine@gmail.com wrote:
Thanks Tilman. Is it possible for to get ENWP-only stats for August 2015? The last data for ENWP pageviews on stats.wikimedia.org is from July. A breakdown of ENWP stats into mobile and desktop would also be helpful.
Pine
On Thu, Sep 17, 2015 at 12:44 PM, Tilman Bayer tbayer@wikimedia.org wrote:
Hi all,
with this email we are starting a weekly look at our most important readership metrics.
The main purpose is to raise awareness about how these are developing, call out the impact of any unusual events in the preceding week (e.g. the media promotion for the Android app this time) and facilitate thinking about core metrics in general.
We will iterate on the presentation (e.g. to better take seasonality into account, in particular including year-over-year comparisons) and eventually want to create dashboards for those which are not already available in that form already. Feedback and discussion welcome.
(All numbers below are averages for September 7-13, 2015 unless otherwise noted.)
Pageviews:
Total: 546 million/day
Context (April 2015-September 2015):
[image: Wikimedia daily pageviews, all vs. mobile (April 2015-).png]
After the drop in June, which by now looks not merely seasonal but likely to be at least partially connected to the rollout of HTTPS-only access begun on June 12, overall pageviews are slightly rising again recently. (Notably, the recent drop https://reportcard.wmflabs.org/graphs/unique_visitors in comScore’s numbers - also in their pageview estimates for Wikimedia sites, not reproduced in that report card - is not consistent with our own traffic data; these discrepancies are being looked into.)
Desktop: 58.8%
Mobile web: 39.9%
Apps: 1.2%
Global North ratio: 77.5% of total pageviews
Context (April 2015-September 2015):
[image: Wikimedia pageviews, Global South vs. Global North (April 2015-).png]
Unique app users
Android: 1.136 million /day
Context (January 2015-September 2015):
While this number is slightly higher than in the preceding week, there’s no noticeable effect visible yet from the media promotion for the Android app (blog post https://blog.wikimedia.org/2015/09/10/wikipedia-app-new-navigation-features/ on September 10, media coverage https://meta.wikimedia.org/wiki/Communications_committee/Press_clippings/2015#September on September 10, 11 and 13).
iOS: 290k / day
Context (January 2015-September 2015):
New app installations
Android: 40,168/day (Daily installs per device, from Google Play, September 7-11)
Context (September 2014-September 2015):
Unfortunately, the stats function of the Google Play is having issues currently and data for recent days has been delayed. (They “expect to resolve the issue shortly”, but the September 11 only became available this morning and I’m sending this report out now, a fuller assessment of the impact of the media campaign will need to wait.) The first two days after the blog post went out on September 10 did not yet show a marked increase:
20150911
40648
20150910
39862
20150909
39927
20150908
39981
20150907
40420
iOS: 5,262/day (download numbers from App Annie)
Context (September 2014-September 2015):
We seem to have a slight upwards trend in recent weeks, but it’s still way below the download rate a year ago.
For reference, the queries and source links used are listed below (access is needed for each). I’ll also see to upload charts to Commons.
hive (wmf)> SELECT SUM(view_count)/7000000 AS avg_daily_views_millions FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT year, month, day, CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, sum(IF(access_method <> 'desktop', view_count, null)) AS mobileviews, SUM(view_count) AS allviews FROM wmf.projectview_hourly WHERE year=2015 AND agent_type = 'user' GROUP BY year, month, day ORDER BY year, month, day LIMIT 1000;
hive (wmf)> SELECT SUM(IF (FIND_IN_SET(country_code, 'AD,AL,AT,AX,BA,BE,BG,CH,CY,CZ,DE,DK,EE,ES,FI,FO,FR,FX,GB,GG,GI,GL,GR,HR,HU,IE,IL,IM,IS,IT,JE,LI,LU,LV,MC,MD,ME,MK,MT,NL,NO,PL,PT,RO,RS,RU,SE,SI,SJ,SK,SM,TR,VA,AU,CA,HK,MO,NZ,JP,SG,KR,TW,US')
0, view_count, 0))/SUM(view_count) FROM wmf.projectview_hourly WHERE
agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13";
hive (wmf)> SELECT access_method, SUM(view_count)/7 FROM wmf.projectview_hourly WHERE agent_type = 'user' AND CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) BETWEEN "2015-09-07" AND "2015-09-13" GROUP BY access_method;
hive (wmf)> SELECT SUM(IF(platform = 'Android',unique_count,0))/7 AS avg_Android_DAU_last_week, SUM(IF(platform = 'iOS',unique_count,0))/7 AS avg_iOS_DAU_last_week FROM wmf.mobile_apps_uniques_daily WHERE CONCAT(year,LPAD(month,2,"0"),LPAD(day,2,"0")) BETWEEN 20150907 AND 20150913;
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'Android';
hive (wmf)> SELECT CONCAT(year,"-",LPAD(month,2,"0"),"-",LPAD(day,2,"0")) as date, unique_count AS Android_DAU FROM wmf.mobile_apps_uniques_daily WHERE platform = 'iOS';
https://play.google.com/apps/publish/?dev_acc=18062848292902787645#StatsPlac...
https://www.appannie.com/dashboard/252257/item/324715238/downloads/?breakdow...
-- Tilman Bayer Senior Analyst Wikimedia Foundation IRC (Freenode): HaeB
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
-- Oliver Keyes Count Logula Wikimedia Foundation
Mobile-l mailing list Mobile-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mobile-l
Thanks Oliver - as already mentioned in my initial email, we indeed aim to create dashboards eventually for those which are not available already, but will iterate a bit first. (For the app installs, it would basically mean reproducing the internal Google Play and App Annie dashboards in public versions.)
To clarify, these metrics are deliberately not called KPIs in the report at this point, and feedback on the metrics selection itself is welcome as well - already received some offlist.
I had been eyeing https://wikitech.wikimedia.org/wiki/Building_a_Shiny_Dashboard with interest some days ago already, and really appreciate your offer of support, may take you up on it later. I have to say I also like the annotation feature of Dashiki, especially for the approach taken here where we try to add some information that helps with understanding and interpreting what's happening, instead of just putting out the naked data. FWIW, there is already a Dashiki dashboard at https://vital-signs.wmflabs.org/ (with some annotations) which can be made to display the total pageviews from May 2015 on (by entering "Totals" on top left), if not the other pageview data from this report. And I know Gergö has been looking into setting up a fuller new def pageview dashboard as a side project.
BTW, the charts from last week's report are now also on Commons https://commons.wikimedia.org/w/index.php?title=Special:ListFiles&dir=prev&offset=20150918000000&user=Tbayer+%28WMF%29&limit=6. For the time being I will update the app DAUs and pageview data there as new reports come out.
On Sun, Sep 20, 2015 at 4:28 PM, Oliver Keyes okeyes@wikimedia.org wrote:
Sure! You just let us know when you're at the stage where management or stakeholders expect regular and consistent reporting - we've been doing this for a while and hope to be doing it for a while longer, so our expertise in this area isn't gonna go away, and neither is our offer of support :)
On 20 September 2015 at 16:28, Jon Katz jkatz@wikimedia.org wrote:
Thanks, Tilman! This is a great start.
Oliver, thank you for your offer of support! For now, we are still in an early 'agile' stage of prioritizing features based on stakeholder's feedback (like the one Pine raised). I think dashboard is something we will consider when we are further down the road on this.
On Thu, Sep 17, 2015 at 12:57 PM, Oliver Keyes okeyes@wikimedia.org wrote:
Are there going to be regularly updated dashboards for these KPIs? The Discovery team is happy to lend you some support in getting a platform set up, moving forward.
On 17 September 2015 at 15:55, Pine W wiki.pine@gmail.com wrote:
Thanks Tilman. Is it possible for to get ENWP-only stats for August 2015? The last data for ENWP pageviews on stats.wikimedia.org is from July. A breakdown of ENWP stats into mobile and desktop would also be helpful.
Pine
On Thu, Sep 17, 2015 at 12:44 PM, Tilman Bayer tbayer@wikimedia.org wrote:
Hi all,
with this email we are starting a weekly look at our most important readership metrics.
The main purpose is to raise awareness about how these are developing, call out the impact of any unusual events in the preceding week (e.g. the media promotion for the Android app this time) and facilitate thinking about core metrics in general.
We will iterate on the presentation (e.g. to better take seasonality into account, in particular including year-over-year comparisons) and eventually want to create dashboards for those which are not already available in that form already. Feedback and discussion welcome.
(All numbers below are averages for September 7-13, 2015 unless otherwise noted.)
...
Hi Pine,
this question seems a bit offtopic here (unless you were suggesting to add monthly pageviews for the English Wikipedia as a separate category to these reports, which I don't believe was the intention). That said, happy to help here; in general you can ask anyone with access to stat1002/Hive/Hue to run this query for you, and soon the information should be accessible via the new public pageview API too.
ENWP had 7.6 billion non-spider pageviews in August 2015, 3.3 billion of them mobile:
hive (wmf)> SELECT sum(IF(access_method <> 'desktop', view_count, null)) AS mobileviews, SUM(view_count) AS allviews FROM wmf.projectview_hourly WHERE year=2015 AND MONTH = 8 AND project = "en.wikipedia" AND agent_type = 'user'; ... mobileviews allviews 3302333038 7634815221
On Thu, Sep 17, 2015 at 12:55 PM, Pine W wiki.pine@gmail.com wrote:
Thanks Tilman. Is it possible for to get ENWP-only stats for August 2015? The last data for ENWP pageviews on stats.wikimedia.org is from July. A breakdown of ENWP stats into mobile and desktop would also be helpful.
Pine
On Thu, Sep 17, 2015 at 12:44 PM, Tilman Bayer tbayer@wikimedia.org wrote:
Hi all,
with this email we are starting a weekly look at our most important readership metrics.
The main purpose is to raise awareness about how these are developing, call out the impact of any unusual events in the preceding week (e.g. the media promotion for the Android app this time) and facilitate thinking about core metrics in general.
We will iterate on the presentation (e.g. to better take seasonality into account, in particular including year-over-year comparisons) and eventually want to create dashboards for those which are not already available in that form already. Feedback and discussion welcome.
(All numbers below are averages for September 7-13, 2015 unless otherwise noted.)
Pageviews:
Total: 546 million/day
Context (April 2015-September 2015):
[image: Wikimedia daily pageviews, all vs. mobile (April 2015-).png]
After the drop in June, which by now looks not merely seasonal but likely to be at least partially connected to the rollout of HTTPS-only access begun on June 12, overall pageviews are slightly rising again recently. (Notably, the recent drop https://reportcard.wmflabs.org/graphs/unique_visitors in comScore’s numbers - also in their pageview estimates for Wikimedia sites, not reproduced in that report card - is not consistent with our own traffic data; these discrepancies are being looked into.)
Desktop: 58.8%
Mobile web: 39.9%
Apps: 1.2%