Hi,
I was browsing Turnilo, and found an odd thing.
Filter by: 1. Time, January 2017 to May 2018 2. Country: Nigeria 3. Project: ig.wikipedia.org
Split by: Time
Select line chart
You'll immediately notice that there are almost zero pageviews from February 12 until April 15.
What could be the reason?
Thanks!
-- Amir Elisha Aharoni · אָמִיר אֱלִישָׁע אַהֲרוֹנִי http://aharoni.wordpress.com “We're living in pieces, I want to live in peace.” – T. Moore
I see the baseline is less than 200k monthly unique devices and there were no huge drops: https://analytics.wikimedia.org/dashboards/vital-signs/#projects=igwiki/metr...
Absent trivial errors, such misclassifications of entire countries have been caused in the past by ISP changes. (I think the biggest case was Australia at some point, it was in Erik Zachte's blog.) Things like moving large IP ranges or slices of traffic from one operator to another. If I remember correctly, some big internet exchanges have been built recently in Central Africa, which may have prompted changes.
I'm not sure at what rate the GeoIP information is updated.
Federico
OK, something is odd then. I'm sending a screenshot from Turnilo (let me know if it doesn't come through).
In Turnilo it goes to almost zero for ig.wikipedia. Other prominent languages in Nigeria are English and Hausa, and they also go somewhat down in the same period, but not nearly so sharply.
How can there be such a difference between unique devices and pageviews?
Also, if I try to look at unique_devices_per_domain_daily on Turnilo, I don't get any data after September 24 2017.
-- Amir Elisha Aharoni · אָמִיר אֱלִישָׁע אַהֲרוֹנִי http://aharoni.wordpress.com “We're living in pieces, I want to live in peace.” – T. Moore
2018-06-21 10:09 GMT+03:00 Federico Leva (Nemo) nemowiki@gmail.com:
I see the baseline is less than 200k monthly unique devices and there were no huge drops: https://analytics.wikimedia.org/dashboards/vital-signs/#proj ects=igwiki/metrics=MonthlyUniqueDevices
Absent trivial errors, such misclassifications of entire countries have been caused in the past by ISP changes. (I think the biggest case was Australia at some point, it was in Erik Zachte's blog.) Things like moving large IP ranges or slices of traffic from one operator to another. If I remember correctly, some big internet exchanges have been built recently in Central Africa, which may have prompted changes.
I'm not sure at what rate the GeoIP information is updated.
Federico
Hi Amir, I think this ticket https://phabricator.wikimedia.org/T187014 describes exactly the problem (Opera-proxy change :) Cheers Joseph
On Thu, Jun 21, 2018 at 9:33 AM, Amir E. Aharoni < amir.aharoni@mail.huji.ac.il> wrote:
OK, something is odd then. I'm sending a screenshot from Turnilo (let me know if it doesn't come through).
In Turnilo it goes to almost zero for ig.wikipedia. Other prominent languages in Nigeria are English and Hausa, and they also go somewhat down in the same period, but not nearly so sharply.
How can there be such a difference between unique devices and pageviews?
Also, if I try to look at unique_devices_per_domain_daily on Turnilo, I don't get any data after September 24 2017.
-- Amir Elisha Aharoni · אָמִיר אֱלִישָׁע אַהֲרוֹנִי http://aharoni.wordpress.com “We're living in pieces, I want to live in peace.” – T. Moore
2018-06-21 10:09 GMT+03:00 Federico Leva (Nemo) nemowiki@gmail.com:
I see the baseline is less than 200k monthly unique devices and there were no huge drops: https://analytics.wikimedia.org/dashboards/vital-signs/#proj ects=igwiki/metrics=MonthlyUniqueDevices
Absent trivial errors, such misclassifications of entire countries have been caused in the past by ISP changes. (I think the biggest case was Australia at some point, it was in Erik Zachte's blog.) Things like moving large IP ranges or slices of traffic from one operator to another. If I remember correctly, some big internet exchanges have been built recently in Central Africa, which may have prompted changes.
I'm not sure at what rate the GeoIP information is updated.
Federico
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
In general, in cases like this it's worth checking https://wikitech. wikimedia.org/wiki/Analytics/Data_Lake/Traffic/Pageview_ hourly#Changes_and_known_problems_since_2015-06-16 (and the other two change/error logs linked there), where this incident was already listed.
On Wed, Jun 20, 2018 at 11:45 PM, Amir E. Aharoni < amir.aharoni@mail.huji.ac.il> wrote:
Hi,
I was browsing Turnilo, and found an odd thing.
Filter by:
- Time, January 2017 to May 2018
- Country: Nigeria
- Project: ig.wikipedia.org
Split by: Time
Select line chart
You'll immediately notice that there are almost zero pageviews from February 12 until April 15.
What could be the reason?
Thanks!
-- Amir Elisha Aharoni · אָמִיר אֱלִישָׁע אַהֲרוֹנִי http://aharoni.wordpress.com “We're living in pieces, I want to live in peace.” – T. Moore
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
