Analytics June 2017

analytics@lists.wikimedia.org

20 participants
15 discussions

Upcoming reboots of all the Analytics hosts (including stat1002, stat1003 and stat1004)
by Luca Toscano 20 Jun '17

20 Jun '17

Hi everybody, due to a severe kernel vulnerability (*https://www.qualys.com/2017/06/19/stack-clash/stack-clash.txt <https://www.qualys.com/2017/06/19/stack-clash/stack-clash.txt>)* we need to reboot the stat1002, stat1003 and stat1004 hosts to install the new kernel. The reboots are scheduled for 8 AM CEST tomorrow (Jun 21st), please follow up with me or anybody in the Analytics team if you have ongoing work that can't be stopped. All the Analytics hosts will be rebooted too during the next hours; event if this maintenance shouldn't cause any major issue, you might experience some service degradation. More up to date information on IRC (in the analytics and operations channels) and T168381. Thanks and apologies in advance for the trouble. Luca and Andrew

1 0

Unique Devices get a lifting
by Joseph Allemandou 15 Jun '17

15 Jun '17

Hello Analytics Fellows, In preparation for a future where unique devices will be counted per-domain and project-wide, we have renamed the unique_devices (also named last_access_uniques in some places) to unique_devices_per_domain. - New URL for dumps: https://dumps.wikimedia.org/other/unique_ devices/per_domain/ - New pivot dataset (needs LDAP credentials): https://pivot. wikimedia.org/#unique-devices-per-domain-daily <https://pivot.wikimedia.org/#unique-devices-per-domain-daily> - New hive table (need cluster access): wmf.unique_devices_per_domain Existing data is still present (duplicated from the renamed one), and will be removed next Monday. Analytically yours, A-Team

1 0

Additional python libraries
by Adrian Bielefeldt 03 Jun '17

03 Jun '17

Hello everyone, I wanted to ask about installing additional python libraries on the analytics machines (specifically stat1002.eqiad.wmnet, regarding csvsort). Are we allowed to install libraries, or do we have to file a request with someone? Greetings, Adrian

3 3

Top editors in a certain namespace across sites?
by Andre Klapper 02 Jun '17

02 Jun '17

Hi, Does anyone know of a way to look up the top editors for a certain namespace (like "Module") across all Wikimedia sites? I'm asking as I'm wondering how to get more aware of developer activity outside of Wikimedia Git/Gerrit. Thanks for any ideas (or pointing out a better place to ask)! Cheers, andre -- Andre Klapper | Wikimedia Bugwrangler http://blogs.gnome.org/aklapper/

7 10

Friendly Remainder - Purging Data from eventlogging
by Nuria Ruiz 01 Jun '17

01 Jun '17

Team: This is just a friendly remainder regarding the fact that if you want to preserve data (of non private nature) in eventlogging beyond the 90 period you have to let us know via ticket or similar. The info per schema should be available on each schema's talk page. Purging info can be found here: https://wikitech.wikimedia.org/wiki/Analytics/EventLogging/Data_retention_a… Thanks, Nuria

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

Analytics June 2017