Hi Everyone,
The development team is in the middle of the sprint that I sent you an update on last week; At the end of next week I'll update this list with what we accomplished during the sprint.
For this week, here is the current status of the Epicshttps://www.mediawiki.org/wiki/Analytics/Prioritization_Planningwe are working on:
Context ====== List of Epics is herehttps://www.mediawiki.org/wiki/Analytics/Prioritization_Planning . Analytics Mingle board is herehttps://wikimedia.mingle.thoughtworks.com/projects/analytics/overview
Epics ==== Production Issues
- Resolved on No sampled-1000 tsv file for 2014-02-06 on stat1002https://bugzilla.wikimedia.org/show_bug.cgi?id=60955 - Wikipedia Zero team investigated ~30% increase of number of lines zero tsvs between 20140218 and 20140220 filehttps://bugzilla.wikimedia.org/show_bug.cgi?id=61660 - Wikipedia Zero team investigated on light drop in zero requests around 2014-02-08 https://bugzilla.wikimedia.org/show_bug.cgi?id=61274 - Data for ULSFO Cache performancehttps://trello.com/c/dNODZnr0/108-measuring-ulsfo-s-impact-on-site-performanceprepared for Ops blog post
Metric Definition Standardization
- Current deliverables from Research and Data (New Editor Metrics) and Development (Page Views) internally reviewed and waiting start of community review process
Accurate Pageviews for Wikipedia Zero
- Dashboards updated to cover all active partners - Port of legacy processing scripts to Hadoop prioritized and will begin next sprint
Editor Engagement Vital Signs
- Sync-up meeting confirmed metrics for first release (New Editors) finished by development - WIkimetrics changes to support scheduled queries under development - Met with FR Tech to discuss results of visualization library review/Wikimetrics -- loosely coupled collaboration seems likely on both.
Metrics about Mobile Usage
- Prototype of mobile browser report running on unsampled mobile data on Hadoop - Decision made to use UA Parser https://github.com/tobie/ua-parser to parse out sanitized UA information for above report - Worked on implementing Hive unit testshttps://wikimedia.mingle.thoughtworks.com/projects/analytics/cards/1293
Simplify Limn Dashboard Deployment
- Proposal from research to simplify dashboard creation for certain "counting' use cases reviewed; will be assessed for next sprint.
Page View API
- We have specs for new server from Henrik for stats.grok.se; Currently working with vendor to purchase. - Worked on implementation of new JVM deployment systemhttps://wikimedia.mingle.thoughtworks.com/projects/analytics/cards/1374 - Worked on puppetizing Camus kafka-HDFS integration toolhttps://wikimedia.mingle.thoughtworks.com/projects/analytics/cards/1313 - Worked on Kaftatee to support legacy analytics systemshttps://wikimedia.mingle.thoughtworks.com/projects/analytics/cards/1425
Please let me know if you have any questions
-Toby