Analytics September 2012

analytics@lists.wikimedia.org

20 participants
18 discussions

MySQL on stat1
by Ori Livneh 17 Sep '12

17 Sep '12

Yo 'lytics, Where do I apply for access to the MySQL instance on stat1? I affirm that I am not a past or present member of the Communist Party. -- Ori Livneh ori(a)wikimedia.org

4 4

Announcing initial version of gerrit-stats
by Diederik van Liere 14 Sep '12

14 Sep '12

Hi everybody, The Analytics Team is happy to announce the first version of gerrit-stats. Gerrit-stats keeps track of the backlog of codereview for Git individual repositories. Gerrit-stats dashboard is available at http://gerrit-stats.wmflabs.org Currently, it has a few example charts but we can add your repo to the dashboard as well, just let us know! To create a new chart yourself visit http://gerrit-stats.wmflabs.org/graphs/new This will launch the interface to create your own graph. Click on 'Data' and Click on 'Add Metric' and a pull down menu with all the repositories will appear. Select the repository of your interest and select the metric that you want to visualize. Once you have selected all the metrics of your interest go back to 'Info' and enter a slug name. Then press 'Enter' and then click the 'Save' button. Currently, the following metrics are tracked (on a daily basis): 1) Number of new changesets 2) Number of changesets without any codereview per day (this excludes automated review from lint and lint-like reviewers). 3) Number of changesets waiting for merge per day (only applies to changesets that received only positive reviews) 4) Number of changesets self reviewed. And for metrics 2 and 3, there is a version for volunteers and for WMF staff. Gerrit-stats is visualized using Limn, Limn is the data GUI developed by the Analytics Team and lead by David Schoonover. Limn is available on https://github.com/wikimedia/limn This is the initial release and I am sure there will be bugs and issues. If you have any questions, or problems using gerrit-stats then either: 1) Head over to #wikimedia-analytics on IRC and ask us 2) Send an email to the analytics mailinglist 3) Contact us directly. Not Yet Frequently Asked Questions: 1) How do I create a visualization of the code review metrics for a repo? Visit gerrit-stats.wmflabs.org/graphs/new This will launch the interface to create your own graph. Click on 'Data' and Click on 'Add Metric' and a pull down menu with all the repositories will appear. Select the repository of your interest and select the metric that you want to visualize. Once you have selected all the metrics of your interest press the 'Save' button. Your are all set and you can use this permalink for future reference. 2) How do I edit an existing chart? Simply append /edit to the URL of your chart and you can edit it. 3) My repository is not showing up in the pull down menu, what happened? By default, all repositories are automagically kept track of as soon they contain a single commit. There are two exceptions: 1) If your repository name contains the string 'test' or 'private', it will be ignored. 2) The orgchart repository is not tracked by gerrit-stats, this is a known issue but Chad and I haven't been able to figure out what causes this. If your repository is missing then please contact me. 4) Will you add metrics for individual committers? Right now, the unit of analysis is a repository but it is definitely possible to keep track of codereview metrics for individuals. However, I would like to hear some use-cases first before embarking on this. 5) The chart looks to spikey, how can I have smoother lines? 1) Go to http://gerrit-stats.wmflabs.org/graphs/name_of_chart/edit 2) Click on 'Options' 3) Click on 'Advanced' (right side of screen) 4) Click on 'rollPeriod' (bottom of screen, yellow box) 5) This allows to create a moving average, so you can replace the 1 with 7 meaning that each datapoint is the average of the past 7 days. This option applies to both metrics but it really smooths out the outliers. 6) I want a new metric. How do I go about it? There are two options: a) Clone the gerrit-stats repo and hack away,it's Python btw. We are happy to help out! b) Send us a suggestion for a new metric, the more precise the more useful! On behalf of the Analytics Team, Diederik

2 1

Repository request
by Ori Livneh 13 Sep '12

13 Sep '12

Hi guys, Just a heads up that I requested a repository ("Glass", after the current fashion of simple nouns) under the "analytics" Git namespace. I'd like to consolidate all the event logging infrastructure code there. (This scope is distinct from E3Analysis, which collects data analysis code.) Let me know if you have any objections. O -- Ori Livneh ori(a)wikimedia.org

2 4

Re: [Analytics] [Wmfall] Welcome, Dan Andreescu!
by Diederik van Liere 10 Sep '12

10 Sep '12

Yay! Welcome Dan, it's awesome to have you onboard! D On Mon, Sep 10, 2012 at 1:34 PM, Rachel Farrand <rfarrand(a)wikimedia.org>wrote: > Welcome Dan! Nice to meet you this morning. :) > Rachel > > On Mon, Sep 10, 2012 at 10:32 AM, Rob Lanphier <robla(a)wikimedia.org>wrote: > >> Hi everyone, >> >> I'm pleased to announce Dan Andreescu will join the Analytics team >> today as our new Javascript/UI engineer. In this role, he will be >> taking on development of Limn[1], our data visualization and dashboard >> building toolkit. He is also going to be responsible for the >> front-end for Kraken[2], the self-servicing data platform that is >> being developed by the Analytics team. >> >> Dan studied Computer Science at Cornell University and he is a builder >> at heart. He is passionate about designing and building almost >> anything: furniture, software, tools and houses. An example of this >> is his work with Earthship[3]: radically sustainable buildings made >> with recycled materials. Clearly, Dan loves working on big problems >> and that's why we are so excited to have him join the Foundation (and >> the Analytics Team in particular)! >> >> Dan is based out of Philadelphia, and is on IRC as "milimetric". >> Please join me in welcoming Dan! >> >> Rob >> [1] https://github.com/wikimedia/limn >> [2] http://www.mediawiki.org/wiki/Analytics/Kraken >> [3] http://earthship.com/ >> >> _______________________________________________ >> Wmfall mailing list >> Wmfall(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wmfall >> > > > _______________________________________________ > Wmfall mailing list > Wmfall(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wmfall > >

2 1

request: "average code review wait time" dashboard
by Sumana Harihareswara 10 Sep '12

10 Sep '12

http://eaves.ca/2012/08/30/community-managers-expectations-experience-and-c… "This is why I keep saying things like code review dashboards matter. I bet if this user could at least *see* what the average wait time is for code review he'd have been much, much happier. Even if that wait time were a month... at least he'd have known *what to expect.* Of course improving the experience and community culture are harder problems to solve... but they clearly would have helped as well." I would love for someone to integrate that kind of wait-time indicator into https://toolserver.org/~bawolff/gerrit-stats.htm or http://gerrit-stats.wmflabs.org/ . My suggested stats: the min/median/average/maximum time between a patchset's submission and its merge or abandonment, and the min/median/average/maximum time between patchset submission and any +1 or -1, divided up by Gerrit repository. Anyone who works on this will probably also want to join the FLOSS communities metrics working group: http://www.theopensourceway.org/mailman/listinfo/metrics-wg -- Sumana Harihareswara Engineering Community Manager Wikimedia Foundation

1 0

Welcome, Dan Andreescu!
by Rob Lanphier 10 Sep '12

10 Sep '12

Hi everyone, I'm pleased to announce Dan Andreescu will join the Analytics team today as our new Javascript/UI engineer. In this role, he will be taking on development of Limn[1], our data visualization and dashboard building toolkit. He is also going to be responsible for the front-end for Kraken[2], the self-servicing data platform that is being developed by the Analytics team. Dan studied Computer Science at Cornell University and he is a builder at heart. He is passionate about designing and building almost anything: furniture, software, tools and houses. An example of this is his work with Earthship[3]: radically sustainable buildings made with recycled materials. Clearly, Dan loves working on big problems and that's why we are so excited to have him join the Foundation (and the Analytics Team in particular)! Dan is based out of Philadelphia, and is on IRC as "milimetric". Please join me in welcoming Dan! Rob [1] https://github.com/wikimedia/limn [2] http://www.mediawiki.org/wiki/Analytics/Kraken [3] http://earthship.com/

2 1

Analytics roadmap, definitions, and proposal for replacement of udp2log
by Sumana Harihareswara 06 Sep '12

06 Sep '12

Analytics did Limn, Kraken, and Report Card work in August, described in https://blog.wikimedia.org/2012/09/04/engineering-august-2012-report/ . For context, you might also like to review their roadmap, goals, and metrics definitions: * https://www.mediawiki.org/wiki/Analytics/2012-2013_Roadmap * https://www.mediawiki.org/wiki/Wikimedia_Engineering/2012-13_Goals#Analytics * https://www.mediawiki.org/wiki/Analytics/Metric_definitions In August and early September, Andrew Otto and Dave Schoonover concluded their research into distributed logging systems to replace udp2log for Kraken,: check out https://www.mediawiki.org/wiki/Analytics/Kraken/Logging_Solutions_Overview . "The options discussed here will be used as the main data firehose into the Analytics Kraken Cluster. This is an overview meant to summarize the research that the Analytics team has done, and will be used to start a discussion with ops." -- Sumana Harihareswara Engineering Community Manager Wikimedia Foundation

2 1

Fwd: Building Analytical Applications on Hadoop
by Dario Taraborelli 04 Sep '12

04 Sep '12

Cloudera's Josh Wills at Trulia on Nov 6 Begin forwarded message: > From: SF Data Mining <info(a)meetup.com> > Date: September 4, 2012 13:21:00 PDT > To: dario.taraborelli(a)gmail.com > Subject: You're invited to Building Analytical Applications on Hadoop > > > > > NEW MEETUP > Building Analytical Applications on Hadoop > SF Data Mining > Added by Todd Holloway > Tuesday, November 6, 2012 > 6:30 PM > Trulia > 116 New Montegomery St > 9th Floor > San Francisco, CA 94109 > Will you attend? > Yes > No > 274 spots left! > We're very excited to have Josh Wills, the Director of Data Science at Cloudera, giving a talk about the intersection of Data Science and Hadoop. Come join us! > 6:30pm. Doors open. Pizza and beer will be served. > 7:00pm. Talk begins. Social+beer... > LEARN MORE > More Meetups from this group > SEP > 24 > Graph Database Workshop > Monday, September 24, 2012 6:30 PM · 168 attending > RSVP > > Follow us! > > Add info(a)meetup.com to your address book to receive all Meetup emails > To unsubscribe from similar emails from this Meetup Group, click here > Meetup, PO Box 4668 #37895 New York, New York 10163-4668 > Meetup HQ in NYC is hiring! http://www.meetup.com/jobs/ >

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

Analytics September 2012