Does this re-open the door for us to potentially work with them? On Wed, Oct 24, 2012 at 11:04 AM, Alolita Sharma <asharma(a)wikimedia.org (mailto:asharma@wikimedia.org)> wrote: -- Jessie Wild Learning & Evaluation Wikimedia Foundation Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! Donate to Wikimedia (https://donate.wikimedia.org/) _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org (mailto:Analytics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/analytics

Jessie: I don't think so, we've now invested a significant amount of effort in building a dedicated infrastructure. It would have been awesome to have an off-the-shelf solution at that time, but the timing of the announcement is unfortunate and I suspect incompatible with our roadmap. Diederik should be able to expand on this. The metamx dashboard remains one of the best examples of how a usable dashboard should look like that doesn't require analysts to operate, but it also requires significant hardware to run (MetaMX use 800+ cores on EC2). Dario On Oct 24, 2012, at 11:06 AM, Jessie Wild <jwild(a)wikimedia.org (mailto:jwild@wikimedia.org)> wrote: _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org (mailto:Analytics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/analytics

If we don't use it directly, I can always borrow any interface ideas that people find compelling. I'll be looking at it but let me know if you have favorite features. On Wed, Oct 24, 2012 at 2:37 PM, David Schoonover <dsc(a)wikimedia.org (mailto:dsc@wikimedia.org)> wrote: _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org (mailto:Analytics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/analytics

a good starting point, if you guys haven't played with it, is to try out their Wikipedia edit dashboard: https://dash.metamx.com/wikipedia_editstream (you'll have to create an account if you haven't got one: https://dash.metamx.com/wikipedia_editstream/signup ) I might be wrong but I was under the impression they had released their whole visualization front-end. In any case Mike Driscoll is a nice person to talk to and they are based a few blocks from WMF if we want to follow up with them. Dario On Oct 24, 2012, at 11:47 AM, David Schoonover &lt;dsc(a)wikimedia.org&gt; wrote: Totally agreed. The same for Limn :) -- David Schoonover dsc(a)wikimedia.org On Wednesday, 24 October 2012 at 11:42 a, Dan Andreescu wrote: If we don't use it directly, I can always borrow any interface ideas that people find compelling. I'll be looking at it but let me know if you have favorite features. On Wed, Oct 24, 2012 at 2:37 PM, David Schoonover &lt;dsc(a)wikimedia.org&gt;wrote;wrote: Yeah, they've got a set of really good graphic and interaction designers. Everything I've ever seen from them has been slick. But I agree with Dario. 1. We're not looking for an end-to-end solution at this point (no matter how often we might get calls and emails pitching them). 2. They didn't open source the dashboard, only their datastore. This isn't surprising, as that's a large portion of the value they add. Plus, we absolutely cannot use SaaS for most analytic purposes because of privacy concerns. If it were fully open and we could host the application ourselves, we definitely would have considered it six months ago. While that ship has sailed, I would still love to pursue other ways of working together, as I have a lot of respect for the MetaMX guys. -- David Schoonover dsc(a)wikimedia.org On Wednesday, 24 October 2012 at 11:27 a, Dario Taraborelli wrote: Jessie: I don't think so, we've now invested a significant amount of effort in building a dedicated infrastructure. It would have been awesome to have an off-the-shelf solution at that time, but the timing of the announcement is unfortunate and I suspect incompatible with our roadmap. Diederik should be able to expand on this. The metamx dashboard remains one of the best examples of how a usable dashboard should look like that doesn't require analysts to operate, but it also requires significant hardware to run (MetaMX use 800+ cores on EC2). Dario On Oct 24, 2012, at 11:06 AM, Jessie Wild &lt;jwild(a)wikimedia.org&gt; wrote: Does this re-open the door for us to potentially work with them? On Wed, Oct 24, 2012 at 11:04 AM, Alolita Sharma &lt;asharma(a)wikimedia.org&gt;wrote;wrote: Awesome! On Wed, Oct 24, 2012 at 9:43 AM, Dario Taraborelli &lt;dtaraborelli(a)wikimedia.org&gt; wrote: partnership/collaboration with MetaMarkets was that part of their analytics stack was proprietary. Today they announced that they are open sourcing Druid, the distributed data store that powers their dashboards: -- Alolita Sharma Director of Engineering Wikimedia Foundation _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics -- *Jessie Wild Learning & Evaluation * *Wikimedia Foundation* * * Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! Donate to Wikimedia <https://donate.wikimedia.org/> _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

the data they are using is from the IRC recentchanges feed so in principle they should have all projects. I guess they arbitrarily decided to expose only the top 36. Keep in mind that this is a proof of concept that they developed based on the data sources we publish, I might be wrong but I expect they won't put a lot of pro bono effort into maintaining/expanding this tool any further without stronger adoption. On Oct 24, 2012, at 6:11 PM, John Vandenberg &lt;jayvdb(a)gmail.com&gt; wrote: I see they only include major languages. Could they load in the other 100,000+ page languages? John Vandenberg. sent from Galaxy Note On Oct 25, 2012 2:31 AM, "Dario Taraborelli" &lt;dtaraborelli(a)wikimedia.org&gt; wrote: _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics