Hi,
I am working on adding MediaViewer opt-out result tracking to multimedia-metrics.wmflabs.org (which maps to limn1). Opt-out data is stored in the mediawiki databases, but only the current state, so I have to store the daily results somewhere to be able to show a timechart. I'm asking for advice on the best way to do that.
The two obvious approaches are: - store the results in mysql on the same server that holds the wiki db (analytics-store.eqiad.wmnet) - store them in mysql locally, on the limn1 instance
The first seems easier to me, since the second would mean transferring data between different DB servers, which is awkward in MySQL; but I don't know well the setup of limn1 and analytics-store. Is there any reason to take the other route (or some third way)? If not, what's the way to get a new DB created on analytics-store where I can store the results?
thanks Gergő
Gerco, I was trying to access: http://multimedia-metrics.wmflabs.org/ but no luck.
There is a third choice as far as I can see (my team needs to double check me on this).
You could have a metric in wikimetrics that harvest the data you are interested on from enwiki,eswiki, arwiki databases (hopefully this is the db we are talking about) and serve that data through limn (for now).
There is some work that both of us would need to do to get this rolling but it might be a viable option.
For example:
Wikimetrics is serving here the number of newly registered users every day, that report is executed daily on enwiki, eswiki...etc and data is shown in limn (for now). http://test-reportcard.wmflabs.org/graphs/newly_registered
Data comes from our staging instance of wikimetrics, we will be deploying this functionality to live pretty soon: https://metrics-staging.wmflabs.org/static/public/datafiles/NewlyRegistered/...
On Wed, Jul 9, 2014 at 3:29 AM, Gergo Tisza gtisza@wikimedia.org wrote:
Hi,
I am working on adding MediaViewer opt-out result tracking to multimedia-metrics.wmflabs.org (which maps to limn1). Opt-out data is stored in the mediawiki databases, but only the current state, so I have to store the daily results somewhere to be able to show a timechart. I'm asking for advice on the best way to do that.
The two obvious approaches are:
- store the results in mysql on the same server that holds the wiki db
(analytics-store.eqiad.wmnet)
- store them in mysql locally, on the limn1 instance
The first seems easier to me, since the second would mean transferring data between different DB servers, which is awkward in MySQL; but I don't know well the setup of limn1 and analytics-store. Is there any reason to take the other route (or some third way)? If not, what's the way to get a new DB created on analytics-store where I can store the results?
thanks Gergő
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
You could have a metric in wikimetrics that harvest the data you are interested on from enwiki,eswiki, arwiki databases
I ran Gergo's query ( https://gerrit.wikimedia.org/r/#/c/143501/2/optout/template.sql) and sadly the data is not available on labsdb.
- store the results in mysql on the same server that holds the wiki db
(analytics-store.eqiad.wmnet)
If you're using the "research" user, it can write to the database called "staging" on analytics-store. So just go ahead and do that right now, but caveat below
- store them in mysql locally, on the limn1 instance
We don't really want to mix purposes for the limn1 server (or future dashboarding servers). Though I'm a little concerned now that limn1 seems to have access to analytics-store. This should not be the case as that would violate the private / public barrier. The mobile web team has solved this problem with this project: https://git.wikimedia.org/tree/analytics%2Flimn-mobile-data. If you're using cron on limn1 to fetch data from analytics-store, that should not be allowed. Let's continue the conversation if that's the case.
Thanks,
Dan