Hello,
I'm working on adding performance instrumentation to the Parsoid codebase with statsd/node-txstatsd, and then visualizing the metrics via Grafana. I'm at the stage where I'm looking to add the metrics' namespaces and schema to the WMF Grafana configs.
It looks like WMF has Grafana working with Graphite/Carbon as a metrics database and ElasticSearch as the db database, where can I find the production Carbon config files to input the settings for tmy metrics?
Also, from my research WMF's carbon data retention schema is set to '1m:1y, 10m:10y', should I default to this as my retention schema? Note that the metrics are fired off anytime the Parsoid API is used so each datapoint doesn't necessarily represent a minute/second/etc of data.
Thanks, Christy
HHi Chisty,
Good questions! Analytics hasn’t (yet?) had much interaction with Graphite and Grafana at WMF. I’m on the Ops team, and the most I’ve used it for is backend system metrics. I’ve used our Grafana instance to make a dashboard or two, but I’ve always done this manually in the Grafana interface.
I’d recommend reaching out to the operations mailing list: https://lists.wikimedia.org/mailman/listinfo/ops https://lists.wikimedia.org/mailman/listinfo/ops
-Ao
On Jan 28, 2015, at 19:14, E.C Okpo ecokpo@gmail.com wrote:
Hello,
I'm working on adding performance instrumentation to the Parsoid codebase with statsd/node-txstatsd, and then visualizing the metrics via Grafana. I'm at the stage where I'm looking to add the metrics' namespaces and schema to the WMF Grafana configs.
It looks like WMF has Grafana working with Graphite/Carbon as a metrics database and ElasticSearch as the db database, where can I find the production Carbon config files to input the settings for tmy metrics?
Also, from my research WMF's carbon data retention schema is set to '1m:1y, 10m:10y', should I default to this as my retention schema? Note that the metrics are fired off anytime the Parsoid API is used so each datapoint doesn't necessarily represent a minute/second/etc of data.
Thanks, Christy
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
I am cc-ing Ori who I believe set up graphana. While we have some opsy graphs in the tool our team has not used it much to date. Hopefully Ori can provide documentation or pointers.
Thanks,
Nuria
On Jan 28, 2015, at 7:14 PM, E.C Okpo ecokpo@gmail.com wrote:
Hello,
I'm working on adding performance instrumentation to the Parsoid codebase with statsd/node-txstatsd, and then visualizing the metrics via Grafana. I'm at the stage where I'm looking to add the metrics' namespaces and schema to the WMF Grafana configs.
It looks like WMF has Grafana working with Graphite/Carbon as a metrics database and ElasticSearch as the db database, where can I find the production Carbon config files to input the settings for tmy metrics?
Also, from my research WMF's carbon data retention schema is set to '1m:1y, 10m:10y', should I default to this as my retention schema? Note that the metrics are fired off anytime the Parsoid API is used so each datapoint doesn't necessarily represent a minute/second/etc of data.
Thanks, Christy
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics