I just announced this potential change in Scrum of Scrums and the Mobile team said they also would like to keep old data, but not for all of their schemas. They're cleaning up their graphs and we should check with them when we start deleting.
On Wed, May 28, 2014 at 2:56 AM, Nuria nuria@wikimedia.org wrote:
Second Dario for NavigationTiming data. Before archiving it I would like us to have a project for processing it. Also, graphs directly query the EL data store in many instances. Removing the data would mean we will only be showing 90 days of data on dashboards, that will send many complaints our way.
On May 28, 2014, at 5:17 AM, Dario Taraborelli dtaraborelli@wikimedia.org wrote:
On May 27, 2014, at 7:49 PM, Sean Pringle springle@wikimedia.org wrote:
On Wed, May 21, 2014 at 5:03 PM, Ori Livneh ori@wikimedia.org wrote:
On Tue, May 20, 2014 at 10:36 PM, Dario Taraborelli < dtaraborelli@wikimedia.org> wrote:
On May 20, 2014, at 10:09 PM, Sean Pringle springle@wikimedia.org wrote:
*Existing schemas* would need to be audited on a case by case basis.
By whom? :) Surely not Sean! It'd be great to get this process going.
We could start archiving data older than 90 days, see who complains about what, then put it back ;-)
Sorry, I seem to have missed Ori’s last question. I promise that if you prune logs like ServerSideAccountCreation you’ll get a lot of attention ;)
I created a few days ago a card to keep track of this [1]. Kevin and I will take the lead on this and connect to the relevant log owners.
Dario
[1] https://trello.com/c/F0DsiSXn/305-audit-historical-el-data-for-retention
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics