On Nov 4, 2014, at 11:55 AM, Aaron Halfaker
<ahalfaker(a)wikimedia.org> wrote:
Hey guys,
Sorry for the late response, but I'm still not sure what lives in
/a/eventlogging/archive/*
Will deleting from there affect what logs we have stored in the DB? Is this an
intermediate log storage place, a canonical one, etc.?
What will we no longer be able to do after it is pruned?
-Aaron
On Thu, Oct 30, 2014 at 2:35 PM, Nuria Ruiz <nuria(a)wikimedia.org> wrote:
Also, I'm not clear on the significance of the
EL archive directory. Can you remind me/direct me to documentation?
Well, the logs
just record the incoming pipeline of events, we have used them to troubleshoot operational
issues in the past but the bulk of data analysis in EL happens from data stored on
database.
Some info here:
https://wikitech.wikimedia.org/wiki/EventLogging#Data_storage
On Thu, Oct 30, 2014 at 12:22 PM, Aaron Halfaker <ahalfaker(a)wikimedia.org> wrote:
Nuria, can you specify which logs will be trimmed.
Also, I'm not clear on the significance of the EL archive directory. Can you remind
me/direct me to documentation?
On Thu, Oct 30, 2014 at 12:36 PM, Nuria Ruiz <nuria(a)wikimedia.org> wrote:
Hello,
To comply with our privacy policy we are going to purge logs in 1002 that are older than
90 days. Please let us know whether this is an issue. We hope to have these changes done
by the end of next week.
A concrete example:
Logs in, for example, the eventlogging archiving directory:
@stat1002:/a/eventlogging/archive$
will be restricted to the last 90 days.
Thanks,
Nuria
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org