<div dir="ltr">Thanks Toby!<div><br></div><div>This change will be deployed today.</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Mar 2, 2016 at 11:53 AM, Toby Negrin <span dir="ltr"><<a href="mailto:tnegrin@wikimedia.org" target="_blank">tnegrin@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks Madhu -- it's great to see the analytics team working proactively on things like this.<div><br></div><div>-Toby</div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="h5">On Wed, Mar 2, 2016 at 10:18 AM, Madhumitha Viswanathan <span dir="ltr"><<a href="mailto:mviswanathan@wikimedia.org" target="_blank">mviswanathan@wikimedia.org</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5"><div dir="ltr"><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px;background-color:rgb(255,255,255)">Hi all,</span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px;background-color:rgb(255,255,255)"> </span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px">The analytics team, in an effort to collect sensitive data less, plans to drop the clientIP field from the EventCapsule(</span><span style="margin:0px;padding:1px 0px"><a href="https://meta.wikimedia.org/wiki/Schema:EventCapsule)" style="margin:0px;padding:0px;white-space:pre-wrap" target="_blank">https://meta.wikimedia.org/wiki/Schema:EventCapsule)</a></span><span style="margin:0px;padding:1px 0px">, which is the wrapper for all events flowing into Eventlogging (Currently IPs and User Agents get purged after the 90 days mark). The field was originally meant only for debugging, but has served some research usecases. Most of these cases have been wrapped up at this point. It has also been used as a proxy to count number of devices visiting sites like our blog - and since IP's are not a good measure of that anyway - we plan to move such cases to use Piwik.</span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px;background-color:rgb(255,255,255)"> </span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px;background-color:rgb(255,255,255)">The rollout of the change will happen in stages (Drop clientIPs first on the EL end, then the EventCapsule in meta, and finally on the VarnishKafka end). It should be a clean deployment and there's no scheduled downtime - EL will keep working as is. What does change? ClientIP's will start being set as NULL in your mysql tables. If you update the Eventlogging schema you maintain - causing new tables to be created, the new tables will not have the clientIp field in them. The change is planned to be rolled out the week of 11th or 18th March '16, pending the completion of data collection for the ongoing QuickSurveys based research work.</span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px;background-color:rgb(255,255,255)"> </span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="background-color:rgb(255,255,255)"><span style="margin:0px;padding:1px 0px">Let us know if you have any questions/concerns on the list or on #wikimedia-analytics. The related phab ticket is here - </span><span style="margin:0px;padding:1px 0px"><a href="https://phabricator.wikimedia.org/T128407" style="margin:0px;padding:0px;white-space:pre-wrap" target="_blank">https://phabricator.wikimedia.org/T128407</a></span><span style="margin:0px;padding:1px 0px">.</span></span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px;background-color:rgb(255,255,255)"> </span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px">Thanks,</div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px;background-color:rgb(255,255,255)">Madhu Viswanathan</span></div><div style="margin:0px;padding:0px;color:rgb(0,0,0);font-family:'Helvetica Neue',Arial,sans-serif;line-height:16px"><span style="margin:0px;padding:1px 0px;background-color:rgb(255,255,255)">Software Engineer, Analytics</span></div>
</div>
<br></div></div>_______________________________________________<br>
Analytics mailing list<br>
<a href="mailto:Analytics@lists.wikimedia.org" target="_blank">Analytics@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/analytics" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/analytics</a><br>
<br></blockquote></div><br></div>
<br>_______________________________________________<br>
Analytics mailing list<br>
<a href="mailto:Analytics@lists.wikimedia.org">Analytics@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/analytics" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/analytics</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr">--Madhu :)</div></div>
</div>