Cross posting. <span></span><br><br>---------- Forwarded message ----------<br>From: <b>Dan Andreescu</b> &lt;<a href="mailto:dandreescu@wikimedia.org">dandreescu@wikimedia.org</a>&gt;<br>Date: Friday, July 29, 2016<br>Subject: [Analytics] [Pageview API] Data Retention Question<br>To: Analytics List &lt;<a href="mailto:analytics@lists.wikimedia.org">analytics@lists.wikimedia.org</a>&gt;<br><br><br><div dir="ltr">Dear Pageview API consumers,<div><br></div><div>We would like to plan storage capacity for our pageview API cluster.  Right now, with a reliable RAID setup, we can keep <b>18 months</b> of data.  If you&#39;d like to query further back than that, you can download dump files (which we&#39;ll make easier to use with python utilities).</div><div><br></div><div>What do you think?  Will you need more than 18 months of data?  If so, we need to add more nodes when we get to that point, and that costs money, so we want to check if there is a real need for it.</div><div><br></div><div>Another option is to start degrading the resolution for older data (only keep weekly or monthly for data older than 1 year for example).  If you need more than 18 months, we&#39;d love to hear your use case and something in the form of:</div><div><br></div><div>need daily resolution for 1 year</div><div>need weekly resolution for 2 years</div><div>need monthly resolution for 3 years</div><div><br></div><div>Thank you!</div><div><br></div><div>Dan</div></div>
<br>