<div dir="ltr">BTW, because SuggestBot uses number of backlinks to penalize highly linked articles in its link traversal code, I maintain backlink counts for all main namespace pages that are not redirects for en, pt, ru, sv, no, fa, and hu wikis (I think this would cover #1 in Navino's list posted earlier). The tables are on the replicated servers (because we need to join them with the page table) and are updated once a day. If anyone would like access to any of them, get in touch with me off-list.<div><br></div><div><br></div><div>Regards,</div><div>Morten</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On 9 September 2014 10:49, Tim Landscheidt <span dir="ltr"><<a href="mailto:tim@tim-landscheidt.de" target="_blank">tim@tim-landscheidt.de</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="">Navino Evans <<a href="mailto:navino@histropedia.com">navino@histropedia.com</a>> wrote:<br>
<br>
> That's great to know, thank you.<br>
<br>
> We'll make sure we only use the API within that limit - basically just for<br>
> individual calls when a user adds a new event to our database.<br>
<br>
> For the bulk processing, we would need to update the backlinks information<br>
> as a monthly maintenance task, so I wouldn't want to trouble you with this<br>
> each time.<br>
<br>
> Would you rather we stick with data dump processing for the large scale<br>
> stuff?<br>
<br>
</span>> [...]<br>
<br>
Do note that you don't have to channel all your requests<br>
through John :-). Apparently, you have developers who could<br>
probably set up this themselves easily, so they could just<br>
apply for access.<br>
<br>
I'm not sure if there have been precedents, but I assume if<br>
you:<br>
<br>
1. don't try to have WMF subsidize your business model,<br>
i. e. don't move heavy lifting stuff to Labs just because<br>
you want to save some CPU time,<br>
<br>
2. ensure that all tools you create and run on Labs are re-<br>
leased as open source, and<br>
<br>
3. ideally make the query results usable by others<br>
<br>
there is nothing wrong with running those queries yourself.<br>
<span class="HOEnZb"><font color="#888888"><br>
Tim<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
<br>
_______________________________________________<br>
Labs-l mailing list<br>
<a href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/labs-l</a><br>
</div></div></blockquote></div><br></div>