[Wikitech-l] Wikistats for all Wikimedia projects

Wikistats are now available for all Wikimedia projects. Stats have been generated from the latest dumps, which are from March 9. Wikipedias http://en.wikipedia.org/wikistats/EN/Sitemap.htm Wiktionaries (use refresh button when you see old stats) http://en.wikipedia.org/wikistats/wiktionary/EN/Sitemap.htm Wikiquotes http://en.wikipedia.org/wikistats/wikiquote/EN/Sitemap.htm Wikibooks http://en.wikipedia.org/wikistats/wikibooks/EN/Sitemap.htm Wikinews http://en.wikipedia.org/wikistats/wikinews/EN/Sitemap.htm Wikispecial: wikisource/meta/sep11/species/commons/foundation http://en.wikipedia.org/wikistats/wikispecial/EN/Sitemap.htm Sj wrote: A dedicated mirrored server for these and other background jobs (e.g. IBM history flow charts and Special Pages) would certainly help. Switching away from processing dumps towards direct SQL access has been suggested before. Especially with the upcoming database scheme change, dumps become more difficult to handle, though not impossible. I had my doubts about switching, because very heavy 'Special:' SQL queries have been often disabled or cancelled halfway to bring down server load, and the stats queries will be very heavy indeed. A separate server would make this less of an issue. Average CPU speed will do fine, memory no less than 1Gb, preferably 2GB. Even though I took great care to keep memory requirements at an acceptable level, some hash tables need to be in memory and their sizes grow like everything else around here. I hope you don't mean running-total literally, where all figures change every second :) At least it should be possible to generate new stats once or twice a week, instead of once a month (the latter depending on how often dumps are generated). Erik Zachte