Hi Dan,How are you! This is Victor, It's been a while since we meet at the 2018 Wikimedia Dev Summit. I hope you are doing great.As I mentioned to you, my team works on extracting the knowledge from Wikipedia. Currently it's undergoing a project that expands language coverage. My teammate Yuan Gao(cc'ed here) is tech leader of this project.She plans to monitor the list of all the current available wikipedia's sites and the number of articles for each language, so that we can compare with our extraction system's output to sanity-check if there is a massive breakage of the extraction logic, or if we need to add/remove languages in the event that a new wikipedia site is introduced to/remove from the wikipedia family.I think your team at Analytics at Wikimedia probably knows the best where we can find this data. Here are 4 places we already know, but doesn't seem to have the data.
List_of_Wikipedias. has the information we need, but the list is manually edited, not automatic
EN/Sitemap.htm, has the full list, but the information seems pretty out of date(last updated almost a month ago)
- StatsV2 UI: https://stats.wikimedia.
org/v2/#/all-projects, I can't find the full list nor the number of articles
- API https://wikimedia.org/api/
rest_v1/suggested by elukey on #wikimedia-analytics channel, it doesn't seem to have # of article informationDo you know what is a good place to find this information? Thank you!Victor---------- Forwarded message ----------
From: Yuan Gao <email@example.com>
Date: Wed, Mar 28, 2018 at 4:15 PM
Subject: Monitor the number of Wikipedia sites and the number of articles in each site
To: Zainan Victor Zhou <firstname.lastname@example.org>
Cc: Wenjie Song <email@example.com>, WikiData <firstname.lastname@example.org>Hi Victor,as we discussed in the meeting, I'd like to monitor:1) the number of Wikipedia sites2) the number of articles in each siteCan you help us to contact with WMF to get a realtime or at least daily update of these numbers? What we can find now is https://en.wikipedia.org/wi
ki/List_of_Wikipedias, but the number of Wikipedia sites is manually updated, and possibly out-of-date.The monitor can help us catch such bugs.--Yuan Gao