I’ve been exploring the enwiki database. I can find the page row for [[Iron]] MariaDB [enwiki_p]> select page_title from page where page_id = 14734; +------------+ | page_title | +------------+ | Iron | +------------+ It looks like it has the right number of revisions: MariaDB [enwiki_p]> select count(*) from revision where rev_page = 14734; +----------+ | count(*) | +----------+ | 5560 | +----------+ But, all of the rev_text_ids are 0 MariaDB [enwiki_p]> select rev_text_id from revision where rev_page = 14734 and rev_text_id != 0; Empty set (0.02 sec) The schema description seems pretty straight-forward. What am I not understanding? _______________________________________________ Cloud mailing list Cloud(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/cloud

Hmmm, interesting. I did read [[Help:Toolforge/Database]] where it says: Tool and Tools users are granted access to replicas of the production databases. Private user data has been redacted from these replicas (some rows are elided and/or some columns are made NULL depending on the table). For most practical purposes this is identical to the production databases and sharded into clusters in much the same way. But didn’t realize that applied to things like rev_text_id. I assumed it was just stuff like user’s passwords and email addresses. If stuff as basic as rev_text_id is redacted, that really stretches the meaning of "For most practical purposes this is identical to the production databases”. I assume by “the API” you mean https://www.mediawiki.org/wiki/API:Main_page ? On Oct 1, 2017, at 12:10 AM, Alex Monk <krenair(a)gmail.com> wrote: The MediaWiki schema description is only valid for the underlying database, you do not have access to that as a labs user - you just have security-sanitised views. rev_text_ids are not useful to you as you cannot access revision texts via the DBs - you must go through the API. On 1 October 2017 at 04:31, Roy Smith <roy(a)panix.com> wrote: I’ve been exploring the enwiki database. I can find the page row for [[Iron]] MariaDB [enwiki_p]> select page_title from page where page_id = 14734; +------------+ | page_title | +------------+ | Iron | +------------+ It looks like it has the right number of revisions: MariaDB [enwiki_p]> select count(*) from revision where rev_page = 14734; +----------+ | count(*) | +----------+ | 5560 | +----------+ But, all of the rev_text_ids are 0 MariaDB [enwiki_p]> select rev_text_id from revision where rev_page = 14734 and rev_text_id != 0; Empty set (0.02 sec) The schema description seems pretty straight-forward. What am I not understanding? _______________________________________________ Cloud mailing list Cloud(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/cloud _______________________________________________ Cloud mailing list Cloud(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/cloud _______________________________________________ Cloud mailing list Cloud(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/cloud

I’m not seeing how to access the wikitext for a specific revision via the API.

What I want to do is get the wikitext for every revision of a page.

I’m not seeing how to access the wikitext for a specific revision via the API. I can get the HTML with /page/html/{title}/{revision}, but I don’t see how to get the wikitext. Do I really need to get the HTML and then feed that through /transform/html/to/wikitext? That seems suboptimal. Not to mention rate limited :-( What I want to do is get the wikitext for every revision of a page.