Hi!
I just published the first version of a Go package which provides
utilities for processing
Wikidata entities JSON dumps and Wikimedia Enterprise HTML dumps. It
processes them in parallel on multiple cores, so processing is rather
fast. I hope it will be useful to others, too.
https://gitlab.com/tozd/go/mediawiki
Any feedback is welcome.
Mitar
--
http://mitar.tnode.com/https://twitter.com/mitar_m
Greetings XML Dump users and contributors!
This is your automatic monthly Dumps FAQ update email. This update
contains figures for the 20211201 full revision history content run.
We are currently dumping 945 projects in total.
---------------------
Stats for tlhwiktionary on date --
Total size of page content dump files for articles, current content only:
No info available (no full run date found)
Total size of page content dump files for all pages, current content only:
No info available (no full run date found)
Total size of page content dump files for all pages, all revisions:
No info available (no full run date found)
---------------------
Stats for enwiki on date 20211201
Total size of page content dump files for articles, current content only:
86,591,331,146
Total size of page content dump files for all pages, current content only:
190,740,317,768
Total size of page content dump files for all pages, all revisions:
23,832,535,435,128
---------------------
Sincerely,
Your friendly Wikimedia Dump Info Collector