Hi, I would like to request custom dump(s) of all (local) images on these wikis: enwiktionary, eswiktionary, frwiktionary, dewiktionary, enwikiquote, eswikiquote, frwikiquote, dewikiquote, enwikibooks, eswikibooks, frwikibooks, dewikibooks. Also, if possible, it would be helpful (but not required) to also have a dump of just the commons images that are used on those wikis.
For context on this e-mail, see: https://meta.wikimedia.org/wiki/Wikimedia_Forum#Help_with_old_dumps and https://meta.wikimedia.org/wiki/User_talk:Xaosflux#Images
I did such script a long time ago.
I should start by asking, how much disk space do you have for this?
Local images are cheap:
+--------+---------+ | number | size | +--------+---------+ | 22 | 2108819 | +--------+---------+
eswiktionary +--------+--------+ | number | size | +--------+--------+ | 14 | 390539 | +--------+--------+
frwiktionary +--------+--------+ | number | size | +--------+--------+ | 6 | 702706 | +--------+--------+
dewiktionary +--------+---------+ | number | size | +--------+---------+ | 104 | 4943453 | +--------+---------+
enwikiquote +--------+------+ | number | size | +--------+------+ | 0 | NULL | +--------+------+
eswikiquote +--------+------+ | number | size | +--------+------+ | 0 | NULL | +--------+------+
frwikiquote +--------+------+ | number | size | +--------+------+ | 0 | NULL | +--------+------+
dewikiquote +--------+---------+ | number | size | +--------+---------+ | 17 | 2236129 | +--------+---------+
enwikibooks +--------+-----------+ | number | size | +--------+-----------+ | 2716 | 153301990 | +--------+-----------+
eswikibooks +--------+------+ | number | size | +--------+------+ | 0 | NULL | +--------+------+
frwikibooks +--------+---------+ | number | size | +--------+---------+ | 169 | 8244783 | +--------+---------+
dewikibooks +--------+------------+ | number | size | +--------+------------+ | 7697 | 2772943547 | +--------+------------+
but the commons files will start requiring a bit more space (about 1 TB):
enwiktionary +--------+--------------+ | number | size | +--------+--------------+ | 724855 | 154587222013 | +--------+--------------+
eswiktionary +--------+-------------+ | number | size | +--------+-------------+ | 18938 | 12918158214 | +--------+-------------+
frwiktionary +--------+--------------+ | number | size | +--------+--------------+ | 560321 | 146933557784 | +--------+--------------+
dewiktionary +--------+-------------+ | number | size | +--------+-------------+ | 933737 | 84462331479 | +--------+-------------+
enwikiquote +--------+-------------+ | number | size | +--------+-------------+ | 55186 | 98435989071 | +--------+-------------+
eswikiquote +--------+------------+ | number | size | +--------+------------+ | 5712 | 7522618990 | +--------+------------+
frwikiquote +--------+-------------+ | number | size | +--------+-------------+ | 7348 | 11151209748 | +--------+-------------+
dewikiquote +--------+------------+ | number | size | +--------+------------+ | 4211 | 6149070638 | +--------+------------+
enwikibooks +--------+--------------+ | number | size | +--------+--------------+ | 106405 | 133670795995 | +--------+--------------+
eswikibooks +--------+--------------+ | number | size | +--------+--------------+ | 44309 | 122871671629 | +--------+--------------+
frwikibooks +--------+--------------+ | number | size | +--------+--------------+ | 98843 | 248629243582 | +--------+--------------+
dewikibooks +--------+-------------+ | number | size | +--------+-------------+ | 69669 | 54020348470 | +--------+-------------+
All of them: +---------+--------------+ | number | size | +---------+--------------+ | 2021173 | 981218142389 | +---------+--------------+
for wiki in enwiktionary eswiktionary frwiktionary dewiktionary enwikiquote eswikiquote frwikiquote dewikiquote enwikibooks eswikibooks frwikibooks dewikibooks; do echo $wiki; sql "${wiki}_p" "SELECT COUNT(img_name) AS number, SUM(img_size) AS size FROM image;"; echo; done for wiki in enwiktionary eswiktionary frwiktionary dewiktionary enwikiquote eswikiquote frwikiquote dewikiquote enwikibooks eswikibooks frwikibooks dewikibooks; do echo $wiki; sql commonswiki_p "SELECT COUNT(img_name) AS number, SUM(img_size) AS size FROM image WHERE img_name IN (SELECT DISTINCT gil_to FROM globalimagelinks WHERE gil_wiki='$wiki')"; echo; done SELECT COUNT(img_name) AS number, SUM(img_size) AS size FROM image WHERE img_name IN (SELECT DISTINCT gil_to FROM globalimagelinks WHERE gil_wiki IN ('enwiktionary', 'eswiktionary', 'frwiktionary', 'dewiktionary', 'enwikiquote', 'eswikiquote', 'frwikiquote', 'dewikiquote', 'enwikibooks', 'eswikibooks', 'frwikibooks', 'dewikibooks')) ;
Ok I've created an account here if that helps. Also, could you please redact my last name?
On Fri, 3 Feb 2023 at 15:36, someone wrote:
Why is it showing my address? I set it to be hidden.
You were emailing me directly, but you now switched to sending it to the mailing list (so it gets to everyone subscribed). The name showed in the email is the one your mail client set. That's completely different to the preference on showing or not the people subscribed to a mailing list.
Regards
xmldatadumps-l@lists.wikimedia.org