This is a simple sounding question, but I have two uploads going on in
parallel right now, one using 8 processing threads and the other using
16, so a total of 24. None of these files is huge, they seem to be
under 15mb, with an occasional outlier around 45mb (though quite a few
drawing scans break the TIFF max size barrier of 50MP even though
these are only a miniscule ~2.5mb in filesize).
GWT was designed for a maximum of 20 threads, and I don't know whether
to feel guilty at running 24 threads this way, even though these
uploads are unlikely to break anything.
Any thoughts? If what I'm doing is somehow self-regulating, I would be
tempted to add another job and bump the "volume" to 40 or more
threads, as this particular upload has over 100,000 images
(potentially 200,000) and I'd rather it didn't take over a month to
complete (which is what it is looking like right now at a rate of
2,800 images per day).
Fae
--
faewik(a)gmail.com
https://commons.wikimedia.org/wiki/User:Fae