open to all ----------- my main concern in regards to opening the tool to everyone is whether or not bad up loaders could be dealt with quickly enough.
too many uploads at once ------------------------ there are already “throttles” in place that limit the amount of files that can be uploaded at once and per background job run and the total number of GWToolset uploads that can exist in the job queue at once:
• http://www.mediawiki.org/wiki/Extension:GWToolset/Technical_Design#Throttles... • http://git.wikimedia.org/blob/mediawiki%2Fextensions%2FGWToolset.git/306957c...
thus far i don’t think we’ve run into issues with those limit.
big upload issue ---------------- as far as i currently understand the issue, the problem was not that GWToolset uploaded too many images; the problem was that the tool that generates thumbnails tried to create too many thumbnails at once. if that’s true, then it seems to me that the tool that takes care of that should have it’s own throttle and job queue so that it doesn’t try to create too many thumbnails at once.
with kind regards, dan
On Apr 27, 2014, at 19:33 , Steinsplitter Wiki steinsplitter@wikipedia.de wrote:
0 - You don't have enough bandwidth on your personal computer
UploadWirzard supports uploadbyurl, but it is only enabled for licenser and admins because upload by url is not 100% stable. GWToolset has bugs too.
3 - Before making massive uploads, people want to try it *with the real tool* (GLAMs too).
We have the betacluster (http://commons.wikimedia.beta.wmflabs.org/) to test. It is a real clone. Per request (mailinglist/talkpage/mail) i can grant the gwtoolset right to trusted user without bureaucracy on the betacluster.
Regards,
Date: Sun, 27 Apr 2014 19:19:50 +0200 From: emmanuel.engelhart@wikimedia.ch To: glamtools@lists.wikimedia.org Subject: Re: [Glamtools] Open GWT to all Commons users
On 27.04.2014 18:39, Steinsplitter Wiki wrote:
We have changed from admin to cratmanegment for a good reason (GWT is powerful tool like botflag).
10 per XML sounds like nonsense. The user can use UploadWirzard...
Here are a few reasons why it makes sense and why the uploadWizard is not adapted in some cases: 0 - You don't have enough bandwidth on your personal computer 1 - You don't have the data on your computer 2 - You already have the metadata in a structured way 3 - Before making massive uploads, people want to try it *with the real tool* (GLAMs too).
But, you make a point, maybe 10 is too low or we should remove this kind of limit and just rely on the upload speed. Anyway, this was just a starter proposition.
Emmanuel
-- Volunteer Technology, GLAM, Trainings Zurich +41 797 670 398
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools