Hi Lizzy and Sandra, Just check the GWToolsetbox "Upload again/Opnieuw opladen" just before submitting the job. If not, error messages like Lizzy's ensue because the requested filenames are in use already. GWToolset doesn't dare to overwrite without permission. Regards, hansmuller Op Di, 22 september, 2015 11:54 am schreef Jesse de Vos:

Dear all, I restarted my upload on september 22nd: I started uploading approx 2600 images with works of art depicting birds. Until 25th of september the images were ingested into Wikimedia Commons (they were slowly dripping in) but over the last two days no new images are ingested. Does anyone knows what went wrong/why the upload stopped (again) and how I can restart my job? I also have difficulties estimating how many images and which images were ingested: which log can I check? I can’t find the relevant log to see what was uploaded or what problems were reported etc. Thank you very much for your help. best wishes Lizzy Jongma

Dear all, Lizzy: i'd say: restart your job, i did the same at 13:48 h (11:48 wikipedia time). My latest upload before that was at 11:04, then nothing so the job had gone somehow. Now my small job to test the waters runs ok again. Groetjes, hansmuller Op Zo, 27 september, 2015 4:46 pm schreef bawolff:

The Flickr2Commons sounds interesting and I will def look into that. I also think it is better to cut up the job a bit (more): 500 or 1000 objects per upload is spreading the eggs a bit more and is easier to keep track off. So I think my solution for next time will be to upload a set in smaller pieces. But if there is a pattern or unexplained drop-out: I will post it immediately! Best wishes, Lizzy

Thank you for helping me with the log files!!! That is really helpful. There are quite a few duplicate titles: some are actually not duplicate but just have the same title. We need to come up with a new and better strategy for naming files! And indeed: some were uploaded before (for instance by me :-) We also encountered some character set issues: I cannot explain where that came from but I will research it a bit more. This has been a huge learning experience for me! So thank you for helping me. Next upload will hopefully go a lot smoother (we also have some rough edges to deal with on our side :-)) Best Lizzy -----Oorspronkelijk bericht----- Van: Glamtools [mailto:glamtools-bounces@lists.wikimedia.org] Namens bawolff Verzonden: zondag 27 september 2015 16:47 Aan: Conversations revolving around the development of GLAM Digital Tools <glamtools(a)lists.wikimedia.org> Onderwerp: Re: [Glamtools] upload from Rijksmuseum has stalled? On Sun, Sep 27, 2015 at 3:27 AM, Lizzy Jongma <L.Jongma(a)rijksmuseum.nl> wrote: The logs for you in particular are at https://commons.wikimedia.org/w/index.php?title=Special%3ALog&type=gwto… If you want the list in xml or json format, you can do https://commons.wikimedia.org/w/api.php?action=query&list=logevents&… . See the api docs for details. In particular leaction can be used to filter by success/failure, and you need to use lecontinue parameter to get the next page of results. There are several entries that appear to be "skipped" due to the image existing already in commons. The records numbers are in the 2800's (The record numbers will skip around a bit, but should very roughly go from low to high in order), so if you only have about 2600 images, I would guess that a the tool went through all the images It seems like that perhaps the xml file has the same filename for several images. For example https://commons.wikimedia.org/wiki/File:Inhoudsopgave.jpeg is marked as being replaced by a second image after your initial upload, and in the log, it looks like record 2815 was going to replace that image a third time, except someone had edited that page in the meantime ( https://commons.wikimedia.org/w/index.php?title=File:Inhoudsopgave.jpeg&… ), so gwtoolset failed instead of silently overwriting I also notice several of the templates and file names have question marks in them. If the ? is unintentional, that might represent issue with charset conversions possibly. GWtoolset is still quite rough around the edges, especially for showing progress and explaining what happened in case of errors. -- -Brian _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

Thanks! -----Oorspronkelijk bericht----- Van: Glamtools [mailto:glamtools-bounces@lists.wikimedia.org] Namens Fæ Verzonden: dinsdag 29 september 2015 11:15 Aan: Conversations revolving around the development of GLAM Digital Tools <glamtools(a)lists.wikimedia.org> Onderwerp: Re: [Glamtools] upload from Rijksmuseum has stalled? On 29 September 2015 at 10:10, Lizzy Jongma <L.Jongma(a)rijksmuseum.nl> wrote: ... Character encoding problems can be very tricky. There is a short bit of guidance in the GWT manual on XML sensitive text to watch out for, these can also trip up the unwary. https://www.mediawiki.org/wiki/Help:Extension:GWToolset#Validating_your_xml Fae _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

Thank you! That was indeed the solution I was thinking of & good to hear others are doing it this way too. -----Oorspronkelijk bericht----- Van: Glamtools [mailto:glamtools-bounces@lists.wikimedia.org] Namens Estermann Beat Verzonden: dinsdag 29 september 2015 11:16 Aan: Conversations revolving around the development of GLAM Digital Tools <glamtools(a)lists.wikimedia.org> Onderwerp: Re: [Glamtools] upload from Rijksmuseum has stalled? Hi Lizzy, In Switzerland, we often just add the inventory number at the end of the file name. This is particularly handy if you have similar items with the same or similar names; otherwise it takes ages to match the items on Commons with the items in your database later on (or when checking against log files ;-). Cheers, Beat -----Original Message----- From: Glamtools [mailto:glamtools-bounces@lists.wikimedia.org] On Behalf Of Lizzy Jongma Sent: Dienstag, 29. September 2015 11:11 To: bawolff+wn(a)gmail.com; Conversations revolving around the development of GLAM Digital Tools Subject: Re: [Glamtools] upload from Rijksmuseum has stalled? Thank you for helping me with the log files!!! That is really helpful. There are quite a few duplicate titles: some are actually not duplicate but just have the same title. We need to come up with a new and better strategy for naming files! And indeed: some were uploaded before (for instance by me :-) We also encountered some character set issues: I cannot explain where that came from but I will research it a bit more. This has been a huge learning experience for me! So thank you for helping me. Next upload will hopefully go a lot smoother (we also have some rough edges to deal with on our side :-)) Best Lizzy -----Oorspronkelijk bericht----- Van: Glamtools [mailto:glamtools-bounces@lists.wikimedia.org] Namens bawolff Verzonden: zondag 27 september 2015 16:47 Aan: Conversations revolving around the development of GLAM Digital Tools <glamtools(a)lists.wikimedia.org> Onderwerp: Re: [Glamtools] upload from Rijksmuseum has stalled? On Sun, Sep 27, 2015 at 3:27 AM, Lizzy Jongma <L.Jongma(a)rijksmuseum.nl> wrote: The logs for you in particular are at https://commons.wikimedia.org/w/index.php?title=Special%3ALog&type=gwto… If you want the list in xml or json format, you can do https://commons.wikimedia.org/w/api.php?action=query&list=logevents&… . See the api docs for details. In particular leaction can be used to filter by success/failure, and you need to use lecontinue parameter to get the next page of results. There are several entries that appear to be "skipped" due to the image existing already in commons. The records numbers are in the 2800's (The record numbers will skip around a bit, but should very roughly go from low to high in order), so if you only have about 2600 images, I would guess that a the tool went through all the images It seems like that perhaps the xml file has the same filename for several images. For example https://commons.wikimedia.org/wiki/File:Inhoudsopgave.jpeg is marked as being replaced by a second image after your initial upload, and in the log, it looks like record 2815 was going to replace that image a third time, except someone had edited that page in the meantime ( https://commons.wikimedia.org/w/index.php?title=File:Inhoudsopgave.jpeg&… ), so gwtoolset failed instead of silently overwriting I also notice several of the templates and file names have question marks in them. If the ? is unintentional, that might represent issue with charset conversions possibly. GWtoolset is still quite rough around the edges, especially for showing progress and explaining what happened in case of errors. -- -Brian _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

allmighty help page :) <https://commons.wikimedia.org/wiki/Commons:Guide_to_batch_uploading#Naming> -- Jean-Fred (Sorry for the double post if list admins validate the other unfinished one)