Hi Nora,

Definitely not typical. Seeing the filesize it should go much faster.
It looks as if your upload stalled after record 11. Some people on this list can probably look to see whether the rest is still pending. But if I were you I would simply use the same xml (if there are no issues with record 12 and onward) and retry the upload once more. The toolset wil skip the files that are already uploaded, and hopefully continue, it has happened to me before :-).  

Something I noticed: only 6 of the files appear in the category you mentioned. Did you add this category as a 'global category' in the toolset?

But there might be other people on the list that can help you better.

Best!
Jesse




2015-10-29 10:12 GMT+01:00 McGregor, Nora <Nora.McGregor@bl.uk>:
Yesterday afternoon we batch uploaded 100 wildlife sound files (https://commons.wikimedia.org/wiki/Category:Wildlife_Sounds_in_the_British_Library) ahead of an edit-a-thon with Europeana happening next week (November 7th): http://www.europeanasounds.eu/event/british-wildlife-recordings-edit-a-thon-at-the-british-library

I don't see any errors in the Special:Log with it but only 12 have loaded so far in the last 24 hours, is this typical of sound files? If it is I'll just leave it and not worry about it but just want to make sure that they will work their way through the system in time for the event. Is there any other way for me to confirm/check on the status of them waiting in the queue?

Thanks so much for all your help!

Best,

Nora McGregor
British Library
@ndalyrose


-----Original Message-----
From: Glamtools [mailto:glamtools-bounces@lists.wikimedia.org] On Behalf Of glamtools-request@lists.wikimedia.org
Sent: 28 October 2015 19:06
To: glamtools@lists.wikimedia.org
Subject: Glamtools Digest, Vol 31, Issue 10

Send Glamtools mailing list submissions to
        glamtools@lists.wikimedia.org

To subscribe or unsubscribe via the World Wide Web, visit
        https://lists.wikimedia.org/mailman/listinfo/glamtools
or, via email, send a message with subject or body 'help' to
        glamtools-request@lists.wikimedia.org

You can reach the person managing the list at
        glamtools-owner@lists.wikimedia.org

When replying, please edit your Subject line so it is more specific than "Re: Contents of Glamtools digest..."


Today's Topics:

   1. Re: TIFF error when using Bulk Uploader (J Hayes)
   2. Re: TIFF error when using Bulk Uploader (Brian Wolff)
   3. Re: TIFF error when using Bulk Uploader (J Hayes)
   4. Re: TIFF error when using Bulk Uploader (Brian Wolff)
   5. Re: TIFF error when using Bulk Uploader (J Hayes)


----------------------------------------------------------------------

Message: 1
Date: Wed, 28 Oct 2015 13:58:17 -0400
From: J Hayes <slowking4@gmail.com>
To: Conversations revolving around the development of GLAM Digital
        Tools <glamtools@lists.wikimedia.org>
Subject: Re: [Glamtools] TIFF error when using Bulk Uploader
Message-ID:
        <CAN38RzJB=ydksox0+d1RU5M5tDpP-SGY-79WqMjRCGFzMyVywg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

large tiffs are not rendering in commons.
"The bug is in the MediaWiki thumbnail generator,"
https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#Polar_bear_in_a_snowstorm.3F

vipscaler might be a solution
https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler


On Tue, Oct 27, 2015 at 3:56 PM, Fæ <faewik@gmail.com> wrote:

> On 27 October 2015 at 19:49, Brian Wolff <bawolff@gmail.com> wrote:
> ...
> > Re Fae's comment: I'm not sure what you mean. Tiffs work fine in
> > media viewer for me.
>
> By this, I mean that you can't view the fullsize TIFF within the
> viewer or browser, while other formats work as you might expect.
>
> Fae
> --
> faewik@gmail.com https://commons.wikimedia.org/wiki/User:Fae
>
> _______________________________________________
> Glamtools mailing list
> Glamtools@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/glamtools
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/glamtools/attachments/20151028/4270a83f/attachment-0001.html>

------------------------------

Message: 2
Date: Wed, 28 Oct 2015 12:16:03 -0600
From: Brian Wolff <bawolff@gmail.com>
To: Conversations revolving around the development of GLAM Digital
        Tools <glamtools@lists.wikimedia.org>
Subject: Re: [Glamtools] TIFF error when using Bulk Uploader
Message-ID:
        <CA+oo+DUN+wUkurzp1p3s_qKQeZ=5RFZ3oLMaFXN0tZxrbdaDvg@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

On 10/28/15, J Hayes <slowking4@gmail.com> wrote:
> large tiffs are not rendering in commons.
> "The bug is in the MediaWiki thumbnail generator,"
> https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#P
> olar_bear_in_a_snowstorm.3F
>
> vipscaler might be a solution
> https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler

Oddly enough, vips scalar was the problem here. There used to be a bug that causes that, its been fixed now (for a long time now), but the old version was cached. If you see any images that are almost entirely white with a bit of black around the edges, do ?action=purge to the image description page.

However there appears to be a second bug (
https://phabricator.wikimedia.org/T116947 ). Rendering the file in sizes less then 2523px seems to be broken.

--
-bawolff



------------------------------

Message: 3
Date: Wed, 28 Oct 2015 14:29:18 -0400
From: J Hayes <slowking4@gmail.com>
To: Conversations revolving around the development of GLAM Digital
        Tools <glamtools@lists.wikimedia.org>
Subject: Re: [Glamtools] TIFF error when using Bulk Uploader
Message-ID:
        <CAN38RzKYH8b-ZgCj7yM4EM-ZfgvGXPyLCCFNMTi27rmDh5NZvg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

thanks - non-render size up to 50 MP which should get most images in use

but there are still some larger
" Error creating thumbnail: Invalid thumbnail parameters or TIFF file with more than 50 MP "

On Wed, Oct 28, 2015 at 2:16 PM, Brian Wolff <bawolff@gmail.com> wrote:

> On 10/28/15, J Hayes <slowking4@gmail.com> wrote:
> > large tiffs are not rendering in commons.
> > "The bug is in the MediaWiki thumbnail generator,"
> >
> https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#P
> olar_bear_in_a_snowstorm.3F
> >
> > vipscaler might be a solution
> > https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler
>
> Oddly enough, vips scalar was the problem here. There used to be a bug
> that causes that, its been fixed now (for a long time now), but the
> old version was cached. If you see any images that are almost entirely
> white with a bit of black around the edges, do ?action=purge to the
> image description page.
>
> However there appears to be a second bug (
> https://phabricator.wikimedia.org/T116947 ). Rendering the file in
> sizes less then 2523px seems to be broken.
>
> --
> -bawolff
>
> _______________________________________________
> Glamtools mailing list
> Glamtools@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/glamtools
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/glamtools/attachments/20151028/4af39fcc/attachment-0001.html>

------------------------------

Message: 4
Date: Wed, 28 Oct 2015 12:56:08 -0600
From: Brian Wolff <bawolff@gmail.com>
To: Conversations revolving around the development of GLAM Digital
        Tools <glamtools@lists.wikimedia.org>
Subject: Re: [Glamtools] TIFF error when using Bulk Uploader
Message-ID:
        <CA+oo+DWYhcMP+a_9mkY28NHb4D=gTjNekB+_i84b8K1Dk1YDMQ@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

There shouldn't be (anymore). Do you have any examples of files with that error?

There are a few (I mean few as in probably less than 10 over all of
commons) tiff files that don't render that I am aware of, but they don't have that error and instead just time out.

--
-bawolff

On 10/28/15, J Hayes <slowking4@gmail.com> wrote:
> thanks - non-render size up to 50 MP which should get most images in
> use
>
> but there are still some larger
> " Error creating thumbnail: Invalid thumbnail parameters or TIFF file
> with more than 50 MP "
>
> On Wed, Oct 28, 2015 at 2:16 PM, Brian Wolff <bawolff@gmail.com> wrote:
>
>> On 10/28/15, J Hayes <slowking4@gmail.com> wrote:
>> > large tiffs are not rendering in commons.
>> > "The bug is in the MediaWiki thumbnail generator,"
>> >
>> https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#
>> Polar_bear_in_a_snowstorm.3F
>> >
>> > vipscaler might be a solution
>> > https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler
>>
>> Oddly enough, vips scalar was the problem here. There used to be a
>> bug that causes that, its been fixed now (for a long time now), but
>> the old version was cached. If you see any images that are almost
>> entirely white with a bit of black around the edges, do ?action=purge
>> to the image description page.
>>
>> However there appears to be a second bug (
>> https://phabricator.wikimedia.org/T116947 ). Rendering the file in
>> sizes less then 2523px seems to be broken.
>>
>> --
>> -bawolff
>>
>> _______________________________________________
>> Glamtools mailing list
>> Glamtools@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/glamtools
>>
>



------------------------------

Message: 5
Date: Wed, 28 Oct 2015 15:05:41 -0400
From: J Hayes <slowking4@gmail.com>
To: Conversations revolving around the development of GLAM Digital
        Tools <glamtools@lists.wikimedia.org>
Subject: Re: [Glamtools] TIFF error when using Bulk Uploader
Message-ID:
        <CAN38RzK33MrvEojROSxe400jjzCABvt37EGqQS1p0o5xk2sepg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

for example this one here:

https://commons.wikimedia.org/wiki/File:Ceremony_dupont_circle_fountain_31125a.tif

i stopped uploading LOC tiff files for this reason

On Wed, Oct 28, 2015 at 2:56 PM, Brian Wolff <bawolff@gmail.com> wrote:

> There shouldn't be (anymore). Do you have any examples of files with
> that error?
>
> There are a few (I mean few as in probably less than 10 over all of
> commons) tiff files that don't render that I am aware of, but they
> don't have that error and instead just time out.
>
> --
> -bawolff
>
> On 10/28/15, J Hayes <slowking4@gmail.com> wrote:
> > thanks - non-render size up to 50 MP which should get most images in
> > use
> >
> > but there are still some larger
> > " Error creating thumbnail: Invalid thumbnail parameters or TIFF
> > file
> with
> > more than 50 MP "
> >
> > On Wed, Oct 28, 2015 at 2:16 PM, Brian Wolff <bawolff@gmail.com> wrote:
> >
> >> On 10/28/15, J Hayes <slowking4@gmail.com> wrote:
> >> > large tiffs are not rendering in commons.
> >> > "The bug is in the MediaWiki thumbnail generator,"
> >> >
> >>
> https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#P
> olar_bear_in_a_snowstorm.3F
> >> >
> >> > vipscaler might be a solution
> >> > https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler
> >>
> >> Oddly enough, vips scalar was the problem here. There used to be a
> >> bug that causes that, its been fixed now (for a long time now), but
> >> the old version was cached. If you see any images that are almost
> >> entirely white with a bit of black around the edges, do
> >> ?action=purge to the image description page.
> >>
> >> However there appears to be a second bug (
> >> https://phabricator.wikimedia.org/T116947 ). Rendering the file in
> >> sizes less then 2523px seems to be broken.
> >>
> >> --
> >> -bawolff
> >>
> >> _______________________________________________
> >> Glamtools mailing list
> >> Glamtools@lists.wikimedia.org
> >> https://lists.wikimedia.org/mailman/listinfo/glamtools
> >>
> >
>
> _______________________________________________
> Glamtools mailing list
> Glamtools@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/glamtools
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/glamtools/attachments/20151028/691d3f1f/attachment.html>

------------------------------

Subject: Digest Footer

_______________________________________________
Glamtools mailing list
Glamtools@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/glamtools


------------------------------

End of Glamtools Digest, Vol 31, Issue 10
*****************************************


******************************************************************************************************************
Experience the British Library online at www.bl.uk<http://www.bl.uk/>
The British Library’s latest Annual Report and Accounts : www.bl.uk/aboutus/annrep/index.html<http://www.bl.uk/aboutus/annrep/index.html>
Help the British Library conserve the world's knowledge. Adopt a Book. www.bl.uk/adoptabook<http://www.bl.uk/adoptabook>
The Library's St Pancras site is WiFi - enabled
*****************************************************************************************************************
The information contained in this e-mail is confidential and may be legally privileged. It is intended for the addressee(s) only. If you are not the intended recipient, please delete this e-mail and notify the postmaster@bl.uk<mailto:postmaster@bl.uk> : The contents of this e-mail must not be disclosed or copied without the sender's consent.
The statements and opinions expressed in this message are those of the author and do not necessarily reflect those of the British Library. The British Library does not take any responsibility for the views of the author.
*****************************************************************************************************************
Think before you print
_______________________________________________
Glamtools mailing list
Glamtools@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/glamtools



--

Met vriendelijke groet,

Jesse de Vos
Researcher Interactive and New Media

T 035 - 677 39 37
Aanwezig: ma t/m do

Nederlands Instituut voor Beeld en Geluid
Media Parkboulevard 1, 1217 WE  Hilversum | Postbus 1060, 1200 BB  Hilversum | beeldengeluid.nl