TIFF error when using Bulk Uploader

List overview All Threads
Download

newer

older

Re: [Glamtools] Batch Upload of...

Fwd: Wikimedia Deutschland invites...

McGregor, Nora

27 Oct 2015 27 Oct '15

11:28 a.m.

Hi Folks! I’m trying to upload some high-res TIFFS using the bulk uploader tool however in Beta it’s struggling with creating the thumbnails: Example: http://commons.wikimedia.beta.wmflabs.org/wiki/File:Tracing_of_Field_Sheet_… 1) Does this reflect the reality of how my upload will render on the live site? 2) When using the bulk uploader am I limited to using .jpgs? The original link to the URL for uploading is here: http://www.webarchive.org.uk/bldatasets/WOA/WOOS_18_3.tif Is it because TIFFS don’t render in the browser that the bulk uploader isn’t able to grab it and display in the same way as the jpg? Please advise, hoping to get these up asap and would prefer to use TIFFS. Cheers! Nora McGregor British Library @ndalyrose ****************************************************************************************************************** Experience the British Library online at www.bl.uk<http://www.bl.uk/> The British Library’s latest Annual Report and Accounts : www.bl.uk/aboutus/annrep/index.html<http://www.bl.uk/aboutus/annrep/inde… Help the British Library conserve the world's knowledge. Adopt a Book. www.bl.uk/adoptabook<http://www.bl.uk/adoptabook> The Library's St Pancras site is WiFi - enabled ***************************************************************************************************************** The information contained in this e-mail is confidential and may be legally privileged. It is intended for the addressee(s) only. If you are not the intended recipient, please delete this e-mail and notify the postmaster@bl.uk<mailto:postmaster@bl.uk> : The contents of this e-mail must not be disclosed or copied without the sender's consent. The statements and opinions expressed in this message are those of the author and do not necessarily reflect those of the British Library. The British Library does not take any responsibility for the views of the author. ***************************************************************************************************************** Think before you print

Attachments:

attachment.htm (text/html — 7.5 KB)

Show replies by date

Fæ

27 Oct 27 Oct

11:55 a.m.

Large TIFFs can be problematic. For the some of my past projects relying on TIFFs, I have created PNG files and JPEGs to help with their reuse, but always uploaded the original TIFF. Note that at the current time TIFFs cannot be browsed in the media player, so they are not ideal if you want the images to be used on Wikipedia articles etc. A relevant past discussion about this is at https://phabricator.wikimedia.org/T67217 Fae On 27 October 2015 at 11:28, McGregor, Nora <Nora.McGregor(a)bl.uk> wrote:

...

Hi Folks! I’m trying to upload some high-res TIFFS using the bulk uploader tool however in Beta it’s struggling with creating the thumbnails: Example: http://commons.wikimedia.beta.wmflabs.org/wiki/File:Tracing_of_Field_Sheet_… 1) Does this reflect the reality of how my upload will render on the live site? 2) When using the bulk uploader am I limited to using .jpgs? The original link to the URL for uploading is here: http://www.webarchive.org.uk/bldatasets/WOA/WOOS_18_3.tif Is it because TIFFS don’t render in the browser that the bulk uploader isn’t able to grab it and display in the same way as the jpg? Please advise, hoping to get these up asap and would prefer to use TIFFS. Cheers! Nora McGregor British Library @ndalyrose ****************************************************************************************************************** Experience the British Library online at www.bl.uk The British Library’s latest Annual Report and Accounts : www.bl.uk/aboutus/annrep/index.html Help the British Library conserve the world's knowledge. Adopt a Book. www.bl.uk/adoptabook The Library's St Pancras site is WiFi - enabled ***************************************************************************************************************** The information contained in this e-mail is confidential and may be legally privileged. It is intended for the addressee(s) only. If you are not the intended recipient, please delete this e-mail and notify the postmaster(a)bl.uk : The contents of this e-mail must not be disclosed or copied without the sender's consent. The statements and opinions expressed in this message are those of the author and do not necessarily reflect those of the British Library. The British Library does not take any responsibility for the views of the author. ***************************************************************************************************************** Think before you print _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

-- faewik(a)gmail.com https://commons.wikimedia.org/wiki/User:Fae Personal and confidential, please do not circulate or re-quote.

Manuela Schwendener

2:35 p.m.

Hi (Not used to posting in mailing lists, so please excuse if I'm doing it wrong.) We have the same problem with some of our large maps that we uploaded as tifs (https://commons.wikimedia.org/wiki/Category:UB_Basel_Maps), uploaded via https://commons.wikimedia.org/wiki/Commons:GLAMwiki_Toolset. The latest reply we got: https://phabricator.wikimedia.org/T111941#1649859 " btw, be advised that due to quirks in how we render tiff thumbnails, the limit on large files where we don't display thumbnails is much higher for the first page then the other page, so we might not display later pages on some of your really big files." The task has been moved to 'Done' - but I'd very much like if this could be fixed. Or if at least - for future uploads by other institutions - there was a warning about that _before_ you start uploading. Prominent example: Mercator's world map from 1569, scanned in 3 stripes https://commons.wikimedia.org/wiki/File:UBBasel_Map_1569_Kartenslg_AA_3-5.t…. To see all 3 pages you have to click on the link 'Original file'. Manuela Schwendener Basel University Library http://www.ub.unibas.ch https://de.wikipedia.org/wiki/Benutzer:Basel_University_Library

...

-----Ursprüngliche Nachricht----- Von: Glamtools [mailto:glamtools-bounces@lists.wikimedia.org] Im Auftrag von Fæ Gesendet: Dienstag, 27. Oktober 2015 12:56 An: Conversations revolving around the development of GLAM Digital Tools Betreff: Re: [Glamtools] TIFF error when using Bulk Uploader Large TIFFs can be problematic. For the some of my past projects relying on TIFFs, I have created PNG files and JPEGs to help with their reuse, but always uploaded the original TIFF. Note that at the current time TIFFs cannot be browsed in the media player, so they are not ideal if you want the images to be used on Wikipedia articles etc. A relevant past discussion about this is at https://phabricator.wikimedia.org/T67217 Fae On 27 October 2015 at 11:28, McGregor, Nora <Nora.McGregor(a)bl.uk> wrote:

Hi Folks! I’m trying to upload some high-res TIFFS using the bulk uploader tool however in Beta it’s struggling with creating the thumbnails:

Example:

http://commons.wikimedia.beta.wmflabs.org/wiki/File:Tracing_of_Field_S heet_9_(WOOS-18-3).tif 1) Does this reflect the reality of how my upload will render on the live site? 2) When using the bulk uploader am I limited to using .jpgs? The original link to the URL for uploading is here: http://www.webarchive.org.uk/bldatasets/WOA/WOOS_18_3.tif Is it because TIFFS don’t render in the browser that the bulk uploader isn’t able to grab it and display in the same way as the jpg? Please advise, hoping to get these up asap and would prefer to use TIFFS. Cheers! Nora McGregor British Library @ndalyrose

********************************************************** ************

******************************************** Experience the British Library online at www.bl.uk The British Library’s latest Annual Report and Accounts : www.bl.uk/aboutus/annrep/index.html Help the British Library conserve the world's knowledge. Adopt a Book. www.bl.uk/adoptabook The Library's St Pancras site is WiFi - enabled

********************************************************** ************

******************************************* The information contained in this e-mail is confidential and may be legally privileged. It is intended for the addressee(s) only. If you are not the intended recipient, please delete this e-mail and notify the postmaster(a)bl.uk : The contents of this e-mail must not be disclosed or copied without the sender's consent. The statements and opinions expressed in this message are those of the author and do not necessarily reflect those of the British Library. The British Library does not take any responsibility for the views of the author.

********************************************************** ************

******************************************* Think before you print _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

-- faewik(a)gmail.com https://commons.wikimedia.org/wiki/User:Fae Personal and confidential, please do not circulate or re-quote. _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

Brian Wolff

7:49 p.m.

Well, that's embarrasing. For large tiff's, we use a program called vips to make previews. This program is not installed on the beta site. (https://phabricator.wikimedia.org/T116816) Your files should work on the real commons site. Note: For multipage tiff files. You should be able to make the first page as large as you want, but subsequent pages have more stricter size limits. So if your tiffs are single page images, all's fine. Re Fae's comment: I'm not sure what you mean. Tiffs work fine in media viewer for me. -- -bawolff On 10/27/15, McGregor, Nora <Nora.McGregor(a)bl.uk> wrote:

...

Fæ

7:56 p.m.

On 27 October 2015 at 19:49, Brian Wolff <bawolff(a)gmail.com> wrote: ...

...

Re Fae's comment: I'm not sure what you mean. Tiffs work fine in media viewer for me.

By this, I mean that you can't view the fullsize TIFF within the viewer or browser, while other formats work as you might expect. Fae -- faewik(a)gmail.com https://commons.wikimedia.org/wiki/User:Fae

J Hayes

28 Oct 28 Oct

5:58 p.m.

large tiffs are not rendering in commons. "The bug is in the MediaWiki thumbnail generator," https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#Polar_… vipscaler might be a solution https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler On Tue, Oct 27, 2015 at 3:56 PM, Fæ <faewik(a)gmail.com> wrote:

...

On 27 October 2015 at 19:49, Brian Wolff <bawolff(a)gmail.com> wrote: ...

Re Fae's comment: I'm not sure what you mean. Tiffs work fine in media viewer for me.

By this, I mean that you can't view the fullsize TIFF within the viewer or browser, while other formats work as you might expect. Fae -- faewik(a)gmail.com https://commons.wikimedia.org/wiki/User:Fae _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

Brian Wolff

6:16 p.m.

On 10/28/15, J Hayes <slowking4(a)gmail.com> wrote:

...

Oddly enough, vips scalar was the problem here. There used to be a bug that causes that, its been fixed now (for a long time now), but the old version was cached. If you see any images that are almost entirely white with a bit of black around the edges, do ?action=purge to the image description page. However there appears to be a second bug ( https://phabricator.wikimedia.org/T116947 ). Rendering the file in sizes less then 2523px seems to be broken. -- -bawolff

J Hayes

6:29 p.m.

thanks - non-render size up to 50 MP which should get most images in use but there are still some larger " Error creating thumbnail: Invalid thumbnail parameters or TIFF file with more than 50 MP " On Wed, Oct 28, 2015 at 2:16 PM, Brian Wolff <bawolff(a)gmail.com> wrote:

...

On 10/28/15, J Hayes <slowking4(a)gmail.com> wrote:

large tiffs are not rendering in commons. "The bug is in the MediaWiki thumbnail generator,"

https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#Polar_…

vipscaler might be a solution https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler

Brian Wolff

6:56 p.m.

There shouldn't be (anymore). Do you have any examples of files with that error? There are a few (I mean few as in probably less than 10 over all of commons) tiff files that don't render that I am aware of, but they don't have that error and instead just time out. -- -bawolff On 10/28/15, J Hayes <slowking4(a)gmail.com> wrote:

...

On 10/28/15, J Hayes <slowking4(a)gmail.com> wrote:

large tiffs are not rendering in commons. "The bug is in the MediaWiki thumbnail generator,"

https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#Polar_…

vipscaler might be a solution https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler

J Hayes

7:05 p.m.

for example this one here: https://commons.wikimedia.org/wiki/File:Ceremony_dupont_circle_fountain_311… i stopped uploading LOC tiff files for this reason On Wed, Oct 28, 2015 at 2:56 PM, Brian Wolff <bawolff(a)gmail.com> wrote:

...

thanks - non-render size up to 50 MP which should get most images in use but there are still some larger " Error creating thumbnail: Invalid thumbnail parameters or TIFF file

with

more than 50 MP " On Wed, Oct 28, 2015 at 2:16 PM, Brian Wolff <bawolff(a)gmail.com> wrote: > On 10/28/15, J Hayes <slowking4(a)gmail.com> wrote: > > large tiffs are not rendering in commons. > > "The bug is in the MediaWiki thumbnail generator," > > >

https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#Polar_…

vipscaler might be a solution https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler

_______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

Brian Wolff

9:15 p.m.

I meant for the " Error creating thumbnail: Invalid thumbnail parameters or TIFF file with more than 50 MP" error. I'm looking into the issue where they render either all white or all black. On 10/28/15, J Hayes <slowking4(a)gmail.com> wrote:

...

thanks - non-render size up to 50 MP which should get most images in use but there are still some larger " Error creating thumbnail: Invalid thumbnail parameters or TIFF file

with

https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#Polar_…

> > vipscaler might be a solution > https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler Oddly enough, vips scalar was the problem here. There used to be a bug that causes that, its been fixed now (for a long time now), but the old version was cached. If you see any images that are almost entirely white with a bit of black around the edges, do ?action=purge to the image description page. However there appears to be a second bug ( https://phabricator.wikimedia.org/T116947 ). Rendering the file in sizes less then 2523px seems to be broken. -- -bawolff _______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

_______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

Brian Wolff

29 Oct 29 Oct

2:03 a.m.

Ok. We have a fix for the issue where 16-bit grey scale tiff files were broken (Showing up as either all black, or almost all white with a couple black lines). Its currently waiting for review. Once that happens it will take about a week to get on site. So hopefully it will be fixed soon. -- -bawolff On 10/28/15, Brian Wolff <bawolff(a)gmail.com> wrote:

...

thanks - non-render size up to 50 MP which should get most images in use but there are still some larger " Error creating thumbnail: Invalid thumbnail parameters or TIFF file

with

https://commons.wikimedia.org/wiki/Commons:Help_desk/Archive/2015/02#Polar_…

> > > > vipscaler might be a solution > > https://meta.wikimedia.org/wiki/Wikimedia_Blog/Drafts/VipsScaler > > Oddly enough, vips scalar was the problem here. There used to be a > bug > that causes that, its been fixed now (for a long time now), but the > old version was cached. If you see any images that are almost > entirely > white with a bit of black around the edges, do ?action=purge to the > image description page. > > However there appears to be a second bug ( > https://phabricator.wikimedia.org/T116947 ). Rendering the file in > sizes less then 2523px seems to be broken. > > -- > -bawolff > > _______________________________________________ > Glamtools mailing list > Glamtools(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/glamtools >

_______________________________________________ Glamtools mailing list Glamtools(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools

3102

days inactive

3104

days old

glamtools@lists.wikimedia.org

Manage subscription

11 comments

5 participants

tags (0)

participants (5)

Brian Wolff
Fæ
J Hayes
Manuela Schwendener
McGregor, Nora