16GB is small change. Dropbox offers 1TB online storage for £8/month. Google drive probably similar. You could just copy them there?
Or we could put them on Labs?
<triggerwarning> Flickr offers 1TB for free. </triggerwarning>
On Tue, Nov 17, 2015 at 5:10 PM "Stefan Kühn" kuehn-s@gmx.net wrote:
Hello,
we have access to 30000 images of historical postcards (from 1897 to 1989) of one publisher in Saxony, Germany. Our small team of Wikipedians has the permission to upload this images to Wikipedia Commons. In the last months we add metadata and categories to 53% of the images in a MySQL-Database. Maybe in two or three months we are finish this job and ready for upload.
Now we search for a tool for the batch upload and found the GLAMwiki Toolset. Maybe this is our solution, but if I understand the user manual, then we need the images online with a URL. At the moment we have the JPGs (16 GB) only on hard disk. And also nobody has so much webspace.
It is possible to upload this direct from hard drive with a GLAMwiki Toolset? If this not possible, can I bring the hard drive to Wikimedia Germany? Who is the contact in Berlin?
Or any other possibilities?
Best regards Stefan Kühn _______________________________________________ Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
"Stefan Kühn", 17/11/2015 18:09:
At the moment we have the JPGs (16 GB) only on hard disk.
16 GB total or 16 GB each image? I assume total, as we're talking of postcards. I don't know about your bandwidth but that should be quick to upload. You can for instance use scp or SFTP to upload them to Tool Labs https://wikitech.wikimedia.org/wiki/Help:Tool_Labs and it will be easy for anyone, including Wikimedia Germany, to pick them up.
Nemo
Hi,
I think, you can use Commonist tool for the uploading process.
Bodhisattwa On 17 Nov 2015 22:52, "Federico Leva (Nemo)" nemowiki@gmail.com wrote:
"Stefan Kühn", 17/11/2015 18:09:
At the moment we have the JPGs (16 GB) only on hard disk.
16 GB total or 16 GB each image? I assume total, as we're talking of postcards. I don't know about your bandwidth but that should be quick to upload. You can for instance use scp or SFTP to upload them to Tool Labs https://wikitech.wikimedia.org/wiki/Help:Tool_Labs and it will be easy for anyone, including Wikimedia Germany, to pick them up.
Nemo
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Am 17.11.2015 um 18:22 schrieb Federico Leva (Nemo):
16 GB total or 16 GB each image? I assume total, as we're talking of
It is total 16 GB in the JPG-Version. The originals are TIFF with 40 MB each. I use perl and ImageMagick to convert this in JPG. So we can easily work with this file and a local website to add metadatas and categories. The publisher set the limit solution for the upload at comman to 1000 pixel on the short side. So we will upload each postcard with approximately 1000x1500 pixel. This is not much but better than nothing and there are some very interesting postcard in this collection.
postcards. I don't know about your bandwidth but that should be quick to upload. You can for instance use scp or SFTP to upload them to Tool Labs https://wikitech.wikimedia.org/wiki/Help:Tool_Labs and it will be easy for anyone, including Wikimedia Germany, to pick them up.
Ok, this could be a way. I can upload this picture at Tool Labs with SFTP. And then I have a URL like https://tools.wmflabs.org/my_project/images/00001.jpg
Yes, I have enough bandwidth.
One more question: Should we upload TIFF or JPG? Ok, TIFF is a lossless image format. But I think JPG is more in use.
Best regards Stefan Kühn
Stefan Kühn, 17/11/2015 19:51:
It is total 16 GB in the JPG-Version. The originals are TIFF with 40 MB each.
So you are reducing the size by 98.7 % on average compared to the original? Quite a pity.
Ok, this could be a way. I can upload this picture at Tool Labs with SFTP. And then I have a URL like https://tools.wmflabs.org/my_project/images/00001.jpg
Yes, though until recently those could not be used directly in GWT.
Yes, I have enough bandwidth.
One more question: Should we upload TIFF or JPG? Ok, TIFF is a lossless image format. But I think JPG is more in use.
A common practive is to upload both. https://commons.wikimedia.org/wiki/Commons:Lossy_and_lossless_compression https://commons.wikimedia.org/wiki/Commons:File_types#TIFF
For a 1000px image of a postcard I think that both reducing space with JPG compression and uploading a "raw" TIFF makes little sense. If I were you I'd just convert to PNG and upload that.
Nemo
if you have on your hard drive, i would suggest also vicuna uploader rather than commonist https://commons.wikimedia.org/wiki/Commons:Vicu%C3%B1aUploader
GWtoolset is good for third party uploads from web but if you have on your hard drive it may not be an improved process
On Tue, Nov 17, 2015 at 2:30 PM, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Stefan Kühn, 17/11/2015 19:51:
It is total 16 GB in the JPG-Version. The originals are TIFF with 40 MB each.
So you are reducing the size by 98.7 % on average compared to the original? Quite a pity.
Ok, this could be a way. I can upload this picture at Tool Labs with
SFTP. And then I have a URL like https://tools.wmflabs.org/my_project/images/00001.jpg
Yes, though until recently those could not be used directly in GWT.
Yes, I have enough bandwidth.
One more question: Should we upload TIFF or JPG? Ok, TIFF is a lossless image format. But I think JPG is more in use.
A common practive is to upload both. https://commons.wikimedia.org/wiki/Commons:Lossy_and_lossless_compression https://commons.wikimedia.org/wiki/Commons:File_types#TIFF
For a 1000px image of a postcard I think that both reducing space with JPG compression and uploading a "raw" TIFF makes little sense. If I were you I'd just convert to PNG and upload that.
Nemo
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Am 18.11.2015 um 04:42 schrieb J Hayes:
if you have on your hard drive, i would suggest also vicuna uploader rather than commonist https://commons.wikimedia.org/wiki/Commons:Vicu%C3%B1aUploader
Today I try Vicuna under Ubuntu. I like it. I can generate the XML-File with perl and MySQL for a bundle upload.
Thanks Stefan
If you get stuck, I'll be happy to upload them from a USB stick or via an online drop, so long as the metadata was easy to sync with filenames and this was around Dec/Jan time. A custom upload of 30k medium size files, with no special tools, would take me about a week.
Fae