Upload-by-URL for test.wikipedia.org

Re: [Commons-l] Commons-l Digest,...

Brion Vibber

21 Mar 2009 21 Mar '09

1:37 a.m.

I've enabled a test configuration of MediaWiki's upload-by-URL ability on http://test.wikipedia.org/ The default configuration limits URL uploads to sysops, so for now you’ll need to be a sysop on Test Wikipedia to try it out. If everything seems fairly problem-free we’ll start rolling this out a bit more widely for Commons and other sites. In addition to being able to handle large files without an ugly manual download+reupload, the upload-by-URL functionality is also needed for future-facing work Michael Dale is working on to allow an on-wiki media picker to fetch freely-licensed files from Flickr, Archive.org, and other places. We may want to consider improvements to UI and workflow, but it seems to at least work. :) More at the Wikimedia technical blog: http://techblog.wikimedia.org/2009/03/upload-by-url-for-testwikipediaorg/ -- brion vibber (brion @ wikimedia.org)

Show replies by date

Magnus Manske

21 Mar 21 Mar

5:59 p.m.

On Sat, Mar 21, 2009 at 12:37 AM, Brion Vibber <brion(a)wikimedia.org> wrote:

...

In addition to being able to handle large files without an ugly manual download+reupload, the upload-by-URL functionality is also needed for future-facing work Michael Dale is working on to allow an on-wiki media picker to fetch freely-licensed files from Flickr, Archive.org, and other places.

The way I wrote the URL upload back in the day would make it an entry point for POST-style uploads from third-party tools. I hope that still works - it might ease mass "single shot" uploads from people or groups who want to push an existing set of their files over to Commons. I wonder if the on-wiki media picker could use external description generators as well. A variant of my CommonsHelper could then enable direct wikipedia-to-Commons file transfers, without people having to go through the toolserver and signing up for my hand-rolled user verification scheme... Plus, bonus-plugin for SUL accounts: "Copy all the (freely licensed) files I uploaded on x.wikipedia to Commons" in one go! I see massive workload coming towards Commons admins, heh heh. Oh wait... Magnus

Marco Schuster

8:35 p.m.

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, Mar 21, 2009 at 5:59 PM, Magnus Manske wrote:

...

Plus, bonus-plugin for SUL accounts: "Copy all the (freely licensed) files I uploaded on x.wikipedia to Commons" in one go!

No. - -- VMSoft GbR Nabburger Str. 15 81737 München Geschäftsführer: Marco Schuster, Volker Hemmert http://vmsoft-gbr.de

...PGP SIGNATURE...

-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (MingW32) Comment: Use GnuPG with Firefox : http://getfiregpg.org (Version: 0.7.5) iD8DBQFJxUGtW6S2GapJUuQRAu7LAJ9aXYIFlkA4+UJBpyWdR5bXmY39ewCeI/qz m1zi4MJK/XJC3pI2Gvkobvo= =kY3/ -----END PGP SIGNATURE-----

Marco Schuster

8:37 p.m.

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, Mar 21, 2009 at 5:59 PM, Magnus Manske wrote:

...

Plus, bonus-plugin for SUL accounts: "Copy all the (freely licensed) files I uploaded on x.wikipedia to Commons" in one go!

No, there are SO many different license tags on all those wikis, and their number is still growing strong. And, the way media copied to commons (NowCommons) is handled is also different on each wiki... No way to do this in a plugin, IMO, (sorry for double send, hit wrong key *argh*). Marco - -- VMSoft GbR Nabburger Str. 15 81737 München Geschäftsführer: Marco Schuster, Volker Hemmert http://vmsoft-gbr.de

...PGP SIGNATURE...

-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (MingW32) Comment: Use GnuPG with Firefox : http://getfiregpg.org (Version: 0.7.5) iD8DBQFJxUIaW6S2GapJUuQRAuEEAJ9YeH2taCs0pAm6B+1vnot15lEvlgCdHqSV J+UQs1FE+N+UxXRlB/WKo5s= =CmEX -----END PGP SIGNATURE-----

ChrisiPK

9:35 p.m.

Marco Schuster schrieb:

...

This is not a real problem, we would of course need different procedure and template link tables for each wiki. However, this already works for CommonsHelper, so it can work for any other application. Regards, ChrisiPK Marco Schuster schrieb: > On Sat, Mar 21, 2009 at 5:59 PM, Magnus Manske wrote: >> Plus, bonus-plugin for SUL accounts: "Copy all the (freely licensed) >> files I uploaded on x.wikipedia to Commons" in one go!

...

> (sorry for double send, hit wrong key *argh*). > > Marco _______________________________________________ Commons-l mailing list Commons-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/commons-l

Robert Rohde

10:26 p.m.

On Sat, Mar 21, 2009 at 12:37 PM, Marco Schuster <marco(a)harddisk.is-a-geek.org> wrote:

...

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, Mar 21, 2009 at 5:59 PM, Magnus Manske wrote:

Plus, bonus-plugin for SUL accounts: "Copy all the (freely licensed) files I uploaded on x.wikipedia to Commons" in one go!

I was recently told that enwiki alone has 277 different licensing tags. -Robert Rohde

Marco Schuster

22 Mar 22 Mar

10:32 a.m.

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sat, Mar 21, 2009 at 10:26 PM, Robert Rohde wrote:

...

On Sat, Mar 21, 2009 at 12:37 PM, Marco Schuster wrote:

On Sat, Mar 21, 2009 at 5:59 PM, Magnus Manske wrote:

Plus, bonus-plugin for SUL accounts: "Copy all the (freely licensed) files I uploaded on x.wikipedia to Commons" in one go!

I was recently told that enwiki alone has 277 different licensing tags.

dewiki also has a lot of licensing tags, where some (PD-Logo!) indicate that it is "free" in terms of "Schöpfungshöhe", but is still protected by brand and other protection laws... I think the most efficient way would be to categorize all license tags into one [[category:free license, usable on commons]] or similar. Marco - -- VMSoft GbR Nabburger Str. 15 81737 München Geschäftsführer: Marco Schuster, Volker Hemmert http://vmsoft-gbr.de

...PGP SIGNATURE...

-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (MingW32) Comment: Use GnuPG with Firefox : http://getfiregpg.org (Version: 0.7.5) iD8DBQFJxgXgW6S2GapJUuQRArFXAJ9h0BH1mon/9tG+mHa75BDzjFeBqwCfcEK8 R5n3Mzs8/LglwHVsQLflsQo= =4TiG -----END PGP SIGNATURE-----

Brion Vibber

23 Mar 23 Mar

2:09 a.m.

On 3/21/09 9:59 AM, Magnus Manske wrote:

...

On Sat, Mar 21, 2009 at 12:37 AM, Brion Vibber<brion(a)wikimedia.org> wrote:

This is how Michael Dale's ongoing work with a media-add wizard is currently using it, though he's been talking about adding an API interface for it too. -- brion

Michael Dale

5:03 p.m.

New subject: [Wikitech-l] Upload-by-URL for test.wikipedia.org

Great that we are moving forward with Upload-by-URL uploads :) I have been simultaneously testing / developing things with the new-upload branch. So the injection script check if upload over javascript api is supported then uses that (over parsing the form html output). We also have to think about how cross site posting could work. ie the user is on a wikipedia page but the repository license indicates we should post the video clip or image to commons. Either the upload api needs to support posting to shared repos (in essence proxying the remote repository) or we need to do a higher level proxy or we have shared edit tokens across internal domains? .... We can't allow the JavaScript to run injections without getting its edit token over local ajax request otherwise things would be open for denial of service / abuse of credentials for resource injection. I could try and add that support to the upload api branch but I don't have much familiarity with how the magic of remote repositories and internal api calls to those remote repository work... will have to investigate. --michael Brion Vibber wrote:

...

Hay (Husky)

5:31 p.m.

Great news! I think this will help a lot in improving external upload frontends, such as the Wikiportrait project. -- Hay On Sat, Mar 21, 2009 at 1:37 AM, Brion Vibber <brion(a)wikimedia.org> wrote:

...

5513

days inactive

5515

days old

commons-l@lists.wikimedia.org

Manage subscription

9 comments

7 participants

tags (0)

participants (7)

Brion Vibber
ChrisiPK
Hay (Husky)
Magnus Manske
Marco Schuster
Michael Dale
Robert Rohde