A few points:
* The reason for the 100meg limit has to do with php and apache and how
it stores the uploaded POST in memory so setting the limit higher would
risk increasing chances of apaches hitting swap if multiple uploads
happened on a given box.
* Modern html5 browsers are starting to be able to natively split files
up into chunks and do separate 1 meg xhr posts. Firefogg extension does
something similar with extension javascript.
* The server side chunk uploading api support was split out into an
extension by Mark Hershberger ( cc'ed )
* We should really get the chunk uploading "reviewed" and deployed. Tim
expressed some concerns with the chunk uploading protocol which we
addressed client side, but I don't he had time to follow up with
proposed changes that we made for server api. At any rate I think the
present protocol is better than normal http POST for large files. We get
lots of manageable 1 meg chunks and a reset connection does not result
in re-sending the whole file, and it works with vanilla php and apache
( other resumable http upload protocols are more complicated and
require php or apache mods )
* Backed storage system will not be able to handle a large influx of
large files for an extended period of time. All of commons is only 10 TB
or so and is on a "single" storage system. So acompaning an increase of
upload size should be an effort / plan to re-architect the backed
storage system.
--michael
On 07/20/2010 09:32 AM, Daniel Kinzler wrote:
Lars Aronsson schrieb:
What are the plans for increasing this limit?
Would it be
possible to allow 500 MB or 1 GB for these file formats,
and maintain the lower limit for other formats?
As far as I know, we are hitting the limits of http here. Increasing the
upload
limit as such isn't a solution, and a per-file-type setting doesn't help, since
the limit strikes before php is even started. It's on the server level.
The solution are "chunked uploads". Which people have been working on for a
while, but I have no idea what the current status is.
-- daniel
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l