Dear List Members,
Does anyone know if the WikiMedia Foundation plans to support Metalink or SPDY for its dump files and/or image files? See RFP references below.
WP-MIRROR downloads dump and image files to build a mirror of a set of wikipedias. WP-MIRROR 0.5 is feature complete. I am now looking for ways to optimize performance (i.e. reduce mirror build time). Were the WMF to support the above two protocols, downloads would be faster and require less time spent on validation.
Sincererly Yours, Kent
On 12/29/12, Sumana Harihareswara sumanah@wikimedia.org wrote:
Hello! I'm sorry, but I don't know the answer to these questions; perhaps you could email the dumps mailing list https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l ? My apologies.
Sumana Harihareswara Engineering Community Manager Wikimedia Foundation
On Sun, Dec 16, 2012 at 6:14 AM, wp mirror wpmirrordev@gmail.com wrote:
Dear Sumana,
- Metalink. Does the Wikimedia Foundation have any plans to support
metalink for either its dump files or its image files?
Documentation: http://tools.ietf.org/html/rfc5854, "The Metalink Download Description Format" http://tools.ietf.org/html/rfc6249, "Metalink/HTTP: Mirrors and Hashes"
- SPDY. Does the Wikimedia Foundation have any plans to support SPDY?
Documentation: http://www.chromium.org/spdy
- WP-MIRROR. We last communicated 2012-01-06 in regards to WP-MIRROR.
Status: WP-MIRROR 0.5 is `feature complete', and works `out-of-the-box' for the GNU/Linux distributions: Debian 7.0 (wheezy) and Ubuntu 12.10 (quantal).
Future: Attention is turning towards performance enhancement and porting to other distributions.
Homepage: http://www.nongnu.org/wp-mirror/
Please give it a try. Feedback is most welcome.
Sincerely Yours, Kent