On Wed, Sep 16, 2009 at 5:24 PM, Jared Williams jared.williams1@ntlworld.com wrote:
Can distribute them across multiple domain names, thereby bypassing the browser/HTTP limits.
Something along the lines of 'c'.(crc32($title) & 3).'.en.wikipedia.org'
Would atleast attempt to download upto 4 times as many things.
Right, but it reduces connection reuse. So you end up taking more TCP handshakes and spend more time with a small transmission window. (plus more DNS round-trips; relevant because wikimedia uses low TTLs for GSLB reasons) TNSTAAFL.