Dear Kevin, Thanks for your help. I can now see the index.html file (see 1 below). However, I can no longer see the other files in that directory (see 2 below).
1) index.html
The following
(shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/
now both report
HTTP/1.1 301 Moved Permanently Location: http://dumps.wikimedia.your.org/
But the following
(shell)$ curl --ipv4 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/ (shell)$ curl --ipv6 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/
follow the redirect and report
HTTP/1.1 200 OK
2) Files
Now, however, I can not get other files from that directory. For example, the following
(shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt
both report
HTTP/1.1 301 Moved Permanently Location: http://dumps.wikimedia.your.org/r
The rather odd value for "Location" makes it impossible to follow the redirect. Thus
(shell)$ curl --ipv4 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt (shell)$ curl --ipv6 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt
report
HTTP/1.1 404 Not Found
Sincerely Yours, Kent
+------------------------------------------------------------------------+ pub 1024D/359E5142 2008-09-01 GPG key available on pgpkeys.mit.edu Key fingerprint = 8D4F 4485 7F7D 5406 230C 9749 B821 2572 359E 5142 uid Dr. Kent L. Miller kent.l.miller@alumni.cmu.edu +------------------------------------------------------------------------+
On Sat, 16 Nov 2013, Kevin Day wrote:
Nice catch!
That should be fixed now, and sending a 301 redirect on both ipv4 and ipv6.
Several of the pages on the “dumps” collection have hardcoded links that require them to be in the / (root) directory, so they require their own hostname.
— Kevin
On Nov 16, 2013, at 2:32 PM, Dr. Kent L. Miller kent.l.miller@alumni.cmu.edu wrote:
Dear Ariel,
When I compare the following two commands
(shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/
The first reports "HTTP/1.1 301 Moved Permanently" The second reports "HTTP/1.1 200 OK"
Has anyone else noticed this?
Sincerely Yours, Kent
+------------------------------------------------------------------------+ pub 1024D/359E5142 2008-09-01 GPG key available on pgpkeys.mit.edu Key fingerprint = 8D4F 4485 7F7D 5406 230C 9749 B821 2572 359E 5142 uid Dr. Kent L. Miller kent.l.miller@alumni.cmu.edu +------------------------------------------------------------------------+
Xmldatadumps-l mailing list Xmldatadumps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l
On Nov 17, 2013, at 12:33 AM, Dr. Kent L. Miller kent.l.miller@alumni.cmu.edu wrote:
Dear Kevin, Thanks for your help. I can now see the index.html file (see 1 below). However, I can no longer see the other files in that directory (see 2 below).
- index.html
The following
(shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/ (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/
now both report
HTTP/1.1 301 Moved Permanently Location: http://dumps.wikimedia.your.org/
But the following
(shell)$ curl --ipv4 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/ (shell)$ curl --ipv6 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/
follow the redirect and report
HTTP/1.1 200 OK
That’s expected, and at least is working now.
Files
Now, however, I can not get other files from that directory. For example, the following
(shell)$ curl --ipv4 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt (shell)$ curl --ipv6 --verbose http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt
both report
HTTP/1.1 301 Moved Permanently Location: http://dumps.wikimedia.your.org/r
The rather odd value for "Location" makes it impossible to follow the redirect. Thus
(shell)$ curl --ipv4 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt (shell)$ curl --ipv6 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt
report
HTTP/1.1 404 Not Found
My apologies, I broke the redirect when adding IPv6 support to the rule.
This should work now!
# curl --ipv4 --verbose --location http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt | more * About to connect() to ftpmirror.your.org port 80 (#0) * Trying 204.9.55.82... % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* connected * Connected to ftpmirror.your.org (204.9.55.82) port 80 (#0)
GET /pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt HTTP/1.1 User-Agent: curl/7.24.0 (amd64-portbld-freebsd9.1) libcurl/7.24.0 OpenSSL/0.9.8y zlib/1.2.7 Host: ftpmirror.your.org Accept: */*
< HTTP/1.1 301 Moved Permanently < Location: http://dumps.wikimedia.your.org/rsync-dirlist-last-1-good.txt < Content-Length: 0 < Date: Sun, 17 Nov 2013 16:04:32 GMT < Server: lighttpd < 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 * Connection #0 to host ftpmirror.your.org left intact * Issue another request to this URL: 'http://dumps.wikimedia.your.org/rsync-dirlist-last-1-good.txt' * About to connect() to dumps.wikimedia.your.org port 80 (#1) * Trying 204.9.55.82... * connected * Connected to dumps.wikimedia.your.org (204.9.55.82) port 80 (#1)
GET /rsync-dirlist-last-1-good.txt HTTP/1.1 User-Agent: curl/7.24.0 (amd64-portbld-freebsd9.1) libcurl/7.24.0 OpenSSL/0.9.8y zlib/1.2.7 Host: dumps.wikimedia.your.org Accept: */*
< HTTP/1.1 200 OK < Content-Type: text/plain < Accept-Ranges: bytes < ETag: "1452520516" < Last-Modified: Sun, 17 Nov 2013 03:55:46 GMT < Content-Length: 17864 < Date: Sun, 17 Nov 2013 16:04:32 GMT < Server: lighttpd < { [data not shown]
— Kevin
On Sun, Nov 17, 2013 at 4:05 PM, Kevin Day kevin@your.org wrote:
My apologies, I broke the redirect when adding IPv6 support to the rule.
This should work now!
LGTM. (looks good)
-Jeremy
$ for i in ipv{4,6}; do echo "$i:"; curl -vsL --"$i" http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt 2>&1 >/dev/null | egrep -e '^< HTTP/1' -e '^< Location: ' -e $'^* (Connected to |Issue another request to this URL:|getaddrinfo(3) failed for|Couldn't resolve host)'; done ipv4: * Connected to ftpmirror.your.org (204.9.55.82) port 80 (#0) < HTTP/1.1 301 Moved Permanently < Location: http://dumps.wikimedia.your.org/rsync-dirlist-last-1-good.txt * Issue another request to this URL: 'http://dumps.wikimedia.your.org/rsync-dirlist-last-1-good.txt' * Connected to dumps.wikimedia.your.org (204.9.55.82) port 80 (#1) < HTTP/1.1 200 OK ipv6: * Connected to ftpmirror.your.org (2001:4978:1:420::cc09:3752) port 80 (#0) < HTTP/1.1 301 Moved Permanently < Location: http://dumps.wikimedia.your.org/rsync-dirlist-last-1-good.txt * Issue another request to this URL: 'http://dumps.wikimedia.your.org/rsync-dirlist-last-1-good.txt' * Connected to dumps.wikimedia.your.org (2001:4978:1:420::cc09:3752) port 80 (#1) < HTTP/1.1 200 OK
xmldatadumps-l@lists.wikimedia.org