On Sun, Aug 11, 2013 at 4:27 AM, Jeremy Baron jeremy@tuxmachine.com wrote:
On Sun, Aug 11, 2013 at 2:25 AM, K. Peachey p858snake@gmail.com wrote:
On Sun, Aug 11, 2013 at 10:44 AM, Leslie Carr lcarr@wikimedia.org wrote:
looks like the robots.txt isn't being served - so googlebot is grabbing things from the zip files client denied by server configuration: /var/www/robots.txt
sadly too jetlagged to keep looking at this :(
make sure you look at robot.txt and not Robot.txt,
As chad points out, its being served now
it's plural (robots.txt)
many thanks for getting it up quickly last time! unfortunately https://git.wikimedia.org is unresponsive again.
rupert