As you all are aware, git.wikimedia.org (powered by GitBlit) has been unstable. The root cause is basically that there is insufficient caching mechanisms in place exacerbated by a lack of robust rules for web indexers (Google, Bing, etc).
Currently, the solution is to disallow all indexers from indexing git.wikimedia.org via the robots.txt file (https://git.wikimedia.org/robots.txt). We hope to open up indexing in a more controlled fashion soon.
For now, git.wikimedia.org should be stable for everyday use.
You can follow along with the caching developments on bug 49371: https://bugzilla.wikimedia.org/show_bug.cgi?id=49371
Thanks to Chad and Ariel, especially, who have been working to make sure this is resolved quickly and permanently.
Greg
I'd like to know what the WMFs position on maintaining stability of urls on GitBlit is. In the past I linked to gitweb at several places, and all those links are now dead. So I guess anything provided by the GitBlit install can also not be relied upon. Some more info on this would be nice though. Also on the mirroring on repos to GitHub. I got quite a few things that will break if changes are made to it in non-bc way.
Hey,
Cheers
-- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 --
On 13 August 2013 23:41, Greg Grossmeier greg@wikimedia.org wrote:
As you all are aware, git.wikimedia.org (powered by GitBlit) has been unstable. The root cause is basically that there is insufficient caching mechanisms in place exacerbated by a lack of robust rules for web indexers (Google, Bing, etc).
Currently, the solution is to disallow all indexers from indexing git.wikimedia.org via the robots.txt file (https://git.wikimedia.org/robots.txt). We hope to open up indexing in a more controlled fashion soon.
For now, git.wikimedia.org should be stable for everyday use.
You can follow along with the caching developments on bug 49371: https://bugzilla.wikimedia.org/show_bug.cgi?id=49371
Thanks to Chad and Ariel, especially, who have been working to make sure this is resolved quickly and permanently.
Greg
-- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
On Tue, Aug 13, 2013 at 3:14 PM, Jeroen De Dauw jeroendedauw@gmail.comwrote:
I'd like to know what the WMFs position on maintaining stability of urls on GitBlit is. In the past I linked to gitweb at several places, and all those links are now dead. So I guess anything provided by the GitBlit install can
also not be relied upon. Some more info on this would be nice though.
You can rely on the Gitblit urls, they're not going anywhere or changing.
Gitweb I had been making promises of killing for a long long time (and never a promise of 1:1 mapping of all urls for rewriting), so here we are with Gitblit and partial url rewriting from the old Gitweb stuff.
Also on the mirroring on repos to GitHub. I got quite a few things that will break if changes are made to it in non-bc way.
What do you mean?
-Chad
On Tue, Aug 13, 2013 at 3:18 PM, Chad innocentkiller@gmail.com wrote:
You can rely on the Gitblit urls, they're not going anywhere or changing.
Gitweb I had been making promises of killing for a long long time (and never a promise of 1:1 mapping of all urls for rewriting), so here we are with Gitblit and partial url rewriting from the old Gitweb stuff.
...and I'm assuming anyone wanting to improve the Gitweb->Gitblit rewrite rules can submit a changeset to improve them: https://git.wikimedia.org/blob/operations%2Fpuppet.git/3c9c28f2c869c3eee471d...
(found the file above with a Gitblit search) \o/
Rob
On Tue, Aug 13, 2013 at 4:01 PM, Rob Lanphier robla@wikimedia.org wrote:
On Tue, Aug 13, 2013 at 3:18 PM, Chad innocentkiller@gmail.com wrote:
You can rely on the Gitblit urls, they're not going anywhere or changing.
Gitweb I had been making promises of killing for a long long time (and never a promise of 1:1 mapping of all urls for rewriting), so here we are with Gitblit and partial url rewriting from the old Gitweb stuff.
...and I'm assuming anyone wanting to improve the Gitweb->Gitblit rewrite rules can submit a changeset to improve them:
https://git.wikimedia.org/blob/operations%2Fpuppet.git/3c9c28f2c869c3eee471d...
(found the file above with a Gitblit search) \o/
Indeed, patches always welcome.
-Chad
Hey,
You can rely on the Gitblit urls, they're not going anywhere or changing.
\o/
Gitweb I had been making promises of killing for a long long time (and
never a promise of 1:1 mapping of all urls for rewriting), so here we are with Gitblit and partial url rewriting from the old Gitweb stuff.
I ended up being surprised by this.
Also
on the mirroring on repos to GitHub. I got quite a few things that will break if changes are made to it in non-bc way.
What do you mean?
Will this replication be maintained indefinitely by WMF, or is it possible that at some point its just stopped? In case WMF wants to stop supporting it, how much of a head notice will be provided?
Cheers
-- Jeroen De Dauw http://www.bn2vs.com Don't panic. Don't be evil. ~=[,,_,,]:3 --
On Tue, Aug 13, 2013 at 4:16 PM, Jeroen De Dauw jeroendedauw@gmail.comwrote:
Will this replication be maintained indefinitely by WMF, or is it possible that at some point its just stopped? In case WMF wants to stop supporting it, how much of a head notice will be provided?
You can rely on this indefinitely. I see no reason we would stop it, at least not without some serious discussion.
-Chad
wikitech-l@lists.wikimedia.org