Forwarded per Ben's request.
---------- Forwarded message ----------
From: Ben Hartshorne <bhartshorne(a)wikimedia.org>
Date: Tue, Jan 31, 2012 at 8:43 PM
Subject: [Wikitech-l] Deploying Swift for thumbnails next Mon-Thurs Feb 6-9
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
Hi Everyone,
Next week we're going to switch the back end system that hosts thumbnail[1]
images. We have been using
ms5<http://ganglia.wikimedia.org/latest/?r=day&cs=&ce=&m=&c=Miscellaneous+pmtpa…>(a
Sun server running linux) to serve all thumbnails. We are switching
to Openstack
Swift <http://wikitech.wikimedia.org/view/Swift>, a clustered object
store. Though we have done testing and expect no problems, I want to
publicize the change so that if issues do appear, they are quickly directed
to the right place.
Here's the schedule:
* Monday Feb 6th: move 0.4% of all thumbnail traffic from ms5 to swift.
Only thumbnails with "/thumb/a/a2/"[2] in the URL will be affected.
* Tuesday: move 12.5% of traffic - thumbnails with "/thumb/a/" or
"/thumb/b/" will be affected
* Wednesday: move 50% of traffic - thumbnails with "/thumb/(a-f or 0 or
1)/" will be affected
* Thundlay: move 100% of traffic - all thumbnails will be served from Swift
Potential symptoms that might be related to this change on Monday:
* a thumbnail image with /a/a2/ simply fails to load
** try changing the number preceding 'px' to generate a different size
image[3]
* you delete an image and the thumbnail is still available
** try purging the cache[4] and see if that makes it go away
** try changing the number preceding 'px' and see what happens
* you move an image to a new name and it's still available at the old name,
when either the new or old name has /a/a2/ in the URL
** please provide full URLs for both the new and old names
If any of these things happen, or if something else odd happens with images
or thumbnails and you feel it might be related, please join #wikimedia-tech
in IRC and ping me (maplebed) or Aaron (AaronSchulz). If neither of us are
available or you would prefer to just leave us a message, add a note to
https://www.mediawiki.org/wiki/SwiftMedia/Issues. :) If things are
severely broken, you can ask someone in the #wikimedia-tech to page me.
Thanks for your help!
-ben
[1] In case you don't know what I mean by thumbnail images, I'm talking
about all URLs that start http://upload.wikimedia.org/ and have /thumb/ in
the path. When an image is uploaded to a wiki (or commons), Mediawiki
automatically generates scaled versions of the image. These are what I
call 'thumbnails'. Nearly every time an image is used in a wiki page it is
actually a thumbnail being used. Try going to any wiki page with an image,
right click on the image, and choose 'view image'. You'll get something
like
http://upload.wikimedia.org/wikipedia/commons/thumb/4/45/Liberty_Head_Nicke…
as the URL (this was taken from enwiki's featured article today)
[2] For example,
http://upload.wikimedia.org/wikipedia/commons*/thumb/a/a2/*Little_kitten_.j…
[6]
[3] For example,
http://upload.wikimedia.org/wikipedia/commons/thumb/a/a2/Little_kitten_.jpg/
*799px*-Little_kitten_.jpg
[4] Find the URL for the main image file (rearrange the URL to find the
original image - /wikipedia/commons -> commons.wikipedia.org) and add
"?action=purge" to the end of the URL (eg
http://commons.wikimedia.org/wiki/File:Little_kitten_.jpg?action=purge
[5] Image in the public domain
[6] cc-by 3.0, Alexanderwdark<http://commons.wikimedia.org/w/index.php?title=User:Alexanderwdark&action=e…>
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
--
Guillaume Paumier
Technical Communications Manager — Wikimedia Foundation
On 26/01/12 18:26, Thehelpfulone wrote:
> If you need any user rights (admin, crat..) for your testing, please feel
> free to request on
> http://labs.wikimedia.beta.wmflabs.org/wiki/Global_Requests#Permissions - I
> can provide rights as needed (as can the other users on
> http://labs.wikimedia.beta.wmflabs.org/wiki/Special:GlobalUsers/steward
> although
> they might be a bit more busy with testing), so feel free to ping me on IRC
> (Thehelpfulone), email me or leave a message on my enwiki/metawiki talk
> page if nobody has replied to your request.
>
> Thanks.
Actually, just asking in #wikimedia-labs, there's an high probability
that someone with appropiate permissions will be there.
-------- Original Message --------
Subject: Re: [Wikitech-l] Please help test MediaWiki 1.19 now -
deployments may start in February
Date: Thu, 26 Jan 2012 17:26:43 +0000
From: Thehelpfulone <thehelpfulonewiki(a)gmail.com>
Reply-To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
On 26 January 2012 16:59, Sumana Harihareswara <sumanah(a)wikimedia.org>wrote:
> The developers of MediaWiki, the software Wikimedia sites run on, are
> wrapping up work on a new version, with hundreds of improvements and
> bugfixes. Description:
>
> https://www.mediawiki.org/wiki/MediaWiki_1.19
>
> There is a draft schedule for deploying this software to all Wikimedia
> sites in February and March. The schedule is tentative and dates are
> going to shift and change. (See the "SCHEDULING" note below in this
> email.)
>
> https://www.mediawiki.org/wiki/MediaWiki_1.19/Roadmap
>
> We want to do a lot of testing BEFORE the rollout, so that we catch
> potential problems before they affect readers and editors. Please help
> us! We have set up replicas of your wikis and installed the latest
> MediaWiki code on those replicas, so you can spot new problems in the
> software's behavior:
>
> http://labs.wikimedia.beta.wmflabs.org
>
> Please look at
> http://labs.wikimedia.beta.wmflabs.org/wiki/Special:SiteMatrix and find
> wikis to test. Try reading, editing, and so on as you normally would;
> treat it as a giant sandbox. If you find a problem, please report it
> here: http://labs.wikimedia.beta.wmflabs.org/wiki/Problem_reports
>
> We are especially interested in finding out about problems that affect
> unique JavaScript user scripts or Gadgets, so we can help you fix them.
>
> SCHEDULING: Now is also a good time to let us know if there are going to
> be big news days or weeks in February where your community would be
> especially unhappy if you had a window with no access or no editability.
> For example, if there's an important national election happening in one
> of the countries you serve, we'd ideally like to avoid taking your site
> down for maintenance on that day.
> https://www.mediawiki.org/wiki/Talk:MediaWiki_1.19/Roadmap would be a
> good place to tell us that.
>
> If you have questions, please feel free to contact us in
> https://www.mediawiki.org/wiki/MediaWiki_on_IRC or via the Wikimedia
> developers' mailing list at
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l .
>
> Thank you.
>
> --
> Sumana Harihareswara
> Volunteer Development Coordinator
> Wikimedia Foundation
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l(a)lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
If you need any user rights (admin, crat..) for your testing, please feel
free to request on
http://labs.wikimedia.beta.wmflabs.org/wiki/Global_Requests#Permissions - I
can provide rights as needed (as can the other users on
http://labs.wikimedia.beta.wmflabs.org/wiki/Special:GlobalUsers/steward
although
they might be a bit more busy with testing), so feel free to ping me on IRC
(Thehelpfulone), email me or leave a message on my enwiki/metawiki talk
page if nobody has replied to your request.
Thanks.
--
Thehelpfulone
http://en.wikipedia.org/wiki/User:Thehelpfulone
English Wikipedia Administrator
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
The developers of MediaWiki, the software Wikimedia sites run on, are
wrapping up work on a new version, with hundreds of improvements and
bugfixes. Description:
https://www.mediawiki.org/wiki/MediaWiki_1.19
There is a draft schedule for deploying this software to all Wikimedia
sites in February and March. The schedule is tentative and dates are
going to shift and change. (See the "SCHEDULING" note below in this email.)
https://www.mediawiki.org/wiki/MediaWiki_1.19/Roadmap
We want to do a lot of testing BEFORE the rollout, so that we catch
potential problems before they affect readers and editors. Please help
us! We have set up replicas of your wikis and installed the latest
MediaWiki code on those replicas, so you can spot new problems in the
software's behavior:
http://labs.wikimedia.beta.wmflabs.org
Please look at
http://labs.wikimedia.beta.wmflabs.org/wiki/Special:SiteMatrix and find
wikis to test. Try reading, editing, and so on as you normally would;
treat it as a giant sandbox. If you find a problem, please report it
here: http://labs.wikimedia.beta.wmflabs.org/wiki/Problem_reports
We are especially interested in finding out about problems that affect
unique JavaScript user scripts or Gadgets, so we can help you fix them.
SCHEDULING: Now is also a good time to let us know if there are going to
be big news days or weeks in February where your community would be
especially unhappy if you had a window with no access or no editability.
For example, if there's an important national election happening in one
of the countries you serve, we'd ideally like to avoid taking your site
down for maintenance on that day.
https://www.mediawiki.org/wiki/Talk:MediaWiki_1.19/Roadmap would be a
good place to tell us that.
If you have questions, please feel free to contact us in
https://www.mediawiki.org/wiki/MediaWiki_on_IRC or via the Wikimedia
developers' mailing list at
https://lists.wikimedia.org/mailman/listinfo/wikitech-l .
Thank you.
--
Sumana Harihareswara
Volunteer Development Coordinator
Wikimedia Foundation
I want to let you know of a new feature we now have on Wikimedia sites.
Please publicize this to wikis, and ask them for suggestions and
criticism, and pass that information along to Max. Thank you.
--
Sumana Harihareswara
Volunteer Development Coordinator
Wikimedia Foundation
-------- Original Message --------
Subject: [Wikitech-l] FeaturedFeeds deployed
Date: Thu, 26 Jan 2012 17:06:16 +0400
From: Max Semenik <maxsem.wiki(a)gmail.com>
Reply-To: Max Semenik <maxsem.wiki(a)gmail.com>, Wikimedia developers
<wikitech-l(a)lists.wikimedia.org>
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
Yesterday we deployed FeaturedFeeds[1] to the cluster (thanks,
Arthur!) Everything looks good so far, examples of feeds: [2], [3].
We haven't enabled feed links in the sidebar like on our staging wiki
at [4] - I wonder if we should enable them on opt-in or opt-out basis.
Overall, I'd apreciate your critics, comments, suggestions. Also,
please assist your local communities in seting up their feeds, especially
if you know less common languages.
---
[1]
https://blog.wikimedia.org/2012/01/26/featuredfeeds-brings-syndication-feed…
[2]
https://en.wikipedia.org/w/api.php?action=featuredfeed&feed=featured&feedfo…
[3]
https://it.wikiquote.org/w/api.php?action=featuredfeed&feed=qotd&feedformat…
[4] http://mobile-feeds.wmflabs.org/w/index.php/Main_Page
--
Best regards,
Max Semenik ([[User:MaxSem]])
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
https://blog.wikimedia.org/2012/01/16/wikipedias-community-calls-for-anti-s…
"...the Wikipedia community has decided to black out the
English-language Wikipedia for 24 hours, worldwide, beginning at 05:00
UTC on Wednesday, January 18. The blackout is a protest against proposed
legislation in the United States —the Stop Online Piracy Act (SOPA) in
the U.S. House of Representatives, and the PROTECTIP Act (PIPA) in the
U.S. Senate— that, if passed, would seriously damage the free and open
Internet, including Wikipedia....."
We'll be disabling editing via the web service API. You can ask
questions regarding the planning in #wikimedia-sopa .
--
Sumana Harihareswara
Volunteer Development Coordinator
Wikimedia Foundation
-------- Original Message --------
Subject: [Wikitech-l] Mailing lists server migration today
Date: Fri, 13 Jan 2012 14:54:00 +0100
From: Mark Bergsma <mark(a)wikimedia.org>
Reply-To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>, Wikimedia
Foundation Mailing List <foundation-l(a)lists.wikimedia.org>
Hi,
Today I will be migrating the mailing lists from a very old server
(lily) in Amsterdam, to a new server (sodium) in our new Ashburn data
center. Mailman will be upgraded to version 2.1.13 along the way.
During the migration, mail will be delayed as all data will need to be
transferred to the new host. No mail should go lost, but no new mails
will be sent out during the process until done, and the web interface
will be unavailable. This shouldn't take more than one hour, if all goes
well.
I will report here when things should be back up and running.
Afterwards, please let us know of any new issues, in bugzilla or on IRC
(#wikimedia-tech). We don't expect any problems, but as with any
software upgrade or migration, this can't be guaranteed...
Thanks,
--
Mark Bergsma <mark(a)wikimedia.org>
Lead Operations Architect
Wikimedia Foundation
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
---------- Forwarded message ----------
From: Mark Bergsma <mark(a)wikimedia.org>
Date: Fri, Jan 13, 2012 at 09:41
Subject: [Wikitech-l] CANCELED: Mailing lists server migration today
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
Cc: Wikimedia Foundation Mailing List <foundation-l(a)lists.wikimedia.org>
On Jan 13, 2012, at 2:54 PM, Mark Bergsma wrote:
> Hi,
>
> Today I will be migrating the mailing lists from a very old server (lily) in Amsterdam, to a new server (sodium) in our new Ashburn data center. Mailman will be upgraded to version 2.1.13 along the way.
...and right after I sent this mail, I rebooted the new server once
more before starting the maintenance. But suddenly it refused to come
back up, or even reinstall. Likely the server has hardware issues.
Therefore the maintenance is canceled for today, until we've figured
out what the problem is. The migration will probably happen next week,
possibly using different hardware.
--
Mark Bergsma <mark(a)wikimedia.org>
Lead Operations Architect
Wikimedia Foundation
