Starting on Tuesday, March 4th, the new Labs install in the eqiad data center will be open for business. Two dramatic things will happen on that day: Wikitech will gain the ability to create instances in eqiad, and wikitech will lose the ability to create new instances in pmtpa.
About a month from Tuesday, the pmtpa labs install will be shut down. If you want your project to still be up and running in April, you must take action!
We are committed to not destroying any instances or data during the shutdown, but projects that remain untouched by human hands during the next few weeks will be mothballed by staff: the data will be preserved but most likely compressed and archived, and instances will be left in a shutdown state.
(Note: Toollabs users can sit tight for a bit; Coren will provide specific migration instructions for you shortly.)
I've written a migration guide, here: https://wikitech.wikimedia.org/wiki/Labs_Eqiad_Migration_Howto It's a work in progress, so check back frequently. Please don't hesitate to ask questions on IRC, make suggestions as to guide improvements, or otherwise question this process. Quite a few of the suggested steps in that guide require action on the part of a Labs op -- for that purpose we've created a bugzilla tracking bug, 62042. To add a migration bug that links to the tracker, use this link: https://bugzilla.wikimedia.org/enter_bug.cgi?product=Wikimedia%20Labs&co...
At the very least, please visit this page and edit it with your project migration plans: https://wikitech.wikimedia.org/wiki/Labs_Eqiad_Migration_Progress Projects that have no activity on that page will be early candidates for mothballing. If you want me to delete your project, please note that as well -- that will allow us to free up resources for future projects.
I am cautiously optimistic about this migration. Most of our testing has gone fairly well, so a lot of you should find the process smooth and easy. That said, we're all going to be early adopters of this tech, so I appreciate your patience and understanding when inevitable bugs shake out. I look forward to hearing about them on IRC!
-Andrew
I am confused about /data mounpoint
You say:
The contents of your shared /data/project or /home directories will not be immediately available in eqiad.
Does it mean that if I decide to move the content by hand, using SCP, it will be overwritten anyway sooner or later? How do I decide if I want to have this content moved by ops or by myself? What if I want to move just some items from /data/project and remaining data can be safely nuked?
On Fri, Feb 28, 2014 at 4:59 PM, Andrew Bogott abogott@wikimedia.org wrote:
Starting on Tuesday, March 4th, the new Labs install in the eqiad data center will be open for business. Two dramatic things will happen on that day: Wikitech will gain the ability to create instances in eqiad, and wikitech will lose the ability to create new instances in pmtpa.
About a month from Tuesday, the pmtpa labs install will be shut down. If you want your project to still be up and running in April, you must take action!
We are committed to not destroying any instances or data during the shutdown, but projects that remain untouched by human hands during the next few weeks will be mothballed by staff: the data will be preserved but most likely compressed and archived, and instances will be left in a shutdown state.
(Note: Toollabs users can sit tight for a bit; Coren will provide specific migration instructions for you shortly.)
I've written a migration guide, here: https://wikitech.wikimedia.org/wiki/Labs_Eqiad_Migration_Howto It's a work in progress, so check back frequently. Please don't hesitate to ask questions on IRC, make suggestions as to guide improvements, or otherwise question this process. Quite a few of the suggested steps in that guide require action on the part of a Labs op -- for that purpose we've created a bugzilla tracking bug, 62042. To add a migration bug that links to the tracker, use this link: https://bugzilla.wikimedia.org/enter_bug.cgi?product=Wikimedia%20Labs&co...
At the very least, please visit this page and edit it with your project migration plans: https://wikitech.wikimedia.org/wiki/Labs_Eqiad_Migration_Progress Projects that have no activity on that page will be early candidates for mothballing. If you want me to delete your project, please note that as well -- that will allow us to free up resources for future projects.
I am cautiously optimistic about this migration. Most of our testing has gone fairly well, so a lot of you should find the process smooth and easy. That said, we're all going to be early adopters of this tech, so I appreciate your patience and understanding when inevitable bugs shake out. I look forward to hearing about them on IRC!
-Andrew
Labs-l mailing list Labs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/labs-l
On 3/1/14 1:25 AM, Petr Bena wrote:
I am confused about /data mounpoint
OK, with luck I will not confuse further.
You say:
The contents of your shared /data/project or /home directories will not be immediately available in eqiad.
Yep. eqiad labs is, for now, a blank slate.
Does it mean that if I decide to move the content by hand, using SCP, it will be overwritten anyway sooner or later?
No. Indeed, you are encouraged to move that content by hand -- just please coordinate with us so we know what you're doing.
How do I decide if I want to have this content moved by ops or by myself? What if I want to move just some items from /data/project and remaining data can be safely nuked?
The next two weeks are designated for you to do exactly that -- move files by hand, and select which things to abandon. This is strongly encouraged! Once you're done and ready to abandon other files please make a note to that effect on the migration progress page ( https://wikitech.wikimedia.org/wiki/Labs_Eqiad_Migration_Progress ).
If in two weeks there's no note on that page and I see that your eqiad shared dirs are still empty then I'll make a unilateral copy of everything.
(There's one caveat here: Because the file copies are going to take a super long time, I've already started a job that will haphazardly copy files over to eqiad and stow them in obviously-named subdirs, e.g. 'glustercopy' or 'nfscopy'. Those are there to save time as part of a future migration... you should leave them be but otherwise ignore them. If you opt for self-migration then you or I can just erase those dirs later on if you have them.)
I hope this makes sense! Please let me know if I'm still being unclear.
-Andrew
wikitech-l@lists.wikimedia.org