Hi all,
I’m in the middle of a (slow) upgrade process for the Hadoop cluster. Currently, we are running CDH 5.0.2, and would like to upgrade to CDH 5.3. There are several steps to this process, the first of which is upgrading our OS to Ubuntu Trusty.
Along the way, I’m replacing our current NameNodes with different hardware. I am ready to do this now. I don’t see much opportunity to schedule this over the next couple of weeks, due to All-Hands travel, so I’d like to schedule this for tomorrow morning (Friday January 16th).
I expect this to be relatively simple downtime, that will only take a few minutes. Just in case, I’d like to reserve 2 hours of time.
So, unless there are serious objections, plan for Hadoop to be offline from
2015-01-16 15:45 - 17:45 UTC
Also, please don’t start jobs before this time slot that you think will take a long time. If there are running jobs, I either can’t shut down the cluster, or I will have to kill the jobs. If I see running jobs, I’ll try to reach out to you before I kill anything.
If anyone is interested in a rough migration plan, it is here:
https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Hadoop/Administration#... https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Hadoop/Administration#Migrating_to_new_HA_NameNodes
Thanks all!
-Ao