Hello,
We need to plan to decommission several of the analytics clients https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients, also referred to as the stats servers, since they have reached their end of service date. The servers in question are:
* stat1004 https://wikitech.wikimedia.org/wiki/Stat1004 * stat1005 https://wikitech.wikimedia.org/wiki/Stat1005 * stat1006 https://wikitech.wikimedia.org/wiki/Stat1006 * stat1007 https://wikitech.wikimedia.org/wiki/Stat1007
If you actively use these servers, please consider moving your work to alternative stat servers (namely, stat10[08-11]) as soon as reasonably possible.
Similarly, should you have personal files in your home directory on any of these servers that you would like to retain, now would be a good time to consider moving them to a different server, or moving them to your HDFS home directory.
There are some guides available on syncing files between stats servers https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients#Rsync_between_clients and also using the hdfs CLI https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster#How_do_I... to manage files, which may help you to clean up the necessary files.
We would like to be able to decommission these servers *three weeks' from today*, which is on *Tuesday May 28th*. Please do feel free to get back to us if you feel that this timescale will not allow sufficient time for you to migrate your work to alternative servers, or if you have any other concerns about this plan.
Kind regards, Ben
Hello,
Just a quick reminder that this work to take stat100[4-7] out of service will be going ahead next Tuesday morning, May 28th.
Please ensure that you have copied any important files to different stat servers or to HDFS before then. Feel free do get in touch with us at if you have any concerns about this schedule.
Kind regards, Ben
On 07/05/2024 12:47 pm, Ben Tullis wrote:
Hello,
We need to plan to decommission several of the analytics clients https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients, also referred to as the stats servers, since they have reached their end of service date. The servers in question are:
- stat1004 https://wikitech.wikimedia.org/wiki/Stat1004
- stat1005 https://wikitech.wikimedia.org/wiki/Stat1005
- stat1006 https://wikitech.wikimedia.org/wiki/Stat1006
- stat1007 https://wikitech.wikimedia.org/wiki/Stat1007
If you actively use these servers, please consider moving your work to alternative stat servers (namely, stat10[08-11]) as soon as reasonably possible.
Similarly, should you have personal files in your home directory on any of these servers that you would like to retain, now would be a good time to consider moving them to a different server, or moving them to your HDFS home directory.
There are some guides available on syncing files between stats servers https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients#Rsync_between_clients and also using the hdfs CLI https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster#How_do_I... to manage files, which may help you to clean up the necessary files.
We would like to be able to decommission these servers *three weeks' from today*, which is on *Tuesday May 28th*. Please do feel free to get back to us if you feel that this timescale will not allow sufficient time for you to migrate your work to alternative servers, or if you have any other concerns about this plan.
Kind regards, Ben
-- *Ben Tullis*(he/him) Senior Site Reliability Engineer Wikimedia Foundation https://wikimediafoundation.org/
I have not been able to make this change today, so I will schedule it for next week instead.
Kind regards, Ben
On 24/05/2024 4:31 pm, Ben Tullis wrote:
Hello,
Just a quick reminder that this work to take stat100[4-7] out of service will be going ahead next Tuesday morning, May 28th.
Please ensure that you have copied any important files to different stat servers or to HDFS before then. Feel free do get in touch with us at if you have any concerns about this schedule.
Kind regards, Ben
On 07/05/2024 12:47 pm, Ben Tullis wrote:
Hello,
We need to plan to decommission several of the analytics clients https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients, also referred to as the stats servers, since they have reached their end of service date. The servers in question are:
- stat1004 https://wikitech.wikimedia.org/wiki/Stat1004
- stat1005 https://wikitech.wikimedia.org/wiki/Stat1005
- stat1006 https://wikitech.wikimedia.org/wiki/Stat1006
- stat1007 https://wikitech.wikimedia.org/wiki/Stat1007
If you actively use these servers, please consider moving your work to alternative stat servers (namely, stat10[08-11]) as soon as reasonably possible.
Similarly, should you have personal files in your home directory on any of these servers that you would like to retain, now would be a good time to consider moving them to a different server, or moving them to your HDFS home directory.
There are some guides available on syncing files between stats servers https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients#Rsync_between_clients and also using the hdfs CLI https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster#How_do_I... to manage files, which may help you to clean up the necessary files.
We would like to be able to decommission these servers *three weeks' from today*, which is on *Tuesday May 28th*. Please do feel free to get back to us if you feel that this timescale will not allow sufficient time for you to migrate your work to alternative servers, or if you have any other concerns about this plan.
Kind regards, Ben
-- *Ben Tullis*(he/him) Senior Site Reliability Engineer Wikimedia Foundation https://wikimediafoundation.org/
-- *Ben Tullis*(he/him) Senior Site Reliability Engineer Wikimedia Foundation https://wikimediafoundation.org/
Hello,
Apologies for the scattergun approach, but I am trying to make sure that I don't inadvertently cause problems for anyone who might still be using the older Analytics Clients https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients, namely *stat100[4-7]*, as they are to be decommissioned shortly.
My plan is to merge this patch https://gerrit.wikimedia.org/r/c/operations/puppet/+/1038329 tomorrow, June 5th at approximately 10:00 UTC, which will disable user login to stat100[4-7].
If you still need to move files from these servers to a different stat server, or to HDFS, please refer to the guidelines here:
* syncing files between stats servers https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients#Rsync_between_clients * using the hdfs CLI https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster#How_do_I...
I plan to keep these servers running in this 'insetup' mode for about a week, just in case there is still something useful on them, before finally decommissioning them.
If this schedule is inconvenient for you, or you have any other concerns about the work, please don't hesitate to reply or to contact the Data Platform SRE team. You can use #data-platforms-sre on Slack, or #wikimedia-data-platform on IRC, or ping me direct.
Kind regards, Ben
On 28/05/2024 12:41 pm, Ben Tullis wrote:
I have not been able to make this change today, so I will schedule it for next week instead.
Kind regards, Ben
On 24/05/2024 4:31 pm, Ben Tullis wrote:
Hello,
Just a quick reminder that this work to take stat100[4-7] out of service will be going ahead next Tuesday morning, May 28th.
Please ensure that you have copied any important files to different stat servers or to HDFS before then. Feel free do get in touch with us at if you have any concerns about this schedule.
Kind regards, Ben
On 07/05/2024 12:47 pm, Ben Tullis wrote:
Hello,
We need to plan to decommission several of the analytics clients https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients, also referred to as the stats servers, since they have reached their end of service date. The servers in question are:
- stat1004 https://wikitech.wikimedia.org/wiki/Stat1004
- stat1005 https://wikitech.wikimedia.org/wiki/Stat1005
- stat1006 https://wikitech.wikimedia.org/wiki/Stat1006
- stat1007 https://wikitech.wikimedia.org/wiki/Stat1007
If you actively use these servers, please consider moving your work to alternative stat servers (namely, stat10[08-11]) as soon as reasonably possible.
Similarly, should you have personal files in your home directory on any of these servers that you would like to retain, now would be a good time to consider moving them to a different server, or moving them to your HDFS home directory.
There are some guides available on syncing files between stats servers https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients#Rsync_between_clients and also using the hdfs CLI https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster#How_do_I... to manage files, which may help you to clean up the necessary files.
We would like to be able to decommission these servers *three weeks' from today*, which is on *Tuesday May 28th*. Please do feel free to get back to us if you feel that this timescale will not allow sufficient time for you to migrate your work to alternative servers, or if you have any other concerns about this plan.
Kind regards, Ben