Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
Hi Luca and team,
I am very excited to see this major improvement. As is no news to you, the change will significantly improve the efficiency of exploratory research work for Research.
Thanks to Analytics and SRE for working with us to make this happen. And thank /you/! :)
Leila
On Fri, Oct 2, 2020 at 12:46 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
Analytics-announce mailing list Analytics-announce@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics-announce
Hi everybody,
I am sorry if I mislead you before but the RAM expansion was to 512G on each node (stat1005/stat1008), I misremembered what was the agreed value ("Luca gives us false hopes! What a bad person!" Yes I agree 100%, sorry! :)
The work on stat1005 is already done, but stat1008 is having some problems (we don't have enough power in the PSU to fuel the GPU and the extra ram banks). We'll probably have to complete the maintenance during another day, I'll keep you posted.
Luca
On Fri, Oct 2, 2020 at 9:46 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
Still 512GB is awesome. You brightened my day Luca! I can do so many terrible things now <3
Thank you so much!
On Mon, Oct 5, 2020 at 6:18 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
I am sorry if I mislead you before but the RAM expansion was to 512G on each node (stat1005/stat1008), I misremembered what was the agreed value ("Luca gives us false hopes! What a bad person!" Yes I agree 100%, sorry! :)
The work on stat1005 is already done, but stat1008 is having some problems (we don't have enough power in the PSU to fuel the GPU and the extra ram banks). We'll probably have to complete the maintenance during another day, I'll keep you posted.
Luca
On Fri, Oct 2, 2020 at 9:46 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
-- Analytics-announce mailing list Analytics-announce@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics-announce
Hi again,
stat1008 is back with 256G of RAM (only +128G). We'll work on adding those extra 256G during the next few days, but it might take a bit :(
Luca
On Mon, Oct 5, 2020 at 6:18 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
I am sorry if I mislead you before but the RAM expansion was to 512G on each node (stat1005/stat1008), I misremembered what was the agreed value ("Luca gives us false hopes! What a bad person!" Yes I agree 100%, sorry! :)
The work on stat1005 is already done, but stat1008 is having some problems (we don't have enough power in the PSU to fuel the GPU and the extra ram banks). We'll probably have to complete the maintenance during another day, I'll keep you posted.
Luca
On Fri, Oct 2, 2020 at 9:46 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
Hi everybody,
We ordered new PSUs for stat1008 to get around the extra power consumption, I'll hopefully schedule another maintenance window to add +256G of ram during the next couple of weeks.
Luca
On Mon, Oct 5, 2020 at 6:43 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi again,
stat1008 is back with 256G of RAM (only +128G). We'll work on adding those extra 256G during the next few days, but it might take a bit :(
Luca
On Mon, Oct 5, 2020 at 6:18 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
I am sorry if I mislead you before but the RAM expansion was to 512G on each node (stat1005/stat1008), I misremembered what was the agreed value ("Luca gives us false hopes! What a bad person!" Yes I agree 100%, sorry! :)
The work on stat1005 is already done, but stat1008 is having some problems (we don't have enough power in the PSU to fuel the GPU and the extra ram banks). We'll probably have to complete the maintenance during another day, I'll keep you posted.
Luca
On Fri, Oct 2, 2020 at 9:46 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
Hi everybody,
Next Tuesday (Nov 17th) at 15:00 UTC we'll shutdown stat1008 to finally add the remaining 256G of RAM. More info in https://phabricator.wikimedia.org/T260448
As always, please reach out to us in the task or via IRC (#wikimedia-analytics) for any issue.
Luca (on behalf of the Analytics team)
On Mon, Oct 12, 2020 at 9:36 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
We ordered new PSUs for stat1008 to get around the extra power consumption, I'll hopefully schedule another maintenance window to add +256G of ram during the next couple of weeks.
Luca
On Mon, Oct 5, 2020 at 6:43 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi again,
stat1008 is back with 256G of RAM (only +128G). We'll work on adding those extra 256G during the next few days, but it might take a bit :(
Luca
On Mon, Oct 5, 2020 at 6:18 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
I am sorry if I mislead you before but the RAM expansion was to 512G on each node (stat1005/stat1008), I misremembered what was the agreed value ("Luca gives us false hopes! What a bad person!" Yes I agree 100%, sorry! :)
The work on stat1005 is already done, but stat1008 is having some problems (we don't have enough power in the PSU to fuel the GPU and the extra ram banks). We'll probably have to complete the maintenance during another day, I'll keep you posted.
Luca
On Fri, Oct 2, 2020 at 9:46 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
Hi everybody,
stat1008 has 512G of RAM now, enjoy :)
Luca
On Tue, Nov 10, 2020 at 7:30 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
Next Tuesday (Nov 17th) at 15:00 UTC we'll shutdown stat1008 to finally add the remaining 256G of RAM. More info in https://phabricator.wikimedia.org/T260448
As always, please reach out to us in the task or via IRC (#wikimedia-analytics) for any issue.
Luca (on behalf of the Analytics team)
On Mon, Oct 12, 2020 at 9:36 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
We ordered new PSUs for stat1008 to get around the extra power consumption, I'll hopefully schedule another maintenance window to add +256G of ram during the next couple of weeks.
Luca
On Mon, Oct 5, 2020 at 6:43 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi again,
stat1008 is back with 256G of RAM (only +128G). We'll work on adding those extra 256G during the next few days, but it might take a bit :(
Luca
On Mon, Oct 5, 2020 at 6:18 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
I am sorry if I mislead you before but the RAM expansion was to 512G on each node (stat1005/stat1008), I misremembered what was the agreed value ("Luca gives us false hopes! What a bad person!" Yes I agree 100%, sorry! :)
The work on stat1005 is already done, but stat1008 is having some problems (we don't have enough power in the PSU to fuel the GPU and the extra ram banks). We'll probably have to complete the maintenance during another day, I'll keep you posted.
Luca
On Fri, Oct 2, 2020 at 9:46 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
\o/ This is great news. This removes major barriers for the Research team's exploratory work and I highly appreciate it. You have our commitment for us to continue moving more and more of the computations to Spark/Hadoop.
Thank you!
Leila
On Tue, Nov 17, 2020 at 7:23 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
stat1008 has 512G of RAM now, enjoy :)
Luca
On Tue, Nov 10, 2020 at 7:30 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
Next Tuesday (Nov 17th) at 15:00 UTC we'll shutdown stat1008 to finally add the remaining 256G of RAM. More info in https://phabricator.wikimedia.org/T260448
As always, please reach out to us in the task or via IRC (#wikimedia-analytics) for any issue.
Luca (on behalf of the Analytics team)
On Mon, Oct 12, 2020 at 9:36 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
We ordered new PSUs for stat1008 to get around the extra power consumption, I'll hopefully schedule another maintenance window to add +256G of ram during the next couple of weeks.
Luca
On Mon, Oct 5, 2020 at 6:43 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi again,
stat1008 is back with 256G of RAM (only +128G). We'll work on adding those extra 256G during the next few days, but it might take a bit :(
Luca
On Mon, Oct 5, 2020 at 6:18 PM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
I am sorry if I mislead you before but the RAM expansion was to 512G on each node (stat1005/stat1008), I misremembered what was the agreed value ("Luca gives us false hopes! What a bad person!" Yes I agree 100%, sorry! :)
The work on stat1005 is already done, but stat1008 is having some problems (we don't have enough power in the PSU to fuel the GPU and the extra ram banks). We'll probably have to complete the maintenance during another day, I'll keep you posted.
Luca
On Fri, Oct 2, 2020 at 9:46 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
on Monday 5th there will be some downtime of stat1005 and stat1008 (hopefully one hour max in total) to expand their RAM to 1.5TB (!!!!). The maintenance is scheduled to start around 16 CEST.
As always, please let us know if this impacts your work!
Luca (on behalf of the Analytics team)
--
Analytics-announce mailing list Analytics-announce@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics-announce
analytics-announce@lists.wikimedia.org