Hi everybody,

the Analytics Hadoop upgrade to Java 8 has been postponed due to unexpected hw failures (https://phabricator.wikimedia.org/T187164 and https://phabricator.wikimedia.org/T187162) happened this morning and causing some HDFS blocks to be under replicated/corrupted. To be on the safe side, we'll wait for the cluster's metrics to fully recover before doing anything. I will update this email thread as soon as we'll be ready, but it this might happen in EU late evening / SF morning.

Sorry for the delay! The Analytics Hadoop cluster staged a rebellion for Java 8, but we'll eventually succeed :)

Luca

2018-02-05 19:48 GMT+01:00 Joseph Allemandou <jallemandou@wikimedia.org>:

Hi Analytics folks,

TL;DR: Hadoop cluster maintenance postponed to Tue 13th February

We've experienced an issue in getting some data onto the cluster this month, making some of our monthly datasets (the ones that depend on that late data) not yet computed.
We have decided to postpone the maintenance of the cluster to next week, allowing for those jobs to be finished.
We are very sorry about the short notice and will send another email the day before maintenance.
Best

Joseph Allemandou on behalf of the Analytics-Team
Data Engineer @ Wikimedia Foundation
IRC: joal

_______________________________________________
Engineering mailing list
Engineering@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/engineering