Hi everybody,
the Analytics Hadoop upgrade to Java 8 has been postponed due to unexpected hw failures (https://phabricator.wikimedia.org/T187164 and https://phabricator.wikimedia.org/T187162) happened this morning and causing some HDFS blocks to be under replicated/corrupted. To be on the safe side, we'll wait for the cluster's metrics to fully recover before doing anything. I will update this email thread as soon as we'll be ready, but it this might happen in EU late evening / SF morning.
Sorry for the delay! The Analytics Hadoop cluster staged a rebellion for Java 8, but we'll eventually succeed :)
Luca
2018-02-05 19:48 GMT+01:00 Joseph Allemandou jallemandou@wikimedia.org:
Hi Analytics folks,
*TL;DR: Hadoop cluster maintenance postponed to Tue 13th February*
We've experienced an issue in getting some data onto the cluster this month, making some of our monthly datasets (the ones that depend on that late data) not yet computed. We have decided to postpone the maintenance of the cluster to next week, allowing for those jobs to be finished. We are very sorry about the short notice and will send another email the day before maintenance. Best
Joseph Allemandou on behalf of the Analytics-Team Data Engineer @ Wikimedia Foundation IRC: joal
Engineering mailing list Engineering@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/engineering