Hi everybody,
the Analytics team is going to enable Kerberos authentication for Hadoop on Monday December 2nd. The procedure will start around 10 AM CET and will hopefully last 3/4 hours, but since this is an invasive change there might be a possibility that it will last more. If you have anything important that requires Hadoop on this date please let us know in advance.
The most visible change from the user's point of view is the introduction of a new account/password to be able to use the Hadoop services (like Hive/HDFS/Spark/Oozie). We created a user guide about what will change with kerberos in https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide. There is also a task opened to track any doubt/question/special-use-cases during the next two weeks: https://phabricator.wikimedia.org/T238560.
Feel free to reach out to IRC #wikimedia-analytics on Freenode too!
Thanks!
Luca (on behalf of the Analytics team)
Hi everybody,
to avoid any conflict with the start of the Fundraising season, we moved the Kerberos maintenance to Dec 16th at 10 AM CET (more info in https://phabricator.wikimedia.org/T238560).
If you use Hadoop and you haven't requested credentials yet, please do so following https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide#Get...
Thanks!
Luca (on behalf of the Analytics team)
Il giorno lun 18 nov 2019 alle ore 16:11 Luca Toscano < ltoscano@wikimedia.org> ha scritto:
Hi everybody,
the Analytics team is going to enable Kerberos authentication for Hadoop on Monday December 2nd. The procedure will start around 10 AM CET and will hopefully last 3/4 hours, but since this is an invasive change there might be a possibility that it will last more. If you have anything important that requires Hadoop on this date please let us know in advance.
The most visible change from the user's point of view is the introduction of a new account/password to be able to use the Hadoop services (like Hive/HDFS/Spark/Oozie). We created a user guide about what will change with kerberos in https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide. There is also a task opened to track any doubt/question/special-use-cases during the next two weeks: https://phabricator.wikimedia.org/T238560.
Feel free to reach out to IRC #wikimedia-analytics on Freenode too!
Thanks!
Luca (on behalf of the Analytics team)
Hi everybody,
the day has finally come, we'll start the procedure at around 13:00 CET.
For any issue please reach out to the Analytics team on Freenode (#wikimedia-analytics) or https://phabricator.wikimedia.org/T238560
We hope to have the cluster back running in a couple of hours, but it might take more if we encounter unexpected issues.
Thanks for the patience!
Luca
Il giorno mar 26 nov 2019 alle ore 09:46 Luca Toscano < ltoscano@wikimedia.org> ha scritto:
Hi everybody,
to avoid any conflict with the start of the Fundraising season, we moved the Kerberos maintenance to Dec 16th at 10 AM CET (more info in https://phabricator.wikimedia.org/T238560).
If you use Hadoop and you haven't requested credentials yet, please do so following https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide#Get...
Thanks!
Luca (on behalf of the Analytics team)
Il giorno lun 18 nov 2019 alle ore 16:11 Luca Toscano < ltoscano@wikimedia.org> ha scritto:
Hi everybody,
the Analytics team is going to enable Kerberos authentication for Hadoop on Monday December 2nd. The procedure will start around 10 AM CET and will hopefully last 3/4 hours, but since this is an invasive change there might be a possibility that it will last more. If you have anything important that requires Hadoop on this date please let us know in advance.
The most visible change from the user's point of view is the introduction of a new account/password to be able to use the Hadoop services (like Hive/HDFS/Spark/Oozie). We created a user guide about what will change with kerberos in https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide. There is also a task opened to track any doubt/question/special-use-cases during the next two weeks: https://phabricator.wikimedia.org/T238560.
Feel free to reach out to IRC #wikimedia-analytics on Freenode too!
Thanks!
Luca (on behalf of the Analytics team)
*For Notebook Users:* you need to kinit from the Jupyter interface, through a terminal. I added docs here: https://wikitech.wikimedia.org/w/index.php?title=SWAP&type=revision&... (highlighting this since I guessed, incorrectly, that I could ssh, kinit, and then tunnel separately. This does not work.)
On Mon, Dec 16, 2019 at 5:54 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
the day has finally come, we'll start the procedure at around 13:00 CET.
For any issue please reach out to the Analytics team on Freenode (#wikimedia-analytics) or https://phabricator.wikimedia.org/T238560
We hope to have the cluster back running in a couple of hours, but it might take more if we encounter unexpected issues.
Thanks for the patience!
Luca
Il giorno mar 26 nov 2019 alle ore 09:46 Luca Toscano < ltoscano@wikimedia.org> ha scritto:
Hi everybody,
to avoid any conflict with the start of the Fundraising season, we moved the Kerberos maintenance to Dec 16th at 10 AM CET (more info in https://phabricator.wikimedia.org/T238560).
If you use Hadoop and you haven't requested credentials yet, please do so following https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide#Get...
Thanks!
Luca (on behalf of the Analytics team)
Il giorno lun 18 nov 2019 alle ore 16:11 Luca Toscano < ltoscano@wikimedia.org> ha scritto:
Hi everybody,
the Analytics team is going to enable Kerberos authentication for Hadoop on Monday December 2nd. The procedure will start around 10 AM CET and will hopefully last 3/4 hours, but since this is an invasive change there might be a possibility that it will last more. If you have anything important that requires Hadoop on this date please let us know in advance.
The most visible change from the user's point of view is the introduction of a new account/password to be able to use the Hadoop services (like Hive/HDFS/Spark/Oozie). We created a user guide about what will change with kerberos in https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide. There is also a task opened to track any doubt/question/special-use-cases during the next two weeks: https://phabricator.wikimedia.org/T238560.
Feel free to reach out to IRC #wikimedia-analytics on Freenode too!
Thanks!
Luca (on behalf of the Analytics team)
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
This is now done. I'll send a separate announcement, but I'm quite proud of my awesome team right now, great work yall.
On Mon, Dec 16, 2019 at 10:58 AM Dan Andreescu dandreescu@wikimedia.org wrote:
*For Notebook Users:* you need to kinit from the Jupyter interface, through a terminal. I added docs here: https://wikitech.wikimedia.org/w/index.php?title=SWAP&type=revision&... (highlighting this since I guessed, incorrectly, that I could ssh, kinit, and then tunnel separately. This does not work.)
On Mon, Dec 16, 2019 at 5:54 AM Luca Toscano ltoscano@wikimedia.org wrote:
Hi everybody,
the day has finally come, we'll start the procedure at around 13:00 CET.
For any issue please reach out to the Analytics team on Freenode (#wikimedia-analytics) or https://phabricator.wikimedia.org/T238560
We hope to have the cluster back running in a couple of hours, but it might take more if we encounter unexpected issues.
Thanks for the patience!
Luca
Il giorno mar 26 nov 2019 alle ore 09:46 Luca Toscano < ltoscano@wikimedia.org> ha scritto:
Hi everybody,
to avoid any conflict with the start of the Fundraising season, we moved the Kerberos maintenance to Dec 16th at 10 AM CET (more info in https://phabricator.wikimedia.org/T238560).
If you use Hadoop and you haven't requested credentials yet, please do so following https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide#Get...
Thanks!
Luca (on behalf of the Analytics team)
Il giorno lun 18 nov 2019 alle ore 16:11 Luca Toscano < ltoscano@wikimedia.org> ha scritto:
Hi everybody,
the Analytics team is going to enable Kerberos authentication for Hadoop on Monday December 2nd. The procedure will start around 10 AM CET and will hopefully last 3/4 hours, but since this is an invasive change there might be a possibility that it will last more. If you have anything important that requires Hadoop on this date please let us know in advance.
The most visible change from the user's point of view is the introduction of a new account/password to be able to use the Hadoop services (like Hive/HDFS/Spark/Oozie). We created a user guide about what will change with kerberos in https://wikitech.wikimedia.org/wiki/Analytics/Systems/Kerberos/UserGuide. There is also a task opened to track any doubt/question/special-use-cases during the next two weeks: https://phabricator.wikimedia.org/T238560.
Feel free to reach out to IRC #wikimedia-analytics on Freenode too!
Thanks!
Luca (on behalf of the Analytics team)
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Note! For Hive Jupyter users, there is an issue with PyHive and Kerberos, so you'll want to switch to Impyla. I've updated docs at https://wikitech.wikimedia.org/wiki/SWAP#with_Hive_(MapReduce) with instructions.