Hi everybody,
stat1005 was replaced almost a year ago by stat1007 to allow GPU research and testing (https://phabricator.wikimedia.org/T148843). After a long journey we are happy to add stat1005 back in the pool of available Analytics client hosts. I have updated the documentation in:
https://wikitech.wikimedia.org/wiki/Stat1005 https://wikitech.wikimedia.org/wiki/Analytics/Data_access#Analytics_clients
The host is now an Hadoop client like stat1004, and also offers an AMD GPU ( https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/AMD_GPU). For the moment we are limiting the access to the GPU to people that explicitly need it, since it is still a testing environment and we'd like to give some priority to people that already have projects relying on it. The end goal is to give access to the GPU by default to everybody, so stay tuned. If you wish to participate to the testing efforts, please reach out to the Analytics team! ( https://wikitech.wikimedia.org/wiki/Analytics/Data_access#GPU_usage).
Last but not the least - stat1005 is running Debian 10 (Buster), and openjdk-8 instead of the ones shipped by Debian (openjdk-11) since the Hadoop cluster is not ready to migrate yet. Everything seem running fine from our tests, but please report to us anything that looks strange.
Thanks in advance!
Luca (on behalf of the Analytics team)