The grid and bastions only support Python 3.5; that won't change until they get an OS upgrade (https://phabricator.wikimedia.org/T275864). As you noted, python 3.7 and 3.9 are available on Kubernetes but writing YAML configuration can be complex. There is a project to build a tool similar to jsub for submitting jobs to the Kubernetes cluster. A beta version of that tool is available for testing on the dev-buster bastion, see https://phabricator.wikimedia.org/T285944 for details. In this case, beta means "might not have all the features" and "implementation details might change". Because it's just another way to submit jobs to the existing k8s cluster, it will still be at least as reliable as the grid.
On Sun, Sep 26, 2021 at 9:44 PM Huji Lee huji.huji@gmail.com wrote:
Hi all,
When I run python3 --version on Toolforge I see version 3.5.3 is installed. Because python 3.5 reached the end of its life in September 2020, pip is really unhappy about that.
Is there a way to use a later version of python3 on Toolforge? If not, are there plans to upgrade the OS and upgrade python with it?
PS: I know from Help:Toolforge/Python that 3.7.3 is available on Kubernetes, but I am dealing with scripts that are submitted via jsub and not k8s, and the overhead of converting them is prohibitive.
Thanks! _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/