I want to use jupyter to do some data visualization. I found PAWS, but I can't access my toolforge directory:
FileNotFoundError: [Errno 2] No such file or directory: '/home/roysmith/sock-classifier/jobs/last/job.out'
Is there a way to access my toolforge directory from within PAWS?
Alternately, is there a way to run jupyter within toolforge? I tried installing it myself but it won't run:
(env) temp $ jupyter notebook Traceback (most recent call last): File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/bin/jupyter-notebook", line 11, in <module> sys.exit(main()) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/jupyter_core/application.py", line 268, in launch_instance return super(JupyterApp, cls).launch_instance(argv=argv, **kwargs) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/traitlets/config/application.py", line 663, in launch_instance app.initialize(argv) File "</mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/decorator.py:decorator-gen-7>", line 2, in initialize File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/traitlets/config/application.py", line 87, in catch_config_error return method(app, *args, **kwargs) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/notebook/notebookapp.py", line 1716, in initialize self.init_resources() File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/notebook/notebookapp.py", line 1420, in init_resources resource.setrlimit(resource.RLIMIT_NOFILE, (soft, hard)) ValueError: not allowed to raise maximum limit
You can access your paws home directory from Toolforge, but not the other way arround.
PAWS home directories live in /data/project/paws/userhomes/{userGlobalId}
(you can find GlobalID for your user from the api or going to http://paws-public.wmflabs.org/paws-public/User:USERNAME/ and looking at the title and h1 tags)
Do mind permissions if you need to he manage files there from outside PAWS. The tools.paws user needs to be able to read and write to the files and directories there.
Cheers,
Chico Venancio
Em sáb, 7 de dez de 2019 14:27, Roy Smith roy@panix.com escreveu:
I want to use jupyter to do some data visualization. I found PAWS, but I can't access my toolforge directory:
FileNotFoundError: [Errno 2] No such file or directory:
'/home/roysmith/sock-classifier/jobs/last/job.out'
Is there a way to access my toolforge directory from within PAWS?
Alternately, is there a way to run jupyter within toolforge? I tried installing it myself but it won't run:
(env) temp $ jupyter notebook Traceback (most recent call last): File
"/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/bin/jupyter-notebook", line 11, in <module>
sys.exit(main())File
"/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/jupyter_core/application.py", line 268, in launch_instance
return super(JupyterApp, cls).launch_instance(argv=argv, **kwargs)File
"/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/traitlets/config/application.py", line 663, in launch_instance
app.initialize(argv)File
"</mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/decorator.py:decorator-gen-7>", line 2, in initialize
File
"/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/traitlets/config/application.py", line 87, in catch_config_error
return method(app, *args, **kwargs)File
"/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/notebook/notebookapp.py", line 1716, in initialize
self.init_resources()File
"/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/notebook/notebookapp.py", line 1420, in init_resources
resource.setrlimit(resource.RLIMIT_NOFILE, (soft, hard))ValueError: not allowed to raise maximum limit
Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud
Hmmm. OK, I see my paws directory mounted on tools-sgebastion-08, but I don't have permission to write there. How do I get my data copied into the paws environment?
drwxr-sr-x 6 tools.paws tools.paws 4096 Dec 7 19:03 /data/project/paws/userhomes/5558061
On Dec 7, 2019, at 1:13 PM, Chico Venancio chicocvenancio@gmail.com wrote:
You can access your paws home directory from Toolforge, but not the other way arround.
PAWS home directories live in /data/project/paws/userhomes/{userGlobalId}
(you can find GlobalID for your user from the api or going to http://paws-public.wmflabs.org/paws-public/User:USERNAME/ http://paws-public.wmflabs.org/paws-public/User:USERNAME/ and looking at the title and h1 tags)
Do mind permissions if you need to he manage files there from outside PAWS. The tools.paws user needs to be able to read and write to the files and directories there.
Cheers,
Chico Venancio
Em sáb, 7 de dez de 2019 14:27, Roy Smith <roy@panix.com mailto:roy@panix.com> escreveu: I want to use jupyter to do some data visualization. I found PAWS, but I can't access my toolforge directory:
FileNotFoundError: [Errno 2] No such file or directory: '/home/roysmith/sock-classifier/jobs/last/job.out'
Is there a way to access my toolforge directory from within PAWS?
Alternately, is there a way to run jupyter within toolforge? I tried installing it myself but it won't run:
(env) temp $ jupyter notebook Traceback (most recent call last): File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/bin/jupyter-notebook", line 11, in <module> sys.exit(main()) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/jupyter_core/application.py", line 268, in launch_instance return super(JupyterApp, cls).launch_instance(argv=argv, **kwargs) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/traitlets/config/application.py", line 663, in launch_instance app.initialize(argv) File "</mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/decorator.py:decorator-gen-7>", line 2, in initialize File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/traitlets/config/application.py", line 87, in catch_config_error return method(app, *args, **kwargs) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/notebook/notebookapp.py", line 1716, in initialize self.init_resources() File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/notebook/notebookapp.py", line 1420, in init_resources resource.setrlimit(resource.RLIMIT_NOFILE, (soft, hard)) ValueError: not allowed to raise maximum limit
Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org mailto:Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org mailto:labs-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud https://lists.wikimedia.org/mailman/listinfo/cloud_______________________________________________ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud
I figured it out. I can make a directory that's world writable, and then push my data files to there. Seems like a strange way to do it, but I'm not seeing anything cleaner.
On Dec 7, 2019, at 2:12 PM, Roy Smith roy@panix.com wrote:
Hmmm. OK, I see my paws directory mounted on tools-sgebastion-08, but I don't have permission to write there. How do I get my data copied into the paws environment?
drwxr-sr-x 6 tools.paws tools.paws 4096 Dec 7 19:03 /data/project/paws/userhomes/5558061
On Dec 7, 2019, at 1:13 PM, Chico Venancio <chicocvenancio@gmail.com mailto:chicocvenancio@gmail.com> wrote:
You can access your paws home directory from Toolforge, but not the other way arround.
PAWS home directories live in /data/project/paws/userhomes/{userGlobalId}
(you can find GlobalID for your user from the api or going to http://paws-public.wmflabs.org/paws-public/User:USERNAME/ http://paws-public.wmflabs.org/paws-public/User:USERNAME/ and looking at the title and h1 tags)
Do mind permissions if you need to he manage files there from outside PAWS. The tools.paws user needs to be able to read and write to the files and directories there.
Cheers,
Chico Venancio
Em sáb, 7 de dez de 2019 14:27, Roy Smith <roy@panix.com mailto:roy@panix.com> escreveu: I want to use jupyter to do some data visualization. I found PAWS, but I can't access my toolforge directory:
FileNotFoundError: [Errno 2] No such file or directory: '/home/roysmith/sock-classifier/jobs/last/job.out'
Is there a way to access my toolforge directory from within PAWS?
Alternately, is there a way to run jupyter within toolforge? I tried installing it myself but it won't run:
(env) temp $ jupyter notebook Traceback (most recent call last): File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/bin/jupyter-notebook", line 11, in <module> sys.exit(main()) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/jupyter_core/application.py", line 268, in launch_instance return super(JupyterApp, cls).launch_instance(argv=argv, **kwargs) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/traitlets/config/application.py", line 663, in launch_instance app.initialize(argv) File "</mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/decorator.py:decorator-gen-7>", line 2, in initialize File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/traitlets/config/application.py", line 87, in catch_config_error return method(app, *args, **kwargs) File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/notebook/notebookapp.py", line 1716, in initialize self.init_resources() File "/mnt/nfs/labstore-secondary-tools-home/roysmith/temp/env/lib/python3.5/site-packages/notebook/notebookapp.py", line 1420, in init_resources resource.setrlimit(resource.RLIMIT_NOFILE, (soft, hard)) ValueError: not allowed to raise maximum limit
Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org mailto:Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org mailto:labs-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud https://lists.wikimedia.org/mailman/listinfo/cloud_______________________________________________ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org mailto:Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org mailto:labs-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud https://lists.wikimedia.org/mailman/listinfo/cloud
Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly labs-l@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud