Hi all,
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Best, Anis
I’ve not seen it delay that long ever (most I’ve ever seen is about a minute) if you run qstat what shows up? Maybe you have too many running jobs??
On Tue, Nov 2, 2021 at 1:31 PM Anis Elebiary anis@usf.edu wrote:
Hi all,
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Best, Anis _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/
Thank you for your response, John. It just says "qw" and it stays that way. I haven't assigned additional memory to be used or anything. ________________________________ From: John phoenixoverride@gmail.com Sent: Tuesday, November 2, 2021 1:49 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
I’ve not seen it delay that long ever (most I’ve ever seen is about a minute) if you run qstat what shows up? Maybe you have too many running jobs??
On Tue, Nov 2, 2021 at 1:31 PM Anis Elebiary <anis@usf.edumailto:anis@usf.edu> wrote: Hi all,
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Best, Anis _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.orgmailto:cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wikimedia.org%2Fpostorius%2Flists%2Fcloud.lists.wikimedia.org%2F&data=04%7C01%7Canis%40usf.edu%7C699efe0b663e4bca270108d99e29fb55%7C741bf7dee2e546df8d6782607df9deaa%7C0%7C0%7C637714725530096686%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=LqUuCjIrtd5J2YQfuaw1Ztn92Jj1m%2FjZGBDFRIVW2uA%3D&reserved=0
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
How many other jobs are listed as being active?
On Tue, Nov 2, 2021 at 2:10 PM Anis Elebiary anis@usf.edu wrote:
Thank you for your response, John. It just says "qw" and it stays that way. I haven't assigned additional memory to be used or anything.
*From:* John phoenixoverride@gmail.com *Sent:* Tuesday, November 2, 2021 1:49 PM *To:* Wikimedia Cloud Services general discussion and support < cloud@lists.wikimedia.org> *Subject:* [Cloud] Re: qsub waiting time on Toolforge
I’ve not seen it delay that long ever (most I’ve ever seen is about a minute) if you run qstat what shows up? Maybe you have too many running jobs??
On Tue, Nov 2, 2021 at 1:31 PM Anis Elebiary anis@usf.edu wrote:
Hi all,
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Best, Anis _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/ https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wikimedia.org%2Fpostorius%2Flists%2Fcloud.lists.wikimedia.org%2F&data=04%7C01%7Canis%40usf.edu%7C699efe0b663e4bca270108d99e29fb55%7C741bf7dee2e546df8d6782607df9deaa%7C0%7C0%7C637714725530096686%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=LqUuCjIrtd5J2YQfuaw1Ztn92Jj1m%2FjZGBDFRIVW2uA%3D&reserved=0
*[EXTERNAL EMAIL]* DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe. _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/
None, it is the only job I am running . ________________________________ From: John phoenixoverride@gmail.com Sent: Tuesday, November 2, 2021 2:11 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
How many other jobs are listed as being active?
On Tue, Nov 2, 2021 at 2:10 PM Anis Elebiary <anis@usf.edumailto:anis@usf.edu> wrote: Thank you for your response, John. It just says "qw" and it stays that way. I haven't assigned additional memory to be used or anything. ________________________________ From: John <phoenixoverride@gmail.commailto:phoenixoverride@gmail.com> Sent: Tuesday, November 2, 2021 1:49 PM To: Wikimedia Cloud Services general discussion and support <cloud@lists.wikimedia.orgmailto:cloud@lists.wikimedia.org> Subject: [Cloud] Re: qsub waiting time on Toolforge
I’ve not seen it delay that long ever (most I’ve ever seen is about a minute) if you run qstat what shows up? Maybe you have too many running jobs??
On Tue, Nov 2, 2021 at 1:31 PM Anis Elebiary <anis@usf.edumailto:anis@usf.edu> wrote: Hi all,
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Best, Anis _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.orgmailto:cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wikimedia.org%2Fpostorius%2Flists%2Fcloud.lists.wikimedia.org%2F&data=04%7C01%7Canis%40usf.edu%7Cbc6e7c1443044a4701b108d99e2c4057%7C741bf7dee2e546df8d6782607df9deaa%7C0%7C0%7C637714735165011975%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=l%2FGUwsncC0bVrZnvc0wpsli2wBaqdee8UavAu0X6VSw%3D&reserved=0
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
_______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.orgmailto:cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wikimedia.org%2Fpostorius%2Flists%2Fcloud.lists.wikimedia.org%2F&data=04%7C01%7Canis%40usf.edu%7Cbc6e7c1443044a4701b108d99e2c4057%7C741bf7dee2e546df8d6782607df9deaa%7C0%7C0%7C637714735165021969%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=Bu8gifDlCUbhTe%2BunJwVH8%2BKpdvGwDGXHZuNuDAUq5k%3D&reserved=0
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
What's the name of the tool account?
On Tue, Nov 2, 2021 at 2:13 PM Anis Elebiary anis@usf.edu wrote:
None, it is the only job I am running . ________________________________ From: John phoenixoverride@gmail.com Sent: Tuesday, November 2, 2021 2:11 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
How many other jobs are listed as being active?
On Tue, Nov 2, 2021 at 2:10 PM Anis Elebiary anis@usf.edu wrote:
Thank you for your response, John. It just says "qw" and it stays that way. I haven't assigned additional memory to be used or anything. ________________________________ From: John phoenixoverride@gmail.com Sent: Tuesday, November 2, 2021 1:49 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
I’ve not seen it delay that long ever (most I’ve ever seen is about a minute) if you run qstat what shows up? Maybe you have too many running jobs??
On Tue, Nov 2, 2021 at 1:31 PM Anis Elebiary anis@usf.edu wrote:
Hi all,
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Best, Anis _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/
I am not running the job from within my tool account. I have the script in my home directory and submitting it from there. Do I have to become my tool first and then do it from there ? my tool account is 'aemisinfo' and my login username is 'anis'.
Thank you. ________________________________ From: AntiCompositeNumber anticompositenumber@gmail.com Sent: Tuesday, November 2, 2021 2:13 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
What's the name of the tool account?
On Tue, Nov 2, 2021 at 2:13 PM Anis Elebiary anis@usf.edu wrote:
None, it is the only job I am running . ________________________________ From: John phoenixoverride@gmail.com Sent: Tuesday, November 2, 2021 2:11 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
How many other jobs are listed as being active?
On Tue, Nov 2, 2021 at 2:10 PM Anis Elebiary anis@usf.edu wrote:
Thank you for your response, John. It just says "qw" and it stays that way. I haven't assigned additional memory to be used or anything. ________________________________ From: John phoenixoverride@gmail.com Sent: Tuesday, November 2, 2021 1:49 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
I’ve not seen it delay that long ever (most I’ve ever seen is about a minute) if you run qstat what shows up? Maybe you have too many running jobs??
On Tue, Nov 2, 2021 at 1:31 PM Anis Elebiary anis@usf.edu wrote:
Hi all,
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Best, Anis _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wiki...
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
Cloud mailing list -- cloud@lists.wikimedia.org List information: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wiki...
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
Cloud mailing list -- cloud@lists.wikimedia.org List information: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wiki...
_______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wiki... [EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
I ran it from within the tool account and it worked ! Thank you for your help ________________________________ From: Anis Elebiary anis@usf.edu Sent: Tuesday, November 2, 2021 2:23 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
I am not running the job from within my tool account. I have the script in my home directory and submitting it from there. Do I have to become my tool first and then do it from there ? my tool account is 'aemisinfo' and my login username is 'anis'.
Thank you. ________________________________ From: AntiCompositeNumber anticompositenumber@gmail.com Sent: Tuesday, November 2, 2021 2:13 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
What's the name of the tool account?
On Tue, Nov 2, 2021 at 2:13 PM Anis Elebiary anis@usf.edu wrote:
None, it is the only job I am running . ________________________________ From: John phoenixoverride@gmail.com Sent: Tuesday, November 2, 2021 2:11 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
How many other jobs are listed as being active?
On Tue, Nov 2, 2021 at 2:10 PM Anis Elebiary anis@usf.edu wrote:
Thank you for your response, John. It just says "qw" and it stays that way. I haven't assigned additional memory to be used or anything. ________________________________ From: John phoenixoverride@gmail.com Sent: Tuesday, November 2, 2021 1:49 PM To: Wikimedia Cloud Services general discussion and support cloud@lists.wikimedia.org Subject: [Cloud] Re: qsub waiting time on Toolforge
I’ve not seen it delay that long ever (most I’ve ever seen is about a minute) if you run qstat what shows up? Maybe you have too many running jobs??
On Tue, Nov 2, 2021 at 1:31 PM Anis Elebiary anis@usf.edu wrote:
Hi all,
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Best, Anis _______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wiki...https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wikimedia.org%2Fpostorius%2Flists%2Fcloud.lists.wikimedia.org%2F&data=04%7C01%7Canis%40usf.edu%7Ccb051f69aea945a061dd08d99e2dfa5f%7C741bf7dee2e546df8d6782607df9deaa%7C0%7C0%7C637714742718537999%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=dk%2F%2BlxOKRYkXCPvP1iRF6dvQNlvsFiGVDEP8PgIN10Y%3D&reserved=0
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
Cloud mailing list -- cloud@lists.wikimedia.org List information: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wiki...https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wikimedia.org%2Fpostorius%2Flists%2Fcloud.lists.wikimedia.org%2F&data=04%7C01%7Canis%40usf.edu%7Ccb051f69aea945a061dd08d99e2dfa5f%7C741bf7dee2e546df8d6782607df9deaa%7C0%7C0%7C637714742718537999%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=dk%2F%2BlxOKRYkXCPvP1iRF6dvQNlvsFiGVDEP8PgIN10Y%3D&reserved=0
[EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
Cloud mailing list -- cloud@lists.wikimedia.org List information: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wiki...https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wikimedia.org%2Fpostorius%2Flists%2Fcloud.lists.wikimedia.org%2F&data=04%7C01%7Canis%40usf.edu%7Ccb051f69aea945a061dd08d99e2dfa5f%7C741bf7dee2e546df8d6782607df9deaa%7C0%7C0%7C637714742718547991%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=SV1whPvyuRv1gRW1fEfIp2ktktO9Euihork4bzS8Mo4%3D&reserved=0
_______________________________________________ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wiki...https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.wikimedia.org%2Fpostorius%2Flists%2Fcloud.lists.wikimedia.org%2F&data=04%7C01%7Canis%40usf.edu%7Ccb051f69aea945a061dd08d99e2dfa5f%7C741bf7dee2e546df8d6782607df9deaa%7C0%7C0%7C637714742718547991%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=SV1whPvyuRv1gRW1fEfIp2ktktO9Euihork4bzS8Mo4%3D&reserved=0 [EXTERNAL EMAIL] DO NOT CLICK links or attachments unless you recognize the sender and know the content is safe.
On 02/11/2021 19:30, Anis Elebiary wrote:
I have a python script that creates a tsv for the redirect table. I submitted the job through qsub and it's been waiting for more than a day now. Is it normal for the waiting time to be this long ? And, if there's a better way to do the aforementioned task, please let me know. Thank you in advance.
Hi, which tool is this about? Waiting times that long are not normal, but it's impossible to say anything about its causes without looking at the specific job.
Taavi