Actually I've made a bit of progress diagnosing this. It has nothing to do with the login or looping in my code but may have to do with the composition of my use of multiprocessing and pywikibot's use of multithreading and may have to do with this bug: https://phabricator.wikimedia.org/T135986 Any advice on managing this?

On Sat, Dec 24, 2016 at 1:36 PM Legoktm legoktm.wikipedia@gmail.com wrote:

Hi,

+cc pywikibot@lists.wikimedia.org

On 12/22/2016 03:55 PM, Anthony Di Franco wrote:

Hi all, I'm doing some renovations on recitation-bot and running into trouble

when

the time comes for pywikibot to upload article data to wikisource and commons. The thread doing so hangs without any sort of informative error.

I

made sure that the unix user under which the web service that is using pywikibot is running is logged into each wiki per Max's advice but I still have the problem. I'm going to try to get more information about what's going on but would also appreciate pointers about what might be going wrong. Particularly, the web service is now running under Kubernetes

rather

than sun grid engine, so I suspect that the login state might not be

making

it into the container - can anyone advise on where the login state is maintained and whether this will be transferred into the kubernetes container?

Pywikibot stores all of its state in the same directory that your user-config.py file is in.

In my experience python hanging is typically an accidental infinite loop. Adding debug logging can help pinpoint where it starts hanging and narrow down the problematic code.

-- Legoktm

_______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l