Please help me set up archivebot.py for English Wikisource

List overview All Threads
Download

newer

older

Re: [Pywikipedia-l] [...

Unicode bug in python 2.6+ (was:...

Spangineer

7 Jan 2011 7 Jan '11

6:24 p.m.

Hi, I'm trying to set up automatic discussion archiving on English Wikisource. I attempted to follow all instructions related to pywikipediabot. All the relevant information can be found at http://en.wikisource.org/wiki/User:Spangineer/Sandbox3 . If more is needed, please let me know: thanks. --Spangineer

Attachments:

attachment.htm (text/html — 451 bytes)

Show replies by date

Bináris

7 Jan 7 Jan

9:08 p.m.

Please click on the website of this list in the footer of the mail, and look for threads - Unicode bug in python 2.6+ (was: Default Python will change to 2.7) - Default Python will change to 2.7 a few days ago. I think this might be relevant for you. Cheers, -- Bináris

Merlijn van Deen

8 Jan 8 Jan

10:09 p.m.

Hi Spangineer/Bináris, On 7 January 2011 21:08, Bináris <wikiposta(a)gmail.com> wrote:

...

Unicode bug in python 2.6+ (was: Default Python will change to 2.7) Default Python will change to 2.7

John

11:51 p.m.

...

Hi Spangineer/Bináris, On 7 January 2011 21:08, Bináris <wikiposta(a)gmail.com> wrote:

Unicode bug in python 2.6+ (was: Default Python will change to 2.7) Default Python will change to 2.7

This probably does not affect you, although it might be better to run under python 2.5. This bug is triggered only with page titles with multiple accents, which means it doesn't happen for many languages -- mainly languages such as hindi and vietnamese are affected. I cannot see anything clear on why archivebot is not working for you -- although I have no experience running it myself, your configuration files and method to start archivebot seem OK to me. If you have any programming experience, try adding some debugging output to archivebot.py (eg. 'print pg' at line 662). If you do not, you'll have to wait for someone who can do this for you - unfortunately, I cannot, at the moment. Best regards, Merlijn _______________________________________________ Pywikipedia-l mailing list Pywikipedia-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Lewis Cawte

11:53 p.m.

New subject: Please help me set up archivebot.py for English Wikisource

Which timestamps? Each timestamp format has to be coded into the script, which can be done fairly easily once we have the format.. -- Lewis Cawte On 08/01/11 22:51, John wrote:

...

I just took a look, you can see my trial edits on the page I got it to work for the most part, apparently its having issues with some timestamps b it does appear to work fine. John On Sat, Jan 8, 2011 at 4:09 PM, Merlijn van Deen <valhallasw(a)arctus.nl <mailto:valhallasw@arctus.nl>> wrote: Hi Spangineer/Bináris, On 7 January 2011 21:08, Bináris <wikiposta(a)gmail.com <mailto:wikiposta@gmail.com>> wrote:

Unicode bug in python 2.6+ (was: Default Python will change to 2.7) Default Python will change to 2.7

This probably does not affect you, although it might be better to run under python 2.5. This bug is triggered only with page titles with multiple accents, which means it doesn't happen for many languages -- mainly languages such as hindi and vietnamese are affected. I cannot see anything clear on why archivebot is not working for you -- although I have no experience running it myself, your configuration files and method to start archivebot seem OK to me. If you have any programming experience, try adding some debugging output to archivebot.py (eg. 'print pg' at line 662). If you do not, you'll have to wait for someone who can do this for you - unfortunately, I cannot, at the moment. Best regards, Merlijn _______________________________________________ Pywikipedia-l mailing list Pywikipedia-l(a)lists.wikimedia.org <mailto:Pywikipedia-l@lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l _______________________________________________ Pywikipedia-l mailing list Pywikipedia-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

John

11:56 p.m.

see http://en.wikisource.org/w/index.php?title=User:Spangineer/Sandbox&acti… On Sat, Jan 8, 2011 at 5:53 PM, Lewis Cawte <lewiscawte(a)googlemail.com>wrote;wrote:

...

Which timestamps? Each timestamp format has to be coded into the script, which can be done fairly easily once we have the format.. -- Lewis Cawte On 08/01/11 22:51, John wrote: I just took a look, you can see my trial edits on the page I got it to work for the most part, apparently its having issues with some timestamps b it does appear to work fine. John On Sat, Jan 8, 2011 at 4:09 PM, Merlijn van Deen <valhallasw(a)arctus.nl>wrote;wrote:

Hi Spangineer/Bináris, On 7 January 2011 21:08, Bináris <wikiposta(a)gmail.com> wrote:

Unicode bug in python 2.6+ (was: Default Python will change to 2.7) Default Python will change to 2.7

_______________________________________________ Pywikipedia-l mailing listPywikipedia-l@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/pywikipedia-l _______________________________________________ Pywikipedia-l mailing list Pywikipedia-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Spangineer

10 Jan 10 Jan

3:27 p.m.

Thanks to all for the comments and effort. Over the weekend I uninstalled python 2.7.1 and tried everything again with 2.6.5 and 2.5.4. I updated my tracking page (http://en.wikisource.org/wiki/User:Spangineer/Sandbox3) with results, but the short answer is that while 2.6.5 did not give me the unicode error, it still did not actually perform an archive. Version 2.5.4 did not even allow me to login, and instead gave me a different error, which I copy/pasted into the bottom of the above-linked page. Merlijn: I have some programming experience, but not in this language, so my efforts to debug will be stabs in the dark... but it's looking more and more necessary. John: what settings did you use? Would you mind telling me, step-by-step, what you did? Spangineer On Sat, Jan 8, 2011 at 5:56 PM, John <phoenixoverride(a)gmail.com> wrote:

...

see http://en.wikisource.org/w/index.php?title=User:Spangineer/Sandbox&acti… On Sat, Jan 8, 2011 at 5:53 PM, Lewis Cawte <lewiscawte(a)googlemail.com>wrote;wrote:

Hi Spangineer/Bináris, On 7 January 2011 21:08, Bináris <wikiposta(a)gmail.com> wrote:

Unicode bug in python 2.6+ (was: Default Python will change to 2.7) Default Python will change to 2.7

_______________________________________________ Pywikipedia-l mailing list Pywikipedia-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

4848

days inactive

4851

days old

pywikipedia-l@lists.wikimedia.org

Manage subscription

6 comments

5 participants

tags (0)

participants (5)

Bináris
John
Lewis Cawte
Merlijn van Deen
Spangineer