Pywikipedia-l January 2008

pywikipedia-l@lists.wikimedia.org

22 participants
449 discussions

[ pywikipediabot-Bugs-1871586 ] interwiki crashes with: regular expression code size limit e
by SourceForge.net 15 Jan '08

15 Jan '08

Bugs item #1871586, was opened at 2008-01-14 23:26 Message generated for change (Comment added) made by mstmst You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871586&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: Remind Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki crashes with: regular expression code size limit e Initial Comment: bot crashes with: regular expression code size limit exceeded error on many pages Error report: Updating links on page [[pl:10,000 Maniacs]]. No changes needed Getting 37 pages from wikipedia:ru... Dump pl (wikipedia) saved Traceback (most recent call last): File "C:\dw\pywikipedia\interwiki.py", line 1606, in <module> bot.run() File "C:\dw\pywikipedia\interwiki.py", line 1381, in run self.queryStep() File "C:\dw\pywikipedia\interwiki.py", line 1355, in queryStep self.oneQuery() File "C:\dw\pywikipedia\interwiki.py", line 1351, in oneQuery subject.workDone(self) File "C:\dw\pywikipedia\interwiki.py", line 724, in workDone elif page.isEmpty() and not page.isCategory(): File "C:\dw\pywikipedia\wikipedia.py", line 860, in isEmpty txt = removeLanguageLinks(txt) File "C:\dw\pywikipedia\wikipedia.py", line 3054, in removeLanguageLinks % languageR, re.IGNORECASE) File "C:\Python25\lib\re.py", line 180, in compile return _compile(pattern, flags) File "C:\Python25\lib\re.py", line 231, in _compile p = sre_compile.compile(pattern, flags) File "C:\Python25\lib\sre_compile.py", line 530, in compile groupindex, indexgroup OverflowError: regular expression code size limit exceeded ---------------------------------------------------------------------- Comment By: masti (mstmst) Date: 2008-01-15 23:09 Message: Logged In: YES user_id=1974561 Originator: NO updated to r4894 unfortunately I can still reproduce same error. ---------------------------------------------------------------------- Comment By: André Malafaya Baptista (malafaya) Date: 2008-01-15 22:56 Message: Logged In: YES user_id=1037345 Originator: NO In fact, it was line 2836. I just commited those changes to SVN (r4894). This bug should be considered fixed if it does not re-occur. ---------------------------------------------------------------------- Comment By: André Malafaya Baptista (malafaya) Date: 2008-01-15 22:44 Message: Logged In: YES user_id=1037345 Originator: NO As of r4893, I believe changing wikipedia.py line 2810 to: 'source': re.compile(r'(?is)<source>.*?</source>'), would solve the problem. There was an unclosed '<' after 'source'. I'm not absolutely sure about this as testing this problem doesn't seem easy. It also occurred to me but I can't precise under which conditions. ---------------------------------------------------------------------- Comment By: masti (mstmst) Date: 2008-01-15 20:02 Message: Logged In: YES user_id=1974561 Originator: NO It looks that the error only occurs when interwiki is run with -autonomous switch. For example runnig this command in pl.wiki: interwiki.py -start:100BASE-FX -autonomous casues bot to run thru multiple pages giving in the end following error: [[100 dni Napoleona]]: [[ja:????]] gives new interwiki [[he:m'h hymym]] [[101 (liczba)]]: [[ja:101]] gives new interwiki [[ms:101 (nombor)]] ======Post-processing [[pl:10164 Akusekijima]]====== Updating links on page [[pl:10164 Akusekijima]]. No changes needed ======Post-processing [[pl:10163 Onomichi]]====== Updating links on page [[pl:10163 Onomichi]]. No changes needed ======Post-processing [[pl:10157 Asagiri]]====== Updating links on page [[pl:10157 Asagiri]]. No changes needed ======Post-processing [[pl:10143 Kamogawa]]====== Updating links on page [[pl:10143 Kamogawa]]. No changes needed ======Post-processing [[pl:10142 Sakka]]====== Updating links on page [[pl:10142 Sakka]]. No changes needed ======Post-processing [[pl:10117 Tanikawa]]====== Updating links on page [[pl:10117 Tanikawa]]. No changes needed Getting 23 pages from wikipedia:id... NOTE: [[id:100 (buku)]] is redirect to [[id:The 100]] Getting 21 pages from wikipedia:uk... Getting 18 pages from wikipedia:lt... Getting 16 pages from wikipedia:fr... Sleeping for 3.2 seconds, 2008-01-15 19:50:31 Getting 15 pages from wikipedia:es... ======Post-processing [[pl:100BASE-FX]]====== ERROR: Found link to [[pl:Fast Ethernet]] [[en:Fast Ethernet]] [[es:Fast Ethernet]] [[fr:100BASE-T4]] [[id:Fast Ethernet]] [[it:Fast Ethernet]] [[ja:100megabitto ihsanetto]] [[lt:Fast Ethernet]] [[pt:Fast Ethernet]] [[uk:Fast Ethernet]] ERROR: Found more than one link for wikipedia:es ERROR: Found more than one link for wikipedia:fr ======Aborted processing [[pl:100BASE-FX]]====== Getting 42 pages from wikipedia:de... Getting 31 pages from wikipedia:sv... Getting 28 pages from wikipedia:nl... Dump pl (wikipedia) saved Traceback (most recent call last): File "C:\dw\pywikipedia\interwiki.py", line 1609, in <module> bot.run() File "C:\dw\pywikipedia\interwiki.py", line 1384, in run self.queryStep() File "C:\dw\pywikipedia\interwiki.py", line 1358, in queryStep self.oneQuery() File "C:\dw\pywikipedia\interwiki.py", line 1354, in oneQuery subject.workDone(self) File "C:\dw\pywikipedia\interwiki.py", line 724, in workDone elif page.isEmpty() and not page.isCategory(): File "C:\dw\pywikipedia\wikipedia.py", line 860, in isEmpty txt = removeLanguageLinks(txt) File "C:\dw\pywikipedia\wikipedia.py", line 3054, in removeLanguageLinks % languageR, re.IGNORECASE) File "C:\Python25\lib\re.py", line 180, in compile return _compile(pattern, flags) File "C:\Python25\lib\re.py", line 231, in _compile p = sre_compile.compile(pattern, flags) File "C:\Python25\lib\sre_compile.py", line 530, in compile groupindex, indexgroup OverflowError: regular expression code size limit exceeded above test done with r4893. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-15 17:07 Message: Logged In: YES user_id=1327030 Originator: NO I can't reproduce the bug. What is the exact command? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871586&group_…

1 0

[ pywikipediabot-Bugs-1871586 ] interwiki crashes with: regular expression code size limit e
by SourceForge.net 15 Jan '08

15 Jan '08

Bugs item #1871586, was opened at 2008-01-14 22:26 Message generated for change (Comment added) made by malafaya You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871586&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open >Resolution: Remind Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki crashes with: regular expression code size limit e Initial Comment: bot crashes with: regular expression code size limit exceeded error on many pages Error report: Updating links on page [[pl:10,000 Maniacs]]. No changes needed Getting 37 pages from wikipedia:ru... Dump pl (wikipedia) saved Traceback (most recent call last): File "C:\dw\pywikipedia\interwiki.py", line 1606, in <module> bot.run() File "C:\dw\pywikipedia\interwiki.py", line 1381, in run self.queryStep() File "C:\dw\pywikipedia\interwiki.py", line 1355, in queryStep self.oneQuery() File "C:\dw\pywikipedia\interwiki.py", line 1351, in oneQuery subject.workDone(self) File "C:\dw\pywikipedia\interwiki.py", line 724, in workDone elif page.isEmpty() and not page.isCategory(): File "C:\dw\pywikipedia\wikipedia.py", line 860, in isEmpty txt = removeLanguageLinks(txt) File "C:\dw\pywikipedia\wikipedia.py", line 3054, in removeLanguageLinks % languageR, re.IGNORECASE) File "C:\Python25\lib\re.py", line 180, in compile return _compile(pattern, flags) File "C:\Python25\lib\re.py", line 231, in _compile p = sre_compile.compile(pattern, flags) File "C:\Python25\lib\sre_compile.py", line 530, in compile groupindex, indexgroup OverflowError: regular expression code size limit exceeded ---------------------------------------------------------------------- >Comment By: André Malafaya Baptista (malafaya) Date: 2008-01-15 21:56 Message: Logged In: YES user_id=1037345 Originator: NO In fact, it was line 2836. I just commited those changes to SVN (r4894). This bug should be considered fixed if it does not re-occur. ---------------------------------------------------------------------- Comment By: André Malafaya Baptista (malafaya) Date: 2008-01-15 21:44 Message: Logged In: YES user_id=1037345 Originator: NO As of r4893, I believe changing wikipedia.py line 2810 to: 'source': re.compile(r'(?is)<source>.*?</source>'), would solve the problem. There was an unclosed '<' after 'source'. I'm not absolutely sure about this as testing this problem doesn't seem easy. It also occurred to me but I can't precise under which conditions. ---------------------------------------------------------------------- Comment By: masti (mstmst) Date: 2008-01-15 19:02 Message: Logged In: YES user_id=1974561 Originator: NO It looks that the error only occurs when interwiki is run with -autonomous switch. For example runnig this command in pl.wiki: interwiki.py -start:100BASE-FX -autonomous casues bot to run thru multiple pages giving in the end following error: [[100 dni Napoleona]]: [[ja:????]] gives new interwiki [[he:m'h hymym]] [[101 (liczba)]]: [[ja:101]] gives new interwiki [[ms:101 (nombor)]] ======Post-processing [[pl:10164 Akusekijima]]====== Updating links on page [[pl:10164 Akusekijima]]. No changes needed ======Post-processing [[pl:10163 Onomichi]]====== Updating links on page [[pl:10163 Onomichi]]. No changes needed ======Post-processing [[pl:10157 Asagiri]]====== Updating links on page [[pl:10157 Asagiri]]. No changes needed ======Post-processing [[pl:10143 Kamogawa]]====== Updating links on page [[pl:10143 Kamogawa]]. No changes needed ======Post-processing [[pl:10142 Sakka]]====== Updating links on page [[pl:10142 Sakka]]. No changes needed ======Post-processing [[pl:10117 Tanikawa]]====== Updating links on page [[pl:10117 Tanikawa]]. No changes needed Getting 23 pages from wikipedia:id... NOTE: [[id:100 (buku)]] is redirect to [[id:The 100]] Getting 21 pages from wikipedia:uk... Getting 18 pages from wikipedia:lt... Getting 16 pages from wikipedia:fr... Sleeping for 3.2 seconds, 2008-01-15 19:50:31 Getting 15 pages from wikipedia:es... ======Post-processing [[pl:100BASE-FX]]====== ERROR: Found link to [[pl:Fast Ethernet]] [[en:Fast Ethernet]] [[es:Fast Ethernet]] [[fr:100BASE-T4]] [[id:Fast Ethernet]] [[it:Fast Ethernet]] [[ja:100megabitto ihsanetto]] [[lt:Fast Ethernet]] [[pt:Fast Ethernet]] [[uk:Fast Ethernet]] ERROR: Found more than one link for wikipedia:es ERROR: Found more than one link for wikipedia:fr ======Aborted processing [[pl:100BASE-FX]]====== Getting 42 pages from wikipedia:de... Getting 31 pages from wikipedia:sv... Getting 28 pages from wikipedia:nl... Dump pl (wikipedia) saved Traceback (most recent call last): File "C:\dw\pywikipedia\interwiki.py", line 1609, in <module> bot.run() File "C:\dw\pywikipedia\interwiki.py", line 1384, in run self.queryStep() File "C:\dw\pywikipedia\interwiki.py", line 1358, in queryStep self.oneQuery() File "C:\dw\pywikipedia\interwiki.py", line 1354, in oneQuery subject.workDone(self) File "C:\dw\pywikipedia\interwiki.py", line 724, in workDone elif page.isEmpty() and not page.isCategory(): File "C:\dw\pywikipedia\wikipedia.py", line 860, in isEmpty txt = removeLanguageLinks(txt) File "C:\dw\pywikipedia\wikipedia.py", line 3054, in removeLanguageLinks % languageR, re.IGNORECASE) File "C:\Python25\lib\re.py", line 180, in compile return _compile(pattern, flags) File "C:\Python25\lib\re.py", line 231, in _compile p = sre_compile.compile(pattern, flags) File "C:\Python25\lib\sre_compile.py", line 530, in compile groupindex, indexgroup OverflowError: regular expression code size limit exceeded above test done with r4893. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-15 16:07 Message: Logged In: YES user_id=1327030 Originator: NO I can't reproduce the bug. What is the exact command? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871586&group_…

1 0

SVN: [4894] trunk/pywikipedia/wikipedia.py
by malafaya＠svn.wikimedia.org 15 Jan '08

15 Jan '08

Revision: 4894 Author: malafaya Date: 2008-01-15 21:53:03 +0000 (Tue, 15 Jan 2008) Log Message: ----------- (bug 1871586) interwiki crashes with: regular expression code size limit e **still needs confirmation** Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-01-15 16:19:57 UTC (rev 4893) +++ trunk/pywikipedia/wikipedia.py 2008-01-15 21:53:03 UTC (rev 4894) @@ -2833,7 +2833,7 @@ 'nowiki': re.compile(r'(?is)<nowiki>.*?</nowiki>'), # preformatted text 'pre': re.compile(r'(?ism)<pre>.*?</pre>'), - 'source': re.compile(r'(?is)<source .*?</source>'), + 'source': re.compile(r'(?is)<source>.*?</source>'), # inline references 'ref': re.compile(r'(?ism)<ref[ >].*?</ref>'), 'timeline': re.compile(r'(?is)<timeline>.*?</timeline>'),

1 0

[ pywikipediabot-Bugs-1871586 ] interwiki crashes with: regular expression code size limit e
by SourceForge.net 15 Jan '08

15 Jan '08

Bugs item #1871586, was opened at 2008-01-14 22:26 Message generated for change (Comment added) made by malafaya You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871586&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki crashes with: regular expression code size limit e Initial Comment: bot crashes with: regular expression code size limit exceeded error on many pages Error report: Updating links on page [[pl:10,000 Maniacs]]. No changes needed Getting 37 pages from wikipedia:ru... Dump pl (wikipedia) saved Traceback (most recent call last): File "C:\dw\pywikipedia\interwiki.py", line 1606, in <module> bot.run() File "C:\dw\pywikipedia\interwiki.py", line 1381, in run self.queryStep() File "C:\dw\pywikipedia\interwiki.py", line 1355, in queryStep self.oneQuery() File "C:\dw\pywikipedia\interwiki.py", line 1351, in oneQuery subject.workDone(self) File "C:\dw\pywikipedia\interwiki.py", line 724, in workDone elif page.isEmpty() and not page.isCategory(): File "C:\dw\pywikipedia\wikipedia.py", line 860, in isEmpty txt = removeLanguageLinks(txt) File "C:\dw\pywikipedia\wikipedia.py", line 3054, in removeLanguageLinks % languageR, re.IGNORECASE) File "C:\Python25\lib\re.py", line 180, in compile return _compile(pattern, flags) File "C:\Python25\lib\re.py", line 231, in _compile p = sre_compile.compile(pattern, flags) File "C:\Python25\lib\sre_compile.py", line 530, in compile groupindex, indexgroup OverflowError: regular expression code size limit exceeded ---------------------------------------------------------------------- >Comment By: André Malafaya Baptista (malafaya) Date: 2008-01-15 21:44 Message: Logged In: YES user_id=1037345 Originator: NO As of r4893, I believe changing wikipedia.py line 2810 to: 'source': re.compile(r'(?is)<source>.*?</source>'), would solve the problem. There was an unclosed '<' after 'source'. I'm not absolutely sure about this as testing this problem doesn't seem easy. It also occurred to me but I can't precise under which conditions. ---------------------------------------------------------------------- Comment By: masti (mstmst) Date: 2008-01-15 19:02 Message: Logged In: YES user_id=1974561 Originator: NO It looks that the error only occurs when interwiki is run with -autonomous switch. For example runnig this command in pl.wiki: interwiki.py -start:100BASE-FX -autonomous casues bot to run thru multiple pages giving in the end following error: [[100 dni Napoleona]]: [[ja:????]] gives new interwiki [[he:m'h hymym]] [[101 (liczba)]]: [[ja:101]] gives new interwiki [[ms:101 (nombor)]] ======Post-processing [[pl:10164 Akusekijima]]====== Updating links on page [[pl:10164 Akusekijima]]. No changes needed ======Post-processing [[pl:10163 Onomichi]]====== Updating links on page [[pl:10163 Onomichi]]. No changes needed ======Post-processing [[pl:10157 Asagiri]]====== Updating links on page [[pl:10157 Asagiri]]. No changes needed ======Post-processing [[pl:10143 Kamogawa]]====== Updating links on page [[pl:10143 Kamogawa]]. No changes needed ======Post-processing [[pl:10142 Sakka]]====== Updating links on page [[pl:10142 Sakka]]. No changes needed ======Post-processing [[pl:10117 Tanikawa]]====== Updating links on page [[pl:10117 Tanikawa]]. No changes needed Getting 23 pages from wikipedia:id... NOTE: [[id:100 (buku)]] is redirect to [[id:The 100]] Getting 21 pages from wikipedia:uk... Getting 18 pages from wikipedia:lt... Getting 16 pages from wikipedia:fr... Sleeping for 3.2 seconds, 2008-01-15 19:50:31 Getting 15 pages from wikipedia:es... ======Post-processing [[pl:100BASE-FX]]====== ERROR: Found link to [[pl:Fast Ethernet]] [[en:Fast Ethernet]] [[es:Fast Ethernet]] [[fr:100BASE-T4]] [[id:Fast Ethernet]] [[it:Fast Ethernet]] [[ja:100megabitto ihsanetto]] [[lt:Fast Ethernet]] [[pt:Fast Ethernet]] [[uk:Fast Ethernet]] ERROR: Found more than one link for wikipedia:es ERROR: Found more than one link for wikipedia:fr ======Aborted processing [[pl:100BASE-FX]]====== Getting 42 pages from wikipedia:de... Getting 31 pages from wikipedia:sv... Getting 28 pages from wikipedia:nl... Dump pl (wikipedia) saved Traceback (most recent call last): File "C:\dw\pywikipedia\interwiki.py", line 1609, in <module> bot.run() File "C:\dw\pywikipedia\interwiki.py", line 1384, in run self.queryStep() File "C:\dw\pywikipedia\interwiki.py", line 1358, in queryStep self.oneQuery() File "C:\dw\pywikipedia\interwiki.py", line 1354, in oneQuery subject.workDone(self) File "C:\dw\pywikipedia\interwiki.py", line 724, in workDone elif page.isEmpty() and not page.isCategory(): File "C:\dw\pywikipedia\wikipedia.py", line 860, in isEmpty txt = removeLanguageLinks(txt) File "C:\dw\pywikipedia\wikipedia.py", line 3054, in removeLanguageLinks % languageR, re.IGNORECASE) File "C:\Python25\lib\re.py", line 180, in compile return _compile(pattern, flags) File "C:\Python25\lib\re.py", line 231, in _compile p = sre_compile.compile(pattern, flags) File "C:\Python25\lib\sre_compile.py", line 530, in compile groupindex, indexgroup OverflowError: regular expression code size limit exceeded above test done with r4893. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-15 16:07 Message: Logged In: YES user_id=1327030 Originator: NO I can't reproduce the bug. What is the exact command? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871586&group_…

1 0

[ pywikipediabot-Bugs-1871586 ] interwiki crashes with: regular expression code size limit e
by SourceForge.net 15 Jan '08

15 Jan '08

Bugs item #1871586, was opened at 2008-01-14 23:26 Message generated for change (Comment added) made by mstmst You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871586&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki crashes with: regular expression code size limit e Initial Comment: bot crashes with: regular expression code size limit exceeded error on many pages Error report: Updating links on page [[pl:10,000 Maniacs]]. No changes needed Getting 37 pages from wikipedia:ru... Dump pl (wikipedia) saved Traceback (most recent call last): File "C:\dw\pywikipedia\interwiki.py", line 1606, in <module> bot.run() File "C:\dw\pywikipedia\interwiki.py", line 1381, in run self.queryStep() File "C:\dw\pywikipedia\interwiki.py", line 1355, in queryStep self.oneQuery() File "C:\dw\pywikipedia\interwiki.py", line 1351, in oneQuery subject.workDone(self) File "C:\dw\pywikipedia\interwiki.py", line 724, in workDone elif page.isEmpty() and not page.isCategory(): File "C:\dw\pywikipedia\wikipedia.py", line 860, in isEmpty txt = removeLanguageLinks(txt) File "C:\dw\pywikipedia\wikipedia.py", line 3054, in removeLanguageLinks % languageR, re.IGNORECASE) File "C:\Python25\lib\re.py", line 180, in compile return _compile(pattern, flags) File "C:\Python25\lib\re.py", line 231, in _compile p = sre_compile.compile(pattern, flags) File "C:\Python25\lib\sre_compile.py", line 530, in compile groupindex, indexgroup OverflowError: regular expression code size limit exceeded ---------------------------------------------------------------------- Comment By: masti (mstmst) Date: 2008-01-15 20:02 Message: Logged In: YES user_id=1974561 Originator: NO It looks that the error only occurs when interwiki is run with -autonomous switch. For example runnig this command in pl.wiki: interwiki.py -start:100BASE-FX -autonomous casues bot to run thru multiple pages giving in the end following error: [[100 dni Napoleona]]: [[ja:????]] gives new interwiki [[he:m'h hymym]] [[101 (liczba)]]: [[ja:101]] gives new interwiki [[ms:101 (nombor)]] ======Post-processing [[pl:10164 Akusekijima]]====== Updating links on page [[pl:10164 Akusekijima]]. No changes needed ======Post-processing [[pl:10163 Onomichi]]====== Updating links on page [[pl:10163 Onomichi]]. No changes needed ======Post-processing [[pl:10157 Asagiri]]====== Updating links on page [[pl:10157 Asagiri]]. No changes needed ======Post-processing [[pl:10143 Kamogawa]]====== Updating links on page [[pl:10143 Kamogawa]]. No changes needed ======Post-processing [[pl:10142 Sakka]]====== Updating links on page [[pl:10142 Sakka]]. No changes needed ======Post-processing [[pl:10117 Tanikawa]]====== Updating links on page [[pl:10117 Tanikawa]]. No changes needed Getting 23 pages from wikipedia:id... NOTE: [[id:100 (buku)]] is redirect to [[id:The 100]] Getting 21 pages from wikipedia:uk... Getting 18 pages from wikipedia:lt... Getting 16 pages from wikipedia:fr... Sleeping for 3.2 seconds, 2008-01-15 19:50:31 Getting 15 pages from wikipedia:es... ======Post-processing [[pl:100BASE-FX]]====== ERROR: Found link to [[pl:Fast Ethernet]] [[en:Fast Ethernet]] [[es:Fast Ethernet]] [[fr:100BASE-T4]] [[id:Fast Ethernet]] [[it:Fast Ethernet]] [[ja:100megabitto ihsanetto]] [[lt:Fast Ethernet]] [[pt:Fast Ethernet]] [[uk:Fast Ethernet]] ERROR: Found more than one link for wikipedia:es ERROR: Found more than one link for wikipedia:fr ======Aborted processing [[pl:100BASE-FX]]====== Getting 42 pages from wikipedia:de... Getting 31 pages from wikipedia:sv... Getting 28 pages from wikipedia:nl... Dump pl (wikipedia) saved Traceback (most recent call last): File "C:\dw\pywikipedia\interwiki.py", line 1609, in <module> bot.run() File "C:\dw\pywikipedia\interwiki.py", line 1384, in run self.queryStep() File "C:\dw\pywikipedia\interwiki.py", line 1358, in queryStep self.oneQuery() File "C:\dw\pywikipedia\interwiki.py", line 1354, in oneQuery subject.workDone(self) File "C:\dw\pywikipedia\interwiki.py", line 724, in workDone elif page.isEmpty() and not page.isCategory(): File "C:\dw\pywikipedia\wikipedia.py", line 860, in isEmpty txt = removeLanguageLinks(txt) File "C:\dw\pywikipedia\wikipedia.py", line 3054, in removeLanguageLinks % languageR, re.IGNORECASE) File "C:\Python25\lib\re.py", line 180, in compile return _compile(pattern, flags) File "C:\Python25\lib\re.py", line 231, in _compile p = sre_compile.compile(pattern, flags) File "C:\Python25\lib\sre_compile.py", line 530, in compile groupindex, indexgroup OverflowError: regular expression code size limit exceeded above test done with r4893. ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-15 17:07 Message: Logged In: YES user_id=1327030 Originator: NO I can't reproduce the bug. What is the exact command? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871586&group_…

1 0

[ pywikipediabot-Support Requests-1871836 ] Encoding error while processing [[en:Chişinău]]
by SourceForge.net 15 Jan '08

15 Jan '08

Support Requests item #1871836, was opened at 2008-01-15 10:27 Message generated for change (Comment added) made by malafaya You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1871836&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Priority: 5 Private: No Submitted By: André Malafaya Baptista (malafaya) Assigned to: Nobody/Anonymous (nobody) Summary: Encoding error while processing [[en:Chişinău]] Initial Comment: I'm almost sure this is not a bug so I'm putting it here in Support Requests. When I try to process the page [[en:Chişinău]] (with bot account on 'en'), I get the following result: X:\>interwiki.py -lang:en Chi%C5%9Fin%C4%83u Checked for running processes. 2 processes currently running, including the curr ent process. Getting 1 pages from wikipedia:en... [[Chisinau]]: [[en:Chisinau]] gives new interwiki [[lt:Kisiniovas]] [[Chisinau]]: [[en:Chisinau]] gives new interwiki [[lv:Kisineva]] (...output ommited deliberately...) ======Post-processing [[en:Chisinau]]====== Updating links on page [[en:Chisinau]]. Exception in Page constructor Dump en (wikipedia) saved Traceback (most recent call last): File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1606, in <module> bot.run() File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1381, in run self.queryStep() File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1360, in queryStep subj.finish(self) File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 967, in finish if self.replaceLinks(page, new, bot): File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1010, in replaceLinks ignorepage = wikipedia.Page(page.site(), iw.groups()[0]) File "D:\Work\pywikipediabot-HEAD\pywikipedia\wikipedia.py", line 425, in __init__ % (site, title, insite, defaultNamespace) File "D:\Program Files\Python\lib\encodings\cp850.py", line 12, in encode return codecs.charmap_encode(input,errors,encoding_map) UnicodeEncodeError: 'charmap' codec can't encode characters in position 28-34: character maps to <undefined> ================ I belive it's an invalid UTF-8 byte sequence somewhere in the page but I'd like someone more experienced to verify this. Thanks. ---------------------------------------------------------------------- >Comment By: André Malafaya Baptista (malafaya) Date: 2008-01-15 18:21 Message: Logged In: YES user_id=1037345 Originator: YES I tried r4893 (latest) and everything went exactly the same way. Call stack and output exactly the same: UnicodeEncodeError: 'charmap' codec can't encode characters in position 28-34: character maps to <undefined> ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-15 16:21 Message: Logged In: YES user_id=1327030 Originator: NO This may be fixed in r4893 (I tried to fix a possible unicode problem in output, and a possible KeyError for an obsolete site). If it doesn't, does it change the output? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1871836&group_…

1 0

[ pywikipediabot-Bugs-1871424 ] -pt: option and time remaning with replace.py
by SourceForge.net 15 Jan '08

15 Jan '08

Bugs item #1871424, was opened at 2008-01-14 19:23 Message generated for change (Comment added) made by crochet_david You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871424&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: David Crochet (crochet_david) Assigned to: Nobody/Anonymous (nobody) Summary: -pt: option and time remaning with replace.py Initial Comment: Hello When we use replace.py with a -pt: option, the times remaning is not calculate correctly. ---------------------------------------------------------------------- >Comment By: David Crochet (crochet_david) Date: 2008-01-15 19:12 Message: Logged In: YES user_id=1944800 Originator: YES yes, it's -putthrolles. When I use my bot in a no-flagged bot account, i use -pt: option to make slow the bot modifing to not spamming the Recent Changes. If, with replace.py, I have 10 replace to do, without -pt: option, python say it had 1 minutes 40 second to do the rest. ok , no problem because it make a modification every 10 secondes. But if i put -pt:240, with 10 modifications to do, python say me that the time working to do is also 1 minutes 40 secondes instead of 40 minutes. It believes make changes every 10 seconds when he must make every 4 minutes ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-15 17:27 Message: Logged In: YES user_id=1327030 Originator: NO Could you please write more details about the problem? (I understand "-pt:" means "-putthrottle:".) ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871424&group_…

1 0

[ pywikipediabot-Bugs-1871424 ] -pt: option and time remaning with replace.py
by SourceForge.net 15 Jan '08

15 Jan '08

Bugs item #1871424, was opened at 2008-01-14 20:23 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871424&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: David Crochet (crochet_david) Assigned to: Nobody/Anonymous (nobody) Summary: -pt: option and time remaning with replace.py Initial Comment: Hello When we use replace.py with a -pt: option, the times remaning is not calculate correctly. ---------------------------------------------------------------------- >Comment By: Rotem Liss (rotemliss) Date: 2008-01-15 18:27 Message: Logged In: YES user_id=1327030 Originator: NO Could you please write more details about the problem? (I understand "-pt:" means "-putthrottle:".) ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1871424&group_…

1 0

[ pywikipediabot-Support Requests-1868291 ] PageFromFile.py parameters
by SourceForge.net 15 Jan '08

15 Jan '08

Support Requests item #1868291, was opened at 2008-01-10 12:07 Message generated for change (Settings changed) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1868291&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: PageFromFile.py parameters Initial Comment: Great bot but "-force" & "-safe" doesnt work !! when it finds that a page exists, it gives me an error and doesnt continue, this is quite annoying, especially if i had 1000 articles, of which 250 exist, it means that i have to restart it manually and change the source UTF8 file not to include the pages already added. any ideas? let me know. [[:w:ar:User:Lord_Anubis]] email: AnubisWP(a)googlemail.com ---------------------------------------------------------------------- Comment By: Rotem Liss (rotemliss) Date: 2008-01-13 19:16 Message: Logged In: YES user_id=1327030 Originator: NO This means you have an edit conflict. As of r4870, the bot shouldn't stop when such errors occur, but show a message and continue. Make sure you update the bot to the latest SVN version, your version seems to be a little old. ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2008-01-10 14:05 Message: Logged In: NO Ok, this is the error i get: Creating page [[ar:Bell]] Traceback (most recent call last): File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 170, in <module> main() File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 134, in main findpage(text) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 127, in findpage findpage(t[location.end()+1:]) File "U:\Programming and websites\WIKI\pywikipedia\pagefromfile.py", line 126, in findpage page.put(contents, comment = commenttext, minorEdit = False) File "U:\Programming and websites\WIKI\pywikipedia\wikipedia.py", line 948, in put return self.putPage(newtext, comment, watchArticle, minorEdit, newPage, self .site().getToken(sysop = sysop), sysop = sysop) File "U:\Programming and websites\WIKI\pywikipedia\wikipedia.py", line 1039, i n putPage raise EditConflict(u'An edit conflict has occured.') wikipedia.EditConflict: An edit conflict has occured. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1868291&group_…

1 0

[ pywikipediabot-Support Requests-1871836 ] Encoding error while processing [[en:Chişinău]]
by SourceForge.net 15 Jan '08

15 Jan '08

Support Requests item #1871836, was opened at 2008-01-15 12:27 Message generated for change (Comment added) made by rotemliss You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1871836&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Priority: 5 Private: No Submitted By: André Malafaya Baptista (malafaya) Assigned to: Nobody/Anonymous (nobody) Summary: Encoding error while processing [[en:Chişinău]] Initial Comment: I'm almost sure this is not a bug so I'm putting it here in Support Requests. When I try to process the page [[en:Chişinău]] (with bot account on 'en'), I get the following result: X:\>interwiki.py -lang:en Chi%C5%9Fin%C4%83u Checked for running processes. 2 processes currently running, including the curr ent process. Getting 1 pages from wikipedia:en... [[Chisinau]]: [[en:Chisinau]] gives new interwiki [[lt:Kisiniovas]] [[Chisinau]]: [[en:Chisinau]] gives new interwiki [[lv:Kisineva]] (...output ommited deliberately...) ======Post-processing [[en:Chisinau]]====== Updating links on page [[en:Chisinau]]. Exception in Page constructor Dump en (wikipedia) saved Traceback (most recent call last): File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1606, in <module> bot.run() File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1381, in run self.queryStep() File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1360, in queryStep subj.finish(self) File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 967, in finish if self.replaceLinks(page, new, bot): File "D:\Work\pywikipediabot-HEAD\pywikipedia\interwiki.py", line 1010, in replaceLinks ignorepage = wikipedia.Page(page.site(), iw.groups()[0]) File "D:\Work\pywikipediabot-HEAD\pywikipedia\wikipedia.py", line 425, in __init__ % (site, title, insite, defaultNamespace) File "D:\Program Files\Python\lib\encodings\cp850.py", line 12, in encode return codecs.charmap_encode(input,errors,encoding_map) UnicodeEncodeError: 'charmap' codec can't encode characters in position 28-34: character maps to <undefined> ================ I belive it's an invalid UTF-8 byte sequence somewhere in the page but I'd like someone more experienced to verify this. Thanks. ---------------------------------------------------------------------- >Comment By: Rotem Liss (rotemliss) Date: 2008-01-15 18:21 Message: Logged In: YES user_id=1327030 Originator: NO This may be fixed in r4893 (I tried to fix a possible unicode problem in output, and a possible KeyError for an obsolete site). If it doesn't, does it change the output? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603139&aid=1871836&group_…

1 0

← Newer
1
...
15
16
17
18
19
20
21
...
45
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l January 2008