Pywikipedia-l August 2008

pywikipedia-l@lists.wikimedia.org

29 participants
206 discussions

SVN: [5869] trunk/pywikipedia/solve_disambiguation.py
by siebrand＠svn.wikimedia.org 31 Aug '08

31 Aug '08

Revision: 5869 Author: siebrand Date: 2008-08-31 22:46:50 +0000 (Sun, 31 Aug 2008) Log Message: ----------- Update solve_disambiguation.py blacklist for nl. It is probably safe to assume that disambiguations in the user namespace are a waste of time. Modified Paths: -------------- trunk/pywikipedia/solve_disambiguation.py Modified: trunk/pywikipedia/solve_disambiguation.py =================================================================== --- trunk/pywikipedia/solve_disambiguation.py 2008-08-29 19:09:43 UTC (rev 5868) +++ trunk/pywikipedia/solve_disambiguation.py 2008-08-31 22:46:50 UTC (rev 5869) @@ -324,20 +324,7 @@ u'Wikipedia:Rodomi nukreipiamieji straipsniai', ], 'nl': [ - u"Gebruiker:.+[aA]rchief.*", - u"Gebruiker:Andre Engels/Haakjesproblemen.*", - u"Gebruiker:Dedalus/Namen/.", - u"Gebruiker:Emiel/artikelen", - u"Gebruiker:Erik Baas.*", - u"Gebruiker:Henna/Ucacha's redirects", - u"Gebruiker:Jeroenvrp/complete lijst", - u"Gebruiker:Magalhães/Artikelen", - u"Gebruiker:Michiel1972/.*", - u"Gebruiker:R'n'B/DPL", - u"Gebruiker:R.Koot/Unicode", - u"Gebruiker:Rex/Encarta/.+", - u"Gebruiker:Rex/Meest storende doorverwijspagina's", - u"Gebruiker:Venullian/Aanvulverhaal", + u"Gebruiker:.*", u"Overleg gebruiker:.+[aA]rchief.*", u"Overleg gebruiker:Pven", u"Portaal:.+[aA]rchief.*", @@ -346,29 +333,6 @@ u"Wikipedia:Project aanmelding bij startpagina's", u"Wikipedia:Wikiproject Roemeense gemeenten/Doorverwijspagina's", u'Categorie:Doorverwijspagina', - u'Gebruiker:Al/Bijdragen', - u'Gebruiker:Al/Informatie Roemenië/.*', - u'Gebruiker:Cars en travel', - u'Gebruiker:CyeZ/Klad2', - u'Gebruiker:Ellywa/kladblok', - u'Gebruiker:GruffiGummi:Problemen', - u'Gebruiker:Gustar/aantekeningen denotatie annex connotatie', - u'Gebruiker:Hooft/robot/Interwiki/lijst van problemen', - u'Gebruiker:IIVQ.*', - u'Gebruiker:Lankhorst/Lijst.*', - u'Gebruiker:Magalhães/Filipijnse geografie', - u'Gebruiker:Mystro82', - u'Gebruiker:Puckly/Bijdragen', - u'Gebruiker:Pven/Romeinse cijfers', - u'Gebruiker:Rex/Gestarte artikelen', - u'Gebruiker:Sybren/Verwijzingen', - u'Gebruiker:Thor NL/Onderhanden werk/.+', - u'Gebruiker:Ucucha/Doorverwijspagina', - u'Gebruiker:Verrekijker/Alle edits', - u'Gebruiker:Verrekijker/Bijdragen', - u'Gebruiker:Waerth/Wikipedia hitsparade.*', - u'Gebruiker:Waerth/bijdragen', - u'Gebruiker:Yorian/oud', u'Lijst van Nederlandse namen van pausen', u'Overleg Wikipedia:Discussie spelling 2005', u'Overleg Wikipedia:Doorverwijspagina', @@ -387,13 +351,6 @@ u'Wikipedia:Top 1000 van meest bekeken artikelen', u'Wikipedia:Wikipedianen met een encyclopedisch artikel', u'Wikipedia:Woorden die niet als zoekterm gebruikt kunnen worden', - u"Gebruiker:Michiel1972/Lijst plaatsen VS.+", - u"Gebruiker:Zanaq/SG1", - u'Gebruiker:Erwin.*', - u'Gebruiker:Romaine/Dp.*', - u'Gebruiker:Romaine/Doorverwijspaginas/Frankrijkgemeentes', - u'Gebruiker:JePe/Artikelen met een ISBN-link', - u'Gebruiker:.+/.*[aA]rchief.*', ], 'pl': [ u'Wikipedysta:.+',

1 0

[ pywikipediabot-Bugs-2083535 ] interwiki.py note gives wrong count
by SourceForge.net 30 Aug '08

30 Aug '08

Bugs item #2083535, was opened at 2008-08-30 05:57 Message generated for change (Settings changed) made by purodha You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2083535&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Resolution: None >Priority: 3 Private: No Submitted By: Purodha B Blissenbach (purodha) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki.py note gives wrong count Initial Comment: Interwiki.py, when started up, ays something like: NOTE: Number of pages queued is 0, trying to add 255 more. If you specify parameters -number:10 and -query:255, it displays "add 255 more", but then only adds 10. I have not tested that, but likely, limiting -array: will have a similar effect. So, better interwiki.py should first compute how many pages are to be added this time, then display the figure, instead of doing it the other way round. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2083535&group_…

1 0

[ pywikipediabot-Bugs-2083535 ] interwiki.py note gives wrong count
by SourceForge.net 30 Aug '08

30 Aug '08

Bugs item #2083535, was opened at 2008-08-30 05:57 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2083535&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Purodha B Blissenbach (purodha) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki.py note gives wrong count Initial Comment: Interwiki.py, when started up, ays something like: NOTE: Number of pages queued is 0, trying to add 255 more. If you specify parameters -number:10 and -query:255, it displays "add 255 more", but then only adds 10. I have not tested that, but likely, limiting -array: will have a similar effect. So, better interwiki.py should first compute how many pages are to be added this time, then display the figure, instead of doing it the other way round. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2083535&group_…

1 0

[JIRA] Created: (PYWP-9) create library for diffs, expand userlib
by David (JIRA) 29 Aug '08

29 Aug '08

Please do not reply to this email, it was automatically generated. If you would like to comment on the issue, visit this URL: https://jira.toolserver.org/browse/PYWP-9 create library for diffs, expand userlib ---------------------------------------- Key: PYWP-9 URL: https://jira.toolserver.org/browse/PYWP-9 Project: pywikipedia Issue Type: New Feature Environment: Wikipedia:en (for now) Reporter: David Assignee: David Priority: Minor Attachments: kal.patch Add a new library, editlib, for parsing diffs. It will parse the diff html page, extracting info like editor, time, edit summary, etc, and creating lists of the lines and words marked as added and deleted. More details can be found in the docstrings. For use with editlib, some new functions are also added to userlib. These will get the user's registration date, the number of edits the user has made, and the number of vandalism warnings on the user's talk page. Only Wikipedia:en is supported - some of the regular expressions rely on English text. Within that scope, I've done reasonably thorough testing on the editlib functions, and somewhat less thorough testing on the new functions for userlib. All of this is designed for use with automated vandalism detection. I am working on a bot to do just that - User:Kalbot - but it's still in an early experimental stage. I am User:DKalkin on the English Wikipedia -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: https://jira.toolserver.org/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira

1 1

SVN: [5868] branches/rewrite/pywikibot/data/api.py
by russblau＠svn.wikimedia.org 29 Aug '08

29 Aug '08

Revision: 5868 Author: russblau Date: 2008-08-29 19:09:43 +0000 (Fri, 29 Aug 2008) Log Message: ----------- replace print with debug Modified Paths: -------------- branches/rewrite/pywikibot/data/api.py Modified: branches/rewrite/pywikibot/data/api.py =================================================================== --- branches/rewrite/pywikibot/data/api.py 2008-08-29 19:08:34 UTC (rev 5867) +++ branches/rewrite/pywikibot/data/api.py 2008-08-29 19:09:43 UTC (rev 5868) @@ -201,7 +201,7 @@ logger.warning( "Non-JSON response received from server %s; the server may be down." % self.site) - print rawdata + logger.debug(rawdata) self.wait() continue if not result:

1 0

SVN: [5867] branches/rewrite/pywikibot/site.py
by russblau＠svn.wikimedia.org 29 Aug '08

29 Aug '08

Revision: 5867 Author: russblau Date: 2008-08-29 19:08:34 +0000 (Fri, 29 Aug 2008) Log Message: ----------- supply missing namespace and argument Modified Paths: -------------- branches/rewrite/pywikibot/site.py Modified: branches/rewrite/pywikibot/site.py =================================================================== --- branches/rewrite/pywikibot/site.py 2008-08-29 19:07:49 UTC (rev 5866) +++ branches/rewrite/pywikibot/site.py 2008-08-29 19:08:34 UTC (rev 5867) @@ -433,9 +433,11 @@ return self._userinfo def getcurrenttimestamp(self): - """Returns a (Mediawiki) timestamp, {{CURRENTTIMESTAMP}}, - the server time. - Format is yyyymmddhhmmss""" + """Return (Mediawiki) timestamp, {{CURRENTTIMESTAMP}}, the server time. + + Format is yyyymmddhhmmss + + """ r = api.Request(site=self, action="parse", text="{{CURRENTTIMESTAMP}}") @@ -1438,8 +1440,8 @@ raise Error("search: searchstring cannot be empty") if where not in ("text", "titles"): raise Error("search: unrecognized 'where' value: %s" % where) - srgen = PageGenerator("search", gsrsearch=searchstring, gsrwhat=where, - site=self) + srgen = api.PageGenerator("search", gsrsearch=searchstring, + gsrwhat=where, site=self) if not namespaces: logger.warning("search: namespaces cannot be empty; using [0].") namespaces = [0] @@ -1509,7 +1511,7 @@ def watchlist_revs(self, start=None, end=None, reverse=False, namespaces=None, showMinor=None, showBot=None, - showAnon=None): + showAnon=None, limit=None): """Iterate revisions to pages on the bot user's watchlist. Iterated values will be in same format as recentchanges. @@ -1526,7 +1528,8 @@ None), only list non-bot edits @param showAnon: if True, only list anon edits; if False (and not None), only list non-anon edits - + @param limit: Maximum number of revisions to iterate + """ if start and end: if reverse:

1 0

SVN: [5866] branches/rewrite/pywikibot/tests/site_tests.py
by russblau＠svn.wikimedia.org 29 Aug '08

29 Aug '08

Revision: 5866 Author: russblau Date: 2008-08-29 19:07:49 +0000 (Fri, 29 Aug 2008) Log Message: ----------- more tests (this completes a barebones framework of tests for non-writing API methods; but more meat needs to be put on the bones) Modified Paths: -------------- branches/rewrite/pywikibot/tests/site_tests.py Modified: branches/rewrite/pywikibot/tests/site_tests.py =================================================================== --- branches/rewrite/pywikibot/tests/site_tests.py 2008-08-29 17:34:01 UTC (rev 5865) +++ branches/rewrite/pywikibot/tests/site_tests.py 2008-08-29 19:07:49 UTC (rev 5866) @@ -153,7 +153,110 @@ self.assertTrue(user.has_key("editcount")) self.assertTrue(user.has_key("registration")) + def testAllImages(self): + """Test the site.allimages() method""" + ai = list(mysite.allimages(limit=10)) + self.assertTrue(len(ai) <= 10) + self.assertTrue(all(isinstance(image, pywikibot.ImagePage) + for image in ai)) + + def testBlocks(self): + """Test the site.blocks() method""" + + bl = list(mysite.blocks(limit=10)) + self.assertTrue(len(bl) <= 10) + self.assertTrue(all(isinstance(block, dict) + for block in bl)) + + def testExturlusage(self): + """Test the site.exturlusage() method""" + + url = "www.google.com" + eu = list(mysite.exturlusage(url, limit=10)) + self.assertTrue(len(eu) <= 10) + self.assertTrue(all(isinstance(link, pywikibot.Page) + for link in eu)) + + def testImageusage(self): + """Test the site.imageusage() method""" + + imagepage = pywikibot.ImagePage(pywikibot.Link("Image:Wiki.png", mysite)) + iu = list(mysite.imageusage(imagepage, limit=10)) + self.assertTrue(len(iu) <= 10) + self.assertTrue(all(isinstance(link, pywikibot.Page) + for link in iu)) + + def testLogEvents(self): + """Test the site.logevents() method""" + + le = list(mysite.logevents(limit=10)) + self.assertTrue(len(le) <= 10) + self.assertTrue(all(isinstance(entry, dict) and entry.has_key("type") + for entry in le)) + + def testRecentchanges(self): + """Test the site.recentchanges() method""" + + rc = list(mysite.recentchanges(limit=10)) + self.assertTrue(len(rc) <= 10) + self.assertTrue(all(isinstance(change, dict) + for change in rc)) + + def testSearch(self): + """Test the site.search() method""" + + se = list(mysite.search("wiki", limit=10)) + self.assertTrue(len(se) <= 10) + self.assertTrue(all(isinstance(hit, pywikibot.Page) + for hit in se)) + + def testUsercontribs(self): + """Test the site.usercontribs() method""" + + uc = list(mysite.usercontribs(user=mysite.user(), limit=10)) + self.assertTrue(len(uc) <= 10) + self.assertTrue(all(isinstance(contrib, dict) + for contrib in uc)) + + def testWatchlistrevs(self): + """Test the site.watchlist_revs() method""" + + wl = list(mysite.watchlist_revs(limit=10)) + self.assertTrue(len(wl) <= 10) + self.assertTrue(all(isinstance(rev, dict) + for rev in wl)) + + def testDeletedrevs(self): + """Test the site.deletedrevs() method""" + + if not mysite.logged_in(True): + return + dr = list(mysite.deletedrevs(limit=10)) + self.assertTrue(len(dr) <= 10) + self.assertTrue(all(isinstance(rev, dict) + for rev in dr)) + dr2 = list(mysite.deletedrevs(titles=mainpage.title(withSection=False), + limit=10)) + self.assertTrue(len(dr2) <= 10) + self.assertTrue(all(isinstance(rev, dict) + for rev in dr2)) + + def testUsers(self): + """Test the site.users() method""" + + us = list(mysite.users([mysite.user()])) + self.assertEqual(len(us), 1) + self.assertTrue(isinstance(us[0], dict)) + + def testRandompages(self): + """Test the site.randompages() method""" + rn = list(mysite.randompages(limit=10)) + self.assertTrue(len(rn) <= 10) + self.assertTrue(all(isinstance(a_page, pywikibot.Page) + for a_page in rn)) + + if __name__ == '__main__': # pywikibot.logging.getLogger().setLevel(pywikibot.logging.DEBUG) try:

1 0

SVN: [5865] trunk/pywikipedia/wikipedia.py
by russblau＠svn.wikimedia.org 29 Aug '08

29 Aug '08

Revision: 5865 Author: russblau Date: 2008-08-29 17:34:01 +0000 (Fri, 29 Aug 2008) Log Message: ----------- tweak redirRegex Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-08-29 15:58:18 UTC (rev 5864) +++ trunk/pywikipedia/wikipedia.py 2008-08-29 17:34:01 UTC (rev 5865) @@ -5452,11 +5452,11 @@ if self.versionnumber() > 12: # in MW 1.13 (at least) a redirect directive can follow whitespace - prefix = r'[\n ]*' + prefix = r'\s*' else: - prefix = r'\n*' + prefix = r'[\r\n]*' return re.compile(prefix + '#' + redirKeywordsR - + '.*?\[\[(.+?)(?:\|.*?)?\]\]', + + '\s*:?\s*\[\[(.+?)(?:\|.*?)?\]\]', re.IGNORECASE | re.UNICODE | re.DOTALL) # The following methods are for convenience, so that you can access

1 0

SVN: [5864] trunk/pywikipedia/wikipedia.py
by russblau＠svn.wikimedia.org 29 Aug '08

29 Aug '08

Revision: 5864 Author: russblau Date: 2008-08-29 15:58:18 +0000 (Fri, 29 Aug 2008) Log Message: ----------- regex bug ('.' matches ANY character) Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-08-28 20:34:46 UTC (rev 5863) +++ trunk/pywikipedia/wikipedia.py 2008-08-29 15:58:18 UTC (rev 5864) @@ -228,7 +228,7 @@ Rwatchlist = re.compile(r"<input tabindex='[\d]+' type='checkbox' " r"name='wpWatchthis' checked='checked'") Rlink = re.compile(r'\[\[(?P<title>[^\]\|\[]*)(\|[^\]]*)?\]\]') -resectiondecodeescapes = re.compile(r".(?=[0-9a-f]{2})",re.I) +resectiondecodeescapes = re.compile(r"\.(?=[0-9a-f]{2})",re.I) resectiondecodeleadingnonalpha = re.compile(r'^x(?=[^a-zA-Z])')

1 0

[ pywikipediabot-Bugs-2082329 ] movepages.py with -del does not delete talk page redirect
by SourceForge.net 29 Aug '08

29 Aug '08

Bugs item #2082329, was opened at 2008-08-29 08:11 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2082329&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Uberfuzzy (uberfuzzy) Assigned to: Nobody/Anonymous (nobody) Summary: movepages.py with -del does not delete talk page redirect Initial Comment: Pywikipedia [http] trunk/pywikipedia (r5858, Aug 28 2008, 11:35:51) Python 2.5.1 (r251:54863, Apr 18 2007, 08:51:08) [MSC v.1310 32 bit (Intel)] when using the movepages.py script with the -del option to delete the leftover redirect, only the redirect for the page is deleted, but not the talk page redirect. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2082329&group_…

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l August 2008