pywikibot

pywikibot@lists.wikimedia.org

3 participants
6830 discussions

[Pywikipedia-l] SVN: [4044] trunk/pywikipedia
by wikipedian＠svn.wikimedia.org 15 Aug '07

15 Aug '07

Revision: 4044 Author: wikipedian Date: 2007-08-15 12:56:24 +0000 (Wed, 15 Aug 2007) Log Message: ----------- Added method protocol() which returns 'http'. This makes it possible to work on sites that only support https. Modified Paths: -------------- trunk/pywikipedia/family.py trunk/pywikipedia/login.py trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/family.py =================================================================== --- trunk/pywikipedia/family.py 2007-08-15 00:30:54 UTC (rev 4043) +++ trunk/pywikipedia/family.py 2007-08-15 12:56:24 UTC (rev 4044) @@ -2402,6 +2402,13 @@ # Methods + def protocol(self, code): + """ + Can be overridden to return 'https'. + Other protocols are not supported. + """ + return 'http' + def hostname(self, code): return self.langs[code] Modified: trunk/pywikipedia/login.py =================================================================== --- trunk/pywikipedia/login.py 2007-08-15 00:30:54 UTC (rev 4043) +++ trunk/pywikipedia/login.py 2007-08-15 12:56:24 UTC (rev 4044) @@ -136,7 +136,7 @@ "User-agent": wikipedia.useragent } data = self.site.urlEncode(predata) - response = urllib2.urlopen(urllib2.Request('http://' + self.site.hostname() + address, data, headers)) + response = urllib2.urlopen(urllib2.Request(self.site.protocol() + '://' + self.site.hostname() + address, data, headers)) data = response.read() wikipedia.cj.save(wikipedia.COOKIEFILE) return "Ok" Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2007-08-15 00:30:54 UTC (rev 4043) +++ trunk/pywikipedia/wikipedia.py 2007-08-15 12:56:24 UTC (rev 4044) @@ -680,7 +680,7 @@ """ Get the permalink page for this page """ - return "http://%s%s&oldid=%i"%(self.site().hostname(), self.site().get_address(self.title()), self.latestRevision()) + return "%s://%s%s&oldid=%i"%(self.site().protocol, self.site().hostname(), self.site().get_address(self.title()), self.latestRevision()) def latestRevision(self): """ @@ -1164,7 +1164,7 @@ predata.append(("Content-type","application/x-www-form-urlencoded")) predata.append(("User-agent", useragent)) data = self.site().urlEncode(predata) - response = urllib2.urlopen(urllib2.Request('http://' + self.site().hostname() + address, data)) + response = urllib2.urlopen(urllib2.Request(self.site().protocol() + '://' + self.site().hostname() + address, data)) # I'm not sure what to check in this case, so I just assume things went ok. # Very naive, I agree. data = u'' @@ -1686,7 +1686,7 @@ predata["Content-type"] = "application/x-www-form-urlencoded" predata["User-agent"] = useragent data = self.site.urlEncode(predata) - response = urllib2.urlopen(urllib2.Request('http://' + self.site.hostname() + address, data)) + response = urllib2.urlopen(urllib2.Request(self.site.protocol() + '://' + self.site.hostname() + address, data)) data = response.read().decode(self.site().encoding()) else: response, data = self.site().postForm(address, predata) @@ -1751,7 +1751,7 @@ predata['Content-type'] = 'application/x-www-form-urlencoded' predata['User-agent'] = useragent data = self.site().urlEncode(predata) - response = urllib2.urlopen(urllib2.Request('http://' + self.site().hostname() + address, data)) + response = urllib2.urlopen(urllib2.Request(self.site().protocol() + '://' + self.site().hostname() + address, data)) data = '' else: response, data = self.site().postForm(address, predata, sysop = sysop) @@ -1808,7 +1808,7 @@ predata['Content-type'] = 'application/x-www-form-urlencoded' predata['User-agent'] = useragent data = self.site().urlEncode(predata) - response = urllib2.urlopen(urllib2.Request('http://' + self.site().hostname() + address, data)) + response = urllib2.urlopen(urllib2.Request(self.site().protocol() + '://' + self.site().hostname() + address, data)) data = u'' else: response, data = self.site().postForm(address, predata, sysop = True) @@ -1970,7 +1970,7 @@ predata["Content-type"] = "application/x-www-form-urlencoded" predata["User-agent"] = useragent data = self.site().urlEncode(predata) - response = urllib2.urlopen(urllib2.Request('http://' + self.site().hostname() + address, data)) + response = urllib2.urlopen(urllib2.Request(self.site().protocol() + '://' + self.site().hostname() + address, data)) data = '' else: data, response = self.site().postForm(address, predata, sysop = True) @@ -2082,7 +2082,6 @@ """ if not self._imagePageHtml: path = self.site().get_address(self.urlname()) - #output(u'Getting http://%s%s' % (self.site().hostname(), path)) self._imagePageHtml = self.site().getUrl(path) return self._imagePageHtml @@ -2310,7 +2309,7 @@ predata["Content-type"] = "application/x-www-form-urlencoded" predata["User-agent"] = useragent data = self.site.urlEncode(predata) - response = urllib2.urlopen(urllib2.Request('http://' + self.site.hostname() + address, data)) + response = urllib2.urlopen(urllib2.Request(self.site.protocol() + '://' + self.site.hostname() + address, data)) data = response.read() else: response, data = self.site.postForm(address, predata) @@ -3149,7 +3148,11 @@ # TODO: add the authenticate stuff here # Encode all of this into a HTTP request - conn = httplib.HTTPConnection(self.hostname()) + if self.protocol() == 'http': + conn = httplib.HTTPConnection(self.hostname()) + elif self.protocol() == 'https': + conn = httplib.HTTPSConnection(self.hostname()) + # otherwise, it will crash, as other protocols are not supported conn.putrequest('POST', address) conn.putheader('Content-Length', str(len(data))) @@ -3261,7 +3264,7 @@ if compress: uo.addheader('Accept-encoding', 'gzip') - url = 'http://%s%s' % (self.hostname(), path) + url = '%s://%s%s' % (self.protocol(), self.hostname(), path) data = self.urlEncode(data) # Try to retrieve the page until it was successfully loaded (just in @@ -3288,7 +3291,7 @@ if retry: # We assume that the server is down. Wait some time, then try again. output(u"%s" % e) - output(u"WARNING: Could not open 'http://%s%s'. Maybe the server or your connection is down. Retrying in %i minutes..." % (self.hostname(), path, retry_idle_time)) + output(u"WARNING: Could not open '%s://%s%s'. Maybe the server or your connection is down. Retrying in %i minutes..." % (self.protocol(), self.hostname(), path, retry_idle_time)) time.sleep(retry_idle_time * 60) # Next time wait longer, but not longer than half an hour retry_idle_time *= 2 @@ -3320,7 +3323,7 @@ text = unicode(text, charset, errors = 'strict') except UnicodeDecodeError, e: print e - output(u'ERROR: Invalid characters found on http://%s%s, replaced by \\ufffd.' % (self.hostname(), path)) + output(u'ERROR: Invalid characters found on %s://%s%s, replaced by \\ufffd.' % (self.protocol(), self.hostname(), path)) # We use error='replace' in case of bad encoding. text = unicode(text, charset, errors = 'replace') @@ -3848,6 +3851,9 @@ def api_address(self): return self.family.api_address(self.lang) + def protocol(self): + return self.family.protocol(self.lang) + def hostname(self): return self.family.hostname(self.lang)

1 0

Re: [Pywikipedia-l] Subversion
by Andre Engels 15 Aug '07

15 Aug '07

2007/8/15, Bryan Tong Minh <bryan.tongminh(a)gmail.com>: > It's svn.wikimedia.org. Hmmm... And now I have forgotten my passphrase... Where can I submit a new public key? -- Andre Engels, andreengels(a)gmail.com ICQ: 6260644 -- Skype: a_engels

2 1

Re: [Pywikipedia-l] Subversion
by Andre Engels 15 Aug '07

15 Aug '07

2007/8/2, Merlijn van Deen <valhallasw(a)arctus.nl>: > windows: > download TortoiseSVN and putty. I downloaded TortoiseSVN. Putty I already had. > Run putty, create a new session with these settings: > host name: svn.mediawiki.org > session name: svn.mediawiki.org > connection/data/username: a_engels > connection/data/SSH/auth/private key: (select your private key) When trying to actually open the session, Putty says "Unable to open connection to svn.mediawiki.org. Host does not exist" > save this session > > Then use tortoiseSVN to checkout > svn+ssh://svn.mediawiki.org/svnroot/pywikipedia/trunk/pywikipedia "Unable to open connection: gethostbyname: unknown error" -- Andre Engels, andreengels(a)gmail.com ICQ: 6260644 -- Skype: a_engels

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1704981 ] can't log in
by SourceForge.net 15 Aug '07

15 Aug '07

Bugs item #1704981, was opened at 2007-04-21 17:15 Message generated for change (Comment added) made by warddr You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1704981&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Closed Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: can't log in Initial Comment: The latest version from CVS won't let me log in. I get this message: Login failed. Wrong password? I also have a separate copy of pywikipedia which is a snapshot download. With this I can log in fine. Both copies are using the same user information, so I know that this and my password are correct. (I can't tell you when the snapshot dates from as I don't see a log file and I can't get a file creation date.) ---------------------------------------------------------------------- Comment By: Warddr (warddr) Date: 2007-08-15 09:18 Message: Logged In: YES user_id=1741827 Originator: NO I also had this problem 2 days ago (with the newest version). It was the first time I used pywikipediabot with linux so i thought the problem was there but now I don't think that's the problem anymore. When I copied all my files from windows to linux it works well so I think the fault is a fault with login.py. ---------------------------------------------------------------------- Comment By: SourceForge Robot (sf-robot) Date: 2007-08-15 02:20 Message: Logged In: YES user_id=1312539 Originator: NO This Tracker item was closed automatically by the system. It was previously set to a Pending status, and the original submitter did not respond within 14 days (the time period specified by the administrator of this Tracker). ---------------------------------------------------------------------- Comment By: Leonardo Gregianin (leogregianin) Date: 2007-07-31 15:10 Message: Logged In: YES user_id=1136737 Originator: NO Try to update SVN repository: svn checkout http://svn.wikimedia.org/svnroot/pywikipedia/trunk/pywikipedia ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1704981&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1704981 ] can't log in
by SourceForge.net 15 Aug '07

15 Aug '07

Bugs item #1704981, was opened at 2007-04-21 10:15 Message generated for change (Comment added) made by sf-robot You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1704981&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed Resolution: None Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: can't log in Initial Comment: The latest version from CVS won't let me log in. I get this message: Login failed. Wrong password? I also have a separate copy of pywikipedia which is a snapshot download. With this I can log in fine. Both copies are using the same user information, so I know that this and my password are correct. (I can't tell you when the snapshot dates from as I don't see a log file and I can't get a file creation date.) ---------------------------------------------------------------------- >Comment By: SourceForge Robot (sf-robot) Date: 2007-08-14 19:20 Message: Logged In: YES user_id=1312539 Originator: NO This Tracker item was closed automatically by the system. It was previously set to a Pending status, and the original submitter did not respond within 14 days (the time period specified by the administrator of this Tracker). ---------------------------------------------------------------------- Comment By: Leonardo Gregianin (leogregianin) Date: 2007-07-31 08:10 Message: Logged In: YES user_id=1136737 Originator: NO Try to update SVN repository: svn checkout http://svn.wikimedia.org/svnroot/pywikipedia/trunk/pywikipedia ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1704981&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Feature Requests-1732058 ] Translate "(disambiguation)" string in page titles.
by SourceForge.net 15 Aug '07

15 Aug '07

Feature Requests item #1732058, was opened at 2007-06-06 06:49 Message generated for change (Comment added) made by sf-robot You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1732058&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed Priority: 5 Private: No Submitted By: Purodha B Blissenbach (purodha) Assigned to: Nobody/Anonymous (nobody) Summary: Translate "(disambiguation)" string in page titles. Initial Comment: The interwiki program for the Wikipedia family of wikies should be able to look for all possible candidates when following hints to several wikies, such as -hintall, "all:", "20:", and similar. For disambuguation pages, the correct target page titles for source page "Name" or "Name (disambiguation)" may be: "Name (disambiguation)", or "name", or "NAME (disambiguation)", or "NAME". Depending on page and/or wiki, any, some, or only one will be elgible. Most usually, they should be searched in the order given above, and the 1st match will be the most likely hit. Very few wikies offer several possible translations of "(disambiguation)". Most have only one such string. Some don't have one. Some Wikipedias always use it with disambiguation pages, the vast majority uses it sometimes, and sometimes not in an unpredictable manner. I suggest, to add a command line switch allowing this kind of page title translation. Maybe, it could take an optional parameter, the value of which may tell in which order the string options should be searched, and/or wether or not an interactive query is desired in cases when several such target pages exist. I might be not skilled enough to create a patch, at least not easily. Before I try, I'd like some feedback, too. I did, however, prepare a collection of translations of the string "(disambiguation)". It is on page http://ksh.wikipedia.org/wiki/Metmaacher:Purodha/disambig Please, if you import the data into the apropriate program or it otherwise becomes obsolete, put a {{delete}} template on this page, so as to tell me that I do not to update it any more. ---------------------------------------------------------------------- >Comment By: SourceForge Robot (sf-robot) Date: 2007-08-14 19:20 Message: Logged In: YES user_id=1312539 Originator: NO This Tracker item was closed automatically by the system. It was previously set to a Pending status, and the original submitter did not respond within 14 days (the time period specified by the administrator of this Tracker). ---------------------------------------------------------------------- Comment By: Leonardo Gregianin (leogregianin) Date: 2007-06-11 07:41 Message: Logged In: YES user_id=1136737 Originator: NO Hi, pywikipediabot identifies the pages of disambiguation for templates include in wikipedia_family.py line 341: self.disambiguationTemplates. ksh wikipedia not included there. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1732058&group_…

1 0

[Pywikipedia-l] SVN: [4043] trunk/pywikipedia/capitalize_redirects.py
by leogregianin＠svn.wikimedia.org 15 Aug '07

15 Aug '07

Revision: 4043 Author: leogregianin Date: 2007-08-15 00:30:54 +0000 (Wed, 15 Aug 2007) Log Message: ----------- rename variables Modified Paths: -------------- trunk/pywikipedia/capitalize_redirects.py Modified: trunk/pywikipedia/capitalize_redirects.py =================================================================== --- trunk/pywikipedia/capitalize_redirects.py 2007-08-15 00:09:01 UTC (rev 4042) +++ trunk/pywikipedia/capitalize_redirects.py 2007-08-15 00:30:54 UTC (rev 4043) @@ -59,8 +59,8 @@ # Show the title of the page we're working on. # Highlight the title in purple. wikipedia.output(u"\n\n>>> \03{lightpurple}%s\03{default} <<<" % page_t) - if not np.exists(): - wikipedia.output(u'%s don\'t exist' % np.title()) + if not page_t.exists(): + wikipedia.output(u'%s don\'t exist' % page_t.title()) if not self.acceptall: choice = wikipedia.inputChoice(u'Do you want create redirect?', ['Yes', 'No', 'All'], ['y', 'N', 'a'], 'N') if choice in ['a', 'A']: @@ -75,7 +75,7 @@ time.sleep(15) continue else: - wikipedia.output(u'%s already exist, skipping...\n' % np.title()) + wikipedia.output(u'%s already exist, skipping...\n' % page_t.title()) def main(): gen = None

1 0

[Pywikipedia-l] SVN: [4042] trunk/pywikipedia/movepages.py
by leogregianin＠svn.wikimedia.org 15 Aug '07

15 Aug '07

Revision: 4042 Author: leogregianin Date: 2007-08-15 00:09:01 +0000 (Wed, 15 Aug 2007) Log Message: ----------- Fix bug 1773949, thanks Falk Steinhauer Modified Paths: -------------- trunk/pywikipedia/movepages.py Modified: trunk/pywikipedia/movepages.py =================================================================== --- trunk/pywikipedia/movepages.py 2007-08-14 19:01:54 UTC (rev 4041) +++ trunk/pywikipedia/movepages.py 2007-08-15 00:09:01 UTC (rev 4042) @@ -27,9 +27,9 @@ its functionality is delete old page that was moved. For example: "movepages.py pagetitle -del". - -addprefix Move pages by adding a namespace prefix to the names of the pages. + -prefix Move pages by adding a namespace prefix to the names of the pages. (Will remove the old namespace prefix if any) - Argument can also be given as "-addprefix:namespace:". + Argument can also be given as "-prefix:namespace:". -always Don't prompt to make changes, just do them. @@ -55,7 +55,6 @@ 'fr': u'Page renommée par bot', 'he': u'העברת דף באמצעות בוט', 'nl': u'Paginatitel gewijzigd door robot', - 'no': u'bot: Flytter side', 'pl': u'Przeniesienie artykułu przez robota', 'pt': u'Página movida por bot', } @@ -67,7 +66,6 @@ 'el': u'Διαγραφή σελίδων με bot', 'fr': u'Page supprimée par bot', 'nl': u'Pagina verwijderd door robot', - 'no': u'bot: Sletter side', 'pl': u'Usunięcie artykułu przez robota', 'pt': u'Página apagada por bot', } @@ -96,6 +94,7 @@ wikipedia.output(u'Page %s is locked!' % page.title()) def treat(self,page): + colors = [None] * 6 + [13] * len(page.title()) + [None] * 4 wikipedia.output(u'\n>>>> %s <<<<' % page.title()) pagetitle = page.titleWithoutNamespace() namesp = page.site().namespace(page.namespace())

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1773949 ] wrong argument description of movepages.py
by SourceForge.net 15 Aug '07

15 Aug '07

Bugs item #1773949, was opened at 2007-08-14 11:31 Message generated for change (Settings changed) made by leogregianin You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1773949&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed >Resolution: Accepted Priority: 5 Private: No Submitted By: Falk Steinhauer (falk_steinhauer) >Assigned to: Leonardo Gregianin (leogregianin) Summary: wrong argument description of movepages.py Initial Comment: I am using snapshot 2007-06-19. The commandline help of movepages.py shows an option called "-addprefix", but the respective option in the sourcecode is spelled "-prefix". Users that are not able to understand the sourcecode might not be able to understand how to call the script. Another thing is, that this script is not using page title highlighting like replace.py when user interaction is desired. The first line in "def treat(self,page)" should be: colors = [None] * 6 + [13] * len(page.title()) + [None] * 4 ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1773949&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Bugs-1722090 ] featured.py duplicates {{Link FA}}
by SourceForge.net 15 Aug '07

15 Aug '07

Bugs item #1722090, was opened at 2007-05-20 05:59 Message generated for change (Comment added) made by leogregianin You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1722090&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open >Resolution: Accepted >Priority: 6 Private: No Submitted By: VasilievVV (vasilievvv) Assigned to: Nobody/Anonymous (nobody) Summary: featured.py duplicates {{Link FA}} Initial Comment: featured.py can't understand that {{Link_FA}} and {{Link FA}} is the same. See http://en.wikipedia.org/wiki/User_talk:VVVBot#broken ---------------------------------------------------------------------- >Comment By: Leonardo Gregianin (leogregianin) Date: 2007-08-14 20:02 Message: Logged In: YES user_id=1136737 Originator: NO This happens due the diverse forms to write template, p.e. capital letters or with underline and featured.py only searchs a form. With two dictionaries with templates solving the problem, A templates to search and another with only template to write in the site. ---------------------------------------------------------------------- Comment By: Eric D. (zolk) Date: 2007-08-14 13:51 Message: Logged In: YES user_id=310741 Originator: NO Same problem on fr with {{lien AdQ}}. Example : http://fr.wikipedia.org/w/index.php?title=Lion&curid=5862&diff=19664918&old… (with duplicate of {{Lien Adq|de}}) Cordialy ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=1722090&group_…

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot