Pywikipedia-l June 2008

pywikipedia-l@lists.wikimedia.org

32 participants
449 discussions

[ pywikipediabot-Bugs-2003088 ] Serious mistake in sk translation in featured.py

by SourceForge.net

Bugs item #2003088, was opened at 2008-06-26 13:26 Message generated for change (Comment added) made by nicdumz You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2003088&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed >Resolution: Fixed Priority: 7 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: Serious mistake in sk translation in featured.py Initial Comment: There has been added "je najlep lnok", but "je najlepší článok" had been requested! The characters š, í, č and á are missing! See: http://sourceforge.net/tracker/index.php?func=detail&aid=1999637&group_id=9… http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/featured.py?r… ---------------------------------------------------------------------- >Comment By: NicDumZ — Nicolas Dumazet (nicdumz) Date: 2008-06-26 18:39 Message: Logged In: YES user_id=1963242 Originator: NO I'm sorry melancholie. I copy pasted the translation, but I think I have copied it from the bug tracker mail; and sadly, the mails from the sourceforge trackers apparently breaks the encoding : "The characters š, í, č and á are missing!", for example, is rendered "The characters , , and are missing!" Sorry again, I had no way to figure out it was a wrong translation :) [Fixed in r5637] ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2003088&group_…

15 years, 9 months

SVN: [5637] trunk/pywikipedia/featured.py

by nicdumz＠svn.wikimedia.org

Revision: 5637 Author: nicdumz Date: 2008-06-26 16:33:58 +0000 (Thu, 26 Jun 2008) Log Message: ----------- Fixing 'sk' translation of featured.py Modified Paths: -------------- trunk/pywikipedia/featured.py Modified: trunk/pywikipedia/featured.py =================================================================== --- trunk/pywikipedia/featured.py 2008-06-26 16:00:09 UTC (rev 5636) +++ trunk/pywikipedia/featured.py 2008-06-26 16:33:58 UTC (rev 5637) @@ -81,7 +81,7 @@ 'pl': u'Bot: Link do artykułu wyróżnionego [[%s:%s]]', 'pt': u'Bot: Ligando artigos destacados para [[%s:%s]]', 'ru': u'Робот: робот: избранная статья [[%s:%s]]', - 'sk': u'Bot: [[%s:%s]] je najlep lnok', + 'sk': u'Bot: [[%s:%s]] je najlepší článok', 'sr': u'Bot: Међувики за изабране чланке за [[%s:%s]]', 'sv': u'Bot: [[%s:%s]] är en utmärkt artikel', 'th': u'บอต: ลิงก์บทความคัดสรร [[%s:%s]]',

15 years, 9 months

SVN: [5636] trunk/pywikipedia/wikipedia.py

by filnik＠svn.wikimedia.org

Revision: 5636 Author: filnik Date: 2008-06-26 16:00:09 +0000 (Thu, 26 Jun 2008) Log Message: ----------- Adding the docu to getDuplicates Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-06-26 14:53:46 UTC (rev 5635) +++ trunk/pywikipedia/wikipedia.py 2008-06-26 16:00:09 UTC (rev 5636) @@ -2638,12 +2638,14 @@ raise NoPage(u'API Error, nothing found in the APIs') def getDuplicates(self): + """ Function that uses APIs to give the duplicates of the given image """ params = { 'action' :'query', 'titles' :self.title(), 'prop' :'imageinfo', 'iiprop' :'sha1', } + # First of all we need the Hash that identify an image data = query.GetData(params, useAPI = True, encodeTitle = False) pageid = data['query']['pages'].keys()[0] try: @@ -2654,6 +2656,7 @@ else: wikipedia.output(u'Image deleted before getting the Hash. Skipping...') return None + # Now get all the images with the same hash #action=query&format=xml&list=allimages&aisha1=%s image_namespace = "%s:" % self._site.image_namespace() # Image: params = {

15 years, 9 months

SVN: [5635] trunk/pywikipedia/imagecopy.py

by filnik＠svn.wikimedia.org

Revision: 5635 Author: filnik Date: 2008-06-26 14:53:46 +0000 (Thu, 26 Jun 2008) Log Message: ----------- The format of getLatestUploader() is changed Modified Paths: -------------- trunk/pywikipedia/imagecopy.py Modified: trunk/pywikipedia/imagecopy.py =================================================================== --- trunk/pywikipedia/imagecopy.py 2008-06-26 14:26:46 UTC (rev 5634) +++ trunk/pywikipedia/imagecopy.py 2008-06-26 14:53:46 UTC (rev 5635) @@ -467,7 +467,7 @@ else: # The first upload is last in the list. try: - username = imagepage.getLatestUploader() + username = imagepage.getLatestUploader()[0] except NotImplementedError: #No API, using the page file instead (datetime, username, resolution, size, comment) = imagepage.getFileVersionHistory().pop()

15 years, 9 months

SVN: [5634] trunk/pywikipedia/checkimages.py

by filnik＠svn.wikimedia.org

Revision: 5634 Author: filnik Date: 2008-06-26 14:26:46 +0000 (Thu, 26 Jun 2008) Log Message: ----------- Fixing the duplicate detector and some minor fixes Modified Paths: -------------- trunk/pywikipedia/checkimages.py Modified: trunk/pywikipedia/checkimages.py =================================================================== --- trunk/pywikipedia/checkimages.py 2008-06-26 14:26:14 UTC (rev 5633) +++ trunk/pywikipedia/checkimages.py 2008-06-26 14:26:46 UTC (rev 5634) @@ -80,7 +80,7 @@ # import re, time, urllib, urllib2, os, locale, sys -import wikipedia, config, pagegenerators, catlib +import wikipedia, config, pagegenerators, catlib, query locale.setlocale(locale.LC_ALL, '') @@ -384,10 +384,6 @@ class NothingFound(wikipedia.Error): """ An exception indicating that a regex has return [] instead of results.""" -class NoHash(wikipedia.Error): - """ The APIs don't return any Hash for the image searched. - Really Strange, better to raise an error. """ - # Other common useful functions def printWithTimeZone(message): """ Function to print the messages followed by the TimeZone encoded correctly. """ @@ -400,23 +396,6 @@ time_zone = unicode(time.strftime(u"%d %b %Y %H:%M:%S (UTC)", time.gmtime())) wikipedia.output(u"%s%s" % (message, time_zone)) -def returnOlderTime(listGiven, timeListGiven): - """ Get some time and return the oldest of them """ - #print listGiven; print timeListGiven - #Output: - #[[1210596312.0, u'Autoritratto.png'], [1210590240.0, u'Duplicato.png'], [1210592052.0, u'Duplicato_2.png']] - #[1210596312.0, 1210590240.0, 1210592052.0] - for element in listGiven: - time = element[0] - imageName = element[1] - not_the_oldest = False - for time_selected in timeListGiven: - if time > time_selected: - not_the_oldest = True - break - if not_the_oldest == False: - return imageName - class EmailSender(wikipedia.Page): """ Class to send emails through the Wikipedia's dedicated page. """ def __init__(self, site, user): @@ -424,6 +403,7 @@ self.user = user page_special_name = u'Special:EmailUser' self.page_special_name = page_special_name + # Special:EmailUser/Filnik page = '%s/%s' % (self.page_special_name, self.user) self.page = page wikipedia.Page.__init__(self, site, page, None, 0) @@ -563,7 +543,7 @@ # paginetta it's the image page object. paginetta = wikipedia.ImagePage(self.site, self.image_namespace + self.image) try: - nick = paginetta.getLatestUploader() + nick = paginetta.getLatestUploader()[0] except wikipedia.NoPage: wikipedia.output(u"Seems that %s hasn't the image at all, but there is something in the description..." % self.image) repme = "\n*[[:Image:%s]] problems '''with the APIs'''" @@ -679,6 +659,44 @@ yield image #continue + def returnOlderTime(self, listGiven, timeListGiven): + """ Get some time and return the oldest of them """ + #print listGiven; print timeListGiven + #Output: + #[[1210596312.0, u'Autoritratto.png'], [1210590240.0, u'Duplicato.png'], [1210592052.0, u'Duplicato_2.png']] + #[1210596312.0, 1210590240.0, 1210592052.0] + usage = False + num = 0 + num_older = None + max_usage = 0 + for element in listGiven: + imageName = element[1] + imagePage = wikipedia.ImagePage(self.site, 'Image:%s' % imageName) + imageUsage = [page for page in imagePage.usingPages()] + if len(imageUsage) != 0 and imageUsage > max_usage: + max_usage = imageUsage + num_older = num + num += 1 + if num_older != None: + return listGiven[num_older][1] + for element in listGiven: + time = element[0] + imageName = element[1] + not_the_oldest = False + for time_selected in timeListGiven: + if time > time_selected: + not_the_oldest = True + break + if not_the_oldest == False: + return imageName + + def convert_to_url(self, page): + # Function stolen from wikipedia.py + """The name of the page this Page refers to, in a form suitable for the URL of the page.""" + title = page.replace(" ", "_") + encodedTitle = title.encode(self.site.encoding()) + return urllib.quote(encodedTitle) + def checkImageOnCommons(self, image): """ Checking if the image is on commons """ self.image = image @@ -706,13 +724,6 @@ # Problems? No, return True return True - def convert_to_url(self, page): - # Function stolen from wikipedia.py - """The name of the page this Page refers to, in a form suitable for the URL of the page.""" - title = page.replace(" ", "_") - encodedTitle = title.encode(self.site.encoding()) - return urllib.quote(encodedTitle) - def checkImageDuplicated(self, image): """ Function to check the duplicated images. """ # {{Dupe|Image:Blanche_Montel.jpg}} @@ -722,23 +733,12 @@ dupTalkText = wikipedia.translate(self.site, duplicates_user_talk_text) dupComment_talk = wikipedia.translate(self.site, duplicates_comment_talk) dupComment_image = wikipedia.translate(self.site, duplicates_comment_image) - self.image = image duplicateRegex = r'\n\*(?:\[\[:Image:%s\]\] has the following duplicates:|\*\[\[:Image:%s\]\])$' % (self.convert_to_url(self.image), self.convert_to_url(self.image)) - imagePage = wikipedia.ImagePage(self.site, 'Image:%s' % self.image) - wikipedia.output(u'Checking if %s has duplicates...' % image) - get_hash = self.site.getUrl(self.site.apipath() + '?action=query&format=xml&titles=Image:%s&prop=imageinfo&iiprop=sha1' % self.convert_to_url(self.image)) - hash_found_list = re.findall(r'<ii sha1="(.*?)" />', get_hash) - if hash_found_list != []: - hash_found = hash_found_list[0] - else: - if imagePage.exists(): - raise NoHash('No Hash found in the APIs! Maybe the regex to catch it is wrong or someone has changed the APIs structure.') - else: - wikipedia.output(u'Image deleted before getting the Hash. Skipping...') - return False # Error, we need to skip the page. - get_duplicates = self.site.getUrl(self.site.apipath() + '?action=query&format=xml&list=allimages&aisha1=%s' % hash_found) - duplicates = re.findall(r'<img name="(.*?)".*?/>', get_duplicates) + imagePage = wikipedia.ImagePage(self.site, 'Image:%s' % self.image) + duplicates = imagePage.getDuplicates() + if duplicates == None: + return False # Error, we need to skip the page. if len(duplicates) > 1: if len(duplicates) == 2: wikipedia.output(u'%s has a duplicate! Reporting it...' % self.image) @@ -758,17 +758,13 @@ time_list = list() for duplicate in duplicates: DupePage = wikipedia.ImagePage(self.site, u'Image:%s' % duplicate) - imagedata = DupePage.getFileVersionHistory()[-1][0] - try: - # Example: 21:15, 5 ott 2005 - data = time.strptime(imagedata, "%H:%M, %d %b %Y") - except ValueError: - # Example: 21:15, 5 Ottobre 2005 - data = time.strptime(imagedata, "%H:%M, %d %B %Y") + imagedata = DupePage.getLatestUploader()[1] + # '2008-06-18T08:04:29Z' + data = time.strptime(imagedata, "%Y-%m-%dT%H:%M:%SZ") data_seconds = time.mktime(data) time_image_list.append([data_seconds, duplicate]) time_list.append(data_seconds) - older_image = returnOlderTime(time_image_list, time_list) + older_image = self.returnOlderTime(time_image_list, time_list) # And if the images are more than two? Page_oder_image = wikipedia.ImagePage(self.site, u'Image:%s' % older_image) string = '' @@ -895,6 +891,7 @@ list_loaded.append(word) def checkbot(): + """ Main function """ # Command line configurable parameters repeat = True # Restart after having check all the images? limit = 80 # How many images check?

15 years, 9 months

SVN: [5633] trunk/pywikipedia/wikipedia.py

by filnik＠svn.wikimedia.org

Revision: 5633 Author: filnik Date: 2008-06-26 14:26:14 +0000 (Thu, 26 Jun 2008) Log Message: ----------- Adding new functionality to getLatestUploader() (now returns also the timestamp) and adding the new function: getDuplicates based on APIs Modified Paths: -------------- trunk/pywikipedia/wikipedia.py Modified: trunk/pywikipedia/wikipedia.py =================================================================== --- trunk/pywikipedia/wikipedia.py 2008-06-26 10:38:10 UTC (rev 5632) +++ trunk/pywikipedia/wikipedia.py 2008-06-26 14:26:14 UTC (rev 5633) @@ -215,6 +215,10 @@ class CaptchaError(Error): """Captcha is asked and config.solve_captcha == False.""" +class NoHash(Error): + """ The APIs don't return any Hash for the image searched. + Really Strange, better to raise an error. """ + SaxError = xml.sax._exceptions.SAXParseException # Pre-compile re expressions @@ -2627,11 +2631,44 @@ try: # We don't know the page's id, if any other better idea please change it pageid = data['query']['pages'].keys()[0] - nick = data['query']['pages'][pageid][u'imageinfo'][0]['user'] - return nick + nick = data['query']['pages'][pageid][u'imageinfo'][0][u'user'] + timestamp = data['query']['pages'][pageid][u'imageinfo'][0][u'timestamp'] + return [nick, timestamp] except IndexError: raise NoPage(u'API Error, nothing found in the APIs') + def getDuplicates(self): + params = { + 'action' :'query', + 'titles' :self.title(), + 'prop' :'imageinfo', + 'iiprop' :'sha1', + } + data = query.GetData(params, useAPI = True, encodeTitle = False) + pageid = data['query']['pages'].keys()[0] + try: + hash_found = data['query']['pages'][pageid][u'imageinfo'][0][u'sha1'] + except KeyError: + if self.exists(): + raise NoHash('No Hash found in the APIs! Maybe the regex to catch it is wrong or someone has changed the APIs structure.') + else: + wikipedia.output(u'Image deleted before getting the Hash. Skipping...') + return None + #action=query&format=xml&list=allimages&aisha1=%s + image_namespace = "%s:" % self._site.image_namespace() # Image: + params = { + 'action' :'query', + 'list' :'allimages', + 'aisha1' :hash_found, + } + data = query.GetData(params, useAPI = True, encodeTitle = False) + allimages = data['query']['allimages'] + duplicates = list() + for imagedata in allimages: + image = imagedata[u'descriptionurl'].split('/wiki/%s' % image_namespace)[1] + duplicates.append(image) + return duplicates + def getFileVersionHistoryTable(self): """Return the version history in the form of a wiki table.""" lines = []

15 years, 9 months

[ pywikipediabot-Bugs-2003148 ] LinkFA Space issue

by SourceForge.net

Bugs item #2003148, was opened at 2008-06-26 22:09 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2003148&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: other Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Woo-Jin Kim (kwj2772) Assigned to: Nobody/Anonymous (nobody) Summary: LinkFA Space issue Initial Comment: featured.py sometimes make a space between Link FA templates. diff links are: http://ko.wikipedia.org/w/index.php?title=%ED%83%9C%EC%96%91&diff=prev&oldi… http://ko.wikipedia.org/w/index.php?title=%EC%95%8C%EB%B2%A0%EB%A5%B4%ED%8A… http://ko.wikipedia.org/w/index.php?title=%EC%84%B1%EC%A0%84_%EA%B8%B0%EC%8… if you go and see [[wikipedia:ko:Special:Contributions/Kimwj.bot]], you may see many bugs. Please fix it. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2003148&group_…

15 years, 9 months

[ pywikipediabot-Bugs-2003088 ] Serious mistake in sk translation in featured.py

by SourceForge.net

Bugs item #2003088, was opened at 2008-06-26 13:26 Message generated for change (Settings changed) made by melancholie You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2003088&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None >Priority: 7 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: Serious mistake in sk translation in featured.py Initial Comment: There has been added "je najlep lnok", but "je najlep lnok" had been requested! The characters , , and are missing! See: http://sourceforge.net/tracker/index.php?func=detail&aid=1999637&group_id=9… http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/featured.py?r… ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2003088&group_…

15 years, 9 months

[ pywikipediabot-Bugs-2003088 ] Serious mistake in sk translation in featured.py

by SourceForge.net

Bugs item #2003088, was opened at 2008-06-26 13:26 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2003088&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Melancholie (melancholie) Assigned to: Nobody/Anonymous (nobody) Summary: Serious mistake in sk translation in featured.py Initial Comment: There has been added "je najlep lnok", but "je najlep lnok" had been requested! The characters , , and are missing! See: http://sourceforge.net/tracker/index.php?func=detail&aid=1999637&group_id=9… http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/featured.py?r… ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603138&aid=2003088&group_…

15 years, 9 months

SVN: [5632] trunk/pywikipedia/commonscat.py

by siebrand＠svn.wikimedia.org

Revision: 5632 Author: siebrand Date: 2008-06-26 10:38:10 +0000 (Thu, 26 Jun 2008) Log Message: ----------- Speed things up a bit, as conflic resolution was not implemented: commonscat found in interwiki: fire. Modified Paths: -------------- trunk/pywikipedia/commonscat.py Modified: trunk/pywikipedia/commonscat.py =================================================================== --- trunk/pywikipedia/commonscat.py 2008-06-26 10:32:34 UTC (rev 5631) +++ trunk/pywikipedia/commonscat.py 2008-06-26 10:38:10 UTC (rev 5632) @@ -173,6 +173,8 @@ commonscats.append(commonscatpage); wikipedia.output("Found link for " + page.title() + " at [[" + ipage.site().language() + ":" + ipage.title() + "]] to " + commonscatpage.title() + "."); commonscatpage = None + if len(commonscats) > 0: + break if len(commonscats) > 0: commonscatpage = commonscats.pop(); commonscat = commonscatpage.titleWithoutNamespace()

15 years, 9 months

← Newer
1
2
3
4
5
6
7
8
9
...
45
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

Pywikipedia-l June 2008