pywikibot

pywikibot@lists.wikimedia.org

6830 discussions

[Pywikipedia-l] [ pywikipediabot-Feature Requests-1500288 ] Have weblinkchecker.py check the Internet Archive for backup
by SourceForge.net 24 Jan '09

24 Jan '09

Feature Requests item #1500288, was opened at 2006-06-04 03:09 Message generated for change (Comment added) made by purodha You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1500288&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: Have weblinkchecker.py check the Internet Archive for backup Initial Comment: weblinkchecker.py apparently has an option to take action on finding a broken link (currently only to add something to a talk page; I haven't been able to get this to work, though). But it would be even better if it could insert, in a comment or perhaps an addendum after the broken link, a link to backups of that page in the Internet Archive/Wayback Machine. I don't think this enhancement would be backbreakingly difficult and troublesome. The script would have to prepend "http://web.archive.org/web/" to the original URL, check whether the string "Not in Archive." (or whatever the current error message is) appears in the Internet Archive page. If it does, then simply carry on with the rest of the links to be checked; if not, if the Archive *does* have something backed up, then take some boilerplate like "The preceding URL appeared to be invalid to weblinkchecker.py; however, backups of the URL can be found in the [[Internet Archive]] $HERE. You may want to consider amending the original link to point to the archived copies and not the live one.", replace $HERE with the URL prepended with the Archive bit, and insert in a comment. -maru ---------------------------------------------------------------------- >Comment By: Purodha B Blissenbach (purodha) Date: 2009-01-23 16:53 Message: The described feature has been implemented meanwhile. ---------------------------------------------------------------------- Comment By: Daniel Herding (wikipedian) Date: 2008-01-31 01:03 Message: Logged In: YES user_id=880694 Originator: NO By the way, I have already implemented Internet Archive lookup long ago. webcitation.org is not yet supported yet, though. ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2008-01-30 20:09 Message: Logged In: NO Isn't it possible to create a bot that checks when the external links works again? In this uses the category with inaccessible external links. When an external link is accessible again the bod removes the message from the talkpage, the bot marks the talkpage with the template for speedy deletion. My apologise if I'm adding this message on the wrong page. Regards, Kenny (from the Dutch Wikipedia http://nl.wikipedia.org/wiki/Gebruiker:Ken123 ) ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2007-06-24 18:42 Message: Logged In: NO In the same vein, it would be good if WebCite <http://www.webcitation.org/> archived pages were included as well. There's apparently some nice programmatic ways of looking for archived URLs according to <http://www.webcitation.org/doc/WebCiteBestPracticesGuide.pdf>. While I'm writing, it'd also be good if the bot would proactively archive pages when they disappear and come back. Variable uptime to me bespeaks a page that is likely to disappear permanently. It isn't hard either - it's just "www.webcitation.org/archive?url=" ++ url ++ "&email=foo(a)bar.com" ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2007-06-24 18:33 Message: Logged In: NO In the same vein, it would be good if WebCite <http://www.webcitation.org/> archived pages were included as well. There's apparently some nice programmatic ways of looking for archived URLs according to <http://www.webcitation.org/doc/WebCiteBestPracticesGuide.pdf>. While I'm writing, it'd also be good if the bot would proactively archive pages when they disappear and come back. Variable uptime to me bespeaks a page that is likely to disappear permanently. It isn't hard either - it's just "www.webcitation.org/archive?url=" ++ url ++ "&email=foo(a)bar.com" ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=1500288&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Feature Requests-2284955 ] interwiki hints from file
by SourceForge.net 24 Jan '09

24 Jan '09

Feature Requests item #2284955, was opened at 2008-11-14 16:45 Message generated for change (Comment added) made by purodha You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2284955&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki hints from file Initial Comment: It would be helpful if interwiki.py could read hints not only from console but also from a file, one per line, e.g. like this: # [[:xx:page_without_interwiki]] [[:en:English_page_used_as_a_hint]] please add this option. thanks ---------------------------------------------------------------------- Comment By: Purodha B Blissenbach (purodha) Date: 2009-01-23 16:35 Message: This artifact has been marked as a duplicate of artifact 2528275 with reason: No explanation provided. ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2008-11-14 17:12 Message: I think the best syntax for this option would be: interwiki.py -hint:file:[hints_file.txt] if no filename is specified after "file", ask for it from console. it would make this option consistent with other existing hint options like number of languages, "all" or "latin". ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2284955&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Feature Requests-2326967 ] interwiki.py -wiktionary
by SourceForge.net 24 Jan '09

24 Jan '09

Feature Requests item #2326967, was opened at 2008-11-22 13:48 Message generated for change (Comment added) made by purodha You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2326967&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: interwiki Group: None Status: Open Priority: 5 Private: No Submitted By: Woo-Jin Kim (kwj2772) Assigned to: Nobody/Anonymous (nobody) Summary: interwiki.py -wiktionary Initial Comment: interwiki.py -wiktionary take too much time to process. Currently, interwiki bot retreives 60 en article, next 60 fr article. (language code is just an example) I suggest for bot to retreive all wiki entries with same name at the same time to reduce time to retreive. Thank you. ---------------------------------------------------------------------- >Comment By: Purodha B Blissenbach (purodha) Date: 2009-01-23 16:31 Message: I am pretty confident that, the current way of retrieval is usually much faster, because it is using the [[Special:Export]] special page so as to retrieve those up to 60 (unless -array is used) pages at once, in a single http request. Pages of different language wikis are retrieved from URLs having different domains, thus there is no way known to me to have them bundeld into a single http request. Thus they would approximately take (up to) 60 times as long. A http request consumes almost the same clock time, while increasing its length only marginally adds to its duration. Thus I suggest closing this suggestion as "wontfix". I leave it open though so as to give others an opportunity to possibly disagree with me :-) ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2326967&group_…

1 0

[Pywikipedia-l] [ pywikipediabot-Feature Requests-2528275 ] wikipedia.py / global bot flag
by SourceForge.net 24 Jan '09

24 Jan '09

Feature Requests item #2528275, was opened at 2009-01-22 10:46 Message generated for change (Comment added) made by purodha You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2528275&group_… Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. >Category: interwiki Group: None >Status: Closed Priority: 5 Private: No Submitted By: Nobody/Anonymous (nobody) >Assigned to: Purodha B Blissenbach (purodha) Summary: wikipedia.py / global bot flag Initial Comment: The bot flag warning if _getUserData should be suppressed if the bot has a global bot flag. ---------------------------------------------------------------------- >Comment By: Purodha B Blissenbach (purodha) Date: 2009-01-23 16:19 Message: Solved with release 6291. See: http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/interwiki.py?… Please make the bot flag request for GhalyBot at: http://meta.wikimedia.org/wiki/Steward_requests/Bot_status#Global_bot_reque… ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2009-01-22 12:20 Message: I would like to apply for a global bot flag for GhalyBot ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=603141&aid=2528275&group_…

1 0

[Pywikipedia-l] SVN: [6291] trunk/pywikipedia/interwiki.py
by purodha＠svn.wikimedia.org 24 Jan '09

24 Jan '09

Revision: 6291 Author: purodha Date: 2009-01-23 16:08:14 +0000 (Fri, 23 Jan 2009) Log Message: ----------- Typing error. Modified Paths: -------------- trunk/pywikipedia/interwiki.py Modified: trunk/pywikipedia/interwiki.py =================================================================== --- trunk/pywikipedia/interwiki.py 2009-01-23 16:06:51 UTC (rev 6290) +++ trunk/pywikipedia/interwiki.py 2009-01-23 16:08:14 UTC (rev 6291) @@ -1617,7 +1617,7 @@ hints.append(arg[6:]) elif arg.startswith('-hintfile:'): hintfilename = arg[10:] - if (hintfilename is None) or (hintfilenname == ''): + if (hintfilename is None) or (hintfilename == ''): hintfilename = wikipedia.input(u'Please enter the hint filename:') f = codecs.open(hintfilename, 'r', config.textfile_encoding) R = re.compile(ur'\[\[(.+?)(?:\]\]|\|)') # hint or title ends either before | or before ]]

1 0

[Pywikipedia-l] SVN: [6290] trunk/pywikipedia/interwiki.py
by purodha＠svn.wikimedia.org 24 Jan '09

24 Jan '09

Revision: 6290 Author: purodha Date: 2009-01-23 16:06:51 +0000 (Fri, 23 Jan 2009) Log Message: ----------- Forgotten case added. Modified Paths: -------------- trunk/pywikipedia/interwiki.py Modified: trunk/pywikipedia/interwiki.py =================================================================== --- trunk/pywikipedia/interwiki.py 2009-01-23 16:03:32 UTC (rev 6289) +++ trunk/pywikipedia/interwiki.py 2009-01-23 16:06:51 UTC (rev 6290) @@ -1617,7 +1617,7 @@ hints.append(arg[6:]) elif arg.startswith('-hintfile:'): hintfilename = arg[10:] - if hintfilename is None: + if (hintfilename is None) or (hintfilenname == ''): hintfilename = wikipedia.input(u'Please enter the hint filename:') f = codecs.open(hintfilename, 'r', config.textfile_encoding) R = re.compile(ur'\[\[(.+?)(?:\]\]|\|)') # hint or title ends either before | or before ]]

1 0

[Pywikipedia-l] SVN: [6289] trunk/pywikipedia/interwiki.py
by purodha＠svn.wikimedia.org 24 Jan '09

24 Jan '09

Revision: 6289 Author: purodha Date: 2009-01-23 16:03:32 +0000 (Fri, 23 Jan 2009) Log Message: ----------- Typing error. Modified Paths: -------------- trunk/pywikipedia/interwiki.py Modified: trunk/pywikipedia/interwiki.py =================================================================== --- trunk/pywikipedia/interwiki.py 2009-01-23 16:00:52 UTC (rev 6288) +++ trunk/pywikipedia/interwiki.py 2009-01-23 16:03:32 UTC (rev 6289) @@ -1616,10 +1616,10 @@ elif arg.startswith('-hint:'): hints.append(arg[6:]) elif arg.startswith('-hintfile:'): - hintfile = arg[10:] - if filename is None: - filename = wikipedia.input(u'Please enter the hint filename:') - f = codecs.open(filename, 'r', config.textfile_encoding) + hintfilename = arg[10:] + if hintfilename is None: + hintfilename = wikipedia.input(u'Please enter the hint filename:') + f = codecs.open(hintfilename, 'r', config.textfile_encoding) R = re.compile(ur'\[\[(.+?)(?:\]\]|\|)') # hint or title ends either before | or before ]] for pageTitle in R.findall(f.read()): hints.append(pageTitle)

1 0

[Pywikipedia-l] SVN: [6288] trunk/pywikipedia/interwiki.py
by purodha＠svn.wikimedia.org 24 Jan '09

24 Jan '09

Revision: 6288 Author: purodha Date: 2009-01-23 16:00:52 +0000 (Fri, 23 Jan 2009) Log Message: ----------- Cannot use page generator for hintfile. Modified Paths: -------------- trunk/pywikipedia/interwiki.py Modified: trunk/pywikipedia/interwiki.py =================================================================== --- trunk/pywikipedia/interwiki.py 2009-01-23 14:58:03 UTC (rev 6287) +++ trunk/pywikipedia/interwiki.py 2009-01-23 16:00:52 UTC (rev 6288) @@ -1617,10 +1617,13 @@ hints.append(arg[6:]) elif arg.startswith('-hintfile:'): hintfile = arg[10:] - hintPageGen = pagegenerators.TextfilePageGenerator(hintfile) - for page in hintPageGen: - hints.append(page.title()) - del hintPageGen + if filename is None: + filename = wikipedia.input(u'Please enter the hint filename:') + f = codecs.open(filename, 'r', config.textfile_encoding) + R = re.compile(ur'\[\[(.+?)(?:\]\]|\|)') # hint or title ends either before | or before ]] + for pageTitle in R.findall(f.read()): + hints.append(pageTitle) + f.close() elif arg == '-force': globalvar.force = True elif arg == '-same':

1 0

[Pywikipedia-l] Translations to catalan and error
by David Virgili 23 Jan '09

23 Jan '09

Good morning everyone, I would like to add the translations to catalan & solve errors in pywikipedia. I tried updating via SVN, but I guess I need permission for that ;) There is an ERROR in featured.py. Catalan featured articles are located in: << 'ca': (CAT, u"Llista d'articles de qualitat"), << There are several TRANSLATIONS which need to be implemented: In featured.py << 'ca': u'Bot: [[%s:%s]] és un article de qualitat', 'en': u'Bot: [[%s:%s]] is a featured article', << In category.py << 'ca':u'Bot:Afegint [[Categoria:%s]]', 'en':u'Robot: Adding [[Category:%s]]', 'ca':u'Bot:Canviant %s', 'en':u'Robot: Changing %s', 'ca':u'Bot:La categoria ha estat moguda a [[:Categoria:%s|%s]]', 'en':u'Robot: Category was moved to [[:Category:%s|%s]]', 'ca':u'Bot: Fent un llistat de %s (%d entrades)', 'en':u'Robot: Listifying from %s (%d entries)', 'ca':u'Bot:La categoria ha estat eliminada', 'en':u'Robot: Category was disbanded', 'ca':u'Bot:Eliminant de %s', 'en':u'Robot: Removing from %s', 'ca': u'(també a %s)', 'en': u'(also in %s)', << In replace.py << 'ca':u'Bot: Reemplaçament automàtic de text %s', 'en':u'Robot: Automated text replacement %s', << Please let me know if I can help in anything else. Thank you, Meldor

1 0

[Pywikipedia-l] SVN: [6287] branches/rewrite/pywikibot/data/api.py
by russblau＠svn.wikimedia.org 23 Jan '09

23 Jan '09

Revision: 6287 Author: russblau Date: 2009-01-23 14:58:03 +0000 (Fri, 23 Jan 2009) Log Message: ----------- fix query-continue handling Modified Paths: -------------- branches/rewrite/pywikibot/data/api.py Modified: branches/rewrite/pywikibot/data/api.py =================================================================== --- branches/rewrite/pywikibot/data/api.py 2009-01-23 14:34:27 UTC (rev 6286) +++ branches/rewrite/pywikibot/data/api.py 2009-01-23 14:58:03 UTC (rev 6287) @@ -407,8 +407,11 @@ if not "query-continue" in self.data: return if not self.continuekey in self.data["query-continue"]: - raise Error("Missing '%s' key in ['query-continue'] value." - % self.continuekey) + pywikibot.output( + u"Missing '%s' key in ['query-continue'] value." + % self.continuekey, + level=pywikibot.VERBOSE) + return update = self.data["query-continue"][self.continuekey] for key, value in update.iteritems(): # query-continue can return ints

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot