pywikibot

pywikibot@lists.wikimedia.org

3 participants
6830 discussions

Re: [Pywikipedia-l] svn migration
by info＠gno.de 27 Dec '12

27 Dec '12

Some remarks from me. Sorry I am not quite familar with git/gerrit vcs as well as svn. I just use these things as long they work for me. I use tortoiseSVN for the svn repository and I played a bit with tortoiseGit and mw repository samples. I guess the only thing I need for git repository is push access via labs. I hope so. I think for bot operators it is quite similar to checkout the git or svn repository or at least use the nightly dump. I agree with Martin to move closer to mw and not to spread over different sites. This is also valid for documentation which is still messy. But bugzilla seems not to be an alternative for sf yet. So we should not move outside the mw family only und just to keep svn. If we could have github as a mirror und the main repository at mw, why not. But I cannot estimate whether this has any benefits. Regards xqt

1 0

[Pywikipedia-l] Iteration support in pywiki
by Yuri Astrakhan 16 Dec '12

16 Dec '12

Hi, I just made a proposal on how to change API to better support simple "continue" scenarious -- see http://lists.wikimedia.org/pipermail/mediawiki-api/2012-December/002768.html , and would like to get some feedback from pywiki community. Would this simplify internal API use inside pywiki? What are the biggest issues with scripts when using API? On the pywiki side, I am thinking of reworking query module in this direction, and help with migrating all API requests through it. There could always be two levels for the script authors - low level, where individual API parameters are known to the script writer and the result is returned as a dict(), and high level - with most common features offered by API are wrapped in methods, yet the speed is almost the same as low level (multiple data items returned per web request). pg1 = Page(u'Python') pg2 = Page(u'Cobra') pg3 = Page(u'Viper') pages = [pg1, pg2, pg3] params = {'prop': 'links', 'pllimit' : 'max', 'titles': pages} # QueryBlocks -- run query until there is no more "continue", return the dictionary as-is from each web call. for block in pywiki.QueryBlocks(params): # Process block # QueryPages -- will take any query that returns a list of pages, and yield one page at a time. The individual page data will be merged accross multiple API calls in case it exceeds the limit. This method could also return pre-populated Page objects. for page in pywiki.QueryPages(params): # process one page at a time # Page object will have its links() property populated # List* methods work with list= API to request all available items based on the parameters: for page in pywiki.ListAllPages(from=u'T', getContent=True, getLinks=True): # each page object will be prepopulated with links and page content Thanks! Any feedback is helpful =) --Yuri

2 2

[Pywikipedia-l] How to revert multiple articles?
by Jan Dudík 14 Dec '12

14 Dec '12

I was changing about 150 articles with replace.py, but there is now bad value in infobox. Some of these articles were modified after it. I want to revert them to the last version before my bots edit, but revertbot.py cannot work with file. How to do it with pywikipedia bot? JAnD

3 2

[Pywikipedia-l] Commit access
by Edinwiki 01 Dec '12

01 Dec '12

Hi all, I would like to request commit access. Currently I'm an administrator on the Bosnian Wikipedia (Edinwiki) and heavily working with pywikipediabot. During my work with pywikipediabot I localized a bunch of messages (i18n) for personal use which I would like to commit to the SVN repository. Furthermore, I noticed a few bugs in multiple scripts of which commonscat.py is one. There are a few pages on which the script (commonscat.py) breaks (i.e. http://bs.wikipedia.org/wiki/Colt_M1911) . Besides these bugs there are some conventions on the Bosnian Wikipedia that we would also like to see implemented in the fixes.py script. For example, the naming of reference sections which is not always done consistently by the users. These are the major things that I could work on. However, there are also other both minor and major changes that I would like to suggest, which I could communicate through the mailing list on a later moment. Needless to say I hope, but I'm familiar with Python. If you need more information or if there are additional requirements then let me know. Kind regards, Edin

2 3

[Pywikipedia-l] Amsterdam Hackathon 2013
by Maarten Dammers 01 Dec '12

01 Dec '12

Hi everyone, Unlike previous years the big European Hackathon won't be in Berlin, but in Amsterdam. We're aiming to do the hackathon in May 2013 with a preference for the weekend of Saturday the 25th. To make sure this is a good weekend I've set up a straw poll at https://www.mediawiki.org/wiki/Amsterdam_Hackathon_2013#Straw_Poll . Please fill it out so we can finalize the date! Thank you, Maarten Wikimedia Nederland Ps. Please forward to any relevant lists I might have missed.

1 0

[Pywikipedia-l] Category.members() not exposing all API options
by Morten Wang 29 Nov '12

29 Nov '12

I noticed that the Category class has a members() method that calls site.categorymembers() but doesn't expose all the options of the latter (e.g. sorting by timestamp). Thought I could see if I could spend a bit of time to write a patch that'll do just that, but maybe there's a reason why I shouldn't? Feel free to let me know. Cheers, Morten

1 0

[Pywikipedia-l] NotImplementedError in replace
by Bináris 29 Nov '12

29 Nov '12

Hi folks, my command was: replace.py -search:korai -regex "(?i)korai éve[ki]" ifjúkorain huwiki. It got 60 pages three times, but during the 3rd package it stopped with Traceback (most recent call last): File "C:\Pywikipedia\pagegenerators.py", line 1211, in __iter__ for page in self.wrapped_gen: File "C:\Pywikipedia\pagegenerators.py", line 1088, in DuplicateFilterPageGenerator for page in generator: File "C:\Pywikipedia\pagegenerators.py", line 808, in SearchPageGenerator for page in site.search(query, number=number, namespaces = namespaces): File "C:\Pywikipedia\wikipedia.py", line 6524, in search raise NotImplementedError('%s' % data['error']['info']) NotImplementedError: text search is disabled text search is disabled Why did this happen to me? :-( -- Bináris

2 1

[Pywikipedia-l] Request to join in Pywikipediabot project
by Jenith 24 Nov '12

24 Nov '12

Hi, I would like to join in Python Wikipedia Robot Framework project in Sourceforge. Some of my contribution: https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3509841&group_… . Currently I have been doing Picasa batch upload automated script. I kindly request to add me in this project Regards, Jenith

2 6

[Pywikipedia-l] Problem saving long pages, restricted to rewrite branch?
by Morten Wang 13 Nov '12

13 Nov '12

Hi all, I noticed that SuggestBot's struggled with saving a user page earlier this week, see http://en.wikipedia.org/w/index.php?title=User_talk:The_Master_of_Mayhem&ac… Notice the larger number of saves that have a diff size of 0 bytes. I suspect it's due to the size of the page, 300+kB, is this a typical problem? If not I can start digging to see if I can figure out what's going on. If it is a common problem, what are some typical ways of solving it? Just checking the page size and skip/abort if it's too large? Regards, Morten

3 7

Re: [Pywikipedia-l] [wikiteam-discuss:608] [WARNING] Don't use dumpgenerator.py with API
by Hydriz Wikipedia 09 Nov '12

09 Nov '12

Scott, Nemo is referring to the dumpgenerator.py being broken on MediaWiki versions above 1.20, and it should not actually affect older MediaWiki versions. You can safely continue with your grab. :) On Sat, Nov 10, 2012 at 12:45 PM, Scott Boyd <scottdb56(a)gmail.com> wrote: > At this link: https://code.google.com/p/wikiteam/issues/detail?id=56 , at > the bottom, there is an entry by project member nemowiki that states: > > Comment 7 <https://code.google.com/p/wikiteam/issues/detail?id=56#c7>by project member > nemowiki <https://code.google.com/u/101255742639286016490/>, Today (9 > hours ago) > > Fixed by emijrp in r806 <https://code.google.com/p/wikiteam/source/detail?r=806>. :-) > > *Status:* Fixed > > So does that mean this problem that "It's completely broken" is now fixed? > I'm running a huge download of 64K+ page titles, and am now using the > "r806" version of dumpgenerator.py. The first 35K+ page titles were > downloaded with an older version). Both versions sure seem to be > downloading MORE than 500 pages per namespace, but I'm not sure, since I > don't know how you can tell if you are getting them all... > > So is it fixed or not? > > > On Fri, Nov 9, 2012 at 4:27 AM, Federico Leva (Nemo) <nemowiki(a)gmail.com>wrote: > >> It's completely broken: https://code.google.com/p/** >> wikiteam/issues/detail?id=56<https://code.google.com/p/wikiteam/issues/detail?id=56> >> It will download only a fraction of the wiki, 500 pages at most per >> namespace. >> >> >> > > -- Regards, Hydriz We've created the greatest collection of shared knowledge in history. Help protect Wikipedia. Donate now: http://donate.wikimedia.org

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot