The following bots have now been ported to the rewrite framework:
category.py editarticle.py replace.py solve_disambiguation.py touch.py
These scripts need testing! Please report any bugs on the sourceforge.net tracker, using the "Rewrite" category. [One known issue: "category.py move" won't work without the -inplace option.]
You can get the rewrite branch with your favorite SVN client:
svn checkout svn+ssh://[yournamehere]@svn.wikimedia.org/svnroot/pywikipedia/branches/rewrite
You will need to make a copy of your existing user-config.py file and store it in a new location. For Windows, this is "C:\Documents and Settings[yournamehere]\Application Data\pywikibot" -- for Unix-like systems, it is "~/.pywikibot" (if you want to put it somewhere else, you can set the environment variable PYWIKIBOT2_DIR to the name of the directory containing your user-config.py, but I don't recommend trying to use the same directory you keep your existing pywikipedia files in).
The bots themselves can be found in the pywikibot/scripts subdirectory under the directory to which you checked out the framework. However, if you add this directory to your PYTHONPATH, you should be able to run the scripts from any directory.
For those who aren't aware, the rewrite branch is a new pywikipedia framework that is designed to be (mostly) backwards-compatible with existing scripts, but which uses the MediaWiki API (instead of screen-scraping) for all access to wiki contents and metadata. The idea is to obsolete the existing framework and replace it with this branch as soon as testing is complete and all major bots have been ported.
Oh, and by the way, patches and other contributions besides bug reports are also welcome!
Russ
On Thu, Feb 5, 2009 at 11:17 PM, Russell Blau russblau@imapmail.org wrote:
The following bots have now been ported to the rewrite framework:
Great work! Using the MediaWiki API instead of screen scraping will be a benefit for bot writers, MediaWiki sysadmins and end users!
Bryan
Let's spend some time using this brand new framework. We have no excuses now that replace.py has been ported =)
I'm currently making "as if" I never installed nor used the branch.
I'm trying to set up everything on a clean ubuntu box, to try to run the yu-tld fix.
-----
# One thing which has to be mentioned is that you have to include the path where you have checked out the branch in your PYTHONPATH so python can find the pywikibot module (makes sense, but it's not usual, for the devs/users of the old framework).
Aka, if you check-out svn checkout svn+ssh://[yournamehere]@svn.wikimedia.org/svnroot/pywikipedia/branches/rewrite api-rewrite you have to include the "api-rewrite" directory in your pythonpath.
For reference, my .bashrc line looks like : export PYTHONPATH=$PYTHONPATH:/home/nicdumz/opensource/api-rewrite/pywikibot/scripts:/home/nicdumz/opensource/api-rewrite
-----
# I think that you might want to clarify that .pywikibot is supposed to be a directory: here, I first created a .pywikibot FILE containing all the info. .pywikibot/ is a directory, containing a user-config.py file
-----
# I was about to rant about the non-easy installation of dependencies (aka moving rewrite/simplejson/simplejson to rewrite/simplejson in SVN would directly include the module in python path, no install needed...) but I forgot that we're writing a full package here that will check for dependencies. So for now, manual install of dependencies, okay.
-----
# I don't understand the strange behavior that is happening when directly running python from the pywikibot module directory : ~/opensource/api-rewrite/pywikibot$ python pagegenerators.py -weblink:*.yu 'import site' failed; use -v for traceback No handlers could be found for logger "wiki.config2" Traceback (most recent call last): File "pagegenerators.py", line 21, in <module> import pywikibot File "/home/nicdumz/opensource/api-rewrite/pywikibot/__init__.py", line 102, in <module> from page import Page, ImagePage, Category, Link File "/home/nicdumz/opensource/api-rewrite/pywikibot/page.py", line 15, in <module> import pywikibot.site File "/home/nicdumz/opensource/api-rewrite/pywikibot/site.py", line 17, in <module> from pywikibot.data import api File "/home/nicdumz/opensource/api-rewrite/pywikibot/data/api.py", line 14, in <module> import simplejson as json ImportError: No module named simplejson
~/opensource/api-rewrite/pywikibot$ easy_install simplejson 'import site' failed; use -v for traceback Traceback (most recent call last): File "/usr/bin/easy_install", line 5, in <module> from pkg_resources import load_entry_point ImportError: No module named pkg_resources
it seems that any python application running in the directory fails to do imports properly.... any idea ?
-----
# After a few fixes (yeehee), I ran into troubles that I wasn't able to fix by myself. Two new "rewrite" bugs, yay !
Thanks Russell =)
2009/2/6 Russell Blau russblau@imapmail.org:
The following bots have now been ported to the rewrite framework:
category.py editarticle.py replace.py solve_disambiguation.py touch.py
These scripts need testing! Please report any bugs on the sourceforge.net tracker, using the "Rewrite" category. [One known issue: "category.py move" won't work without the -inplace option.]
You can get the rewrite branch with your favorite SVN client:
svn checkout svn+ssh://[yournamehere]@svn.wikimedia.org/svnroot/pywikipedia/branches/rewrite
You will need to make a copy of your existing user-config.py file and store it in a new location. For Windows, this is "C:\Documents and Settings[yournamehere]\Application Data\pywikibot" -- for Unix-like systems, it is "~/.pywikibot" (if you want to put it somewhere else, you can set the environment variable PYWIKIBOT2_DIR to the name of the directory containing your user-config.py, but I don't recommend trying to use the same directory you keep your existing pywikipedia files in).
The bots themselves can be found in the pywikibot/scripts subdirectory under the directory to which you checked out the framework. However, if you add this directory to your PYTHONPATH, you should be able to run the scripts from any directory.
For those who aren't aware, the rewrite branch is a new pywikipedia framework that is designed to be (mostly) backwards-compatible with existing scripts, but which uses the MediaWiki API (instead of screen-scraping) for all access to wiki contents and metadata. The idea is to obsolete the existing framework and replace it with this branch as soon as testing is complete and all major bots have been ported.
Oh, and by the way, patches and other contributions besides bug reports are also welcome!
Russ
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
pywikipedia-l@lists.wikimedia.org