Patches item #3509885, was opened at 2012-03-21 15:32
Message generated for change (Tracker Item Submitted) made by aronsson
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3509885&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Lars Aronsson (aronsson)
Assigned to: Nobody/Anonymous (nobody)
Summary: djvutext.py fails to retrieve namespace names (Index, Page)
Initial Comment:
To get the names of the namespaces (Index and Page), the source code of djvutext.py uses two different methods, both wrong.
This fails on sv.wikisource and ru.wikisource, making djvutext.py useless.
At line 230, the index namespace is retrieved with Page(...).get() which fails if the page in MediaWiki: namespace doesn't exist.
At line 123, the page namespace is retrieved with [104], assuming the namespace has this number, which it doesn't always have.
The solution is to use site.mediawiki_message(...) instead, as this patch does.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3509885&group_…
Patches item #3502676, was opened at 2012-03-12 07:40
Message generated for change (Comment added) made by valhallasw
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3502676&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
>Status: Closed
>Resolution: Accepted
Priority: 5
Private: No
Submitted By: Lars Aronsson (aronsson)
Assigned to: Nobody/Anonymous (nobody)
Summary: New option "-no" to djvutext.py
Initial Comment:
djvutext.py adds OCR text to books in Wikisource. Some books already have text for some pages, but not for others. The "-no" flag added by this patch only adds new pages, but doesn't alter the text for any existing pages. (At any such question, it answers "no" automatically.)
----------------------------------------------------------------------
>Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 14:31
Message:
Committed in r10036 [ http://toolserver.org/~pywikipedia/r10036 ]. Thanks!
----------------------------------------------------------------------
Comment By: Lars Aronsson (aronsson)
Date: 2012-03-21 13:11
Message:
A better patch (patch-djvutext-overwrite.py) has been uploaded now.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 11:07
Message:
Last housekeeper's note: this patch applies cleanly to r10035 (duh. it's
the same djvutext.py)
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 10:44
Message:
For reference: I had a discussion on this patch with Lars on IRC and
mentioned some improvements (naming/parameter). He's working on a new patch
version.
Again, thanks for the effort, Lars! :-)
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3502676&group_…
Patches item #3502676, was opened at 2012-03-12 07:40
Message generated for change (Comment added) made by aronsson
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3502676&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Lars Aronsson (aronsson)
Assigned to: Nobody/Anonymous (nobody)
Summary: New option "-no" to djvutext.py
Initial Comment:
djvutext.py adds OCR text to books in Wikisource. Some books already have text for some pages, but not for others. The "-no" flag added by this patch only adds new pages, but doesn't alter the text for any existing pages. (At any such question, it answers "no" automatically.)
----------------------------------------------------------------------
>Comment By: Lars Aronsson (aronsson)
Date: 2012-03-21 13:11
Message:
A better patch (patch-djvutext-overwrite.py) has been uploaded now.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 11:07
Message:
Last housekeeper's note: this patch applies cleanly to r10035 (duh. it's
the same djvutext.py)
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 10:44
Message:
For reference: I had a discussion on this patch with Lars on IRC and
mentioned some improvements (naming/parameter). He's working on a new patch
version.
Again, thanks for the effort, Lars! :-)
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3502676&group_…
Feature Requests item #3176247, was opened at 2011-02-08 23:24
Message generated for change (Comment added) made by valhallasw
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=3176247&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
>Priority: 2
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
Summary: enable/disable cosmetic_changes per namespace
Initial Comment:
Cosmetic changes are helpful for most documents, but dangerous for some namespaces, esp. Template namespace.
It would be helpful if:
cosmetic_changes_disable_namespace = {'Template'}
or something.
----------------------------------------------------------------------
>Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 12:52
Message:
Is there a problem with just using the -namespace parameter when running
the bot? Then you explicitly allow certain namespaces.
-namespace Filter the page generator to only yield pages in the
-ns specified namespaces. Separate multiple namespace
numbers
with commas. Example: -ns:"0,2,4" (Take care of
quotation
marks as comma may qualify as command line separator.)
Will ask for namespaces if you write just -namespace or
-ns.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=3176247&group_…
Feature Requests item #3440654, was opened at 2011-11-21 01:21
Message generated for change (Comment added) made by valhallasw
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=3440654&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
>Priority: 3
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
>Summary: Pagegenerators Filter: skip page on specific last user
Initial Comment:
please add -lastUserExeption to PageGenarator.py .this argument will useful to have list of pages that specific user didn't have last revision on them
----------------------------------------------------------------------
>Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 12:50
Message:
Note that to get the list, a database query is more appropriate.
A filter to filter on the last user (and user class, etc) should be added
as pagegenerator, but I'm not sure how to implement it from the command
line.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=3440654&group_…
Feature Requests item #3441423, was opened at 2011-11-23 03:06
Message generated for change (Comment added) made by valhallasw
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=3441423&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: interwiki
Group: None
>Status: Closed
Priority: 5
Private: No
Submitted By: Nobody/Anonymous (nobody)
Assigned to: Nobody/Anonymous (nobody)
Summary: Very difficult pages
Initial Comment:
In some sport articles there is used many flagicons, inserted templates etc. Bot have problems with editing those pages and freeze for half a hour for each.
Is there any way for quicker skipping this pages?
======Post-processing [[cs:Sportovní aktuality červenec 2011]]======
Updating links on page [[cs:Sportovní aktuality červenec 2011]].
Changes to be made: Robot: Adding [[en:July 2011 in sports]]
+
+ [[en:July 2011 in sports]]
NOTE: Updating live wiki...
Updating page [[Sportovní aktuality červenec 2011]] via API
Updating links on page [[en:July 2011 in sports]].
Changes to be made: Robot: Adding [[cs:Sportovní aktuality červenec 2011]]
+
+ [[cs:Sportovní aktuality červenec 2011]]
NOTE: Updating live wiki...
Updating page [[en:July 2011 in sports]] via API
HTTPError: 504 Gateway Time-out
WARNING: Could not open 'http://en.wikipedia.org/w/api.php'.
Maybe the server is down. Retrying in 1 minutes...
HTTPError: 504 Gateway Time-out
WARNING: Could not open 'http://en.wikipedia.org/w/api.php'.
Maybe the server is down. Retrying in 2 minutes...
HTTPError: 504 Gateway Time-out
WARNING: Could not open 'http://en.wikipedia.org/w/api.php'.
Maybe the server is down. Retrying in 4 minutes...
HTTPError: 504 Gateway Time-out
WARNING: Could not open 'http://en.wikipedia.org/w/api.php'.
Maybe the server is down. Retrying in 8 minutes...
HTTPError: 504 Gateway Time-out
WARNING: Could not open 'http://en.wikipedia.org/w/api.php'.
Maybe the server is down. Retrying in 16 minutes...
HTTPError: 504 Gateway Time-out
ERROR putting page: ()
WARNING: wikipedia: [[en:July 2011 in sports]] does not link to [[cs:Sportovní a
ktuality červenec 2011]]
----------------------------------------------------------------------
>Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 12:41
Message:
Closing this because of lack of response (and I'm not sure if this actually
is a pwb problem...)
----------------------------------------------------------------------
Comment By: xqt (xqt)
Date: 2012-02-20 04:12
Message:
You may set the maxretries for the number of retries before giving up when
putting a page, e.g. set it to 1:
# Number of retries before giving up when putting a page
maxretries = 1
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603141&aid=3441423&group_…
Support Requests item #3436146, was opened at 2011-11-10 08:00
Message generated for change (Comment added) made by valhallasw
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603139&aid=3436146&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Priority: 5
Private: No
Submitted By: solab (solab)
Assigned to: Nobody/Anonymous (nobody)
Summary: Compatibilit pywikipedia and mw 1.18.0beta1
Initial Comment:
I upgraded MW to 1.18.0.beta1.
the get.py is now broken..
Question
is pywikipedia compatible with mw 1.18.0beta1?
Regards
G
----------------------------------------------------------------------
>Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 12:32
Message:
If I understand correctly, this is no longer a problem?
----------------------------------------------------------------------
Comment By: solab (solab)
Date: 2011-11-11 02:54
Message:
Double check non Problem with mediawiki 1.17
python get.py -family:solab Xx -v
Config.py
- base_dir: /opt/tools/mybot/pywikipedia
- done.
Pywikipediabot [http] trunk/pywikipedia (r9753, 2011/11/11, 10:12:19)
Python 2.7.2+ (default, Oct 4 2011, 20:06:09)
[GCC 4.6.1]
######
Sleeping for 1.0 seconds, 2011-11-11 11:53:12
==== API action:query ====
inprop: protection|subjectid
rvprop: content|ids|flags|timestamp|user|comment|size
prop: revisions|info
titles: Xx
rvlimit: 1
----------------
Requesting API query from solab:en
getting huge siprop magicwords...
==== API action:query ====
meta: siteinfo
siprop: magicwords
----------------
Requesting API query from solab:en
Test
----------------------------------------------------------------------
Comment By: solab (solab)
Date: 2011-11-11 02:49
Message:
python get.py -family:solab Xx -v
Config.py
- base_dir: /opt/tools/mybot/pywikipedia
- done.
Pywikipediabot [http] trunk/pywikipedia (r9753, 2011/11/11, 10:12:19)
Python 2.7.2+ (default, Oct 4 2011, 20:06:09)
[GCC 4.6.1]
######
Sleeping for 1.0 seconds, 2011-11-11 11:45:28
==== API action:query ====
inprop: protection|subjectid
rvprop: content|ids|flags|timestamp|user|comment|size
prop: revisions|info
titles: Xx
rvlimit: 1
----------------
Requesting API query from solab:en
{u'lastrevid': 8645, u'pageid': 1831, u'title': u'Xx', u'counter': 0,
u'length': 4, u'protection': [], u'touched': u'2011-11-10T17:58:41Z',
u'new': u'', u'ns': 0}
Traceback (most recent call last):
File "get.py", line 33, in <module>
main()
File "get.py", line 29, in main
pywikibot.output(page.get(), toStdout = True)
File "/opt/tools/mybot/pywikipedia/wikipedia.py", line 694, in get
expandtemplates = expandtemplates)
File "/opt/tools/mybot/pywikipedia/wikipedia.py", line 788, in
_getEditPage
raise ServerError('ServerError: No textarea found in %s' % self)
pywikibot.exceptions.ServerError: ServerError: No textarea found in
[[en:Xx]]
&
File uploaded
----------------------------------------------------------------------
Comment By: xqt (xqt)
Date: 2011-11-11 02:41
Message:
You must checkout the new pywikibot release from svn first to use the
-verbose option. Could you also upload the new family file.
----------------------------------------------------------------------
Comment By: solab (solab)
Date: 2011-11-11 02:33
Message:
==STEP1==
python generate_family_file.py http://localhost/solab solab
Generating family file from http://localhost/solab
==================================
api url: http://localhost/solab/api.php
MediaWiki version: 1.18.0beta1
==================================
Determining other languages...
Loading wikis...
* en... in cache
Retrieving namespaces... en
Writing families/solab_family.py...
families/solab_family.py already exists. Overwrite? (y/n)y
==STEP 2==
python get.py -family:solab Xx -v
Config.py
- base_dir: /opt/tools/mybot/pywikipedia
- done.
Pywikipediabot [http] trunk/pywikipedia (r9739, 2011/11/10, 07:39:48)
Python 2.7.2+ (default, Oct 4 2011, 20:06:09)
[GCC 4.6.1]
Sleeping for 1.0 seconds, 2011-11-11 11:30:20
==== API action:query ====
inprop: protection|subjectid
rvprop: content|ids|flags|timestamp|user|comment|size
prop: revisions|info
titles: Xx
rvlimit: 1
----------------
Requesting API query from solab:en
Traceback (most recent call last):
File "get.py", line 33, in <module>
main()
File "get.py", line 29, in main
pywikibot.output(page.get(), toStdout = True)
File "/opt/tools/mybot/pywikipedia/wikipedia.py", line 694, in get
expandtemplates = expandtemplates)
File "/opt/tools/mybot/pywikipedia/wikipedia.py", line 786, in
_getEditPage
raise ServerError('ServerError: No textarea found in %s' % self)
pywikibot.exceptions.ServerError: ServerError: No textarea found in
[[en:Xx]]
----------------------------------------------------------------------
Comment By: xqt (xqt)
Date: 2011-11-11 02:17
Message:
In addition to valhallasws suggestion please run your command line again
with -verbose option:
python get.py -family:solab Xx -v
I've added a debugging code to the wikipedia library which gives additional
information about the page call and the servers response. Please post it.
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-11-11 02:09
Message:
Looks like it should work. Two things that might work:
a) generate a family file using generate_family_file.py -- maybe there is
something in the file I overlooked. To do this, run:
generate_family_file.py <url of a wiki page> solab
b) change 1.18.0beta1 to 1.18 or 1.18.0 (if this fixes it, there is a bug
in the version detection code), or to 1.17 (if that fixes it, there is some
bigger bug somewhere)
Thanks!
----------------------------------------------------------------------
Comment By: solab (solab)
Date: 2011-11-11 02:00
Message:
solab_family.py.buggy uploaded
----------------------------------------------------------------------
Comment By: xqt (xqt)
Date: 2011-11-11 01:55
Message:
as solab_family.py is not a part of the framework, we need its content.
----------------------------------------------------------------------
Comment By: solab (solab)
Date: 2011-11-11 01:33
Message:
Veriosn
Python 2.7.2+ (default, Oct 4 2011, 20:06:09)
[GCC 4.6.1]
config-settings:
use_api = True
use_api_login = True
unicode test: ok
user-config.py
mylang = 'en'
family = 'solab'
usernames['solab']['en'] = u'xxxx'
MediaWiki 1.18.0beta1
==Log==
python get.py -family:solab Xx
Traceback (most recent call last):
File "get.py", line 33, in <module>
main()
File "get.py", line 29, in main
pywikibot.output(page.get(), toStdout = True)
File "/opt/tools/mybot/pywikipedia/wikipedia.py", line 694, in get
expandtemplates = expandtemplates)
File "/opt/tools/mybot/pywikipedia/wikipedia.py", line 786, in
_getEditPage
raise ServerError('ServerError: No textarea found in %s' % self)
==Family==
solab_family.py
pywikibot.exceptions.ServerError: ServerError: No textarea found in
[[en:Xx]]
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2011-11-10 08:11
Message:
Please add the output from version.py, your user-config.py, your family
file and the output you get when running get.py.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603139&aid=3436146&group_…
Patches item #3509841, was opened at 2012-03-21 11:10
Message generated for change (Tracker Item Submitted) made by yjenith
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3509841&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Jenith (yjenith)
Assigned to: Nobody/Anonymous (nobody)
Summary: Flickrripper.py update
Initial Comment:
When we upload the invalid license images through Flickrripper,py bot run at stand alone program in Pywikipediaot currently the tool does not allow copyrighted images, but it does not show any message to the user like (invalid license). This patch fixed that by adding the message 'Unsuitable license', if the license validation is failed. so that user can aware of why the image did get upload.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3509841&group_…
Patches item #3502676, was opened at 2012-03-12 07:40
Message generated for change (Comment added) made by valhallasw
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3502676&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Lars Aronsson (aronsson)
Assigned to: Nobody/Anonymous (nobody)
Summary: New option "-no" to djvutext.py
Initial Comment:
djvutext.py adds OCR text to books in Wikisource. Some books already have text for some pages, but not for others. The "-no" flag added by this patch only adds new pages, but doesn't alter the text for any existing pages. (At any such question, it answers "no" automatically.)
----------------------------------------------------------------------
>Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 11:07
Message:
Last housekeeper's note: this patch applies cleanly to r10035 (duh. it's
the same djvutext.py)
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 10:44
Message:
For reference: I had a discussion on this patch with Lars on IRC and
mentioned some improvements (naming/parameter). He's working on a new patch
version.
Again, thanks for the effort, Lars! :-)
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3502676&group_…
Patches item #3367839, was opened at 2011-07-15 03:11
Message generated for change (Comment added) made by valhallasw
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3367839&group_…
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: None
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: lankier (lankier)
Assigned to: Nobody/Anonymous (nobody)
Summary: Retrieve / edit the section
Initial Comment:
This patch adds new parameter 'section' to Page.get & Page.put.
(See also feature requests https://sourceforge.net/tracker/?func=detail&atid=603141&aid=3104703&group_… )
Examples:
add a new section:
page.put('New section text', comment='New section header', section='new')
edit the top section:
text = page.get(section=0)
page.put(text+'\n\n==New section==\nNew text', section=0)
----------------------------------------------------------------------
>Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 11:06
Message:
Housekeeper's note: the patch applies cleanly to r10035 (with some fuzz).
----------------------------------------------------------------------
Comment By: Merlijn S. van Deen (valhallasw)
Date: 2012-03-21 10:03
Message:
Is referring to sections by ID a good idea? Isn't it worth the extra query
to get the section ID first? (by calling action=render). We currently
'support' sections by having a Page object with title "page title#section",
and I think this is the sensible way to work with sections.
----------------------------------------------------------------------
Comment By: Bináris (binbot)
Date: 2011-07-15 11:32
Message:
Great and important contribution, I support the fast acceptation! This
feature has long been missing from Pywiki.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=603140&aid=3367839&group_…