[ pywikipediabot-Bugs-3585132 ] Wikia returns cached pages for get.py editarticle.py - Pywikipedia-bugs

7 Nov 2012


      Bugs item #3585132, was opened at 2012-11-07 04:36
Message generated for change (Comment added) made by xqt
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3585132...
Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: General
Group: None
Status: Open
Resolution: None
Priority: 5
Private: No
Submitted By: Throwy (throwy)
Assigned to: Nobody/Anonymous (nobody)
Summary: Wikia returns cached pages for get.py  editarticle.py
Initial Comment:
get.py and editarticle.py use a method of page fetching that results in cached pages from Wikia
replace.py uses the pagegenerator method, which fetches the latest version of pages from Wikia
The issue is probably a Wikia issue, but it would be nice to implement a workaround in pywikipediabot.
Steps to reproduce:
Create or edit a page on a Wikia wiki. Fetch the page with editarticle.py or get.py . The bot should fetch a cached version. Edit the page with replace.py and the bot should fetch the most recent version, which is the expected behavior.
Comments:
Someone had already solved this issue for me on #pywikipediabot on freenode. It requires very little alteration to get.py and editarticle.py. Unfortunately I did not back up or document the changes before updating pywikipediabot from SVN and the changes were lost.
----
$ python version.py
Pywikipedia [http] trunk/pywikipedia (r10663, 2012/11/04, 19:53:31)
Python 2.7.3 (v2.7.3:70274d53c1dd, Apr  9 2012, 20:52:43) 
[GCC 4.2.1 (Apple Inc. build 5666) (dot 3)]
config-settings:
use_api = True
use_api_login = True
unicode test: ok
----------------------------------------------------------------------
...
Comment By: xqt (xqt)
Date: 2012-11-07 05:56
Message:
Some remarks:
I changed the hostname() in family file to "mlp.wikia.com" and used the
following statements:
import wikipedia as wp
s = wp.getSite('wikia', 'wikia')
p = wp.Page(s, 'Template:Date/doc')
t = p.get(force=True)
result:
Traceback (most recent call last):
  File "<pyshell#69>", line 1, in <module>
    t = p.get(force=True)
  File "wikipedia.py", line 699, in get
    expandtemplates = expandtemplates)
  File "wikipedia.py", line 800, in _getEditPage
    "Page does not exist. In rare cases, if you are certain the page does
exist, look into overriding family.RversionTab")
NoPage: (wikia:wikia, u'[[wikia:Template:Date/doc]]', 'Page does not exist.
In rare cases, if you are certain the page does exist, look into overriding
family.RversionTab')
the query param dict was:
{'inprop': ['protection', 'subjectid'], 'rvprop': ['content', 'ids',
'flags', 'timestamp', 'user', 'comment', 'size'], 'prop': ['revisions',
'info'], 'titles': u'Template:Date/doc', 'rvlimit': 1, 'action': 'query'}
the result data dict was:
{u'query': {u'pages': {u'-1': {u'protection': [], u'ns': 10, u'missing':
u'', u'title': u'Template:Date/doc'}}}}
and last the url is:
/api.php?inprop=protection%7Csubjectid&format=json&rvprop=content%7Cids%7Cflags%7Ctimestamp%7Cuser%7Ccomment%7Csize&prop=revisions%7Cinfo&titles=Template%3ADate/doc&rvlimit=1&action=query
which gives the right result via browser e.g.:
http://mlp.wikia.com/api.php?inprop=protection%7Csubjectid&format=json&a...
----------------------------------------------------------------------
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=603138&aid=3585132...