Hoi,
Core and Compat are the two faces of pywikipedia. Who is interested to answer some questions that helps me understand this better.
I would like to ask ten questions about this and publish the answers on my blog.
Thanks, Gerard
PS please answer off-list
Post your questions to the list bravely. The worst thing that can happen is that you get more than one answer for some of them with more than one point of view.
2013/10/14 Gerard Meijssen gerard.meijssen@gmail.com
Hoi,
Core and Compat are the two faces of pywikipedia. Who is interested to answer some questions that helps me understand this better.
I would like to ask ten questions about this and publish the answers on my blog.
Thanks, Gerard
PS please answer off-list
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
Le 14/10/13 16:11, Gerard Meijssen a écrit :
Hoi,
Core and Compat are the two faces of pywikipedia. Who is interested to answer some questions that helps me understand this better.
As I understand it Compat is the old version of pywikibot started in 2003. Core is a full rewrite started in 2007.
But I am merely a lurker here :-]
I would like to ask ten questions about this and publish the answers on my blog.
*be bold*
Hoi,
Ok ... ten questions ... I want to publish the answers on my blog before the pywikipedia bugday (october 24)... if only to get as many people as possible to attend.
When I send questions, I always indicate that some questions may not work well. <grin> I can replace a question if need be </grin> Thanks, Gerard
1. What is pywikipedia? 2. As I understand it there are two versions, core and compat. What is pywikipedia core and what is compat? 3. Why keep them both, it must be a lot of work to have to maintain them both 4. Recently all the bugs have been moved to bugzilla ... What is it that you hope to achieve by this? 5. Recently all the code has been moved to git ... What is it that you hope to achieve by this? 6. What is the biggest challenge running the pywikipedia bot? 7. How many people are using the pywikipedia bot and how many people are developing code for pywikipedia bot 8. It is possible to use the pywikipedia bot in so many ways... Is it easy to learn what it can and cannot do? 9. How long does it take before pywikipedia bot supports a new Wikidata data type ? 10. There will be a pywikibot bugday... What is it and who can participate?
On 14 October 2013 21:49, Antoine Musso hashar+wmf@free.fr wrote:
Le 14/10/13 16:11, Gerard Meijssen a écrit :
Hoi,
Core and Compat are the two faces of pywikipedia. Who is interested to answer some questions that helps me understand this better.
As I understand it Compat is the old version of pywikibot started in 2003. Core is a full rewrite started in 2007.
But I am merely a lurker here :-]
I would like to ask ten questions about this and publish the answers on my blog.
*be bold*
-- Antoine "hashar" Musso
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
Hi
On 10/18/13, Gerard Meijssen gerard.meijssen@gmail.com wrote:
Hoi,
Ok ... ten questions ... I want to publish the answers on my blog before the pywikipedia bugday (october 24)... if only to get as many people as possible to attend.
When I send questions, I always indicate that some questions may not work well. <grin> I can replace a question if need be </grin> Thanks, Gerard
- What is pywikipedia?
1-Pywikibot is a python-based framework made to interact Wikipedia and all other mediawiki-based sites
- As I understand it there are two versions, core and compat. What is
pywikipedia core and what is compat?
2- Compat is older version of PWB, Core is newer version of PWB, I explain with more details in below
- Why keep them both, it must be a lot of work to have to maintain them
both
3-Compat and core are same on user side (there are just little differences in usage) but they are really different in their cores (handling connections, site modeling, etc.). Core is newer and has better efficiency, and the codes are really clean and understandable but It's also incomplete and incompatible with non-WMF wikis (It's not that doesn't have at all, but it's not good as compat), in other hand Compat is older and dirtier and creepy in some ways but It's compatible (compat is abbreviation of compatibility) and complete
- Recently all the bugs have been moved to bugzilla ... What is it that
you hope to achieve by this?
Handling bugs will be a lot more easier, there will be more eyes to keep on debugging process, tasks will be centralized, it will be more wikified by merging in WMF infrastructure, you can see more in my suggestion page: http://www.mediawiki.org/wiki/Manual%20talk:Pywikipediabot/Migrating_to_bugz...
- Recently all the code has been moved to git ... What is it that you
hope to achieve by this?
We'll review patches (changes in codes) before committing them into main codes, handling different commits will be easier and main thing is now everybody can submit their patches and after a review by a developer, it can be merged directly There is a blog post about it but It's not very helpful for this issue: https://blog.wikimedia.org/2013/07/23/pywikipediabot-moving-to-git-on-july-2...
- What is the biggest challenge running the pywikipedia bot?
IMO It's not being so much user-friendly, It's a little hard to work with
- How many people are using the pywikipedia bot and how many people are
developing code for pywikipedia bot
It has been widely used since 2003, and It has more than 100 authors but now they are just five active developers
- It is possible to use the pywikipedia bot in so many ways... Is it
easy to learn what it can and cannot do?
Absolutely yes, there is lack of documentation but I can say you can do almost whatever you want on pages of Wikipedia by less than four lines if you want I can send you some example to understand it better
- How long does it take before pywikipedia bot supports a new Wikidata
data type ?
Usually takes a week or two based on how much developers (including me) are willing to do
- There will be a pywikibot bugday... What is it and who can
participate?
10-Anybody can participate, Bug day is procedure focused mainly on categorizing and prioritizing and closing non-reproducible bugs and fixing them if the bug is not very big deal. Because we just migrated there are ~700 open bugs (some of them are really old and it's fixed long time ago) so need to clean up them and so It's really necessary to have a "bug triage"
On 14 October 2013 21:49, Antoine Musso hashar+wmf@free.fr wrote:
Le 14/10/13 16:11, Gerard Meijssen a écrit :
Hoi,
Core and Compat are the two faces of pywikipedia. Who is interested to answer some questions that helps me understand this better.
As I understand it Compat is the old version of pywikibot started in 2003. Core is a full rewrite started in 2007.
But I am merely a lurker here :-]
I would like to ask ten questions about this and publish the answers on my blog.
*be bold*
-- Antoine "hashar" Musso
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
Best
2013/10/18 Gerard Meijssen gerard.meijssen@gmail.com:
Hoi,
Ok ... ten questions ... I want to publish the answers on my blog before the pywikipedia bugday (october 24)... if only to get as many people as possible to attend.
When I send questions, I always indicate that some questions may not work well. <grin> I can replace a question if need be </grin> Thanks, Gerard
What is pywikipedia? As I understand it there are two versions, core and compat. What is pywikipedia core and what is compat? Why keep them both, it must be a lot of work to have to maintain them both
Great question, can't wait to hear the answers :) Feature parity seems to have been abandoned, which is a shame.
Recently all the bugs have been moved to bugzilla ... What is it that you hope to achieve by this? Recently all the code has been moved to git ... What is it that you hope to achieve by this? What is the biggest challenge running the pywikipedia bot?
On the pywikibot side, learning its limitation and working around them.
On the larger, bot side of things, performance. You have to always balance the API/server performance with the local computer's performance (mostly disk access for me, might be RAM limitations when running on a VPS) and the network performance. While not related to pwb, this is something you have to consider for each new bot one writes.
pwb could help by providing more advanced support for threads, such as thread-safe generators and better support for sections (such as retrieve the whole page but submit a section or vice versa).
How many people are using the pywikipedia bot and how many people are developing code for pywikipedia bot It is possible to use the pywikipedia bot in so many ways... Is it easy to learn what it can and cannot do?
Answer as a user: not really. There are a few manuals, on mediawiki.org, wikibooks, wikiversity and others, but they are outdated and for the most part only apply to the compat version. The simplest way is to look in the source (aka RTFS [1])
While it does support (almost?) all the API calls from MediaWiki, the functions used to access those APIs can be significantly different. This might also be due to the way the API is designed, I haven't really dug into that.
How long does it take before pywikipedia bot supports a new Wikidata data type ? There will be a pywikibot bugday... What is it and who can participate?
Thanks, Strainu
[1] http://www.urbandictionary.com/define.php?term=RTFS
On 14 October 2013 21:49, Antoine Musso hashar+wmf@free.fr wrote:
Le 14/10/13 16:11, Gerard Meijssen a écrit :
Hoi,
Core and Compat are the two faces of pywikipedia. Who is interested to answer some questions that helps me understand this better.
As I understand it Compat is the old version of pywikibot started in 2003. Core is a full rewrite started in 2007.
But I am merely a lurker here :-]
I would like to ask ten questions about this and publish the answers on my blog.
*be bold*
-- Antoine "hashar" Musso
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
I am only user of pwb, so some answers from my POV:
2013/10/18 Gerard Meijssen gerard.meijssen@gmail.com
Hoi,
Ok ... ten questions ... I want to publish the answers on my blog before the pywikipedia bugday (october 24)... if only to get as many people as possible to attend.
When I send questions, I always indicate that some questions may not work well. <grin> I can replace a question if need be </grin> Thanks, Gerard
- What is pywikipedia?
- As I understand it there are two versions, core and compat. What is
pywikipedia core and what is compat?
compat (formely trunk) is the older version, which is easier to use
(script.py -parameters), but have some limitations core (formely rewrite) is newer, little bit harder to use (pwb.py script -parameters) and have some other limitations (some scripts were not rewrited yet) new names are little bi confusing (co*/co* vs. tr*/re*)
- Why keep them both, it must be a lot of work to have to maintain
them both 2. Recently all the bugs have been moved to bugzilla ... What is it that you hope to achieve by this?
Maybe some very old requests for features can be reopened and fulfilled
- Recently all the code has been moved to git ... What is it that you
hope to achieve by this?
This move have some problems - harder updating on windows, need of review
causes longer time before patch is live
- What is the biggest challenge running the pywikipedia bot?
If you want to use more scripts, its good to know regexp :-)
- How many people are using the pywikipedia bot and how many people
are developing code for pywikipedia bot
After launch ow Wikidata many bots lost its work :-) e.g. my bot was
active on all wikipedias, now works only on 2-4 and wiktionaries.
- It is possible to use the pywikipedia bot in so many ways... Is it
easy to learn what it can and cannot do?
When script have documentation inside, its easier. Some scripts have
documentation on mediawiki.org, but nobody knows about it.
- How long does it take before pywikipedia bot supports a new
Wikidata data type ?
From my POV very long, but it can be only because lack of informations - i
know only about two scripts which works on wikidata
- There will be a pywikibot bugday... What is it and who can
participate?
JAnD
On 14 October 2013 21:49, Antoine Musso hashar+wmf@free.fr wrote:
Le 14/10/13 16:11, Gerard Meijssen a écrit :
Hoi,
Core and Compat are the two faces of pywikipedia. Who is interested to answer some questions that helps me understand this better.
As I understand it Compat is the old version of pywikibot started in 2003. Core is a full rewrite started in 2007.
But I am merely a lurker here :-]
I would like to ask ten questions about this and publish the answers on my blog.
*be bold*
-- Antoine "hashar" Musso
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l