pywikibot

pywikibot@lists.wikimedia.org

3 participants
6830 discussions

Simplifying logging?
by Roy Smith 10 Jan '23

10 Jan '23

Pywikibot, even if you're just using it as a library, configures its own complicated logging structure: o "pywiki" | Level Level 11 | Propagate OFF | Handler <TerminalHandler <stderr> (INFO)> | Level INFO | Filter <pywikibot.userinterfaces.terminal_interface_base.MaxLevelFilter object at 0x7f7f66dafe50> | Formatter fmt='%(message)s%(newline)s' datefmt=None | Handler <TerminalHandler <stdout> (STDOUT)> | Level STDOUT | Filter <pywikibot.userinterfaces.terminal_interface_base.MaxLevelFilter object at 0x7f7f66daffa0> | Formatter fmt='%(message)s%(newline)s' datefmt=None | Handler <TerminalHandler <stderr> (WARNING)> | Level WARNING | Formatter fmt='%(levelname)s: %(message)s%(newline)s' datefmt=None | | | o<--[pywiki.wiki] | | | o<--"pywiki.wiki.family" | Level NOTSET so inherits level Level 11 | Is there any way to make it not do this? I want to have full control of the logging config in my application. In particular, I want all the logging to go to my logfile. Having a library install its own handlers which are hard-wired to a TerminalHandler just complicates that.

2 3

OAuth errors?
by Roy Smith 04 Jan '23

04 Jan '23

I found these in my dykbot-cron.err file. What causes this? Is it something to worry about? WARNING: API error mwoauth-invalid-authorization: The authorization headers in your request are not valid: Nonce already used: <hex string elided> ERROR: Retrying failed OAuth authentication for wikipedia:en: The authorization headers in your request are not valid: Nonce already used: <hex string elided>

1 0

Next node?
by Roy Smith 01 Jan '23

01 Jan '23

Let's say I've got the following wikitext: Some stuff More stuff {{MyTemplate}} Blah Blah I want to find {{MyTemplate}} but only if it's immediately followed by , and insert something after the comment. Is there anything that does that kind of pattern matching? I can use mwparserfromhell to find the template: > for node in wikicode.nodes: > if isinstance(node, mwp.nodes.Template) and node.name.matches("MyTemplate"): but I don't see any way to match on two consecutive nodes without building my own little state machine in the loop to keep track of what the previous node was.

2 1

How to install in toolforge?
by Roy Smith 29 Dec '22

29 Dec '22

How do people install their bots into toolforge? In the past, I've just done a "git pull" to the bastion host and run with the code directly out of the source tree, but I'm not sure that's a good plan. My current project is a more complicated, with a bot that I'm going to run on krb as a toolforge cron job <https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework#Creating_…>, a web service that's going to run via "webservice --backend=kubernetes python3.9 start" and also some command-line scripts that I'll want to run interactively. All this code will be in the same git repo. So I'm thinking of building a wheel and installing it that way. So, I guess that means building the wheel locally with setuptools, scp the wheel over to the bastion, shell into a krb node to do "pip install" into my virtualenv. The stumbling block with that plan seems to be that toolforge insists on your webapp being installed at $HOME/www/python/src/app.py, which isn't going to play well with a wheel installation.

3 3

Getting started
by ayushanand_mc21a11_34＠dtu.ac.in 28 Dec '22

28 Dec '22

I have recently installed pywikibot and wanted to ask whether a prior knowledge of scripting is required to get started with it?

2 2

What IDE for Mac desktop?
by Roy Smith 27 Dec '22

27 Dec '22

I never thought I'd ever write this, but after close to 40 years of using emacs for everything, I'm thinking of switching to a real IDE for python development. My latest evolution is emacs with elpy, which is pretty powerful as these things go, but I seem to spend more time configuring emacs and less time writing code than I want to. I got clarity on this the other day when I was comparing the toolforge bastion hosts, the cloud VPS images, and the kubernetes back ends to see which versions of emacs each one had and realized this really was the tail wagging the dog. I'm kind of in "big paradigm shift" mode right now. Moving from Django to Flask. From mwclient to pywikibot. From unittest to pytest. I guess since I'm reinventing the universe, I might as well look at editors too. Other than the basic syntax coloring and auto-completion, I'm looking for good integrations with running unit tests and with git. I also need support for web technologies like HTML, jinja templates, and javascript in the same tool. I've heard good things about Sublime, but never used it. I'm not averse to purchasing a license if it's worth it. I've used Eclipse in the past for Java, and was pretty happy with that. I gather that Eclipse + PyDev is pretty neat but never tried it. I know a lot of people live in Jupyter, but that's not really my style. What else should I be looking at? What are folks out there using?

4 5

Use re.fullmatch instead of $ at the end of regex
by Bináris 27 Dec '22

27 Dec '22

I got a mail from Gerrit with the above subject. Just to put my 2 cents: while this change may help the regex to be more readable, such changes in high-scale may harden the transforming of regexes between Pywikibot format and AWB format, and we have a Phab ticket about the cooperation. As we use more Python-specific regexes, the Pywikibot users and AWB uers may be able to help each other less on bot owners' noticeboards. This is not a critics, just a point of view which may worth to consider. -- Bináris

2 2

Pywikibot documentation
by info＠gno.de 23 Dec '22

23 Dec '22

2 2

Working with wikitables
by Bináris 22 Dec '22

22 Dec '22

Do we have anything to exclude tables from page text? I read mwparserfromhell doc, but did not find. -- Bináris

3 8

How to edit template parameters?
by Roy Smith 21 Dec '22

21 Dec '22

I'm trying to implement the idea that was suggested in this edit. <https://en.wikipedia.org/w/index.php?title=Wikipedia:Bots/Requests_for_appr…> I see how I can find the existing {{DYK-Tools-Bot was here}}, with Page.templatesWithParams(). But once I've got that, how do I actually change the parameters in the wikitext?

2 2

← Newer
1
...
5
6
7
8
9
10
11
...
683
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

pywikibot