A recent discussion around high-volume APIs led to a ticket about generating HTML dumps on the foundation servers: https://phabricator.wikimedia.org/T254275
Kelson weighed in there, highlighting that it isn't clear everyone working on this is aware of the existing kiwix pipeline. Seemed worth mentioning here.
SJ --
Samuel Klein, 21/06/20 04:29:
Kelson weighed in there, highlighting that it isn't clear everyone working on this is aware of the existing kiwix pipeline. Seemed worth mentioning here.
Thanks. I've read this task a couple weeks ago when Kelson commented but then I stopped looking because it was too depressing. I see that there were some answers on technicalities but nothing on the basics i.e. what they're trying to achieve.
It sounds like yet another project doomed to fail, because it's doing everything in the reverse. Personally I only hope it doesn't do lasting damage (apart from burning dollars). But maybe there's still a small chance that the team is allowed to do a better a job by learning the best practices from their colleagues, some of which were condensed in: https://www.mediawiki.org/wiki/Wikimedia_Product_Guidance
Federico
There was a positive reply by RBrounley from the WMF side, asking to learn more. Kelson, have you been in touch with them by chance?
Utterly silly that they should not already have started by experimenting with the kiwix toolchain, but otherwise positive.
🌍🌏🌎🌑
On Sun., Jun. 21, 2020, 3:15 a.m. Federico Leva (Nemo), nemowiki@gmail.com wrote:
Samuel Klein, 21/06/20 04:29:
Kelson weighed in there, highlighting that it isn't clear everyone
working
on this is aware of the existing kiwix pipeline. Seemed worth mentioning here.
Thanks. I've read this task a couple weeks ago when Kelson commented but then I stopped looking because it was too depressing. I see that there were some answers on technicalities but nothing on the basics i.e. what they're trying to achieve.
It sounds like yet another project doomed to fail, because it's doing everything in the reverse. Personally I only hope it doesn't do lasting damage (apart from burning dollars). But maybe there's still a small chance that the team is allowed to do a better a job by learning the best practices from their colleagues, some of which were condensed in: https://www.mediawiki.org/wiki/Wikimedia_Product_Guidance
Federico
On 01.07.20 19:31, Samuel Klein wrote:
There was a positive reply by RBrounley from the WMF side, asking to learn more. Kelson, have you been in touch with them by chance?
Yes, I had a short meeting with Ryan & Nick. They are a new team. The motto of this team seems to have a better offer around Wikimedia APIs. They have chosen to start with this HTML dump topic as Phabricator had quite a bit of tasks around this. They had a look a bit to what we do at Kiwix... but so far this does not seem really clear what should be the outcome of their effort. Therefore I was not really able to help at this stage. Our toolchain might be a solution or not... depending which problem they want to fix.
Emmanuel