Hi
We have published a new version of MWoffliner: the Mediawiki scraper. Version 1.7.0 is - like always - available here: https://www.npmjs.com/package/mwoffliner
This new release contains mainly fixing an code improvements, here is the detailed changelog: * UPDATE: Deprecated desktop scraping (not --mobileLayout) * UPDATE: Improve the article list welcome page #449 * UPDATE: Add string translation mechanism #16 * UPDATE: Fetch hundreds of redirects at a time instead of one #325 * UPDATE: Integrated MCS alongside Parsoid #388 #347 #404 * UPDATE: Introduce automated testing #146 * UPDATE: Support remote articleList and favicon #457 * UPDATE: Added --useCache option #263
This is the second milestone of a few we have planned with the support of the WMF. Next one on the list is 1.8 and is planned for begin of March. With 1.8 will get rid of zimwriterfs and write directly ZIM files without temporary files on the hard disk. This will allow substantial speed-ups and need less mass storage during the scraping process.
Like always, PR and bug reports are welcome at: https://github.com/openzim/mwoffliner
Regards Emmanuel