Hello! I am using WikiTaxi for importing wiki databases and their offline usage. I've never had issues before but the latest two English wiktionary databases haven't been working correctly. As seen in the screenshot, the translations from various languages can't be seen - instead I can see only the code.
I noticed that first in the datadump from November but thought it was an onetime issue as sometimes happens when I import a fresh database. But the same happened with the latest December dump.
The latest datadump that didn't give me any issues was from september, I think.
Does anyone have any ideas why this is happening now and how to make it work?
Thank you in advance
Tina Lukša, 08/12/2013 18:01:
Hello! I am using WikiTaxi for importing wiki databases and their offline usage. I've never had issues before but the latest two English wiktionary databases haven't been working correctly. As seen in the screenshot, the translations from various languages can't be seen - instead I can see only the code.
What makes you think it's a dump issue? You seem to lack the Scribunto extension to render those lua-based templates: install it.
Nemo
The reason I think it's a dump issue is because a former data dump (it was either from late september or early october) worked just fine - no code text but a perfect translation on several languages beneath the etymology section for each word.
And I didn't even heard of Scribunto until now - if I understod correctly it's an extension for MediaWiki, which I am not using.
I use WikiTaxi for offline wiki browsing which is an executable app and which only requiers the taxi importer for the bz2 dump and the taxi app itself which alows me to view an imported wiki. There were never requierments for any extensions - it's a straightforward portable app.
Unfortunately, once I update a wiki I delete the old import so I neither know the exact date of the working dump nor can I take a screencap to prove that everything worked just fine prior the update :/
Tina
2013/12/9, Federico Leva (Nemo) nemowiki@gmail.com:
Tina Lukša, 08/12/2013 18:01:
Hello! I am using WikiTaxi for importing wiki databases and their offline usage. I've never had issues before but the latest two English wiktionary databases haven't been working correctly. As seen in the screenshot, the translations from various languages can't be seen - instead I can see only the code.
What makes you think it's a dump issue? You seem to lack the Scribunto extension to render those lua-based templates: install it.
Nemo
Tina Lukša, 09/12/2013 20:51:
The reason I think it's a dump issue is because a former data dump (it was either from late september or early october) worked just fine - no code text but a perfect translation on several languages beneath the etymology section for each word.
And I didn't even heard of Scribunto until now - if I understod correctly it's an extension for MediaWiki, which I am not using.
Well, WikiTaxi can't convert wikitext into whatever else (HTML?) by magic, so it must be using code. If the code is not under your control, then it's WikiTaxi's fault here. Probably previous dumps worked because they were not using Lua modules yet on en.wikt.
Nemo
I use WikiTaxi for offline wiki browsing which is an executable app and which only requiers the taxi importer for the bz2 dump and the taxi app itself which alows me to view an imported wiki. There were never requierments for any extensions - it's a straightforward portable app.
Unfortunately, once I update a wiki I delete the old import so I neither know the exact date of the working dump nor can I take a screencap to prove that everything worked just fine prior the update :/
Tina
2013/12/9, Federico Leva (Nemo) nemowiki@gmail.com:
Tina Lukša, 08/12/2013 18:01:
Hello! I am using WikiTaxi for importing wiki databases and their offline usage. I've never had issues before but the latest two English wiktionary databases haven't been working correctly. As seen in the screenshot, the translations from various languages can't be seen - instead I can see only the code.
What makes you think it's a dump issue? You seem to lack the Scribunto extension to render those lua-based templates: install it.
Nemo
Hi Tina!
English Wiktionary has been using Scribunto since at least May of this year. I'm not sure how Wikitaxi handled these dumps; it may have just been squashing the errors.
As you've discovered, Wikitaxi will not be able to handle the #invoke tags in the newer wiki dumps from this year. Given that Wikitaxi was last released on 2010-06-20, I doubt it will be resolved anytime soon. If you want to continue using Wikitaxi, I'd recommend you use a dump from earlier this year: http://dumps.wikimedia.org/enwiktionary/20130225/. Scribunto was being rolled out at this time, so it's likely that this Wiktionary dump would not have #invoke tags.
If you want to try another offline application, you can try XOWA: http://xowa.sourceforge.net [1]. It imports database dumps, is portable, handles Scribunto, and is open-source. You can look at some screenshots here: http://xowa.sourceforge.net/screenshots.html . They're for English Wikipedia, but you'll see English Wikisource and Wikimedia Commons there as well. I've also uploaded a screenshot of "martial" in XOWA from the English Wiktionary 2013-12-02 dump: http://i.imgur.com/xi97qNZ.jpg. If you want a complete package of English Wiktionary with images, you can download it from here: https://archive.org/details/Xowa_enwiktionary_2013-11-17_complete . Otherwise, you can download XOWA and import the latest dump by visiting Help:Import/List
Hope this helps.
[1]: For full disclosure's sake, I am the XOWA dev.
On Mon, Dec 9, 2013 at 2:51 PM, Tina Lukša vale2712@gmail.com wrote:
The reason I think it's a dump issue is because a former data dump (it was either from late september or early october) worked just fine - no code text but a perfect translation on several languages beneath the etymology section for each word.
And I didn't even heard of Scribunto until now - if I understod correctly it's an extension for MediaWiki, which I am not using.
I use WikiTaxi for offline wiki browsing which is an executable app and which only requiers the taxi importer for the bz2 dump and the taxi app itself which alows me to view an imported wiki. There were never requierments for any extensions - it's a straightforward portable app.
Unfortunately, once I update a wiki I delete the old import so I neither know the exact date of the working dump nor can I take a screencap to prove that everything worked just fine prior the update :/
Tina
2013/12/9, Federico Leva (Nemo) nemowiki@gmail.com:
Tina Lukša, 08/12/2013 18:01:
Hello! I am using WikiTaxi for importing wiki databases and their offline usage. I've never had issues before but the latest two English wiktionary databases haven't been working correctly. As seen in the screenshot, the translations from various languages can't be seen - instead I can see only the code.
What makes you think it's a dump issue? You seem to lack the Scribunto extension to render those lua-based templates: install it.
Nemo
Xmldatadumps-l mailing list Xmldatadumps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l
Thank you so much for the detailed answer! I've been looking for a replacement for wikitaxi ever since discovering it, being aware that it will become obsolete without updates if changes are made on the wikimedia (seems I jinxed myself as that's exactly what happened xD) but none of the other tools listed under the datadump handling help page were what I was looking for. Either it was required to setup a local server, extract the dump itself or in general took to long and to much space to process the database and make it usable :(
Thank you for the advice - I will try the app as soon as possible because I don't have a regular access to the internet and am highly dependant on the offline version for my college homework.
I will gladly make another post here once I've tested everything out :)
P.S. Since your app seems similar, are you familiar with Evopedia? I've been googling alternatives for offline wiki and stumbled upon it but found no real reviews. It seems it's still quite new.
2013/12/10, gnosygnu gnosygnu@gmail.com:
Hi Tina!
English Wiktionary has been using Scribunto since at least May of this year. I'm not sure how Wikitaxi handled these dumps; it may have just been squashing the errors.
As you've discovered, Wikitaxi will not be able to handle the #invoke tags in the newer wiki dumps from this year. Given that Wikitaxi was last released on 2010-06-20, I doubt it will be resolved anytime soon. If you want to continue using Wikitaxi, I'd recommend you use a dump from earlier this year: http://dumps.wikimedia.org/enwiktionary/20130225/. Scribunto was being rolled out at this time, so it's likely that this Wiktionary dump would not have #invoke tags.
If you want to try another offline application, you can try XOWA: http://xowa.sourceforge.net [1]. It imports database dumps, is portable, handles Scribunto, and is open-source. You can look at some screenshots here: http://xowa.sourceforge.net/screenshots.html . They're for English Wikipedia, but you'll see English Wikisource and Wikimedia Commons there as well. I've also uploaded a screenshot of "martial" in XOWA from the English Wiktionary 2013-12-02 dump: http://i.imgur.com/xi97qNZ.jpg. If you want a complete package of English Wiktionary with images, you can download it from here: https://archive.org/details/Xowa_enwiktionary_2013-11-17_complete . Otherwise, you can download XOWA and import the latest dump by visiting Help:Import/List
Hope this helps.
[1]: For full disclosure's sake, I am the XOWA dev.
On Mon, Dec 9, 2013 at 2:51 PM, Tina Lukša vale2712@gmail.com wrote:
The reason I think it's a dump issue is because a former data dump (it was either from late september or early october) worked just fine - no code text but a perfect translation on several languages beneath the etymology section for each word.
And I didn't even heard of Scribunto until now - if I understod correctly it's an extension for MediaWiki, which I am not using.
I use WikiTaxi for offline wiki browsing which is an executable app and which only requiers the taxi importer for the bz2 dump and the taxi app itself which alows me to view an imported wiki. There were never requierments for any extensions - it's a straightforward portable app.
Unfortunately, once I update a wiki I delete the old import so I neither know the exact date of the working dump nor can I take a screencap to prove that everything worked just fine prior the update :/
Tina
2013/12/9, Federico Leva (Nemo) nemowiki@gmail.com:
Tina Lukša, 08/12/2013 18:01:
Hello! I am using WikiTaxi for importing wiki databases and their offline usage. I've never had issues before but the latest two English wiktionary databases haven't been working correctly. As seen in the screenshot, the translations from various languages can't be seen - instead I can see only the code.
What makes you think it's a dump issue? You seem to lack the Scribunto extension to render those lua-based templates: install it.
Nemo
Xmldatadumps-l mailing list Xmldatadumps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l
xmldatadumps-l@lists.wikimedia.org
