Hey everyone, as one of the last things for my Wikipedian in Residency for the National Archive in the Netherlands i've written a tool to preprocess XML dumps from their API for processing in the GWT.
Check it out here: http://tools.wmflabs.org/hay/gwtcook/
I've played around with the GWT with dumps from the National Archive API, and not all the fields map nicely to the Commons template tags. Because i like my colleagues there to use the GWT themselves without my help i thought it would be useful to have a simple tool where they could upload an XML file from their API and get a transformed version with extra fields for the GWT upload.
I did a little test run on Commons Beta (haven't got the GWT flag on production yet) and it seems to work properly there.
Anyway, i could imagine that this might be useful for other people as well, so if you have some PHP skills feel free to write a 'transformer' and open a pull request so i can include it in the tool. Code is available over here:
https://github.com/hay/wiki-tools.
Specifically, look at the class-gwtcook*.php files in the 'lib' directory.
Let me know if you've got any comments or remarks.
Kind regards, -- Hay
Nice, nice, nice :-) Op 1 okt. 2014 21:03 schreef "Hay (Husky)" huskyr@gmail.com:
Hey everyone, as one of the last things for my Wikipedian in Residency for the National Archive in the Netherlands i've written a tool to preprocess XML dumps from their API for processing in the GWT.
Check it out here: http://tools.wmflabs.org/hay/gwtcook/
I've played around with the GWT with dumps from the National Archive API, and not all the fields map nicely to the Commons template tags. Because i like my colleagues there to use the GWT themselves without my help i thought it would be useful to have a simple tool where they could upload an XML file from their API and get a transformed version with extra fields for the GWT upload.
I did a little test run on Commons Beta (haven't got the GWT flag on production yet) and it seems to work properly there.
Anyway, i could imagine that this might be useful for other people as well, so if you have some PHP skills feel free to write a 'transformer' and open a pull request so i can include it in the tool. Code is available over here:
https://github.com/hay/wiki-tools.
Specifically, look at the class-gwtcook*.php files in the 'lib' directory.
Let me know if you've got any comments or remarks.
Kind regards, -- Hay
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
excellent. thanks hay!
On Oct 1, 2014, at 21:03 , Hay (Husky) huskyr@gmail.com wrote:
Hey everyone, as one of the last things for my Wikipedian in Residency for the National Archive in the Netherlands i've written a tool to preprocess XML dumps from their API for processing in the GWT.
Check it out here: http://tools.wmflabs.org/hay/gwtcook/
I've played around with the GWT with dumps from the National Archive API, and not all the fields map nicely to the Commons template tags. Because i like my colleagues there to use the GWT themselves without my help i thought it would be useful to have a simple tool where they could upload an XML file from their API and get a transformed version with extra fields for the GWT upload.
I did a little test run on Commons Beta (haven't got the GWT flag on production yet) and it seems to work properly there.
Anyway, i could imagine that this might be useful for other people as well, so if you have some PHP skills feel free to write a 'transformer' and open a pull request so i can include it in the tool. Code is available over here:
https://github.com/hay/wiki-tools.
Specifically, look at the class-gwtcook*.php files in the 'lib' directory.
Let me know if you've got any comments or remarks.
Kind regards, -- Hay
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Hay (Husky), 01/10/2014 21:03:
as one of the last things for my Wikipedian in Residency for the National Archive in the Netherlands i've written a tool to preprocess XML dumps from their API for processing in the GWT.
Thanks, bookmarked (though I'm not sure I'll be able to use GWT for BEIC*). I added a link to your tools from https://outreach.wikimedia.org/wiki/GLAM/Resources/Tools but we should have an easier to browse and more up to date directory of WIR tools. Perhaps copy all the information of that list to your tool directory and ensure there are appropriate keywords?
Nemo
(*) https://outreach.wikimedia.org/wiki/GLAM/Newsletter/September_2014/Contents/Italy_report
Great to see that tools are emerging for this task!
I wrote about my experiments about such conversions with XSLT. These are simple, browser-based solutions but they might useful for someone: http://wikimedia.fi/2014/10/01/glams-and-glamwiki-toolset/
Best regards, Ari Häyrinen tech assisant Wikimedia Finland
Sent from my Debian. http://www.opendimension.org/
2014-10-02 10:51 GMT+03:00 Federico Leva (Nemo) nemowiki@gmail.com:
Hay (Husky), 01/10/2014 21:03:
as one of the last things for my Wikipedian in Residency for the National Archive in the Netherlands i've written a tool to preprocess XML dumps from their API for processing in the GWT.
Thanks, bookmarked (though I'm not sure I'll be able to use GWT for BEIC*). I added a link to your tools from https://outreach.wikimedia. org/wiki/GLAM/Resources/Tools but we should have an easier to browse and more up to date directory of WIR tools. Perhaps copy all the information of that list to your tool directory and ensure there are appropriate keywords?
Nemo
(*) https://outreach.wikimedia.org/wiki/GLAM/Newsletter/ September_2014/Contents/Italy_report
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
thanks ari, this activity is great to see!
On Oct 2, 2014, at 10:08 , Ari Häyrinen ari.hayrinen@gmail.com wrote:
Great to see that tools are emerging for this task!
I wrote about my experiments about such conversions with XSLT. These are simple, browser-based solutions but they might useful for someone: http://wikimedia.fi/2014/10/01/glams-and-glamwiki-toolset/
Best regards, Ari Häyrinen tech assisant Wikimedia Finland
Sent from my Debian. http://www.opendimension.org/
2014-10-02 10:51 GMT+03:00 Federico Leva (Nemo) nemowiki@gmail.com: Hay (Husky), 01/10/2014 21:03: as one of the last things for my Wikipedian in Residency for the National Archive in the Netherlands i've written a tool to preprocess XML dumps from their API for processing in the GWT.
Thanks, bookmarked (though I'm not sure I'll be able to use GWT for BEIC*). I added a link to your tools from https://outreach.wikimedia.org/wiki/GLAM/Resources/Tools but we should have an easier to browse and more up to date directory of WIR tools. Perhaps copy all the information of that list to your tool directory and ensure there are appropriate keywords?
Nemo
(*) https://outreach.wikimedia.org/wiki/GLAM/Newsletter/September_2014/Contents/Italy_report
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Thanks Dan!
And Hay, I know exactly what you mean :) They are weird ... but they are friend of a lazy people like me.
Ari
Sent from my Debian. http://www.opendimension.org/
2014-10-02 11:14 GMT+03:00 dan entous dan.entous.wikimedia@gmail.com:
thanks ari, this activity is great to see!
On Oct 2, 2014, at 10:08 , Ari Häyrinen ari.hayrinen@gmail.com wrote:
Great to see that tools are emerging for this task!
I wrote about my experiments about such conversions with XSLT. These are
simple, browser-based solutions but they might useful for someone:
http://wikimedia.fi/2014/10/01/glams-and-glamwiki-toolset/
Best regards, Ari Häyrinen tech assisant Wikimedia Finland
Sent from my Debian. http://www.opendimension.org/
2014-10-02 10:51 GMT+03:00 Federico Leva (Nemo) nemowiki@gmail.com: Hay (Husky), 01/10/2014 21:03: as one of the last things for my Wikipedian in Residency for the National Archive in the Netherlands i've written a tool to preprocess XML dumps from their API for processing in the GWT.
Thanks, bookmarked (though I'm not sure I'll be able to use GWT for
BEIC*).
I added a link to your tools from
https://outreach.wikimedia.org/wiki/GLAM/Resources/Tools but we should have an easier to browse and more up to date directory of WIR tools. Perhaps copy all the information of that list to your tool directory and ensure there are appropriate keywords?
Nemo
(*) <
https://outreach.wikimedia.org/wiki/GLAM/Newsletter/September_2014/Contents/...
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools
Hey Nemo, i didn't actually know that there was a 'GLAM tools' list..
Anyway, i think that about 75% of that list is already on the tools directory (for those who don't know what i'm talking about, see tools.wmflabs.org/hay/directory). At least Magnus has ported virtually all of his tools to the tool directory. Keeping up the toolinfo.json files for all the other ones is something i think individual tool authors should do themselves...
Considering XSLT: i know that would be the 'logical' way for XML transformation, but just looking at XSLT files makes my eyes hurt :)
-- Hay
On Thu, Oct 2, 2014 at 9:51 AM, Federico Leva (Nemo) nemowiki@gmail.com wrote:
Hay (Husky), 01/10/2014 21:03:
as one of the last things for my Wikipedian in Residency for the National Archive in the Netherlands i've written a tool to preprocess XML dumps from their API for processing in the GWT.
Thanks, bookmarked (though I'm not sure I'll be able to use GWT for BEIC*). I added a link to your tools from https://outreach.wikimedia.org/wiki/GLAM/Resources/Tools but we should have an easier to browse and more up to date directory of WIR tools. Perhaps copy all the information of that list to your tool directory and ensure there are appropriate keywords?
Nemo
(*) https://outreach.wikimedia.org/wiki/GLAM/Newsletter/September_2014/Contents/Italy_report
Glamtools mailing list Glamtools@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/glamtools