Maarten,
What tools are there already in-place for WLM? I'd like to have a look at the data model... there's no point in developing our own tools, if we can extend existing ones.
Best,
Hi Nuno,
Op 12-3-2011 20:03, Nuno Tavares schreef:
Maarten,
What tools are there already in-place for WLM?
Two tools to put the monuments on the map: * http://toolserver.org/~erfgoed/monumenten_op_de_kaart/ only for the Rijksmonumenten in the Netherlands * http://toolserver.org/~erfgoed/monuments_test/ for all countries Both tools I'm not happy about and should probably be rewritten from scratch with the current knowledge.
Besides that I have last years tools (still running), see http://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Monuments_2010/template... These tools could be used as a basis to write tools which work in multiple countries.
I'd like to have a look at the data model... there's no point in developing our own tools, if we can extend existing ones.
I updated http://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Monuments_2011/Monument... today. Should give a good overview of what data we already have.
I would really like to have a tool to search the database and output it in different formats (Google earth/maps, JSON, gpx format, etc). For exampe: Give me all the monuments within 10km of my home which don't have a photo yet. This shouldn't be too hard to build, but I'm just not getting to it. Help would be much appreciated.
Maarten
Best,
Maarten,
That was my point: establishing a common interface, instead of each going its own way. I was building a tool like that, at http://wlm.wikimedia.pt/tools/plist http://wlm.wikimedia.pt/monumentos.php
(I think it's pretty straightforward playing around with the simple filter box (caixa de filtros), but would help if you know portuguese, though).
Based on our ETL, I've already detected some errors on the structured lists introduced by the bot conversion, which I hope I can fixed them in time, so everyone can get clean (and complete) lists.
Btw, these lists are pretty old, and we're now updating it with official lists in a versioned warehousing fashion. I was playing last nights around (partial) dynamic statistics: http://wlm.wikimedia.pt/tools/plist/stats.php
(You can easily see that there are more than 14 objects with images).
I'm also trying to add more internal information: * I want to show progress graphs, I'm sure they'll motivate our partners; * How many of these have already articles - done; * How many of these (that have article) have already images - half-done, I want to cross information from Commons, which we'll give far more realistic results. * We have different status/degrees of classification, I think that should be kept. * We have multiple sources, so we have multiple source ids, which should be kept for update in the future. * I want our system to allow easily corrections: mainly coordinates.
I'm not sure if both databases need to co-exist (yours being an exported version of our own), as I'd like to have more detail than the monuments_pt_(pt) table.
Thanks for the tools information. Unfortuneately, I don't do python.
Regards,
Hi Nuno,
Op 12-3-2011 21:40, Nuno Tavares schreef:
Maarten,
That was my point: establishing a common interface, instead of each going its own way. I was building a tool like that, at http://wlm.wikimedia.pt/tools/plist http://wlm.wikimedia.pt/monumentos.php
(I think it's pretty straightforward playing around with the simple filter box (caixa de filtros), but would help if you know portuguese, though).
Looks good!
Based on our ETL, I've already detected some errors on the structured lists introduced by the bot conversion, which I hope I can fixed them in time, so everyone can get clean (and complete) lists.
Btw, these lists are pretty old, and we're now updating it with official lists in a versioned warehousing fashion. I was playing last nights around (partial) dynamic statistics: http://wlm.wikimedia.pt/tools/plist/stats.php
(You can easily see that there are more than 14 objects with images).
I'm also trying to add more internal information:
- I want to show progress graphs, I'm sure they'll motivate our
partners;
At the Dutch Wikipedia we maintain quite extensive progress statistics. Next step would be to put these stats in a graph.
- How many of these have already articles - done;
- How many of these (that have article) have already images - half-done,
I want to cross information from Commons, which we'll give far more realistic results.
- We have different status/degrees of classification, I think that
should be kept.
The monuments_pt_(pt) table contains all the fields. Some drop off in the monuments_all table. I think I will just add more fields to the monuments_all table to handle extended descriptions and classifications.
- We have multiple sources, so we have multiple source ids, which should
be kept for update in the future.
- I want our system to allow easily corrections: mainly coordinates.
I'm not sure if both databases need to co-exist (yours being an exported version of our own), as I'd like to have more detail than the monuments_pt_(pt) table.
The monuments database resides on the shared account "erfgoed" (heritage in Dutch) at the Toolserver. We can easily give more people access so we can use it as a shared development place.
Thanks for the tools information. Unfortuneately, I don't do python.
That's no problem at all. The input side is python. You probably want to work on the output side. Php is more suitable for that anyway :-)
Maarten
Regards,
Give me all the monuments within 10km of my home which don't have a photo yet.
I was precisely working on that :). Let's better not duplicate work; and divide work. I can program in Python. But my program only works for Catalan monuments, since I have my own way of accessing them. It's not easy to export. IMHO, we should create a database (for example, in a XML way) common to all countries with WLM. Everyone could therefore develop their own tools and could be used anywhere. Shall we work on that? Maybe KML files would work... I don't know.
Joan Creus.
2011/3/12 Maarten Dammers maarten@mdammers.nl
Hi Nuno,
Op 12-3-2011 21:40, Nuno Tavares schreef:
Maarten,
That was my point: establishing a common interface, instead of each going its own way. I was building a tool like that, at http://wlm.wikimedia.pt/tools/plist http://wlm.wikimedia.pt/monumentos.php
(I think it's pretty straightforward playing around with the simple filter box (caixa de filtros), but would help if you know portuguese, though).
Looks good!
Based on our ETL, I've already detected some errors on the structured lists introduced by the bot conversion, which I hope I can fixed them in time, so everyone can get clean (and complete) lists.
Btw, these lists are pretty old, and we're now updating it with official lists in a versioned warehousing fashion. I was playing last nights around (partial) dynamic statistics: http://wlm.wikimedia.pt/tools/plist/stats.php
(You can easily see that there are more than 14 objects with images).
I'm also trying to add more internal information:
- I want to show progress graphs, I'm sure they'll motivate our
partners;
At the Dutch Wikipedia we maintain quite extensive progress statistics. Next step would be to put these stats in a graph.
- How many of these have already articles - done;
- How many of these (that have article) have already images - half-done,
I want to cross information from Commons, which we'll give far more realistic results.
- We have different status/degrees of classification, I think that
should be kept.
The monuments_pt_(pt) table contains all the fields. Some drop off in the monuments_all table. I think I will just add more fields to the monuments_all table to handle extended descriptions and classifications.
- We have multiple sources, so we have multiple source ids, which should
be kept for update in the future.
- I want our system to allow easily corrections: mainly coordinates.
I'm not sure if both databases need to co-exist (yours being an exported version of our own), as I'd like to have more detail than the monuments_pt_(pt) table.
The monuments database resides on the shared account "erfgoed" (heritage in Dutch) at the Toolserver. We can easily give more people access so we can use it as a shared development place.
Thanks for the tools information. Unfortuneately, I don't do python.
That's no problem at all. The input side is python. You probably want to work on the output side. Php is more suitable for that anyway :-)
Maarten
Regards,
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.eu
Hello all, I just join the mailing list, so maybe I have miss a point :-D
"Give me all the monuments within 10km of my home which don't have a photo yet."
This tools already exist for FR and EN
http://toolserver.org/~myst/coord/ http://toolserver.org/~alexz/coord/
2011/3/13 Joan Creus joan.creus.c@gmail.com
Give me all the monuments within 10km of my home which don't have a photo yet.
I was precisely working on that :). Let's better not duplicate work; and divide work. I can program in Python. But my program only works for Catalan monuments, since I have my own way of accessing them. It's not easy to export. IMHO, we should create a database (for example, in a XML way) common to all countries with WLM. Everyone could therefore develop their own tools and could be used anywhere. Shall we work on that? Maybe KML files would work... I don't know.
Joan Creus.
2011/3/12 Maarten Dammers maarten@mdammers.nl
Hi Nuno,
Op 12-3-2011 21:40, Nuno Tavares schreef:
Maarten,
That was my point: establishing a common interface, instead of each going its own way. I was building a tool like that, at http://wlm.wikimedia.pt/tools/plist http://wlm.wikimedia.pt/monumentos.php
(I think it's pretty straightforward playing around with the simple filter box (caixa de filtros), but would help if you know portuguese, though).
Looks good!
Based on our ETL, I've already detected some errors on the structured lists introduced by the bot conversion, which I hope I can fixed them in time, so everyone can get clean (and complete) lists.
Btw, these lists are pretty old, and we're now updating it with official lists in a versioned warehousing fashion. I was playing last nights around (partial) dynamic statistics: http://wlm.wikimedia.pt/tools/plist/stats.php
(You can easily see that there are more than 14 objects with images).
I'm also trying to add more internal information:
- I want to show progress graphs, I'm sure they'll motivate our
partners;
At the Dutch Wikipedia we maintain quite extensive progress statistics. Next step would be to put these stats in a graph.
- How many of these have already articles - done;
- How many of these (that have article) have already images - half-done,
I want to cross information from Commons, which we'll give far more realistic results.
- We have different status/degrees of classification, I think that
should be kept.
The monuments_pt_(pt) table contains all the fields. Some drop off in the monuments_all table. I think I will just add more fields to the monuments_all table to handle extended descriptions and classifications.
- We have multiple sources, so we have multiple source ids, which should
be kept for update in the future.
- I want our system to allow easily corrections: mainly coordinates.
I'm not sure if both databases need to co-exist (yours being an exported version of our own), as I'd like to have more detail than the monuments_pt_(pt) table.
The monuments database resides on the shared account "erfgoed" (heritage in Dutch) at the Toolserver. We can easily give more people access so we can use it as a shared development place.
Thanks for the tools information. Unfortuneately, I don't do python.
That's no problem at all. The input side is python. You probably want to work on the output side. Php is more suitable for that anyway :-)
Maarten
Regards,
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.eu
Wiki Loves Monuments mailing list WikiLovesMonuments@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikilovesmonuments http://www.wikilovesmonuments.eu
Hi Charles,
Op 13-3-2011 11:52, charles andres schreef:
Hello all, I just join the mailing list, so maybe I have miss a point :-D
"Give me all the monuments within 10km of my home which don't have a photo yet."
This tools already exist for FR and EN
http://toolserver.org/~myst/coord/ http://toolserver.org/%7Emyst/coord/ http://toolserver.org/~alexz/coord/ http://toolserver.org/%7Ealexz/coord/
We can certainly reuse some of the ideas of these tools. This was just an example. We have the monuments in a mysql database. There should be an integrated tool to do: * Different kind of queries (for example the one I just described) * With different kind of output formats (for example KML, JSON, GPX, Layar, etc)
Snippets of these functionality are already available. For example for the structured output formats we could use the Mediawiki api code.
Maarten
Hi Joan,
Op 13-3-2011 11:44, Joan Creus schreef:
Give me all the monuments within 10km of my home which don't have a photo yet.I was precisely working on that :). Let's better not duplicate work; and divide work. I can program in Python. But my program only works for Catalan monuments, since I have my own way of accessing them. It's not easy to export. IMHO, we should create a database (for example, in a XML way) common to all countries with WLM. Everyone could therefore develop their own tools and could be used anywhere. Shall we work on that? Maybe KML files would work... I don't know.
We already have a database common to all countries, see http://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Monuments_2011/Monument...
Maarten
Joan Creus.
wikilovesmonuments@lists.wikimedia.org