Wikimedia Maps-l,
Etienne (80n) is seeking a stable host for another instance of OSM-XAPI http://wiki.openstreetmap.org/wiki/Xapi Request: http://lists.openstreetmap.org/pipermail/talk-gb/2009-June/003965.html
XAPI is currently used as a backend for the Wikipedia demonstration by Tim Alder "Query-to-map" running on WM Toolserver: http://wiki.openstreetmap.org/wiki/Query-to-map
Maybe there is room on one of the new servers? Best to contact 80n for install assistance.
XAPI codebase available here: http://xapi.openstreetmap.org/scripts/
/ Grant
Sounds like something that would go on the osm toolserver (Cassini). The only question to me is how much room it needs in the database. from what i gather, there will be no room for all data about everythiong on the map TS.
But it's Tim's job now to investigate this :)
-- daniel
Grant Slater schrieb:
Wikimedia Maps-l,
Etienne (80n) is seeking a stable host for another instance of OSM-XAPI http://wiki.openstreetmap.org/wiki/Xapi Request: http://lists.openstreetmap.org/pipermail/talk-gb/2009-June/003965.html
XAPI is currently used as a backend for the Wikipedia demonstration by Tim Alder "Query-to-map" running on WM Toolserver: http://wiki.openstreetmap.org/wiki/Query-to-map
Maybe there is room on one of the new servers? Best to contact 80n for install assistance.
XAPI codebase available here: http://xapi.openstreetmap.org/scripts/
/ Grant
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
It would need about 350Gb.
On Tue, Jun 16, 2009 at 1:12 PM, Daniel Kinzler <daniel.kinzler@wikimedia.de
wrote:
Sounds like something that would go on the osm toolserver (Cassini). The only question to me is how much room it needs in the database. from what i gather, there will be no room for all data about everythiong on the map TS.
But it's Tim's job now to investigate this :)
-- daniel
Grant Slater schrieb:
Wikimedia Maps-l,
Etienne (80n) is seeking a stable host for another instance of OSM-XAPI http://wiki.openstreetmap.org/wiki/Xapi Request: http://lists.openstreetmap.org/pipermail/talk-gb/2009-June/003965.html
XAPI is currently used as a backend for the Wikipedia demonstration by Tim Alder "Query-to-map" running on WM Toolserver: http://wiki.openstreetmap.org/wiki/Query-to-map
Maybe there is room on one of the new servers? Best to contact 80n for install assistance.
XAPI codebase available here: http://xapi.openstreetmap.org/scripts/
/ Grant
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
--
Daniel Kinzler Software Developer Wikimedia Deutschland
Phone +49 30 219 158 260
Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us achieve that! http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
80n schrieb:
It would need about 350Gb.
Phew. Hm... what would that include? Is that data useful for others as well, or is it a smecpailized index?
That amount of data for a single tool is probably too much, but if the data is useful for all, it might be feseable.
-- daniel
On Tue, Jun 16, 2009 at 1:12 PM, Daniel Kinzler <daniel.kinzler@wikimedia.de mailto:daniel.kinzler@wikimedia.de> wrote:
Sounds like something that would go on the osm toolserver (Cassini). The only question to me is how much room it needs in the database. from what i gather, there will be no room for all data about everythiong on the map TS. But it's Tim's job now to investigate this :) -- daniel Grant Slater schrieb: > Wikimedia Maps-l, > > Etienne (80n) is seeking a stable host for another instance of OSM-XAPI > http://wiki.openstreetmap.org/wiki/Xapi > Request: > http://lists.openstreetmap.org/pipermail/talk-gb/2009-June/003965.html > > XAPI is currently used as a backend for the Wikipedia demonstration by > Tim Alder "Query-to-map" running on WM Toolserver: > http://wiki.openstreetmap.org/wiki/Query-to-map > > Maybe there is room on one of the new servers? Best to contact 80n for > install assistance. > > XAPI codebase available here: > http://xapi.openstreetmap.org/scripts/ > > / Grant > > _______________________________________________ > Maps-l mailing list > Maps-l@lists.wikimedia.org <mailto:Maps-l@lists.wikimedia.org> > https://lists.wikimedia.org/mailman/listinfo/maps-l -- Daniel Kinzler Software Developer Wikimedia Deutschland Phone +49 30 219 158 260 Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us achieve that! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985. _______________________________________________ Maps-l mailing list Maps-l@lists.wikimedia.org <mailto:Maps-l@lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/maps-l
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Daniel It's a specialised index, but the resulting API has lots of uses. Query-to-map is one such use. Almost anything that reads data from the OSM API could use XAPI as an alternative.
80n
On Tue, Jun 16, 2009 at 1:31 PM, Daniel Kinzler <daniel.kinzler@wikimedia.de
wrote:
80n schrieb:
It would need about 350Gb.
Phew. Hm... what would that include? Is that data useful for others as well, or is it a smecpailized index?
That amount of data for a single tool is probably too much, but if the data is useful for all, it might be feseable.
-- daniel
On Tue, Jun 16, 2009 at 1:12 PM, Daniel Kinzler <daniel.kinzler@wikimedia.de mailto:daniel.kinzler@wikimedia.de>
wrote:
Sounds like something that would go on the osm toolserver (Cassini). The only question to me is how much room it needs in the database. from what i gather, there will be no room for all data about everythiong on the map TS. But it's Tim's job now to investigate this :) -- daniel Grant Slater schrieb: > Wikimedia Maps-l, > > Etienne (80n) is seeking a stable host for another instance of OSM-XAPI > http://wiki.openstreetmap.org/wiki/Xapi > Request: >http://lists.openstreetmap.org/pipermail/talk-gb/2009-June/003965.html
> > XAPI is currently used as a backend for the Wikipedia demonstrationby
> Tim Alder "Query-to-map" running on WM Toolserver: > http://wiki.openstreetmap.org/wiki/Query-to-map > > Maybe there is room on one of the new servers? Best to contact 80nfor
> install assistance. > > XAPI codebase available here: > http://xapi.openstreetmap.org/scripts/ > > / Grant > > _______________________________________________ > Maps-l mailing list > Maps-l@lists.wikimedia.org <mailto:Maps-l@lists.wikimedia.org> > https://lists.wikimedia.org/mailman/listinfo/maps-l -- Daniel Kinzler Software Developer Wikimedia Deutschland Phone +49 30 219 158 260 Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us achieve that! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985. _______________________________________________ Maps-l mailing list Maps-l@lists.wikimedia.org <mailto:Maps-l@lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/maps-l
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
--
Daniel Kinzler Software Developer Wikimedia Deutschland
Phone +49 30 219 158 260
Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us achieve that! http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
80n schrieb:
Daniel It's a specialised index, but the resulting API has lots of uses. Query-to-map is one such use. Almost anything that reads data from the OSM API could use XAPI as an alternative.
Hm... discuss it with Tim and Avar perhaps. You would be using about 20% of the total resources, that doesn't sound good.
-- daniel
As far as I see this could be the basis of many other projects.
Maybe just give it a try and see how much it will be used?
Peter
Am 16.06.2009 um 16:42 schrieb Daniel Kinzler <daniel.kinzler@wikimedia.de
:
80n schrieb:
Daniel It's a specialised index, but the resulting API has lots of uses. Query-to-map is one such use. Almost anything that reads data from the OSM API could use XAPI as an alternative.
Hm... discuss it with Tim and Avar perhaps. You would be using about 20% of the total resources, that doesn't sound good.
-- daniel
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
If someone could give me an account, on whichever box is most appropriate, I could get started on setting it up.
On Tue, Jun 16, 2009 at 4:22 PM, "Körner, Peter" peter@mazdermind.dewrote:
As far as I see this could be the basis of many other projects.
Maybe just give it a try and see how much it will be used?
Peter
Am 16.06.2009 um 16:42 schrieb Daniel Kinzler <daniel.kinzler@wikimedia.de
:
80n schrieb:
Daniel It's a specialised index, but the resulting API has lots of uses. Query-to-map is one such use. Almost anything that reads data from the OSM API could use XAPI as an alternative.
Hm... discuss it with Tim and Avar perhaps. You would be using about 20% of the total resources, that doesn't sound good.
-- daniel
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
80n schrieb:
If someone could give me an account, on whichever box is most appropriate, I could get started on setting it up.
There was a mix up during racking, Cassini and Ortelius were switched and ended up in the wrong racks. It will probably take until next week until that is sorted out.
On Tue, Jun 16, 2009 at 2:42 PM, Daniel Kinzlerdaniel.kinzler@wikimedia.de wrote:
80n schrieb:
Daniel It's a specialised index, but the resulting API has lots of uses. Query-to-map is one such use. Almost anything that reads data from the OSM API could use XAPI as an alternative.
Hm... discuss it with Tim and Avar perhaps. You would be using about 20% of the total resources, that doesn't sound good.
Total disk resources? (where are the server specs anyway?).
XAPI is useful, and if we can host it we probably should, it'll be useful to some toolserver users and we can always throw it out later if it becomes a problem.
A lot of people in the OSM community are also missing XAPI so it'll give us some initial publicity / hammering of the server :)
Total disk resources? (where are the server specs anyway?).
Looking at the specs again, I see I was wrong - the toolserver is going to have far less room than that. It really can't take 350 GB, it only 584 total. I was calculating with 2TB, but that's the DB server.
Reiterating the server specs:
* Cassini, the Toolserver: X4150, 2x4 cores, 24 GB RAM, 4*146 GB Disks ~ 1/2 TB * Ptolemy, the database: X4250, 2x4 cores, 32 GB RAM, 16*146 GB Disks ~ 2 TB * Ortelius, squid/render: 1x4 cores, 28 GB RAM, 4*146 GB Disk ~ 1/2 TB
XAPI is useful, and if we can host it we probably should, it'll be useful to some toolserver users and we can always throw it out later if it becomes a problem.
So, this means it can only be on the production servers. That would mean extending the original profile the servers were layed out for, and it raises the question of access. How is the XAPI accessed? Is it a standalone server? Does it need apache? So far, I think Ortelius would run squid and lighttpd.
Also, who would maintain it on the production boxes? And is mark OK with having an extra service there?
On Tue, Jun 16, 2009 at 9:10 PM, Daniel Kinzler <daniel.kinzler@wikimedia.de
wrote:
Total disk resources? (where are the server specs anyway?).
Looking at the specs again, I see I was wrong - the toolserver is going to have far less room than that. It really can't take 350 GB, it only 584 total. I was calculating with 2TB, but that's the DB server.
Reiterating the server specs:
- Cassini, the Toolserver: X4150, 2x4 cores, 24 GB RAM, 4*146 GB Disks ~
1/2 TB
- Ptolemy, the database: X4250, 2x4 cores, 32 GB RAM, 16*146 GB Disks ~ 2
TB
- Ortelius, squid/render: 1x4 cores, 28 GB RAM, 4*146 GB Disk ~ 1/2 TB
XAPI is useful, and if we can host it we probably should, it'll be useful to some toolserver users and we can always throw it out later if it becomes a problem.
So, this means it can only be on the production servers. That would mean extending the original profile the servers were layed out for, and it raises the question of access. How is the XAPI accessed? Is it a standalone server? Does it need apache? So far, I think Ortelius would run squid and lighttpd.
XAPI is pretty independent of anything else. The api is published via http. Usually using Apache. I've not tried it with lighttpd but it only requires CGI and URL-rewriting. lighttpd supports both of these so that shouldn't be an issue.
Also, who would maintain it on the production boxes? And is mark OK with having an extra service there?
I'd be prepared to maintain it, wherever it ends up.
80n
On Tue, Jun 16, 2009 at 3:16 PM, Ævar Arnfjörð Bjarmason avarab@gmail.comwrote:
Total disk resources? (where are the server specs anyway?).
XAPI is useful, and if we can host it we probably should, it'll be useful to some toolserver users and we can always throw it out later if it becomes a problem.
A lot of people in the OSM community are also missing XAPI so it'll give us some initial publicity / hammering of the server :)
Agree that XAPI would be useful for many tools and projects, and suggest we host it.
I see some server specs here: https://wiki.toolserver.org/view/Servers
At some point, if we needed to add more disk space, what is the maximum capacity for the servers?
I have spoken with people at NASA about getting a copy of the World Wind imagery (e.g. Blue Marble, Landsat, aerial imagery, or whatever we want). If provided with additional disks of imagery data, can they be added -- probably to the production servers?
-Aude
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
I have spoken with people at NASA about getting a copy of the World Wind imagery (e.g. Blue Marble, Landsat, aerial imagery, or whatever we want). If provided with additional disks of imagery data, can they be added -- probably to the production servers?
I think the internal space for disks is pretty much maxed out. We have a couple of arrays sitting in the toolserver rack which we might use for something like that. Flat file data may also be hosted on the big file store box we have in amsterdam.
So... it's possible, it's not trivial though. The people to talk to are mark and river, I suppose.
On Tue, Jun 16, 2009 at 5:23 PM, Daniel Kinzler <daniel.kinzler@wikimedia.de
wrote:
I have spoken with people at NASA about getting a copy of the World Wind imagery (e.g. Blue Marble, Landsat, aerial imagery, or whatever we want). If provided with additional disks of imagery data, can they be added -- probably to the production servers?
I think the internal space for disks is pretty much maxed out. We have a couple of arrays sitting in the toolserver rack which we might use for something like that. Flat file data may also be hosted on the big file store box we have in amsterdam.
So... it's possible, it's not trivial though. The people to talk to are mark and river, I suppose.
I know it's not trivial. I can talk to Mark and River.
-Aude
--
Daniel Kinzler Software Developer Wikimedia Deutschland
Phone +49 30 219 158 260
Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us achieve that! http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l