Here's an update on the server status from Daniel, looks like we won't be able to do anything with the servers until the end of the month. Cassini (the osm-toolserver) is also down for what looks like until the end of the month.
I'll be afk for almost all of august leading up to Wikimania so I the things I need before that time I'm just going to set up on my own somewhat more limited colo server.
---------- Forwarded message ---------- From: Daniel Kinzler daniel.kinzler@wikimedia.de Date: Mon, Jul 13, 2009 at 1:19 PM Subject: OSM server status To: Ævar Arnfjörð Bjarmason avarab@gmail.com, Sven Anders sven@anders-hamburg.de, Kolossos tim.alder@s2002.tu-chemnitz.de
Hi all
Jens just told me that we'll have to wait some more until the OSM boxes are up. There is currently no console access, so Jens can't set up the OS. This will have to wait until Mark is back, it seems. Mark is graduating, so we only have someone for emergencies at the colo. Any hardware setup has to wait until he is back, which will be at the end of july.
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
* Set up a Planet.osm -> Cassini mirror * Set up a multilingular PostGIS database (see https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition * Set up mapnik 0.6 with a multilingular CGI export script, something like this: http://svn.openstreetmap.org/sites/tile.openstreetmap.org/cgi-bin/export * A corresponding mod_tile / renderd config: http://wiki.openstreetmap.org/index.php/Mod_tile * A squid in front of this all to take the load off apache/the export script
Then I'm going to set up a MediaWiki installation on my personal box which'll use these services via the SlippyMap plugin.
On Mon, Jul 13, 2009 at 2:12 PM, Ævar Arnfjörð Bjarmasonavarab@gmail.com wrote:
Here's an update on the server status from Daniel, looks like we won't be able to do anything with the servers until the end of the month. Cassini (the osm-toolserver) is also down for what looks like until the end of the month.
I'll be afk for almost all of august leading up to Wikimania so I the things I need before that time I'm just going to set up on my own somewhat more limited colo server.
---------- Forwarded message ---------- From: Daniel Kinzler daniel.kinzler@wikimedia.de Date: Mon, Jul 13, 2009 at 1:19 PM Subject: OSM server status To: Ævar Arnfjörð Bjarmason avarab@gmail.com, Sven Anders sven@anders-hamburg.de, Kolossos tim.alder@s2002.tu-chemnitz.de
Hi all
Jens just told me that we'll have to wait some more until the OSM boxes are up. There is currently no console access, so Jens can't set up the OS. This will have to wait until Mark is back, it seems. Mark is graduating, so we only have someone for emergencies at the colo. Any hardware setup has to wait until he is back, which will be at the end of july.
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com:
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
- Set up a Planet.osm -> Cassini mirror
- Set up a multilingular PostGIS database (see
https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
Thanks Colin
On Sat, Jul 18, 2009 at 5:45 PM, Colin Marquardtcmarqu42@googlemail.com wrote:
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com:
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
- Set up a Planet.osm -> Cassini mirror
- Set up a multilingular PostGIS database (see
https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
What I'm setting up now on Cassini is just a temporary hacky system that rightly should be setup on the database server / tileserver, it'll be taken down again once the rest of this stuff is up.
I'm taking notes on what I'm doing here as I go along:
https://wiki.toolserver.org/view/Cassini/Setup_notes
and here are some scripts in MW svn I'm writing:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/
It would be easy to add stuff the hiking map needs, but this is all a temporary setup anyway so we shouldn't move any production stuff to it I think.
On 7/19/09, Ævar Arnfjörð Bjarmason avarab@gmail.com wrote:
On Sat, Jul 18, 2009 at 5:45 PM, Colin Marquardtcmarqu42@googlemail.com wrote:
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com:
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
- Set up a Planet.osm -> Cassini mirror
- Set up a multilingular PostGIS database (see
https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
What I'm setting up now on Cassini is just a temporary hacky system that rightly should be setup on the database server / tileserver, it'll be taken down again once the rest of this stuff is up.
I'm taking notes on what I'm doing here as I go along:
https://wiki.toolserver.org/view/Cassini/Setup_notes
and here are some scripts in MW svn I'm writing:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/
It would be easy to add stuff the hiking map needs, but this is all a temporary setup anyway so we shouldn't move any production stuff to it I think.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Is there anything you need help with, such as setting up the database.
For the setup on the toolserver, I am fine with trying things and see how they work. But, I hope that we won't be locked into using one set of tools for rendering and working with the OSM data. It would be good to try alternative ways of styling the data that fit with what Wikimedia needs, beyond just supporting multiple languages.
-Aude
On Tue, Jul 21, 2009 at 2:01 PM, Audeaude.wiki@gmail.com wrote:
On 7/19/09, Ævar Arnfjörð Bjarmason avarab@gmail.com wrote:
On Sat, Jul 18, 2009 at 5:45 PM, Colin Marquardtcmarqu42@googlemail.com wrote:
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com:
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
- Set up a Planet.osm -> Cassini mirror
- Set up a multilingular PostGIS database (see
https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
What I'm setting up now on Cassini is just a temporary hacky system that rightly should be setup on the database server / tileserver, it'll be taken down again once the rest of this stuff is up.
I'm taking notes on what I'm doing here as I go along:
https://wiki.toolserver.org/view/Cassini/Setup_notes
and here are some scripts in MW svn I'm writing:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/
It would be easy to add stuff the hiking map needs, but this is all a temporary setup anyway so we shouldn't move any production stuff to it I think.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Is there anything you need help with, such as setting up the database.
These are the notes I'm taking when setting it up: http://www.mediawiki.org/wiki/Extension:SlippyMap/Cassini/Setup_notes
and here are the scripts I'm writing to make things easier: http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/osm2pgsql-st...
What needs to be done is:
* Hack up an export script: https://bugzilla.wikimedia.org/show_bug.cgi?id=19860 https://bugzilla.wikimedia.org/show_bug.cgi?id=19861
This is an easy task someone else could do.
* Set up apache/mod_tile
I'll try to do this when the osm2pgsql --slim import finishes.
* Set up planet.osm/osm2pgsql mirroring so that it's automatically updated.
I haven't looked into how to do this. It would be very helpful if someone would read up on the optimal way to configure postgres / how to do this updating so that I can stick something in cron that'll keep it up-to-date.
* Set up squid in front of the cgi-bin/export script & tile server
Someone just needs to give me a squid config I can use, or alternatively it would probably be better to adapt the tile cache Jens set up so that it can cache cassini too.
For the setup on the toolserver, I am fine with trying things and see how they work. But, I hope that we won't be locked into using one set of tools for rendering and working with the OSM data. It would be good to try alternative ways of styling the data that fit with what Wikimedia needs, beyond just supporting multiple languages.
Oh yes, what I'm doing now is just a hacky way of getting something to run. We'll want some alternative styles later (if we can get someone to maintain it!) but in the meantime I'm just poking the box because it's better than having it idle.
Of course for some osm2pgsql styles (like the hikingmap) we'll need to add extra fields to the postgis database.
Whether we're going to need one "production" rendering DB that does the main rendering Wikipedia wants to use and another one with a lot of fields or just shove everything in the DB & replicate it or something else is something we're going to have to figure out once we actually have a database server and some users to run tools.
Speaking of which why don't we have any users yet? Is everything stalled on getting the DB machine up or are there some tools that can just use Cassini as-is? How is Unix-account approval being managed (who's taking care of that?).
FWIW, I got my toolserver account two weeks ago. Colin
2009/7/21, Ævar Arnfjörð Bjarmason avarab@gmail.com:
On Tue, Jul 21, 2009 at 2:01 PM, Audeaude.wiki@gmail.com wrote:
On 7/19/09, Ævar Arnfjörð Bjarmason avarab@gmail.com wrote:
On Sat, Jul 18, 2009 at 5:45 PM, Colin Marquardtcmarqu42@googlemail.com wrote:
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com:
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
- Set up a Planet.osm -> Cassini mirror
- Set up a multilingular PostGIS database (see
https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
What I'm setting up now on Cassini is just a temporary hacky system that rightly should be setup on the database server / tileserver, it'll be taken down again once the rest of this stuff is up.
I'm taking notes on what I'm doing here as I go along:
https://wiki.toolserver.org/view/Cassini/Setup_notes
and here are some scripts in MW svn I'm writing:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/
It would be easy to add stuff the hiking map needs, but this is all a temporary setup anyway so we shouldn't move any production stuff to it I think.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Is there anything you need help with, such as setting up the database.
These are the notes I'm taking when setting it up: http://www.mediawiki.org/wiki/Extension:SlippyMap/Cassini/Setup_notes
and here are the scripts I'm writing to make things easier: http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/osm2pgsql-st...
What needs to be done is:
- Hack up an export script:
https://bugzilla.wikimedia.org/show_bug.cgi?id=19860 https://bugzilla.wikimedia.org/show_bug.cgi?id=19861
This is an easy task someone else could do.
- Set up apache/mod_tile
I'll try to do this when the osm2pgsql --slim import finishes.
- Set up planet.osm/osm2pgsql mirroring so that it's automatically updated.
I haven't looked into how to do this. It would be very helpful if someone would read up on the optimal way to configure postgres / how to do this updating so that I can stick something in cron that'll keep it up-to-date.
- Set up squid in front of the cgi-bin/export script & tile server
Someone just needs to give me a squid config I can use, or alternatively it would probably be better to adapt the tile cache Jens set up so that it can cache cassini too.
For the setup on the toolserver, I am fine with trying things and see how they work. But, I hope that we won't be locked into using one set of tools for rendering and working with the OSM data. It would be good to try alternative ways of styling the data that fit with what Wikimedia needs, beyond just supporting multiple languages.
Oh yes, what I'm doing now is just a hacky way of getting something to run. We'll want some alternative styles later (if we can get someone to maintain it!) but in the meantime I'm just poking the box because it's better than having it idle.
Of course for some osm2pgsql styles (like the hikingmap) we'll need to add extra fields to the postgis database.
Whether we're going to need one "production" rendering DB that does the main rendering Wikipedia wants to use and another one with a lot of fields or just shove everything in the DB & replicate it or something else is something we're going to have to figure out once we actually have a database server and some users to run tools.
Speaking of which why don't we have any users yet? Is everything stalled on getting the DB machine up or are there some tools that can just use Cassini as-is? How is Unix-account approval being managed (who's taking care of that?).
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
On Tue, Jul 21, 2009 at 2:40 PM, Ævar Arnfjörð Bjarmasonavarab@gmail.com wrote:
On Tue, Jul 21, 2009 at 2:01 PM, Audeaude.wiki@gmail.com wrote:
On 7/19/09, Ævar Arnfjörð Bjarmason avarab@gmail.com wrote:
On Sat, Jul 18, 2009 at 5:45 PM, Colin Marquardtcmarqu42@googlemail.com wrote:
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com:
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
- Set up a Planet.osm -> Cassini mirror
- Set up a multilingular PostGIS database (see
https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
What I'm setting up now on Cassini is just a temporary hacky system that rightly should be setup on the database server / tileserver, it'll be taken down again once the rest of this stuff is up.
I'm taking notes on what I'm doing here as I go along:
https://wiki.toolserver.org/view/Cassini/Setup_notes
and here are some scripts in MW svn I'm writing:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/
It would be easy to add stuff the hiking map needs, but this is all a temporary setup anyway so we shouldn't move any production stuff to it I think.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Is there anything you need help with, such as setting up the database.
These are the notes I'm taking when setting it up: http://www.mediawiki.org/wiki/Extension:SlippyMap/Cassini/Setup_notes
and here are the scripts I'm writing to make things easier: http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/osm2pgsql-st...
What needs to be done is:
- Hack up an export script:
https://bugzilla.wikimedia.org/show_bug.cgi?id=19860 https://bugzilla.wikimedia.org/show_bug.cgi?id=19861
I've been hacking this up at my box. It now renders maps in different locales depending on what locale= I pass to it. It also supporst maptype= but currently I only have osm-like/ stylesheets. It would be easy to add new stylesheets though if someone made them.
- Set up apache/mod_tile
I'll try to do this when the osm2pgsql --slim import finishes.
The import is still running:
Processing: Node(387769k) Way(28714k) Relation(0k)
Hopefully it'll finish tonight.
And here's a new todo:
* Get renderd running
This is pending the completion of the osm2pgsql import.
It would be neat to inject into the rendering queue the area that corresponds to what the static map we generate covers.
On Tue, Jul 21, 2009 at 8:31 PM, Ævar Arnfjörð Bjarmasonavarab@gmail.com wrote:
On Tue, Jul 21, 2009 at 2:40 PM, Ævar Arnfjörð Bjarmasonavarab@gmail.com wrote:
On Tue, Jul 21, 2009 at 2:01 PM, Audeaude.wiki@gmail.com wrote:
On 7/19/09, Ævar Arnfjörð Bjarmason avarab@gmail.com wrote:
On Sat, Jul 18, 2009 at 5:45 PM, Colin Marquardtcmarqu42@googlemail.com wrote:
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com:
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
- Set up a Planet.osm -> Cassini mirror
- Set up a multilingular PostGIS database (see
https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
What I'm setting up now on Cassini is just a temporary hacky system that rightly should be setup on the database server / tileserver, it'll be taken down again once the rest of this stuff is up.
I'm taking notes on what I'm doing here as I go along:
https://wiki.toolserver.org/view/Cassini/Setup_notes
and here are some scripts in MW svn I'm writing:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/
It would be easy to add stuff the hiking map needs, but this is all a temporary setup anyway so we shouldn't move any production stuff to it I think.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Is there anything you need help with, such as setting up the database.
These are the notes I'm taking when setting it up: http://www.mediawiki.org/wiki/Extension:SlippyMap/Cassini/Setup_notes
and here are the scripts I'm writing to make things easier: http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/osm2pgsql-st...
What needs to be done is:
- Hack up an export script:
https://bugzilla.wikimedia.org/show_bug.cgi?id=19860 https://bugzilla.wikimedia.org/show_bug.cgi?id=19861
I've been hacking this up at my box. It now renders maps in different locales depending on what locale= I pass to it. It also supporst maptype= but currently I only have osm-like/ stylesheets. It would be easy to add new stylesheets though if someone made them.
- Set up apache/mod_tile
I'll try to do this when the osm2pgsql --slim import finishes.
The import is still running:
Processing: Node(387769k) Way(28714k) Relation(0k)
Hopefully it'll finish tonight.
And here's a new todo:
- Get renderd running
This is pending the completion of the osm2pgsql import.
renderd is now running with fr/nl:
http://cassini.toolserver.org/browse-fr.html http://cassini.toolserver.org/browse-nl.html
I'll put up the static renderer & the rest of the Wikipedia languages later.
It would be neat to inject into the rendering queue the area that corresponds to what the static map we generate covers.
On Wed, Jul 22, 2009 at 12:51 PM, Ævar Arnfjörð Bjarmasonavarab@gmail.com wrote:
On Tue, Jul 21, 2009 at 8:31 PM, Ævar Arnfjörð Bjarmasonavarab@gmail.com wrote:
On Tue, Jul 21, 2009 at 2:40 PM, Ævar Arnfjörð Bjarmasonavarab@gmail.com wrote:
On Tue, Jul 21, 2009 at 2:01 PM, Audeaude.wiki@gmail.com wrote:
On 7/19/09, Ævar Arnfjörð Bjarmason avarab@gmail.com wrote:
On Sat, Jul 18, 2009 at 5:45 PM, Colin Marquardtcmarqu42@googlemail.com wrote:
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com: > Cassini is back up now thanks to the Toolserver admins, since it's > inactive at the moment I'm going to set it up with a rendering stack > that'll run until Wikimania, of course if the database server pops > back up at the beginning of august we may actually have something > production ready by that time. > > So what I'm going to do with it (pending objections) is: > > * Set up a Planet.osm -> Cassini mirror > * Set up a multilingular PostGIS database (see > https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should > take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
What I'm setting up now on Cassini is just a temporary hacky system that rightly should be setup on the database server / tileserver, it'll be taken down again once the rest of this stuff is up.
I'm taking notes on what I'm doing here as I go along:
https://wiki.toolserver.org/view/Cassini/Setup_notes
and here are some scripts in MW svn I'm writing:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/
It would be easy to add stuff the hiking map needs, but this is all a temporary setup anyway so we shouldn't move any production stuff to it I think.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Is there anything you need help with, such as setting up the database.
These are the notes I'm taking when setting it up: http://www.mediawiki.org/wiki/Extension:SlippyMap/Cassini/Setup_notes
and here are the scripts I'm writing to make things easier: http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/osm2pgsql-st...
What needs to be done is:
- Hack up an export script:
https://bugzilla.wikimedia.org/show_bug.cgi?id=19860 https://bugzilla.wikimedia.org/show_bug.cgi?id=19861
I've been hacking this up at my box. It now renders maps in different locales depending on what locale= I pass to it. It also supporst maptype= but currently I only have osm-like/ stylesheets. It would be easy to add new stylesheets though if someone made them.
- Set up apache/mod_tile
I'll try to do this when the osm2pgsql --slim import finishes.
The import is still running:
Processing: Node(387769k) Way(28714k) Relation(0k)
Hopefully it'll finish tonight.
And here's a new todo:
- Get renderd running
This is pending the completion of the osm2pgsql import.
renderd is now running with fr/nl:
http://cassini.toolserver.org/browse-fr.html http://cassini.toolserver.org/browse-nl.html
I'll put up the static renderer & the rest of the Wikipedia languages later.
All 279 languages are now up, note that clicking on any of those will very likely yield a blank page when you first try it since it'll have to render the world at zoom 2 for that language (unless someone had it rendered already):
http://cassini.toolserver.org/tile-browse/
But some of them are already up:
http://cassini.toolserver.org/tile-browse/browse-de.html
The static export script is also there, it has additional locale=* and maptype=* keys. with only the osm-like maptype being supported at the moment:
http://cassini.toolserver.org/cgi-bin/export?bbox=-21.9641,64.0961,-21.7125,...
All 279 languages are now up, note that clicking on any of those will very likely yield a blank page when you first try it since it'll have to render the world at zoom 2 for that language (unless someone had it rendered already):
http://cassini.toolserver.org/tile-browse/
But some of them are already up:
I came across some encoding problems on the german map: http://tinyurl.com/ngu965
they seem to be better on the english one: http://tinyurl.com/msqlea
but in comparison to the official osm-page they are missing localized names: http://tinyurl.com/mwd64c
i also saw some not-translated country-names. e.g. on http://tinyurl.com/m6rhc5 "Democratic Republic of the Congo" should read "Demokratische Republik Kongo", also "Central African Republic" should be "Zentralafrikanische Republik".
Peter
Hi there
i'd like to ask if this issue is being addressed. I'm sure these problems exist in other languages, too. I'm not familar with configuring mapnik, so i don't think i can be of any use, beside of pointing on some error-spots.
Peter
Peter Körner schrieb:
All 279 languages are now up, note that clicking on any of those will very likely yield a blank page when you first try it since it'll have to render the world at zoom 2 for that language (unless someone had it rendered already):
http://cassini.toolserver.org/tile-browse/
But some of them are already up:
I came across some encoding problems on the german map: http://tinyurl.com/ngu965
they seem to be better on the english one: http://tinyurl.com/msqlea
but in comparison to the official osm-page they are missing localized names: http://tinyurl.com/mwd64c
i also saw some not-translated country-names. e.g. on http://tinyurl.com/m6rhc5 "Democratic Republic of the Congo" should read "Demokratische Republik Kongo", also "Central African Republic" should be "Zentralafrikanische Republik".
Peter
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
On Wed, Jul 22, 2009 at 8:34 PM, Peter Körnerpeter@mazdermind.de wrote:
All 279 languages are now up, note that clicking on any of those will very likely yield a blank page when you first try it since it'll have to render the world at zoom 2 for that language (unless someone had it rendered already):
http://cassini.toolserver.org/tile-browse/
But some of them are already up:
I came across some encoding problems on the german map: http://tinyurl.com/ngu965
they seem to be better on the english one: http://tinyurl.com/msqlea
but in comparison to the official osm-page they are missing localized names: http://tinyurl.com/mwd64c
i also saw some not-translated country-names. e.g. on http://tinyurl.com/m6rhc5 "Democratic Republic of the Congo" should read "Demokratische Republik Kongo", also "Central African Republic" should be "Zentralafrikanische Republik".
Sorry I missed this E-Mail 6 days ago.
All the issues you point out can be explained by what tags the OSM data contains and how the translation views for the i18n map work.
When I render the German map I'm checking if a "name:de" key exists for the given feature, if it does I use that, if not I fall back on "name".
Here's one of the towns in your first examples:
http://www.openstreetmap.org/browse/node/245765070
As you can see it has name:en but no name:de
And the reason you see "Democratic Republic of the Congo" but not "Demokratische Republik Kongo" is because that country node has no name:de tag:
Ævar Arnfjörð Bjarmason schrieb:
On Wed, Jul 22, 2009 at 8:34 PM, Peter Körnerpeter@mazdermind.de wrote:
All 279 languages are now up, note that clicking on any of those will very likely yield a blank page when you first try it since it'll have to render the world at zoom 2 for that language (unless someone had it rendered already):
http://cassini.toolserver.org/tile-browse/
But some of them are already up:
I came across some encoding problems on the german map: http://tinyurl.com/ngu965
they seem to be better on the english one: http://tinyurl.com/msqlea
but in comparison to the official osm-page they are missing localized names: http://tinyurl.com/mwd64c
i also saw some not-translated country-names. e.g. on http://tinyurl.com/m6rhc5 "Democratic Republic of the Congo" should read "Demokratische Republik Kongo", also "Central African Republic" should be "Zentralafrikanische Republik".
Sorry I missed this E-Mail 6 days ago.
All the issues you point out can be explained by what tags the OSM data contains and how the translation views for the i18n map work.
When I render the German map I'm checking if a "name:de" key exists for the given feature, if it does I use that, if not I fall back on "name".
Here's one of the towns in your first examples:
http://www.openstreetmap.org/browse/node/245765070
As you can see it has name:en but no name:de
Okay, it seems, that in Zoomlevel 7 everything is ok (http://cassini.toolserver.org/tiles/osm-like/de/7/92/53.png) but in Level 6 the special characters are still missing: http://cassini.toolserver.org/tiles/osm-like/de/6/46/26.png
And the reason you see "Democratic Republic of the Congo" but not "Demokratische Republik Kongo" is because that country node has no name:de tag:
Hey, cool! I didn't know editing country-names is as easy as editing other POIs. So I'll go ahead and add the German names to where it seems necessary.
Peter
On Tue, Jul 28, 2009 at 8:40 PM, Peter Körnerpeter@mazdermind.de wrote:
Ævar Arnfjörð Bjarmason schrieb:
On Wed, Jul 22, 2009 at 8:34 PM, Peter Körnerpeter@mazdermind.de wrote:
All 279 languages are now up, note that clicking on any of those will very likely yield a blank page when you first try it since it'll have to render the world at zoom 2 for that language (unless someone had it rendered already):
http://cassini.toolserver.org/tile-browse/
But some of them are already up:
I came across some encoding problems on the german map: http://tinyurl.com/ngu965
they seem to be better on the english one: http://tinyurl.com/msqlea
but in comparison to the official osm-page they are missing localized names: http://tinyurl.com/mwd64c
i also saw some not-translated country-names. e.g. on http://tinyurl.com/m6rhc5 "Democratic Republic of the Congo" should read "Demokratische Republik Kongo", also "Central African Republic" should be "Zentralafrikanische Republik".
Sorry I missed this E-Mail 6 days ago.
All the issues you point out can be explained by what tags the OSM data contains and how the translation views for the i18n map work.
When I render the German map I'm checking if a "name:de" key exists for the given feature, if it does I use that, if not I fall back on "name".
Here's one of the towns in your first examples:
http://www.openstreetmap.org/browse/node/245765070
As you can see it has name:en but no name:de
Okay, it seems, that in Zoomlevel 7 everything is ok (http://cassini.toolserver.org/tiles/osm-like/de/7/92/53.png) but in Level 6 the special characters are still missing: http://cassini.toolserver.org/tiles/osm-like/de/6/46/26.png
Those both look the same to me, i.e. the Hindi characters appear just fine. All the tiles currently on the server are also rendered after I installed unifont fonts so all the asian languages should appear correctly.
And the reason you see "Democratic Republic of the Congo" but not "Demokratische Republik Kongo" is because that country node has no name:de tag:
Hey, cool! I didn't know editing country-names is as easy as editing other POIs. So I'll go ahead and add the German names to where it seems necessary.
Yay, but for the moment they won't appear on the i18n map since we're not updating automatically from the planet dumps, yet.
Ævar Arnfjörð Bjarmason schrieb:
On Tue, Jul 28, 2009 at 8:40 PM, Peter Körnerpeter@mazdermind.de wrote:
Ævar Arnfjörð Bjarmason schrieb:
On Wed, Jul 22, 2009 at 8:34 PM, Peter Körnerpeter@mazdermind.de wrote:
All 279 languages are now up, note that clicking on any of those will very likely yield a blank page when you first try it since it'll have to render the world at zoom 2 for that language (unless someone had it rendered already):
http://cassini.toolserver.org/tile-browse/
But some of them are already up:
I came across some encoding problems on the german map: http://tinyurl.com/ngu965
they seem to be better on the english one: http://tinyurl.com/msqlea
but in comparison to the official osm-page they are missing localized names: http://tinyurl.com/mwd64c
i also saw some not-translated country-names. e.g. on http://tinyurl.com/m6rhc5 "Democratic Republic of the Congo" should read "Demokratische Republik Kongo", also "Central African Republic" should be "Zentralafrikanische Republik".
Sorry I missed this E-Mail 6 days ago.
All the issues you point out can be explained by what tags the OSM data contains and how the translation views for the i18n map work.
When I render the German map I'm checking if a "name:de" key exists for the given feature, if it does I use that, if not I fall back on "name".
Here's one of the towns in your first examples:
http://www.openstreetmap.org/browse/node/245765070
As you can see it has name:en but no name:de
Okay, it seems, that in Zoomlevel 7 everything is ok (http://cassini.toolserver.org/tiles/osm-like/de/7/92/53.png) but in Level 6 the special characters are still missing: http://cassini.toolserver.org/tiles/osm-like/de/6/46/26.png
Those both look the same to me, i.e. the Hindi characters appear just fine. All the tiles currently on the server are also rendered after I installed unifont fonts so all the asian languages should appear correctly.
Damn it, i just cleared the cache and there they are. I just saw squares instead of these special chars, but now everything is fine.
And the reason you see "Democratic Republic of the Congo" but not "Demokratische Republik Kongo" is because that country node has no name:de tag:
Hey, cool! I didn't know editing country-names is as easy as editing other POIs. So I'll go ahead and add the German names to where it seems necessary.
Yay, but for the moment they won't appear on the i18n map since we're not updating automatically from the planet dumps, yet.
Yes but that's not the point - it the information is there, it will soon or later be used. that's all the magic of osm :)
But for the moment i'm trying to find out the node-id of a country/island. e.g. i'm trying to edit http://tinyurl.com/nyy93g. How could i do this? Opening this region in josm/postlatch is not possible due to it's sizr, but higher zooms the name's not visible anymore.
Peter
On Tue, Jul 28, 2009 at 9:09 PM, Peter Körnerpeter@mazdermind.de wrote:
Ævar Arnfjörð Bjarmason schrieb:
On Tue, Jul 28, 2009 at 8:40 PM, Peter Körnerpeter@mazdermind.de wrote:
Ævar Arnfjörð Bjarmason schrieb:
On Wed, Jul 22, 2009 at 8:34 PM, Peter Körnerpeter@mazdermind.de wrote:
All 279 languages are now up, note that clicking on any of those will very likely yield a blank page when you first try it since it'll have to render the world at zoom 2 for that language (unless someone had it rendered already):
http://cassini.toolserver.org/tile-browse/
But some of them are already up:
I came across some encoding problems on the german map: http://tinyurl.com/ngu965
they seem to be better on the english one: http://tinyurl.com/msqlea
but in comparison to the official osm-page they are missing localized names: http://tinyurl.com/mwd64c
i also saw some not-translated country-names. e.g. on http://tinyurl.com/m6rhc5 "Democratic Republic of the Congo" should read "Demokratische Republik Kongo", also "Central African Republic" should be "Zentralafrikanische Republik".
Sorry I missed this E-Mail 6 days ago.
All the issues you point out can be explained by what tags the OSM data contains and how the translation views for the i18n map work.
When I render the German map I'm checking if a "name:de" key exists for the given feature, if it does I use that, if not I fall back on "name".
Here's one of the towns in your first examples:
http://www.openstreetmap.org/browse/node/245765070
As you can see it has name:en but no name:de
Okay, it seems, that in Zoomlevel 7 everything is ok (http://cassini.toolserver.org/tiles/osm-like/de/7/92/53.png) but in Level 6 the special characters are still missing: http://cassini.toolserver.org/tiles/osm-like/de/6/46/26.png
Those both look the same to me, i.e. the Hindi characters appear just fine. All the tiles currently on the server are also rendered after I installed unifont fonts so all the asian languages should appear correctly.
Damn it, i just cleared the cache and there they are. I just saw squares instead of these special chars, but now everything is fine.
And the reason you see "Democratic Republic of the Congo" but not "Demokratische Republik Kongo" is because that country node has no name:de tag:
Hey, cool! I didn't know editing country-names is as easy as editing other POIs. So I'll go ahead and add the German names to where it seems necessary.
Yay, but for the moment they won't appear on the i18n map since we're not updating automatically from the planet dumps, yet.
Yes but that's not the point - it the information is there, it will soon or later be used. that's all the magic of osm :)
But for the moment i'm trying to find out the node-id of a country/island. e.g. i'm trying to edit http://tinyurl.com/nyy93g. How could i do this? Opening this region in josm/postlatch is not possible due to it's sizr, but higher zooms the name's not visible anymore.
(There's a thread on osm-talk about how this interface sucks for translators)
You can:
1. Search for e.g. "Democratic Republic of the Congo" in the search box 2. Click the namefinder result 3. Zoom in to maximum zoom 4. Click edit
You could, if the xapi was up, issue a query to get all place=* nodes for the entire planet, but unfortunately it has been down for a couple of months or so.
On Tue, Jul 21, 2009 at 10:40 AM, Ævar Arnfjörð Bjarmason avarab@gmail.comwrote:
On Tue, Jul 21, 2009 at 2:01 PM, Audeaude.wiki@gmail.com wrote:
On 7/19/09, Ævar Arnfjörð Bjarmason avarab@gmail.com wrote:
On Sat, Jul 18, 2009 at 5:45 PM, Colin Marquardt<
cmarqu42@googlemail.com>
wrote:
2009/7/18 Ævar Arnfjörð Bjarmason avarab@gmail.com:
Cassini is back up now thanks to the Toolserver admins, since it's inactive at the moment I'm going to set it up with a rendering stack that'll run until Wikimania, of course if the database server pops back up at the beginning of august we may actually have something production ready by that time.
So what I'm going to do with it (pending objections) is:
- Set up a Planet.osm -> Cassini mirror
- Set up a multilingular PostGIS database (see
https://bugzilla.wikimedia.org/show_bug.cgi?id=19668). This should take around 50GB of space from the 345G /sql partition
For my hiking map (http://opentiles.com/cmarqu/), I would need some more keys imported with osm2pgsql. My default.style file is
http://code.google.com/p/mapnik-utils/source/browse/sandbox/cascadenik/hike_...
Not sure if you want to support that already, but I thought I'd mention it.
What I'm setting up now on Cassini is just a temporary hacky system that rightly should be setup on the database server / tileserver, it'll be taken down again once the rest of this stuff is up.
I'm taking notes on what I'm doing here as I go along:
https://wiki.toolserver.org/view/Cassini/Setup_notes
and here are some scripts in MW svn I'm writing:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/
It would be easy to add stuff the hiking map needs, but this is all a temporary setup anyway so we shouldn't move any production stuff to it I think.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
Is there anything you need help with, such as setting up the database.
These are the notes I'm taking when setting it up: http://www.mediawiki.org/wiki/Extension:SlippyMap/Cassini/Setup_notes
and here are the scripts I'm writing to make things easier:
http://svn.wikimedia.org/viewvc/mediawiki/trunk/tools/osm-tools/osm2pgsql-st...
What needs to be done is:
- Hack up an export script:
https://bugzilla.wikimedia.org/show_bug.cgi?id=19860 https://bugzilla.wikimedia.org/show_bug.cgi?id=19861
This is an easy task someone else could do.
- Set up apache/mod_tile
I'll try to do this when the osm2pgsql --slim import finishes.
- Set up planet.osm/osm2pgsql mirroring so that it's automatically updated.
I haven't looked into how to do this. It would be very helpful if someone would read up on the optimal way to configure postgres / how to do this updating so that I can stick something in cron that'll keep it up-to-date.
- Set up squid in front of the cgi-bin/export script & tile server
Someone just needs to give me a squid config I can use, or alternatively it would probably be better to adapt the tile cache Jens set up so that it can cache cassini too.
For the setup on the toolserver, I am fine with trying things and see how they work. But, I hope that we won't be locked into using one set of tools for rendering and working with the OSM data. It would be good to try alternative ways of styling the data that fit with what Wikimedia needs, beyond just supporting multiple languages.
Oh yes, what I'm doing now is just a hacky way of getting something to run. We'll want some alternative styles later (if we can get someone to maintain it!) but in the meantime I'm just poking the box because it's better than having it idle.
Of course for some osm2pgsql styles (like the hikingmap) we'll need to add extra fields to the postgis database.
Whether we're going to need one "production" rendering DB that does the main rendering Wikipedia wants to use and another one with a lot of fields or just shove everything in the DB & replicate it or something else is something we're going to have to figure out once we actually have a database server and some users to run tools.
Speaking of which why don't we have any users yet? Is everything stalled on getting the DB machine up or are there some tools that can just use Cassini as-is? How is Unix-account approval being managed (who's taking care of that?).
I would be willing to help with database tasks, including getting the OSM updates going and optimizing things. Of course, I would need access to the server to do anything.
After that's done, I can help with developing styles suitable for Wikipedia and other tasks.
-Aude
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
On Wed, Jul 22, 2009 at 1:39 AM, Audeaude.wiki@gmail.com wrote:
I would be willing to help with database tasks, including getting the OSM updates going and optimizing things. Of course, I would need access to the server to do anything.
I don't think you can get root access to cassini since it's a wikimedia box, they want to keep root access as restricted as possible.
You could test it locally of course and submit something that works:)
After that's done, I can help with developing styles suitable for Wikipedia and other tasks.
On Wed, Jul 22, 2009 at 9:01 AM, Ævar Arnfjörð Bjarmason avarab@gmail.comwrote:
On Wed, Jul 22, 2009 at 1:39 AM, Audeaude.wiki@gmail.com wrote:
I would be willing to help with database tasks, including getting the OSM updates going and optimizing things. Of course, I would need access to
the
server to do anything.
I don't think you can get root access to cassini since it's a wikimedia box, they want to keep root access as restricted as possible.
You could test it locally of course and submit something that works:)
Who is they? Brion? or who? People who handle things like OTRS are well trusted.
Anyway, database tasks require a postgres account with superuser privileges, which is independent of root access, and permissions for the postgres directories (e.g. config files) would help.
Or perhaps you don't need any help?
-Aude
After that's done, I can help with developing styles suitable for
Wikipedia
and other tasks.
Maps-l mailing list Maps-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/maps-l
I don't think you can get root access to cassini since it's a wikimedia box, they want to keep root access as restricted as possible. You could test it locally of course and submit something that works:)Who is they? Brion? or who? People who handle things like OTRS are well trusted.
In case of cassini, it's both WMDE and the WMF, since it's a toolserver box. The problem is that root access to a toolserver box implies access to *all* data in the wiki databases, including user email, password hashes, etc. That is much more than what OTRS folks get to see.
Ironically, root access to the *production* OSM boxes isn't that critical, because all you can break there is, well, OSM.
Anyway, you might be able to get tooserver root access if you really need it, but as long as you can do without, that would be preferred. Getting you a superuser account on postgres shouldn't be a problem, that's up to Avar.
On Wed, Jul 22, 2009 at 2:22 PM, Audeaude.wiki@gmail.com wrote:
I don't think you can get root access to cassini since it's a wikimedia box, they want to keep root access as restricted as possible.
You could test it locally of course and submit something that works:)
Who is they? Brion? or who? People who handle things like OTRS are well trusted.
Anyway, database tasks require a postgres account with superuser privileges, which is independent of root access, and permissions for the postgres directories (e.g. config files) would help.
Or perhaps you don't need any help?
Oh no, I'd like all the help I can get. And in fact ideally I'd like not to do any system administration at all.
I was just under the impression that I couldn't give anyone else elevated permissions due to some WM/WMDE policy.
But you're right of course that elevated permissions to the postgres database / the osm data are well contained, and since Daniel has no objections I'll grant you that, and anything else you need to work.
What's your toolserver username?
That also applies to anyone else who'd like to help actively, especially people who've been involved in OSM server administration and want to help getting OSM working for Wikimedia too.