Hi
During the last weeks a lot of things happened to the tile-toolserver server. There's still progress going on but I'd like to give you a short status update:
ptolemy now uses tirex instead of renderd This change was done last weekend, mainly for performance reasons, but it also enlarged the number of tools that are available to manage the rendering server (batch render & co.) Comprehensive tutorials on how a new style can be added to the tileserver are tbd.
ptolemy is now visible in the munin graphs Some statistics of munin are now available at http://munin.toolserver.org/OSM/ptolemy/index.html but there are still some old in (renderd) as well as some missing (postgres) and some corrupted (replication_delay2). I'm working on consolidating the list of munin plugins and fixing the bugs.
fallback for default style The default style which is visible by default on http://toolserver.org/~osm/styles/ is now using a fallback routine that makes the browser weitch to the osm.org tiles when our toolserver can't render the tiles quickly enough. At the moment there are lots of places where we don't have any tiles yet on the disk. Those areas need to be rendered completely out-of-nothing when a visitor first views that area. This fallback will help in making the period until we have a comprehensive set of pre-rendered tiles less painful for our visitors.
Peter
Am 21.09.2010 16:26, schrieb Peter Körner:
During the last weeks a lot of things happened to the tile-toolserver server. There's still progress going on but I'd like to give you a short status update:
ptolemy does now expire updated tiles Tiles that are changed during the database update are now expired on disk. When accessed next, it is enqueued into tirex. The process is still experimental and may not work stable.
Peter
2010/9/21 Peter Körner osm-lists@mazdermind.de:
ptolemy does now expire updated tiles Tiles that are changed during the database update are now expired on disk. When accessed next, it is enqueued into tirex. The process is still experimental and may not work stable.
Awesome, thanks for all the work.
Cheers Colin
Hi Peter!
2010/9/21 Peter Körner osm-lists@mazdermind.de:
During the last weeks a lot of things happened to the tile-toolserver server. There's still progress going on but I'd like to give you a short status update.
Thanks a lot for the update :-)
Are there any plans to have some kind of tiles upload policy to the tile-toolservers?
I recently started tinkering with open access environmental satellite data and just finished rendering a OSGeo TMS compliant Night Lights Emission Map for the European Symposium for Protection of the Night Sky which can be found at http://light.datenscheibe.org
The software tools I'm using (GDAL,GMT,Python,Gdal2Tiles) are quite different from the tools that are used for OSM. But it would be great if I could donate & keep updating the 10GB of pre-rendered Night Lights PNG tiles I already have to the Wikipedia tile-toolserver setup.
That would free a lot of resources on my web server and I could focus on preparing my next batch of tiles which will be based on the European Environment Agency CORINE Land Cover data.
cu andreas
Am 21.09.2010 19:23, schrieb Andreas Trawoeger:
Are there any plans to have some kind of tiles upload policy to the tile-toolservers?
Hi
With the new setup on tirex basis I have much less worries on hosting more styles.
The only bottleneck with having more styles is the expire process that needs to do a stat call for each expired metatile in each style, so with ~3000 expired tiles per minute, a new style adds 3000 stat calls per minute to the expiry process.
But it would be great if I could donate & keep updating the 10GB of pre-rendered Night Lights PNG tiles I already have to the Wikipedia tile-toolserver setup.
We have a very similar setup with the hillshading tiles [1]. They are about 492.62G in 126629282 files so far away from your 10G. If no one opposes we could set up an rsync process to sync the changed tiles in regular intervals.
Please contact me private to talk about the technical stuff.
Peter
Am 21.09.2010 20:51, schrieb Peter Körner:
We have a very similar setup with the hillshading tiles [1]. They are about 492.62G in 126629282 files so far away from your 10G. If no one opposes we could set up an rsync process to sync the changed tiles in regular intervals.
Ahh damn link: [1] http://toolserver.org/~osm/styles/?zoom=8&lat=47.5617&lon=11.84875&layers=00B0F0FT0000F0FFFF
Peter
Hi Peter!
2010/9/21 Peter Körner osm-lists@mazdermind.de:
Am 21.09.2010 19:23, schrieb Andreas Trawoeger:
But it would be great if I could donate & keep updating the 10GB of pre-rendered Night Lights PNG tiles I already have to the Wikipedia tile-toolserver setup.
We have a very similar setup with the hillshading tiles [1]. They are about 492.62G in 126629282 files so far away from your 10G. If no one opposes we could set up an rsync process to sync the changed tiles in regular intervals.
The satellite data I'm working on is comparable low-res (150m/pixel) and only updated once a year (if ever). Main reason for updating the tiles is that I'm still experimenting with thing like PNG quantization and compression options.
What could become interesting in near term is the European Global Monitoring for Environment and Security (GMES) satellite project. Which despite having the name security in it is supposed to have an Open Data Policy [1].
European institutions tend to have a strange implementations of "Open Data Policies", but continuous and free access to multi spectral satellite data with 10m/pixel resolution could keep us pretty busy.
cu andreas
[1] http://www.spacenews.com/civil/100630-officials-open-data-policy-gmes.html