Hi, On 01/02/2012 12:33 PM, Kay Drangmeister wrote: A bit of both I think... ;-). It seems it is less finished than I originally thought. It is now already on the third pass through with render_old, which should render all of the old tiles. However, Tirex still needs to be regularly restarted due to memory leaks, and in the past to tweak some settings. In the time it needs to restart, the requests get dropped. There also still seem to be occasionally issues with socket errors, such that some requests again get dropped. By the looks more tiles got missed on the first and second pass than I had expected, so we'll see how long the third pass still takes. Yes, space is an issue. The tiles are on a large 5Tb NFS array that is shared between all toolserver users. Exactly how much can be used for osm tiles is a little flexible I guess, but of cause one needs to be considerate with other users and in total only about 150Gb of space was left. Therefore DaB has started to delete old tiles yesterday to free up some space. ( https://jira.toolserver.org/browse/MNT-1168 ) I let a du run a couple of days ago (before the deleting of old tiles) and the result was the following: 377G /tiles/ 165G /tiles/default 134G /tiles/hikebike 31G /tiles/osm-no-labels 9.4G /tiles/bw-mapnik 6.5G /tiles/germany 5.6G /tiles/parking-bw 5.4G /tiles/bw-noicons 3.5G /tiles/osm-labels-de 3.3G /tiles/osm-locale-de 1.9G /tiles/osm-labels-ru 1.9G /tiles/osm-labels-fr 1.2G /tiles/osm-locale-hsb 909M /tiles/osm-labels-pl 868M /tiles/osm-labels-it 835M /tiles/osm-labels-en 728M /tiles/osm-labels-es 722M /tiles/osm-locale-zh 621M /tiles/bicycle 586M /tiles/osm-labels-nl 391M /tiles/shape-names 347M /tiles/osm-labels-da 307M /tiles/lighting 272M /tiles/powermap 248M /tiles/osm-labels-no 185M /tiles/osm-labels-fa 173M /tiles/osm-labels-ca 99M /tiles/parktrans 92M /tiles/osm-labels-ro 86M /tiles/mtb-overlay 83M /tiles/bicycle_network 74M /tiles/osm-labels-he 67M /tiles/osm-labels-sv 66M /tiles/osm-labels-et 61M /tiles/osm-labels-gsw 56M /tiles/osm-labels-zh 52M /tiles/surveillance 52M /tiles/osm-labels-lv Other styles are less than 50Mb each currently. Yes, that is the name of the "default" mapnik style used on osm.org. It is just called default for legacy reasons really. Kai

Hi, Am 02.01.2012, 13:55 Uhr, schrieb Kai Krueger <kakrueger(a)gmail.com>om>: Obvious follow-up question given "default" is the most space and presumably also the most time consuming style: why are we duplicating the original osm tiles in the first place? As a backup, or for keeping load off the osm.org server? Kind regards, Kay

On 01/02/2012 01:57 PM, Tim Alder wrote: Interesting. At least according to my local proxy logs, it loads the language tiles in the german wikipedia at z15 as well. I am not sure if it only displays the default style, but it is loading the other ones, too. It first loads tiles for "osm-no-labels" then "osm-labels-de" and finally "default". I have seen that for all of the different coordinate types, some of which load at z11, some at z13 and some at z15. Is the load really that much? The maps displayed in wikipedia are fairly small and (spatially) localized around where the articles are. So that is probably only a small subset of tiles that would be needed for a general purpose slippy map. Perhaps it would be good to analyze the apache logs and check the referrers and user-agent to see how much traffic really comes from which wikipedia, and how much comes from other sites like hikebikemap.de or from e.g. smartphone apps using the toolserver as a source for tiles. Kai

On 01/02/2012 07:16 PM, Tim Alder wrote: I went to e.g. http://de.wikipedia.org/wiki/Statue_of_Liberty as a non-logged in user and clicked on "Karte" in the top right corner. According to my local squid logs, it loads all three styles (although if you repeat it, it will be cached in firefox and not load again). Kai

On 01/02/2012 01:57 PM, Tim Alder wrote: If the language labels are only used for zoom 0-6, then there is not much point in expiring them at z15 - 18. I might as well disable expiry and move over to a background re-render for everything but the default style. As zoom 0 - 10 tiles can take many minutes per tile, those zoom levels would always be redered in the background anyway. So far the server seems to be able to cope reasonably well with expiry of z15 - z18. I will start expanding expiry further to try and get up to expiring z11, which is the lowest zoom that is shown by default in wikipedia. We should probably test it to see how it goes. Who would be the people on the russian wikipedia to talk to, to see what they need? Also, should any changes take effect, who can tel us if everything is working out and if the changes are positively received? Kai