Hello !
I'm working on the maps infrastructure for Wikimedia Maps. As guessed
by Eugene, we don't pregenerate tiles. You can find some info on our
infrastructure on wikitech [1] (as always, documentation should be
better than it is).
We generate vector tiles that we store in Cassandra, regenerating
those vector tiles when we import changes from OSM. Raster tiles
(.png) are generated on the fly from the vector tiles and cached by
Varnish. That rasterization process is cheap, so some level of cache
miss are not an issue. That being said, please don't try to download
all our tiles by iterating over them!
We don't provide dumps of our vector tiles either, as this is not that
helpful, since you would still have to build the rendering
infrastructure. At that point, you're probably better off building the
full stack.
Options that might work for you:
* Have a proxy on your side that would cache our tiles. Depending on
your access patterns and the cache duration, this might be enough.
* Build your own rendering stack, reusing our style.
Note that Paul Norman was working on a new style for WMF, which has a
number of improvements about our current style. I recommend you have a
look into it as well! It is available on his github account [2]. See
his blog post about it [3].
Good luck!
Guillaume
[1]
https://wikitech.wikimedia.org/wiki/Maps
[2]
https://github.com/pnorman/bolder
[3]
http://www.paulnorman.ca/blog/2018/08/more-work-on-bolder/
On Wed, Oct 3, 2018 at 12:01 PM Gandalf Corvotempesta
<gandalf.corvotempesta(a)gmail.com> wrote:
Il giorno mer 3 ott 2018 alle ore 08:55 Eugene Alvin Villar
<seav80(a)gmail.com> ha scritto:
I am not a member of the Wikimedia Maps team, but
I assume that like many other organizations that render map tiles, they do not pre-render
these tiles because that is a waste of disk space. Please refer to the following page for
more information:
https://wiki.openstreetmap.org/wiki/Tile_disk_usage
That's true.
In particular, pre-rendering all tiles would use
approximately 54 TB of storage and majority of them are never viewed by the end user. So
most map tile servers generally just render tiles as needed and then cache them.
Do you have any idea on how to put wikimedia tiles under a CDN like
Cloudflare ? Current tiles are hosting at about 220ms from here.
I've thought to regenerate them on the fly with a local tileserver but
we have to import the whole europe/world map to Postgresql and this
takes weeks and tons of ram that we don't have.
_______________________________________________
Maps-l mailing list
Maps-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/maps-l
--
Guillaume Lederrey
Operations Engineer, Search Platform
Wikimedia Foundation
UTC+2 / CEST