Hello Sumana (and Brandon and Marc-André),

There's been a mention of getting 2 copies of the "OSM database", one for the use of the production tileserver and the other for the use of Wikimedia Labs. Is this correct?

What I'd like to know is if this is the raw OSM database, which contains the raw OSM data that is suitable for editing, or a rendering OSM database suitable for rendering map tiles. The rendering database is usually loaded with a program like osm2pgsql[1] from raw OSM data that is either in XML or PBF file formats.

The problem with a rendering OSM database is that this is optimized for rendering map tiles, which is excellent for the production tileserver. However, this database is (mostly) unsuitable for other purposes such as routing and (probably) spatial analysis. This may hamper possible use cases of developers on Wikimedia Labs wanting to explore using OSM data for various purposes.

[1] http://wiki.openstreetmap.org/wiki/Osm2pgsql

Thanks,
Eugene


On Fri, Aug 23, 2013 at 3:47 AM, Sumana Harihareswara <sumanah@wikimedia.org> wrote:
Hi folks! I am the Engineering Community Manager at the Wikimedia
Foundation, which means I'm a liaison for people who want to improve the
technical capabilities of our projects. I spoke with a few of you
offlist (including at Wikimania) about maps and Wikimedia. While I'm
still getting up to speed on the proposals and tools people have made, I
wanted to give you an update regarding what's happening with Wikimedia's
planned OpenStreetMap tileserver.

We know that we will set up a production tileserver.  That is, Wikimedia
plans to have an OpenStreetMap tileserver, in production (that is, fully
supported by our Operations department and with uptime expectations
similar to those for our main sites). We need this not only for the
tools community but also for use in our official mobile apps. Brandon
Black is the contact for this.  He is a member of the Operations team at
WMF. In order to set up a production-level tileserver, we will also need
a production OSM database, so he is working on figuring out how best to
grab that data from the official OSM database regularly (I am
oversimplifying here).

Brandon has already started on the project of setting up the production
tileserver.  I know that he will be posting regular updates at
https://wikitech.wikimedia.org/wiki/OSM_Tileserver but he is still in
the investigation and architecture phase so he does not have a timeline
yet. I'm sorry, I know that is frustrating.

Very soon after we have the production tileserver running, we plan to
replicate that OSM database to Wikimedia Labs for use on Tool Labs, or
do similar SQL import magic.  People using Labs will be able to draw
data directly from that replica, and will be able to grab tiles from the
production tileserver.  I'm the contact on this but since Coren
(Marc-Andre Pelletier) is the domain expert on this particular bit of
database replication, please go ahead and include both of us on any
questions.

Thanks, all.

--
Sumana Harihareswara
Engineering Community Manager
Wikimedia Foundation