Hi Lydia,

Thanks for getting back to us on this.

We would like to set up a complete replica of wikidata, including all its components, wikibase, GUI, triple store, etc. The reason we want to do this is that we want to run experiments of how we can extend wikidata with statistical data from census, FBI, NOAA, etc, which are sources that provide interesting data about entities already existing in wikidata. We need to develop new properties and classes and before we engage in a community discussion, we want to prototype it internally so we can try out different approaches.

We know how to do the extensions in the triple store, i.e., write our robots/data ingestors to create triples in the triple store, but we rather write wikidata robots.

One possibility could be to set up an empty Wikibase in our end, populate it with the statistical data, and then import the triples into our installation of wikidata that contains all the wikidata triples.

If you have suggestions, please let us know.

Pedro

On Apr 7, 2019, at 11:17 AM, Lydia Pintscher lydia.pintscher@wikimedia.de wrote:

Hi Ke,

On Thu, Mar 28, 2019 at 9:51 AM Ke Xu kxu582@isi.edu wrote:

...

Hello developers at WikiData,

This is Ke from Information Sciences Institute of USC. We find WikiData really easy to use, and it may be a great help to our research.

That's really great to hear.

...

Thus we want to keep a whole copy of your services locally. But here’re some problems. Hope you can address these for us. First, we need to upload our own data, so that we need the whole services from you. How can we download and implement the whole bundle including GUI, Triple Store, WikiBase and ES as well.

Have you tried the Docker image already?

...

Second, we found you provided an API (https://github.com/filbertkm/WikibaseImport) to load data from Wikidata.org. But it seems the script queries one item once and upload it into our WikiBase. It’s really time consuming. So that do you provide any method to load the dumps and upload them into our WikiBase (not Triple Store)? Also, we want our database auto updated with yours.

That's currently unfortunately not possible or well supported. Can you tell us a bit more about what you are doing and what you want to do? Then we can better help you get to a working solution.

Cheers Lydia

-- Lydia Pintscher - http://about.me/lydia.pintscher Product Manager for Wikidata

Wikimedia Deutschland e.V. Tempelhofer Ufer 23-24 10963 Berlin www.wikimedia.de

Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V.

Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.