We currently rely on the Wikidata Query API to identify whether or not a set of claims exists on a given property. Some of our previous bot runs has created duplicates since recent additions didn't make it to the WDQ API yet.

In our efforts to prevent the creation of duplicate entries, I am trying to better understand the WDQ-api.

The documentation of the WDQ-api states that [1] "Also, the data used here is from WikiData "dumps", so it can be a few hours old.". However, when I check on the datadumps they are either updated weekly with json dumps or incremental daily dumps as xml [2].

Also, sometimes the WDQ-api seems to have instant behaviour with claims being added, in the sense that they are immediately available through the WDQ API.

How often is the WDQ api really being updated? Is it possible to query wikidata live, with WDQ and if not, are there alternatives that would allow this?

Regards,

Andra Waagmeester

[1] https://wdq.wmflabs.org/api_documentation.html

[2] https://www.wikidata.org/wiki/Wikidata:Database_download