On 2/26/21 3:46 AM, Guillaume Lederrey wrote:

We are working on a new update process for WDQS, based on a stream of changes [1]. While not exactly the solution you are looking for, this might be a building block for differential dumps. For example by aggregating the stream of changes over a period of time.

Note that at this point, the stream of changes that we construct is published to an internal Kafka that isn't exposed to the internet. If there is enough interest, we might be able to expose it in some form.

Have fun!


[1] https://phabricator.wikimedia.org/T244590

Hi Guillaume,

I am very interested in exposure right now since we are trying to have an up-to-date mirror of Wikidata.

We can discuss offline if you like.


On Fri, Feb 26, 2021 at 8:49 AM Federico Leva (Nemo) <nemowiki@gmail.com> wrote:
Kingsley Idehen via Wikidata, 25/02/21 19:26:
> Is there a mechanism in place for producing and publishing delta-centric
> dumps for Wikidata?


Magnus Manske used to maintain some biweekly dumps as part of its WDQ
service, IIRC.


Wikidata mailing list

Guillaume Lederrey (he/him)
Engineering Manager
Wikimedia Foundation

Wikidata mailing list


Kingsley Idehen	      
Founder & CEO 
OpenLink Software   
Home Page: http://www.openlinksw.com
Community Support: https://community.openlinksw.com
Weblogs (Blogs):
Company Blog: https://medium.com/openlink-software-blog
Virtuoso Blog: https://medium.com/virtuoso-blog
Data Access Drivers Blog: https://medium.com/openlink-odbc-jdbc-ado-net-data-access-drivers

Personal Weblogs (Blogs):
Medium Blog: https://medium.com/@kidehen
Legacy Blogs: http://www.openlinksw.com/blog/~kidehen/

Profile Pages:
Pinterest: https://www.pinterest.com/kidehen/
Quora: https://www.quora.com/profile/Kingsley-Uyi-Idehen
Twitter: https://twitter.com/kidehen
Google+: https://plus.google.com/+KingsleyIdehen/about
LinkedIn: http://www.linkedin.com/in/kidehen

Web Identities (WebID):
Personal: http://kingsley.idehen.net/public_home/kidehen/profile.ttl#i
        : http://id.myopenlink.net/DAV/home/KingsleyUyiIdehen/Public/kingsley.ttl#this