Dear colleagues,
I'm running a custom instance of Wikibase with SPARQL service and I'd noticed that updater service (runUpdate.sh) doesn't really update triplestore with new properties created in my Wikibase instance. As well as I can see, newly created P-item names aren't even returned by API call for "recentchanges". So new properties with their names and other attributes never appear in the triplestore after their creation.
Once the property is used in some statement or qualifier, corresponding triples are put into the triplestore immediately, but the property remains without names or descriptions.
Is it because properties are managed centrally in Wikidata? Is it assumed that I should reload a full snapshot each time I create a new property? Or is it some bug on my side?
Thank you for your help! Victor Agroskin
Hi Victor,
Your intuition on "recentchanges" is correct - if Kafka broker is not specified in options, recentchanges is used and if triples for property do not appear there, data on it will not be updated.
On the question of whether properties data should appear there, I have to get back to you on that later - unless someone with more knowledge on Wikibase manages to answer sooner.
Regards, Zbyszko
On Mon, Feb 8, 2021 at 12:45 PM Victor Agroskin vic5784@gmail.com wrote:
Dear colleagues,
I'm running a custom instance of Wikibase with SPARQL service and I'd noticed that updater service (runUpdate.sh) doesn't really update triplestore with new properties created in my Wikibase instance. As well as I can see, newly created P-item names aren't even returned by API call for "recentchanges". So new properties with their names and other attributes never appear in the triplestore after their creation.
Once the property is used in some statement or qualifier, corresponding triples are put into the triplestore immediately, but the property remains without names or descriptions.
Is it because properties are managed centrally in Wikidata? Is it assumed that I should reload a full snapshot each time I create a new property? Or is it some bug on my side?
Thank you for your help! Victor Agroskin _______________________________________________ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech
Hi Victor,
After discussing this with colleagues I'm still unable to tell you why recentchanges isn't sending out property changes. It definitely should, as you can clearly observe on production. Please verify if you're not using some filters on rcnamespace.
Another issue is that even if you get it to work, properties may not be added properly to the triplestore, because the updater also filters out namespaces - by default 0 (Q-items) and 120(properties) are processed. Since wikibase uses different ones (120 and 122), you'd need to use runUpdate parameter *--entityNamespaces 120,122* (or other values you might've set up).
Sorry I can't be more helpful - wikibase isn't my area of expertise. Zbyszko
On Tue, Feb 9, 2021 at 4:25 PM Zbyszko Papierski zpapierski@wikimedia.org wrote:
Hi Victor,
Your intuition on "recentchanges" is correct - if Kafka broker is not specified in options, recentchanges is used and if triples for property do not appear there, data on it will not be updated.
On the question of whether properties data should appear there, I have to get back to you on that later - unless someone with more knowledge on Wikibase manages to answer sooner.
Regards, Zbyszko
On Mon, Feb 8, 2021 at 12:45 PM Victor Agroskin vic5784@gmail.com wrote:
Dear colleagues,
I'm running a custom instance of Wikibase with SPARQL service and I'd noticed that updater service (runUpdate.sh) doesn't really update triplestore with new properties created in my Wikibase instance. As well as I can see, newly created P-item names aren't even returned by API call for "recentchanges". So new properties with their names and other attributes never appear in the triplestore after their creation.
Once the property is used in some statement or qualifier, corresponding triples are put into the triplestore immediately, but the property remains without names or descriptions.
Is it because properties are managed centrally in Wikidata? Is it assumed that I should reload a full snapshot each time I create a new property? Or is it some bug on my side?
Thank you for your help! Victor Agroskin _______________________________________________ Wikidata-tech mailing list Wikidata-tech@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-tech
--
Zbyszko Papierski (He/Him)
Senior Software Engineer
Wikimedia Foundation https://wikimediafoundation.org/
Hi Zbyszko!
Thank you! The problem indeed was in the missing namespace 122.
It works now, Q-items are returned from ns 120, and P-items from ns 122.
Sincerely, Victor
Date: Wed, 10 Feb 2021 10:22:24 +0100 From: Zbyszko Papierski zpapierski@wikimedia.org To: Wikidata technical discussion wikidata-tech@lists.wikimedia.org Subject: Re: [Wikidata-tech] Is updater script really updating the set of properties? Message-ID: < CAAsUyi8vX6Jy4O9nEa4+-rgQ-BYwsffV3SUzg2EePt9_g6GZoA@mail.gmail.com> Content-Type: text/plain; charset="utf-8" Hi Victor, After discussing this with colleagues I'm still unable to tell you why recentchanges isn't sending out property changes. It definitely should, as you can clearly observe on production. Please verify if you're not using some filters on rcnamespace. Another issue is that even if you get it to work, properties may not be added properly to the triplestore, because the updater also filters out namespaces - by default 0 (Q-items) and 120(properties) are processed. Since wikibase uses different ones (120 and 122), you'd need to use runUpdate parameter *--entityNamespaces 120,122* (or other values you might've set up). Sorry I can't be more helpful - wikibase isn't my area of expertise. Zbyszko
On Mon, 8 Feb 2021 at 14:45, Victor Agroskin vic5784@gmail.com wrote:
Dear colleagues,
I'm running a custom instance of Wikibase with SPARQL service and I'd noticed that updater service (runUpdate.sh) doesn't really update triplestore with new properties created in my Wikibase instance. As well as I can see, newly created P-item names aren't even returned by API call for "recentchanges". So new properties with their names and other attributes never appear in the triplestore after their creation.
Once the property is used in some statement or qualifier, corresponding triples are put into the triplestore immediately, but the property remains without names or descriptions.
Is it because properties are managed centrally in Wikidata? Is it assumed that I should reload a full snapshot each time I create a new property? Or is it some bug on my side?
Thank you for your help! Victor Agroskin
wikidata-tech@lists.wikimedia.org