Is there a big problem with the SPARQL servers ?
I was just about to update some of the numbers at https://en.wikipedia.org/wiki/Wikipedia_talk:GLAM/Your_paintings/header which has the numbers for sitelinks, cross-properties etc for painters with P1367 (Art UK artist ID; formerly "Your Paintings" artist ID).
SPARQL used to return 22,412 hits; and Autolist currently returns 22,458 hits (the latter includes deprecated values).
But now SPARQL is only returning 18,291 hits http://tinyurl.com/zbqznun
What's going on?
The number has been over 22,000 since at least October last year. (And before that was down at about 8,700).
Should all SPARQL searches be currently seen as unreliable ?
Should there be a warning on the search page advising of this ?
-- James.
On Sun, May 1, 2016 at 12:47 PM James Heald j.heald@ucl.ac.uk wrote:
Is there a big problem with the SPARQL servers ?
I was just about to update some of the numbers at
https://en.wikipedia.org/wiki/Wikipedia_talk:GLAM/Your_paintings/header which has the numbers for sitelinks, cross-properties etc for painters with P1367 (Art UK artist ID; formerly "Your Paintings" artist ID).
SPARQL used to return 22,412 hits; and Autolist currently returns 22,458 hits (the latter includes deprecated values).
But now SPARQL is only returning 18,291 hits http://tinyurl.com/zbqznun
What's going on?
The number has been over 22,000 since at least October last year. (And before that was down at about 8,700).
Should all SPARQL searches be currently seen as unreliable ?
Should there be a warning on the search page advising of this ?
Yes unfortunately there are some hickups currently. See this email by Stas: https://lists.wikimedia.org/pipermail/wikidata/2016-April/008618.html
Cheers Lydia
On 01/05/2016 11:56, Lydia Pintscher wrote:
On Sun, May 1, 2016 at 12:47 PM James Heald j.heald@ucl.ac.uk wrote:
Is there a big problem with the SPARQL servers ?
SPARQL used to return 22,412 hits; and Autolist currently returns 22,458 hits (the latter includes deprecated values).
But now SPARQL is only returning 18,291 hits http://tinyurl.com/zbqznun
The number has been over 22,000 since at least October last year. (And before that was down at about 8,700).
Yes unfortunately there are some hickups currently. See this email by Stas: https://lists.wikimedia.org/pipermail/wikidata/2016-April/008618.html
Cheers Lydia
Ah, okay. Thanks Lydia.
I had seen that Stas was proposing to roll back the SPARQL data to mid-April, https://lists.wikimedia.org/pipermail/wikidata/2016-April/008618.html but I didn't realise that was still in the pipeline.
If I am reading the bug correctly, it seems that a fix may now have been found for the underlying problem, which should be deployed on Monday, https://phabricator.wikimedia.org/T133924 so I guess that's implying the SPARQL database is now hoped to be repaired after that, once there's a new dump to work from?
-- James.
(Thanks to all for getting to the bottom of the root problem so fast.)
On Sun, May 1, 2016 at 6:25 PM James Heald j.heald@ucl.ac.uk wrote:
Ah, okay. Thanks Lydia.
I had seen that Stas was proposing to roll back the SPARQL data to mid-April, https://lists.wikimedia.org/pipermail/wikidata/2016-April/008618.html but I didn't realise that was still in the pipeline.
If I am reading the bug correctly, it seems that a fix may now have been found for the underlying problem, which should be deployed on Monday, https://phabricator.wikimedia.org/T133924 so I guess that's implying the SPARQL database is now hoped to be repaired after that, once there's a new dump to work from?
Yes I believe so. Fingers crossed ;-)
Cheers Lydia
Hi!
But now SPARQL is only returning 18,291 hits http://tinyurl.com/zbqznun
I suspect this is a wrong SPARQL - that one returns properties and as such can't return so many :) In any case, I've reloaded from older dump which is not affected by the dump issue, so now the queries should be back on track. The service is still about day or two behind Wikidata, but should catch up soon. Please tell me if you still have missing data (that wasn't updated in last 2 days) - please quote the query and the data items you think are missing, that helps a lot when tracing issues.
On 01/05/2016 20:59, Stas Malyshev wrote:
Hi!
But now SPARQL is only returning 18,291 hits http://tinyurl.com/zbqznun
I suspect this is a wrong SPARQL - that one returns properties and as such can't return so many :) In any case, I've reloaded from older dump which is not affected by the dump issue, so now the queries should be back on track. The service is still about day or two behind Wikidata, but should catch up soon. Please tell me if you still have missing data (that wasn't updated in last 2 days) - please quote the query and the data items you think are missing, that helps a lot when tracing issues.
The first property the query above returns is P1367 itself -- which is indeed now giving 22440, slightly up from the 22412 as of 22 April, https://en.wikipedia.org/wiki/Wikipedia_talk:GLAM/Your_paintings/header
Counts for other properties in the set with P1367 also look about right, slightly up from the 22 April numbers given in the second bullet of the link above.
So now looking much better -- Thank you!
-- James.