Timeout on example queries

List overview All Threads
Download

newer

older

[CfP] ESWC 2020 Call for...

Weekly Summary #386

Fabrizio Carrai

12 Oct 2019 12 Oct '19

11:41 p.m.

I noticed few timeouts on example queries, for example

Whose birthday is today ? https://query.wikidata.org/#%23Di%20chi%20%C3%A8%20il%20compleanno%20oggi%3F%0A%23Whose%20birthday%20is%20today%3F%0ASELECT%20%3Fentity%20%3FentityLabel%20%3FentityDescription%20%28YEAR%28%3Fdate%29%20as%20%3Fyear%29%0AWHERE%20%7B%0A%20%20%20%20BIND%28MONTH%28NOW%28%29%29%20AS%20%3FnowMonth%29%0A%20%20%20%20BIND%28DAY%28NOW%28%29%29%20AS%20%3FnowDay%29%0A%20%20%20%20%3Fentity%20wdt%3AP569%20%3Fdate%20.%0A%20%20%20%20FILTER%20%28MONTH%28%3Fdate%29%20%3D%20%3FnowMonth%20%26%26%20DAY%28%3Fdate%29%20%3D%20%3FnowDay%29%0A%0ASERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%20%20%20%0A%7D%0ALIMIT%2010

Is it correct to have this condition ?

-- *Fabrizio*

Attachments:

attachment.htm (text/html — 1.0 KB)

Show replies by date

Gerard Meijssen

12 Oct 12 Oct

11:53 p.m.

Hoi, Our database grows, more and more users are explained how to query. Our query service is not keeping up with the pace so it fits in with other growing pains. When you consider all the scientists for whom we do not have a birthday yet, it is certain that this query will become even more expensive. Thanks, GerardM

On Sat, 12 Oct 2019 at 18:41, Fabrizio Carrai fabrizio.carrai@gmail.com wrote:

...

I noticed few timeouts on example queries, for example

Whose birthday is today ? https://query.wikidata.org/#%23Di%20chi%20%C3%A8%20il%20compleanno%20oggi%3F%0A%23Whose%20birthday%20is%20today%3F%0ASELECT%20%3Fentity%20%3FentityLabel%20%3FentityDescription%20%28YEAR%28%3Fdate%29%20as%20%3Fyear%29%0AWHERE%20%7B%0A%20%20%20%20BIND%28MONTH%28NOW%28%29%29%20AS%20%3FnowMonth%29%0A%20%20%20%20BIND%28DAY%28NOW%28%29%29%20AS%20%3FnowDay%29%0A%20%20%20%20%3Fentity%20wdt%3AP569%20%3Fdate%20.%0A%20%20%20%20FILTER%20%28MONTH%28%3Fdate%29%20%3D%20%3FnowMonth%20%26%26%20DAY%28%3Fdate%29%20%3D%20%3FnowDay%29%0A%0ASERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%20%20%20%0A%7D%0ALIMIT%2010

Is it correct to have this condition ?

*Fabrizio* _______________________________________________ Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Nicolas VIGNERON

13 Oct 13 Oct

12:01 a.m.

Hi,

The "wikibase:label" service is know to consume and it timeouts often (nothing new it happens since the beginning ; but as Wikidata grows, it's more or more visible).

This simplified version of the query works (without intermediate variables and without the service): https://w.wiki/9yR

Cheers, ~nicolas

Le sam. 12 oct. 2019 à 18:41, Fabrizio Carrai fabrizio.carrai@gmail.com a écrit :

...

I noticed few timeouts on example queries, for example

Whose birthday is today ? https://query.wikidata.org/#%23Di%20chi%20%C3%A8%20il%20compleanno%20oggi%3F%0A%23Whose%20birthday%20is%20today%3F%0ASELECT%20%3Fentity%20%3FentityLabel%20%3FentityDescription%20%28YEAR%28%3Fdate%29%20as%20%3Fyear%29%0AWHERE%20%7B%0A%20%20%20%20BIND%28MONTH%28NOW%28%29%29%20AS%20%3FnowMonth%29%0A%20%20%20%20BIND%28DAY%28NOW%28%29%29%20AS%20%3FnowDay%29%0A%20%20%20%20%3Fentity%20wdt%3AP569%20%3Fdate%20.%0A%20%20%20%20FILTER%20%28MONTH%28%3Fdate%29%20%3D%20%3FnowMonth%20%26%26%20DAY%28%3Fdate%29%20%3D%20%3FnowDay%29%0A%0ASERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%20%20%20%0A%7D%0ALIMIT%2010

Is it correct to have this condition ?

*Fabrizio* _______________________________________________ Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Imre Samu

9:04 a.m.

...

The "wikibase:label" service is know to consume and it timeouts often

imho: We can use subquery for optimization so the label service doesn’t have to do as much work

https://w.wiki/9zD ( LIMIT 1000 + Labels + Descriptions )

LIMIT 10000 - 6924 results in 59861 ms ( birthday = 13 October 2014 ) LIMIT 1000 - 1000 results in 12050 ms

the ideal case will be - if the sparql engine can detect and automatically optimize this type of queries.

Imre

Nicolas VIGNERON vigneron.nicolas@gmail.com ezt írta (időpont: 2019. okt. 12., Szo, 19:01):

...

Hi,

The "wikibase:label" service is know to consume and it timeouts often (nothing new it happens since the beginning ; but as Wikidata grows, it's more or more visible).

This simplified version of the query works (without intermediate variables and without the service): https://w.wiki/9yR

Cheers, ~nicolas

Le sam. 12 oct. 2019 à 18:41, Fabrizio Carrai fabrizio.carrai@gmail.com a écrit :

...
I noticed few timeouts on example queries, for example

Whose birthday is today ? https://query.wikidata.org/#%23Di%20chi%20%C3%A8%20il%20compleanno%20oggi%3F%0A%23Whose%20birthday%20is%20today%3F%0ASELECT%20%3Fentity%20%3FentityLabel%20%3FentityDescription%20%28YEAR%28%3Fdate%29%20as%20%3Fyear%29%0AWHERE%20%7B%0A%20%20%20%20BIND%28MONTH%28NOW%28%29%29%20AS%20%3FnowMonth%29%0A%20%20%20%20BIND%28DAY%28NOW%28%29%29%20AS%20%3FnowDay%29%0A%20%20%20%20%3Fentity%20wdt%3AP569%20%3Fdate%20.%0A%20%20%20%20FILTER%20%28MONTH%28%3Fdate%29%20%3D%20%3FnowMonth%20%26%26%20DAY%28%3Fdate%29%20%3D%20%3FnowDay%29%0A%0ASERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%20%20%20%0A%7D%0ALIMIT%2010

Is it correct to have this condition ?

*Fabrizio* _______________________________________________ Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Fabrizio Carrai

1:56 p.m.

Thanks all for the explanations, now my point is on the examples as seen by some first Wikidata users: if the examples are there and fail, that's disappointing. Have we to comment out examples that could fail ? Should we mark this ? I don't like the latter, but if it is a contingent situation it makes sense.

Till the work load is not managed, e.g. by optimizations, can we increase the timeout ?

Thanks

Fabrizio

Il giorno dom 13 ott 2019 alle ore 04:05 Imre Samu pella.samu@gmail.com ha scritto:

...

...
The "wikibase:label" service is know to consume and it timeouts often

imho: We can use subquery for optimization so the label service doesn’t have to do as much work

https://w.wiki/9zD ( LIMIT 1000 + Labels + Descriptions )

LIMIT 10000 - 6924 results in 59861 ms ( birthday = 13 October 2014 ) LIMIT 1000 - 1000 results in 12050 ms

the ideal case will be - if the sparql engine can detect and automatically optimize this type of queries.

Imre

Nicolas VIGNERON vigneron.nicolas@gmail.com ezt írta (időpont: 2019. okt. 12., Szo, 19:01):

...
Hi,

The "wikibase:label" service is know to consume and it timeouts often (nothing new it happens since the beginning ; but as Wikidata grows, it's more or more visible).

This simplified version of the query works (without intermediate variables and without the service): https://w.wiki/9yR

Cheers, ~nicolas

Le sam. 12 oct. 2019 à 18:41, Fabrizio Carrai fabrizio.carrai@gmail.com a écrit :

...
I noticed few timeouts on example queries, for example

Whose birthday is today ? https://query.wikidata.org/#%23Di%20chi%20%C3%A8%20il%20compleanno%20oggi%3F%0A%23Whose%20birthday%20is%20today%3F%0ASELECT%20%3Fentity%20%3FentityLabel%20%3FentityDescription%20%28YEAR%28%3Fdate%29%20as%20%3Fyear%29%0AWHERE%20%7B%0A%20%20%20%20BIND%28MONTH%28NOW%28%29%29%20AS%20%3FnowMonth%29%0A%20%20%20%20BIND%28DAY%28NOW%28%29%29%20AS%20%3FnowDay%29%0A%20%20%20%20%3Fentity%20wdt%3AP569%20%3Fdate%20.%0A%20%20%20%20FILTER%20%28MONTH%28%3Fdate%29%20%3D%20%3FnowMonth%20%26%26%20DAY%28%3Fdate%29%20%3D%20%3FnowDay%29%0A%0ASERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%20%20%20%0A%7D%0ALIMIT%2010

Is it correct to have this condition ?

*Fabrizio* _______________________________________________ Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

-- *Fabrizio*

BOISSEL Sylvain

15 Oct 15 Oct

3:57 p.m.

If adding a LIMIT makes the query work, we can just edit the example to have the said limit. It is only an example query, it doesn't have to return all the results.

Cheers, Sylvain

-- SYLVAIN BOISSEL ADMINISTRATEUR SYSTÈME ET RÉSEAUX _WIKIMÉDIA FRANCE_ _ _ _TÉL: __ +33__ 9 67 45 12 67_ _MOBILE : +33_ 7 84 37 91 03 _WWW.WIKIMEDIA.FR [2]_ _40 rue de Cléry, __75002 Paris_ [3] _Imaginez un monde où chaque personne sur la planète aurait librement accès à la totalité du savoir humain. C'est notre engagement. Aidez Wikimedia France à en faire une réalité [4]._ Le 2019-10-13 08:56, Fabrizio Carrai a écrit : > Thanks all for the explanations, now my point is on the examples as seen by some first Wikidata users: if the examples are there and fail, that's disappointing. > Have we to comment out examples that could fail ? Should we mark this ? > I don't like the latter, but if it is a contingent situation it makes sense. > > Till the work load is not managed, e.g. by optimizations, can we increase the timeout ? > > Thanks > > Fabrizio > > Il giorno dom 13 ott 2019 alle ore 04:05 Imre Samu pella.samu@gmail.com ha scritto: > >> The "wikibase:label" service is know to consume and it timeouts often > > imho: We can use subquery for optimization so the label service doesn't have to do as much work > > https://w.wiki/9zD ( LIMIT 1000 + Labels + Descriptions ) > LIMIT 10000 - 6924 results in 59861 ms ( birthday = 13 October 2014 ) > LIMIT 1000 - 1000 results in 12050 ms > > the ideal case will be - if the sparql engine can detect and automatically optimize this type of queries. > > Imre > > Nicolas VIGNERON vigneron.nicolas@gmail.com ezt írta (időpont: 2019. okt. 12., Szo, 19:01): > > Hi, > > The "wikibase:label" service is know to consume and it timeouts often (nothing new it happens since the beginning ; but as Wikidata grows, it's more or more visible). > > This simplified version of the query works (without intermediate variables and without the service): https://w.wiki/9yR > > Cheers, > ~nicolas > > Le sam. 12 oct. 2019 à 18:41, Fabrizio Carrai fabrizio.carrai@gmail.com a écrit : > I noticed few timeouts on example queries, for example > > Whose birthday is today ? [1] > > Is it correct to have this condition ? -- > > _Fabrizio_ _______________________________________________ > Wikidata mailing list > Wikidata@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikidata _______________________________________________ > Wikidata mailing list > Wikidata@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikidata _______________________________________________ Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata -- _Fabrizio_ _______________________________________________ Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata Links: ------ [1] https://query.wikidata.org/#%23Di%20chi%20%C3%A8%20il%20compleanno%20oggi%3F... [2] http://www.wikimedia.fr/ [3] http://www.openstreetmap.org/node/691082430#map=19/48.86814/2.34683 [4] https://dons.wikimedia.fr

Fabrizio Carrai

5:11 p.m.

Unfortunately I just tried again with a limit of 10 and I got a timeout anyhow.

I agree it is an example, but do we have to say that some queries could never run on wikidata? I don't know if there are some other query tool/methods to got the results?

Thanks Fabrizio

Il mar 15 ott 2019, 11:02 BOISSEL Sylvain sylvain.boissel@wikimedia.fr ha scritto:

...

If adding a LIMIT makes the query work, we can just edit the example to have the said limit. It is only an example query, it doesn't have to return all the results.

Cheers, Sylvain

-- *Sylvain Boissel* ADMINISTRATEUR SYSTÈME ET RÉSEAUX *WIKIMÉDIA FRANCE*

*Tél: ** +33 9 67 45 12 67* *Mobile : +33*

7 84 37 91 03*

*www.wikimedia.fr http://www.wikimedia.fr/* *40 rue de Cléry, **75002 Paris* http://www.openstreetmap.org/node/691082430#map=19/48.86814/2.34683

*Imaginez un monde où chaque personne sur la planète aurait librement accès à la totalité du savoir humain. C'est notre engagement. Aidez Wikimedia France à en faire une réalité https://dons.wikimedia.fr.*

Le 2019-10-13 08:56, Fabrizio Carrai a écrit :

Thanks all for the explanations, now my point is on the examples as seen by some first Wikidata users: if the examples are there and fail, that's disappointing. Have we to comment out examples that could fail ? Should we mark this ? I don't like the latter, but if it is a contingent situation it makes sense.

Till the work load is not managed, e.g. by optimizations, can we increase the timeout ?

Thanks

Fabrizio

Il giorno dom 13 ott 2019 alle ore 04:05 Imre Samu pella.samu@gmail.com ha scritto:

...
...
The "wikibase:label" service is know to consume and it timeouts often

imho: We can use subquery for optimization so the label service doesn’t have to do as much work

https://w.wiki/9zD ( LIMIT 1000 + Labels + Descriptions )

LIMIT 10000 - 6924 results in 59861 ms ( birthday = 13 October 2014 ) LIMIT 1000 - 1000 results in 12050 ms

the ideal case will be - if the sparql engine can detect and automatically optimize this type of queries.

Imre

Nicolas VIGNERON vigneron.nicolas@gmail.com ezt írta (időpont: 2019. okt. 12., Szo, 19:01):

...
Hi,

The "wikibase:label" service is know to consume and it timeouts often (nothing new it happens since the beginning ; but as Wikidata grows, it's more or more visible).

This simplified version of the query works (without intermediate variables and without the service): https://w.wiki/9yR

Cheers, ~nicolas

Le sam. 12 oct. 2019 à 18:41, Fabrizio Carrai fabrizio.carrai@gmail.com a écrit :

...
I noticed few timeouts on example queries, for example

Whose birthday is today ? https://query.wikidata.org/#%23Di%20chi%20%C3%A8%20il%20compleanno%20oggi%3F%0A%23Whose%20birthday%20is%20today%3F%0ASELECT%20%3Fentity%20%3FentityLabel%20%3FentityDescription%20%28YEAR%28%3Fdate%29%20as%20%3Fyear%29%0AWHERE%20%7B%0A%20%20%20%20BIND%28MONTH%28NOW%28%29%29%20AS%20%3FnowMonth%29%0A%20%20%20%20BIND%28DAY%28NOW%28%29%29%20AS%20%3FnowDay%29%0A%20%20%20%20%3Fentity%20wdt%3AP569%20%3Fdate%20.%0A%20%20%20%20FILTER%20%28MONTH%28%3Fdate%29%20%3D%20%3FnowMonth%20%26%26%20DAY%28%3Fdate%29%20%3D%20%3FnowDay%29%0A%0ASERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22.%20%7D%20%20%20%0A%7D%0ALIMIT%2010

Is it correct to have this condition ?

*Fabrizio* _______________________________________________ Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

-- *Fabrizio*

Wikidata mailing listWikidata@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikidata

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

1820

Age (days ago)

1823

Last active (days ago)

wikidata@lists.wikimedia.org

6 comments

5 participants

tags (0)

participants (5)

BOISSEL Sylvain
Fabrizio Carrai
Gerard Meijssen
Imre Samu
Nicolas VIGNERON