Hi all -
We've been using a locally installed wikidata stand-alone service
for several months now. Recently the service went down for a significant
amount of time, and when we ran runUpdate.sh -n wdq, instead of catching
up to real time as it usually does, the update process lagged, failing
even to keep parity with real time.
Example output from the log:
09:30:39.805 [main] INFO org.wikidata.query.rdf.tool.Update - Polled up
to 2016-10-24T23:01:05Z at (0.0, 0.0, 0.0) updates per second and
(271.8, 56.2, 18.8) milliseconds per second
This is normal when starting the update of course, but the system never
seems to find its feet, and continues to stumble and lag. Restarting
both the blazegraph process and the update process has no lasting effect.
From time to time, a message like this will appear:
INFO org.wikidata.query.rdf.tool.RdfRepository - HTTP request failed:
failed to respond, retrying in 2175 ms.
I have experienced this effect in the past, and had success replacing an
old journal which was the product of a long update process with a new
journal rebuilt from the latest dump. This strategy did not work. I
tried rebuilding with the latest git pull from origin and rebuilding the
journal, again with no effect.
This problem started about 3 days ago, and we're now polling up to a
point in time 18 hours earlier than real time.
I would appreciate any guidance.
Also: is this an appropriate list to write to with such problems? Are
there more appropriate places?
we plan to drop the "wb-status" page prop as it's unused as far as we
can tell and of questionable value, see
<https://phabricator.wikimedia.org/T146792>. This will affect you if you
use the action=query API to retrieve page props from entity pages or if
you use the page_props table (on tool labs for example), to retrieve
this page property.
Please let us know if and how you use this page prop, so that we can
find a solution for your use cases.
In case there are no issues with removing this, we will drop it in
December 2016 (or later).
The Wikimedia Developer Summit
<https://www.mediawiki.org/wiki/Wikimedia_Developer_Summit> is the annual
meeting to push the evolution of MediaWiki and other technologies
supporting the Wikimedia movement. The next edition will be held in San
Francisco on January 9-11, 2017.
We welcome all Wikimedia technical contributors, third party developers,
and users of MediaWiki and the Wikimedia APIs. We specifically want to
increase the participation of volunteer developers and other contributors
dealing with extensions, apps, tools, bots, gadgets, and templates.
- Monday, October 24: This is the last day to request travel
sponsorship. Applying takes less than five minutes.
- Monday, October 31: This is the last day to propose an activity. Bring
the topics you care about!
Subscribe to weekly updates: https://www.mediawiki
Please feel free to forward this email to anyone who might be interested in
we will soon change how Wikibase outputs data as Wikitext per default.
This might affect users of the "action=wbformatvalue" API that either
use "generate=text/x-wiki" or omit the "generate" parameter (Wikitext
output is the default for that API module). I briefly looked through our
API logs in order to see how many users will be affected by this and
found that no one uses this feature.
Please note that for our internal functionality (like the property
parser function, or the Lua functionality), we made sure that the output
Only the output obtained via the wbformatvalue-API module might change!
Property filter does not seem to be working for me.
WikibaseDataFetcher wbdf = WikibaseDataFetcher.getWikidataDataFetcher();
i am still receiving all statements. what am i missing ?
Thanks in advance