Wikidata-tech

wikidata-tech@lists.wikimedia.org

1 participants
626 discussions

Save the date: Wikidata Data Reuse Days online event coming up in February 2025
by Léa Lacroix 19 Dec '24

19 Dec '24

Hello all, I'm happy to announce that we started preparing our next Wikidata community online event: the *Data Reuse Days 2025 <https://www.wikidata.org/wiki/Event:Data_Reuse_Days_2025>*. The event will be focusing on *how people and organizations use Wikidata's data to build interesting applications and tools*. It aims to bring together data reusers and editors to learn from each other and discover cool Wikidata-powered applications. We will also cover technical aspects of Wikidata and share research and ideas for the future of reusing Wikidata’s data. The event is taking place *online*, we will have sessions taking place during *periods of 2 hours through 8 days: from February 18 to 27, 2025*. You will be able to join sessions live, or to watch the replay later on. You will find the schedule below on this page. The sessions take place in English, and are open to everyone interested in the topic of data reuse. We are welcoming proposals from Wikidata editors and reusers who want to showcase their applications or facilitate discussions! You can *propose sessions on the talk page until January 12th <https://www.wikidata.org/wiki/Event_talk:Data_Reuse_Days_2025>*. We will then select some of them and add them to the schedule. We are especially welcoming demos of tools or applications using Wikidata's data, discussions between editors and reusers, and technical presentations. While waiting for the event to take place, you can also rewatch some sessions from our last edition in 2022 <https://www.youtube.com/playlist?list=PLduaHBu_3ejNaZk15ybdHNWY8z-FyunRm>. If you have any questions or suggestions, feel free to write on the talk page or to reach out to me directly. Best, -- Léa Lacroix Community Engagement & Events Consultant Contractor for Wikimedia Deutschland e.V.

1 1

[BREAKING CHANGE ANNOUNCEMENT] wbformatvalue API no longer accepts most options
by Danny Benjafield 13 Nov '24

13 Nov '24

Hello, This is a breaking change announcement for the options parameter of the wbformatvalue API. Based on recent usage data, we don’t expect most API users to be affected by this change. The wbformatvalue API has an options parameter, where various formatting options can be specified in a JSON object. Historically, Wikibase has allowed any option to be set to any (JSON) value here, and because the formatter implementations often did not validate the options, it was possible to produce various (mostly harmless) crashes in Wikibase by setting e.g. a string-valued option to an integer. Also, even when the options were being used correctly, most of them were of questionable usefulness, and tracking shows <https://grafana.wikimedia.org/d/h-hXQTtIz/wikibase-api-wbformatvalue?orgId=…> that only very few options were actually used in practice. To simplify the API, we are changing it so that only four options are allowed in the JSON: lang, applyRounding, applyUnit, and showcalendar.These allowed options and their possible values are documented in the API documentation. Currently, invalid values for these options are already rejected; as of 2024-11-27, any option name other than these four will also be rejected, regardless of value. According to the tracking mentioned above, no API request has mentioned any of the other options in the past six months, so we do not expect that anyone will actually have to update their code to stop sending other options. If you have any questions, feel free to leave a comment on T323778 <https://phabricator.wikimedia.org/T323778>. -- *Danny Benjafield* Community Communications Manager Wikidata Integrations Team Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Phone: +49 (0)30-577 11 62-0 https://wikimedia.de Keep up to date! Current news and exciting stories about Wikimedia, Wikipedia and Free Knowledge in our newsletter (in German): Subscribe now. <https://www.wikimedia.de/newsletter/> Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us to achieve our vision! https://spenden.wikimedia.de Wikimedia Deutschland — Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Charlottenburg, VR 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207. Geschäftsführende Vorstände: Franziska Heine, Dr. Christian Humborg

1 0

[BREAKING CHANGE ANNOUNCEMENT] Wikidata Query Service graph split available in production; scholarly entity queries require migration by March 2025
by Guillaume Lederrey 10 Sep '24

10 Sep '24

Hi all! As part of the WDQS Graph Split project,[1] we have new SPARQL endpoints available for serving the “main”[2] and “scholarly”[3] subgraphs of Wikidata. As you might be aware we are addressing the Wikidata Query Service stability and scaling issues. We have been working on several projects to address these issues. This announcement is about one of them, the WDQS Graph Split.[1] This change will have an impact on certain uses of the Wikidata Query Service. We are now entering a transition period until the end of February 2025. The three SPARQL endpoints will remain in place until the end of the transition. At the end of the transition, query.wikidata.org will serve the main Wikidata subgraph (without scholarly articles). The query-main and query-scholarly endpoints will continue to be available after the transition. If you know to want more this change, please refer to the talk page on Wikidata.[4] Have fun! Guillaume [1] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_graph_split [2] https://query-main.wikidata.org [3] https://query-scholarly.wikidata.org [4] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_backend_up… -- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

4 8

Re: [Call for Beta Testing] New "mul" term language code on Wikidata
by Mohammed Sadat Abdulai 05 Aug '24

05 Aug '24

*(This [SIGNIFICANT Change Announcement] is relevant for all Wikidata users working with Labels and Aliases.)* Hello, You may recall our previous announcement <https://lists.wikimedia.org/hyperkitty/list/wikidata@lists.wikimedia.org/me…> inviting you to test out the “default values for all languages” feature, introducing the language code "mul" for labels and aliases, on https://test.wikidata.org. I'm pleased to announce that we are now proceeding with a limited release on Wikidata. This feature will be available for testing starting July 29. Note of Caution and Tips for Testing - To try out the new feature during this limited release, you need to add the language code “mul” to your Babel boxes <https://www.wikidata.org/wiki/Wikidata:Userboxes#Babel>. A full release will follow on the week of August 12, displaying default values to everyone by default. - Please refrain from starting any Bot-runs for mul during the limited release. We will use this limited release to test the performance and verify that everything works as planned. Bot-runs for mul should only commence after the full feature is released. - Please also test the help page <https://www.wikidata.org/wiki/Help:Default_values_for_labels_and_aliases> explaining how to use the feature. It will be important to get this help page right, as the full release will initially contain an onboarding element that guides people to this help page. I would like to thank everyone who has participated in the previous testing phases or provided feedback thus far. We are eager to hear more from you during this limited release. Please do not hesitate to reach out with questions or concerns on the talk page of the Help page <https://www.wikidata.org/wiki/Help_talk:Default_values_for_labels_and_alias…>, or for technical details, in this Phabricator ticket (phab:T356169 <https://phabricator.wikimedia.org/T356169>) There has also been some discussion on the help page <https://www.wikidata.org/wiki/Help_talk:Default_values_for_labels_and_alias…> regarding the copy used for the language. We would like to reach a consensus before the full release. Join the discussion to add your thoughts and input on the thread. This week, a survey will be included in the Weekly Summary for those who prefer to provide anonymous feedback. Cheers! -Mohammed On Mon, Feb 12, 2024 at 9:00 AM Mohammed Sadat Abdulai < mohammed.abdulai(a)wikimedia.de> wrote: > (This announcement is relevant for all Wikidata users working with Labels > and Aliases.) > > > Hello, > > We're excited to invite you to participate in the community testing of the > “default values for labels and aliases” feature. Based on a long-standing > community request around language fallback (T285156 > <https://phabricator.wikimedia.org/T285156>), and based on your feedback > from our previous announcement > <https://lists.wikimedia.org/hyperkitty/list/wikidata@lists.wikimedia.org/me…>, > we are currently testing this feature on https://test.wikidata.org > <https://test.wikidata.org/wiki/Q42> with the release planned for Q1 2024. > > What is coming? > > 1. > > Default values for labels and aliases (mul): Items that repeat the > same label and aliases over and over are hard to maintain and can strain > our infrastructure, especially the Wikidata Query Service. As a solution, > we are introducing the option for default values in the termbox. The > default values are considered in the language fallback chain (language code > “mul”). > > > > 2. > > Visualisation of the language fallback chain: Previously, Wikidata’s > fallback chain was not visible in the user interface, making it challenging > to determine if additional information was needed. As a first step toward > improvement, we will now clearly show what content is already available via > language fallback in the placeholders for labels (including default values). > > > We need your feedback > > Please leave your feedback on Help talk:Default values for labels and > aliases > <https://www.wikidata.org/w/index.php?title=Help_talk:Default_values_for_lab…>. > Your feedback will play a crucial role in verifying if the current version > is ready for Wikidata. Additionally, you can find some test Items, known > limitations and open questions there for you to review. We will analyze > your feedback one week after today's announcement. > > The next steps > > After you have left your feedback, please make sure that the guidelines > on Help:Default values for labels and aliases > <https://www.wikidata.org/wiki/Help:Default_values_for_labels_and_aliases> > are ready for the launch. You can also already plan bot-runs for mul, but > please be sure to start with uncontroversial cases. If there are no > blockers, we will then prepare a limited release on Wikidata in the > coming weeks. The limited release will only be visible if you put mul in > your Babel boxes. We will use this limited release to test the performance > and verify that everything works as planned. Please don’t start any > bot-runs for mul during the limited release. A full release will follow a > few weeks later, displaying default values for everyone by default, and > featuring an onboarding element that will guide people to the help page. > Bot-runs for mul can commence at this stage. > > Do not hesitate to reach out with questions or concerns in the talk page > of the help page > <https://www.wikidata.org/wiki/Help_talk:Default_values_for_labels_and_alias…> > and for technical details in this Phabricator ticket (T356169 > <https://phabricator.wikimedia.org/T356169>). > > > Thank you for your support! > > Cheers, > -- > Mohammed Sadat Abdulai > *Community Communications Manager, Wikidata* > > Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin > Phone: +49 (0) 30 577 116 2466 > https://wikimedia.de > > Grab a spot in my calendar for a chat: calendly.com/masssly. > > A lot is happening around Wikidata - Keep up to date! > <https://www.wikidata.org/wiki/Wikidata:Status_updates> Current news and > exciting stories about Wikimedia, Wikipedia and Free Knowledge in our > newsletter (in German): Subscribe now > <https://www.wikimedia.de/newsletter/>. > > Imagine a world in which every single human being can freely share in the > sum of all knowledge. Help us to achieve our vision! > https://spenden.wikimedia.de > > Wikimedia Deutschland — Gesellschaft zur Förderung Freien Wissens e. V. > Eingetragen im Vereinsregister des Amtsgerichts Charlottenburg, VR 23855 B. > Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, > Steuernummer 27/029/42207. Geschäftsführende Vorstände: Franziska Heine, > Dr. Christian Humborg >

1 2

Wikibase: Releasing Wikibase Suite Deploy 1.0.0, 2.0.0 and 3.0.0
by Mónica Pinedo 15 Jul '24

15 Jul '24

Hello, We would like to announce a major update to the Wikibase Suite product offering: Wikibase Suite Deploy <https://github.com/wmde/wikibase-release-pipeline/blob/main/deploy/README.md>. It’s a total overhaul of what used to be the Wikibase Suite “example” directory, transforming it into a complete deployment kit for Wikibase production environments. Highlights: 1. It significantly improves the separation of config, code, and data. Making configuration for deployment clearer, easier, and more robust across updates. Now, all the config lives in a single “config” directory; all data is located in docker volumes; and container images containing the code can be updated individually, without touching config or data. We also consolidated our docker compose files and restructured them for better legibility. 2. We did a total overhaul of the deployment documentation <https://github.com/wmde/wikibase-release-pipeline/tree/main/deploy> along with individual docs for each of our containers. 3. We included a Traefik <https://doc.traefik.io/traefik/> reverse proxy with SSL termination and ACME support; allowing for, among other benefits, QuickStatements Authentication and https certification out of the box. 4. Simplifying our images, we combined the “wikibase” and “wikibase-bundle” images into a single image called “wikibase”. Please note that this means “wikibase-bundle” is now deprecated; however, all of its original functionality remains intact in “wikibase”. 5. A new versioning scheme. Each Wikibase Suite Image is now separately versioned as is the Wikibase Suite Deploy product. The new versioning scheme follows the rules of Semantic Versioning <https://semver.org>, which you’re likely familiar with already. The releases of Wikibase Suite Deploy we’re making today carry a major version for each Mediawiki version we support: - Wikibase Suite Deploy 1.0.0 <https://github.com/wmde/wikibase-release-pipeline/tree/deploy-1/deploy> ships Wikibase Image 1.0.0 based on Mediawiki 1.39 - Wikibase Suite Deploy 2.0.0 <https://github.com/wmde/wikibase-release-pipeline/tree/deploy-2/deploy> ships Wikibase Image 2.0.0 based on Mediawiki 1.41 - Wikibase Suite Deploy 3.0.0 <https://github.com/wmde/wikibase-release-pipeline/tree/deploy-3/deploy> ships Wikibase Image 3.0.0 based on Mediawiki 1.42 - All other services such as WDQS and Quickstatements shipped with all Wikibase Suite Deploy versions start on image version 1.0.0 today. Subsequent releases will be shipped as minor or patch updates to Wikibase Suite Deploy and the Wikibase Suite Images respectively. The upcoming Mediawiki 1.43 will be released as a new Wikibase Suite Deploy major version. Read more about versioning and updating in the Wikibase Suite Deploy documentation <https://github.com/wmde/wikibase-release-pipeline/tree/main/deploy>. All Wikibase Suite Image Releases are available on the Wikibase Docker Hub repository <https://hub.docker.com/repositories/wikibase>, from now on tagged with their semantic version. Here are the MediaWiki release notes <https://www.mediawiki.org/wiki/Release_notes> for more info. I want to say a huge thank you to you in the community who have partnered with us along the way trying the software out in production, offering us feedback, answering our and each other’s questions, sharing your needs, and submitting tickets on phabricator. I also want to say a huge thank you to our user researcher and wonderful team of engineers who made realising these improvements possible. We’re excited to continue to work with you to improve Wikibase Suite. Let us know how migrating to deploy works out for you and let us know if you need any help by creating a ticket on Phabricator <https://phabricator.wikimedia.org/maniphest/task/edit/form/129/>. Warm Regards, The Wikibase Suite team Mónica Pinedo Bajo (she/her) Engineering Manager Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0https://wikimedia.de Keep up to date! Current news and exciting stories about Wikimedia, Wikipedia and Free Knowledge in our newsletter (in German): Subscribe now <https://www.wikimedia.de/newsletter/> Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us to achieve our vision!https://spenden.wikimedia.de Wikimedia Deutschland – Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

1 0

dashes - in JSON keys - suck
by Thad Guidry 20 Jun '24

20 Jun '24

"mainsnak": { "snaktype": "value", "property": "P31", "hash": "d679b35e7a9523b92903b52661a9e4c15d8d76d3", "datavalue": { "value": { "entity-type": "item", "numeric-id": 112826905, "id": "Q112826905" }, "type": "wikibase-entityid" }, "datatype": "wikibase-item" }, One of the constant pain points that I have heard and run across is this: Any chance Wikidata's JSON format might be a little more developer friendly > for tooling in general? Like why do they sometimes have "entity-type" and > "numeric-id" as keys with dashes, when a lot of the world and our parsing > libraries have sorta standardized around at least only camelCase or > snake_case in JSON. I mean, look at what they did with "snaktype" and > "entity-type" ! Can you find out, Thad ? So I said to them, sure. 😉 (granted I know all characters are allowed for object property names in JSON and someone likely in the team at the time said, "eh, doesn't matter, it's JSON, it eats anything".) Thad https://www.linkedin.com/in/thadguidry/ https://calendly.com/thadguidry/

1 0

[BREAKING Change Announcement] Upcoming Changes to Wikibase: new EntitySchema data type
by Lydia Pintscher 18 Jun '24

18 Jun '24

Hi everyone, This is a breaking change announcement relevant for some Wikibase API users. What is Changing? On 2 July 2024, we will enable the EntitySchema data type on Wikidata, and we expect the community to create the first properties with that data type and start using them in statements shortly afterwards. This means that there will be values with the data value type wikibase-entityid containing an EntitySchema ID (with "entity-type": "entity-schema" in the JSON value). However, EntitySchema is not yet a full-featured Wikibase entity type; it is our intention to eventually make it work like other entity types (Item, Property, etc.), but at the moment, using EntitySchema in e.g. the wbgetentities API or Special:EntityData does not work. Who is Affected? Code which assumes that IDs found in wikibase-entityid data values can be used with other Wikibase entity APIs may need adjusting. Other Wikibases instances besides Wikidata are not affected unless they also use the EntitySchema extension and set $wgEntitySchemaEnableDatatype = true. What You Need to Do If your code works with statements of arbitrary data types, and looks up entities referenced in values with the data value type wikibase-entityid, you probably want to check that the entity-type is not entity-schema before proceeding. (Note that, if your goal is to display the value, you can instead use the wbformatvalue API for any data type.) If you use the wbformatvalue API, you should make sure that you also specify the datatype or property parameter (depending on which information you have available; note that specifying both parameters at once is an error). Without this information, not all values can be formatted correctly; in particular, trying to format an EntitySchema value without specifying the datatype or property will result in an error (“An illegal set of parameters have been used”). (Specifying the datatype or property parameter for wbformatvalue has always been advisable, and necessary for some other data value types, but this is the first time it becomes relevant for wikibase-entityid data values.) As previously announced <https://lists.wikimedia.org/hyperkitty/list/wikidata@lists.wikimedia.org/th…>, the new data type is already enabled on Test Wikidata, so you can try out the behaviour there. (An example item on Test Wikidata with a statement linking to an EntitySchema is human <https://test.wikidata.org/wiki/Q497>.) If you have any questions or concerns about this change, please don’t hesitate to reach out to us in this ticket (T332157 <https://phabricator.wikimedia.org/T332157>). Cheers, Lydia -- Lydia Pintscher - https://lydiapintscher.de - WD:Q18016466 <https://www.wikidata.org/wiki/Q18016466> Portfolio Lead for Wikidata Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Phone: +49 (0)30-577 11 62-0 https://wikimedia.de Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us to achieve our vision! https://spenden.wikimedia.de Wikimedia Deutschland — Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Charlottenburg, VR 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207. Geschäftsführende Vorstände: Franziska Heine, Dr. Christian Humborg

1 0

(DEC 2024) Huawei H13-811_V3.0 Dumps [Questions] Simple Strategy for Achievement
by xutehosaulle＠gmail.com 15 Apr '24

15 Apr '24

JustCerts offers three formats of actual and newest H13-811_V3.0 Exam Questions to help students customize their HCIA Cloud Service H13-811_V3.0 study experience. These real Huawei H13-811_V3.0 Dumps (Questions) are available with up to 90 days of free updates that remove post-purchase anxiety. Buy today and get free H13-811_V3.0 Dumps (Questions) updates.

1 0

Timestamps with calendarmodel other than Q1985727 and Q1985786
by Mitar 24 Mar '24

24 Mar '24

Hi! Recently, a timestamp with calendarmodel https://www.wikidata.org/wiki/Q12138 has been introduced into Wikidata: https://www.wikidata.org/w/index.php?title=Q105958428&oldid=2004936527 How is this possible? I thought that the only allowed values are Q1985727 and Q1985786? Mitar -- https://mitar.tnode.com/ https://twitter.com/mitar_m https://noc.social/@mitar

1 1

From JSON to RDF dumps
by daniel＠degu.cl 25 Feb '24

25 Feb '24

Hi all, I wonder if the Wikidata RDF dump (in https://dumps.wikimedia.org/wikidatawiki/entities/) is generated directly from the JSON dump. If this is the case, what tool used? Best Regards, Daniel

4 3

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

Wikidata-tech