Hi,
If you're a researcher (whether from academia, industry, other sectors,
or independent), you'll probably be interested in participating in the
online session "Scientific greetings", which will be held this Sunday,
31 October, as part of the WikidataCon 2021
<https://www.wikidata.org/wiki/Wikidata:WikidataCon_2021>. In this
condensed session each researcher will have 5 minutes to present what
aspects of Wikidata they're studying or how Wikidata is useful for their
research, find out what other colleagues are working on, and ask for or
offer collaboration.
We're sending this email to inform you that prior registration is
required to present at this session, so we encourage you to follow the
steps below:
1. Sign up for the WikidataCon 2021
<https://www.wikidata.org/wiki/Wikidata:WikidataCon_2021> (online,
29-31 Oct) if you haven't already done so. It's free and requires no
personal data.
2. *Add your name or username and, optionally, other details **here
<https://www.wikidata.org/wiki/Wikidata:WikidataCon_2021/Program/Scientific_…>**as
soon as possible*. Slots will be allocated on a first-come,
first-served basis.
If you want to prepare slides, feel free to use this template
<https://docs.google.com/presentation/d/1XqQYDwfOnIAlhEjz__AJxg3lluYuNp3QOyo…>.
If you're planning a pre-recorded session, please upload it to Youtube
or Vimeo (unfortunately, we can't display videos from Commons).
Please feel free to share this email with anyone who might find it
useful, and write to us if you have any questions. We hope you enjoy the
session and the conference.
The organizers of the session,
Tiago, Gabriel and David
Hi all!
This is a reminder / retroactive breaking change announcement for the
Wikidata Query Service and Wikibase RDF model.
The change was already announced
<https://lists.wikimedia.org/hyperkitty/list/wikidata@lists.wikimedia.org/me…>,
and we invite you to review that announcement if you haven’t seen it
before; but that email was quite a while ago, and we also didn’t send it to
all of the usual channels, so we wanted to send this email to ensure
everyone is aware of the change.
The most important part: queries that tested for blank nodes using the
standard isBlank() SPARQL function must now use wikibase:isSomeValue()
instead.
Best regards,
—
*Mike Pham* (he/him)
Sr Product Manager, Search
Wikimedia Foundation <https://wikimediafoundation.org/>
Thanks Galder :-) - answers are below:
On Thu, Oct 14, 2021 at 9:38 PM Galder Gonzalez Larrañaga <
galder158(a)hotmail.com> wrote:
> Thanks, Brigit, for this hub, it is great to have it! I have tried and
> can't find any way to look for tools that are not nominated as "Coolest
> Tool Award" besides looking for name. Is there a way for searching by
> categories?
>
Today you can try searching for various keywords to find tools in the
catalog (i.e. "Wikidata", "image", "editor", "template" ...). We're
interested in adding support for the community to organize tools in
categories/based on use cases in the future. There are some notes from past
Design Research on that in the Data Model documentation. [0]
Please feel welcome to comment on the talk page if you have further
questions or ideas! [1]
Birgit
[0] https://meta.wikimedia.org/wiki/Toolhub/Data_model#Tool_use_cases
[1] https://meta.wikimedia.org/wiki/Talk:Toolhub
>
> Thanks
> Galder
> ------------------------------
> *From:* Birgit Müller <bmueller(a)wikimedia.org>
> *Sent:* Thursday, October 14, 2021 4:58 PM
> *To:* wikitech-l <wikitech-l(a)lists.wikimedia.org>;
> wikimedia-l(a)lists.wikimedia.org <wikimedia-l(a)lists.wikimedia.org>;
> Wikimedia Cloud Services general discussion and support <
> cloud(a)lists.wikimedia.org>; wikidata(a)lists.wikimedia.org <
> wikidata(a)lists.wikimedia.org>; wikitech-ambassadors(a)lists.wikimedia.org <
> wikitech-ambassadors(a)lists.wikimedia.org>
> *Subject:* [Wikimedia-l] Toolhub 1.0 is launched! Discover software tools
> used at Wikimedia
>
>
> Hi All,
>
> We are happy to announce the launch of Toolhub
> <https://toolhub.wikimedia.org/> – a community-authored catalogue that
> aims to make software tools
> <https://meta.wikimedia.org/wiki/Toolhub#What_is_a_%22tool%22?> used in
> the Wikimedia movement discoverable to everyone.
>
> Community developed tools – including web applications, bots, gadgets,
> user scripts, lua modules, and more – play a significant role in the
> Wikimedia projects. These software applications address a wide range of use
> cases including finding bad faith edits and other content curation, bulk
> editing, collecting statistical information, creating special citations,
> and much more. About ⅓ of all edits are made by bots and tools. In
> addition, semi-automated edits are helped by user scripts, gadgets, and
> other editing assistance tools that run from the user's local computer or
> directly inside the wikis. There are thousands of tools available, but how
> can you find them?
>
> With Toolhub, you can document and find tools
> <https://meta.wikimedia.org/wiki/Toolhub>, promote their use in your wiki
> community, and help improve them by contributing data. You can create and
> share lists of tools relevant to your work - for example, for GLAM tools,
> or for wiki projects such as Women in Red.
>
> This first release provides a core set of functionalities
> <https://meta.wikimedia.org/wiki/Toolhub/Roadmap>, and contains an
> initial data set of about 1500 tools. Most of the initial tools in the
> catalog are imported from the same data files developers have created for Hay's
> Directory <https://hay.toolforge.org/directory/> which has been a major
> inspiration for Toolhub.
>
> Toolhub serves developers and users of tools alike. It is part of our
> efforts to improve the infrastructure and services for technical
> contributors, captured under one of Technology’s top level objectives in
> the FY 2020-2021 and 2021-2022 annual plans: Tech Community Building
> <https://www.mediawiki.org/wiki/Wikimedia_Technology/Annual_Plans/ERF_OKR:_T…>.
> We hope to continue conversations with developers and users of tools, plan
> to improve Toolhub, and to further expand the functionality.
>
> A collaborative system and open developer platform
>
> Toolhub is built as an API driven platform that makes it possible to
> extend and remix the catalogue, and to make collecting and reusing
> information about tools as open and collaborative as we can. Everything
> that can be done interactively with the Toolhub website can also be done
> remotely through the API. We would love to hear from technical
> contributors interested in using the Toolhub API
> <https://meta.wikimedia.org/wiki/Talk:Toolhub#API-use> to build new tools
> that make new ways to add or consume information from Toolhub's catalog.
>
> Our decision record
> <https://meta.wikimedia.org/wiki/Toolhub/Decision_record> and weekly
> progress reports
> <https://meta.wikimedia.org/wiki/Toolhub/Progress_reports> on Meta
> provide more insights in technical implementation details and decisions
> made throughout the development process. The Toolhub/About page
> <https://meta.wikimedia.org/wiki/Toolhub/About> provides information on
> project origin, research, use cases, data model, and roadmap. This recording
> from a lightning talk at ‘21 Wikimania
> <https://www.youtube.com/watch?v=J2hNm7bKjDo> gives an overview of the
> main aspects in 10 minutes.
>
> Thank you <3
>
> This project wouldn’t have been possible without the support, knowledge,
> ideas and prior work of many. One of the nicest side-effects of a release
> is that it’s a great opportunity to thank folks for their time and
> contributions :-)
>
>
> -
>
> Husky <https://meta.wikimedia.org/wiki/User:Husky>, whose Hay's
> Directory <https://hay.toolforge.org/directory/> provided the
> foundation for the data model used by Toolhub and inspired some of its
> features.
> -
>
> Harej <https://meta.wikimedia.org/wiki/User:Harej>, for his invaluable
> contributions in the early stages of the Toolhub project.
> -
>
> Our 'advisory board' - Giuseppe
> <https://meta.wikimedia.org/wiki/User:GLavagetto_(WMF)> (SRE), Risker
> <https://meta.wikimedia.org/wiki/User:Risker> (editor, admin), Reedy
> <https://meta.wikimedia.org/wiki/User:Reedy_(WMF)> (Security), Keegan
> <https://meta.wikimedia.org/wiki/User:Keegan_(WMF)> (Community
> Relations), and Eran
> <https://meta.wikimedia.org/wiki/User:%D7%A2%D7%A8%D7%9F> (volunteer
> developer & RTL expert) for providing their perspectives on key questions
> throughout the development process.
> -
>
> Giuseppe, Kunal <https://meta.wikimedia.org/wiki/User:Legoktm>, Manuel
> <https://meta.wikimedia.org/wiki/User:MArostegui_(WMF)>, Effie
> <https://meta.wikimedia.org/wiki/User:EMouzeli_(WMF)>, Cole
> <https://meta.wikimedia.org/wiki/User:CWhite_(WMF)> and Emanuele
> <https://meta.wikimedia.org/wiki/User:ERocca_(WMF)> from SRE and
> Majavah <https://en.wikipedia.org/wiki/User:Majavah> for their help on
> finding and resolving deployment issues.
> -
>
> Dan <https://www.mediawiki.org/wiki/User:Dzduvall> and Jeena
> <https://www.mediawiki.org/wiki/User:JHuneidi_(WMF)> from Release
> Engineering for help with build tooling.
> -
>
> Guillaume <https://www.mediawiki.org/wiki/User:GLederrey_(WMF)> and
> the rest of the Search Platform team for supporting our search index needs.
> -
>
> Manuel for supporting our database needs.
> -
>
> Niklas <https://meta.wikimedia.org/wiki/User:Nlaxstrom-WMF> and the
> whole translatewiki.net community for help with localization and
> internationalization.
> -
>
> Rita <https://meta.wikimedia.org/wiki/User:RHo_(WMF)>, Olga
> <https://meta.wikimedia.org/wiki/User:OTichonova_(WMF)>, Alex
> <https://meta.wikimedia.org/wiki/User:AHollender_(WMF)>, and Matthew
> <https://meta.wikimedia.org/wiki/User:MWilliams_(WMF)> from the Product
> Design <https://www.mediawiki.org/wiki/Design> team for their feedback
> on the Toolhub user interface.
> -
>
> Scott <https://www.mediawiki.org/wiki/User:SBassett_(WMF)> from the
> Security team for our security readiness review.
> -
>
> Amire <https://en.wikipedia.org/wiki/User:Amire80>, Kunal, Eran,
> Reedy, and Dan for contributing code to the project.
> -
>
> Ricordisamoa <https://meta.wikimedia.org/wiki/User:Ricordisamoa>, Quim
> <https://meta.wikimedia.org/wiki/User:Qgil-WMF>, and the people
> participating in conversations on wikitech-l
> <https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/…>
> for T115650 <https://phabricator.wikimedia.org/T115650> which inspired
> this whole project.
> -
>
> Finally, a huge thanks to all the folks who gave input and feedback on
> the talk page, in Phabricator, and at sessions - this is really
> appreciated!
>
>
> We hope that this new resource will be fun to explore, inspire you with
> new ideas, and ultimately be useful for your work.
>
> Feedback, bug reports, ideas and questions are more than welcome on the talk
> page of the project <https://meta.wikimedia.org/wiki/Talk:Toolhub>, or in
> Phabricator <https://phabricator.wikimedia.org/project/board/3224/>. Bryan
> (tech lead) & Seve (our new Product Manager) will be there to chat with
> interested folks and help with any questions. We are looking forward to
> evolving this project step-by-step and jointly with everyone!
>
> Birgit – on behalf of Technical Engagement & our Toolhub project team
>
>
> --
> Birgit Müller (she/her)
> Director of Technical Engagement
>
> Wikimedia Foundation <https://wikimediafoundation.org/>
> _______________________________________________
> Wikimedia-l mailing list -- wikimedia-l(a)lists.wikimedia.org, guidelines
> at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and
> https://meta.wikimedia.org/wiki/Wikimedia-l
> Public archives at
> https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org…
> To unsubscribe send an email to wikimedia-l-leave(a)lists.wikimedia.org
--
Birgit Müller (she/her)
Director of Technical Engagement
Wikimedia Foundation <https://wikimediafoundation.org/>
Hello,
The next Wikidata+Wikibase office hours
<https://www.wikidata.org/wiki/Category:Office_hour_notes> will take place
on Wednesday, 20th October 2021 at 16:00 UTC (18:00 Berlin time) in
the Wikidata
Telegram group <https://t.me/joinchat/IeCRo0j5Uag1qR4Tk8Ftsg>.
*The Wikidata and Wikibase office hours are online events where the
development team present what we have been working on over the past
quarter, and the community is welcome to ask questions and discuss
important issues related to the development of Wikidata and Wikibase.*
Looking forward to seeing you all next week.
--
Mohammed Sadat
*Community Communications Manager for Wikidata/Wikibase*
Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Phone: +49 (0)30 219 158 26-0
https://wikimedia.de
Keep up to date! Current news and exciting stories about Wikimedia,
Wikipedia and Free Knowledge in our newsletter (in German): Subscribe now
<https://www.wikimedia.de/newsletter/>.
Imagine a world in which every single human being can freely share in the
sum of all knowledge. Help us to achieve our vision!
https://spenden.wikimedia.de
Wikimedia Deutschland – Gesellschaft zur Förderung Freien Wissens e. V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/029/42207.
Hi everyone!
Just a reminder that there is one week left to submit your Coolest Tool
Award nominations. It only takes a few minutes to fill the form in!
Please recommend your favorite tools by October 27nd:
https://meta.wikimedia.org/wiki/Coolest_Tool_Award
Thanks!
andre, for the Coolest Tool Academy 2021
--
Andre Klapper (he/him) | Bugwrangler / Developer Advocate
https://blogs.gnome.org/aklapper/
Dear all,
I recently downloaded the following file: "wikidata-20210830-all.json.bz2" available here: https://dumps.wikimedia.org/wikidatawiki/entities/20210830/
I used the timestamp "20210830" (30th of August 2021) to get this dataset. My question is the following: What range of dates does the file cover? Is it the month of August? Or the previous month (July)?
Can someone explain to me how the data is aligned?
Thanks for your time,
Best,
Augustin Kapps
Hello all,
Thank you again for your all recent thoughts and feedback with regard to
the recent Wikidata: Query Service (WDQS) scaling update Aug 2021
<https://www.wikidata.org/wiki/Wikidata:Query_Service_scaling_update_Aug_2021>,
and for everyone who has responded to the WDQS user survey
<https://www.wikidata.org/wiki/Wikidata:Project_chat/Archive/2021/08#Wikidat…>.
As part of our ongoing work to scale WDQS, we will begin shipping the new
Flink-based Streaming Updater from test servers to production on 11 October
2021, with the entire data transfer process expected to finish by 18
October 2021.
The primary goal of this new Streaming Updater is to reduce update lag, and
throttling, of edits to Wikidata: going from an average of 10 edits/second
to an average of 88 edits/second. We are excited that this is almost a 9x
improvement in our ability to make sure that Wikidata Query Service has the
freshest updates from Wikidata, a priority that many of you ranked highly
in the recent survey. Additionally, the new update process will lessen the
impact on Blazegraph itself by moving diff reconciliation away from the
service. This update process will be more stable as a result, with more use
cases like un/deletes handled correctly.
In order to minimize risks of failure during the rollout of the Streaming
Updater, we will be moving individual servers over one at a time. During
the anticipated 7 days this data transfer process will happen (11-18 Oct),
it is possible that some users will see inconsistent behavior or other bugs
while querying. While we encourage these bugs to be filed, please note that
it may be difficult for the Search team to accurately diagnose the source
of these errors due to the nature of the process. We hope for a seamless
transfer, of course, in which users will not notice any errors during the
switchover.
We previously announced the new Streaming Updater being released to test
servers in March 2021
<https://www.wikidata.org/wiki/Wikidata:Project_chat/Archive/2021/03#New_WDQ…>;
the changes announced there will now be effective for all WDQS users
effective 18 Oct 2021.
The changes that allow the new Streaming Updater to reduce update lag comes
with two notable changes, which have the potential to break current usage
and workflows:
1.
Blank nodes in Wikidata have been skolemized
<https://www.mediawiki.org/wiki/Wikidata_Query_Service/Blank_Node_Skolemizat…>.
From a user perspective, (1) queries using isBlank() will need to be
rewritten; (2) queries using isIRI/isURI will need to be verified; (3)
WDQS results will no longer include blank nodes.
2.
Constraint Fetching -- specifically wikibase:hasViolationForConstraint
-- will be temporarily disabled until we are able to expose constraint
violations in a more production-ready way
<https://phabricator.wikimedia.org/T192565>.
For more details on these changes, please refer again to our prior
announcement
<https://www.wikidata.org/wiki/Wikidata:Project_chat/Archive/2021/03#New_WDQ…>
.
We find it encouraging that the new Streaming Updater has not caused major
relevant issues in the last six months while it has been on
https://query-preview.wikidata.org/. We understand these changes may not be
optimal for everyone. However, we believe the ability to greatly reduce
Wikidata’s edit lag will be a beneficial improvement for all editors.
We’re excited to ship the new Flink-based Streaming Updater to production,
and believe this is a significant step in scaling Wikidata and WDQS. As
always, we encourage you to report technical problems
<https://www.wikidata.org/wiki/Wikidata:Report_a_technical_problem/WDQS_and_…>
and/or leave general comments/feedback in Project Chat
<https://www.wikidata.org/wiki/Wikidata:Project_chat>.
Best,
WMF Search & WMDE
—
*Mike Pham* (he/him)
Sr Product Manager, Search
Wikimedia Foundation <https://wikimediafoundation.org/>
Dear Wikidata List,I am a data science master's student at EPFL. For my semester project, I am working with some of your data.
I realized recently that the JSON dataset from 2021-08-30
("https://dumps.wikimedia.org/wikidatawiki/entities/20210830/wikidata-2021083…") doesn't have any field named 'modified' (described here: "https://doc.wikimedia.org/Wikibase/master/php/md_docs_topics_json.html").
When parsing the JSON I obtain the following top-level structure :
{
"id": "Q60",
"type": "item",
"labels": {},
"descriptions": {},
"aliases": {},
"claims": {},
"sitelinks": {},
"lastrevid": 195301613
}
Which almost matches the one described except for the "modified" field that is missing.
Could you please tell me more about the field and where can I find it?
Kindest regards,
Augustin Kapps