Please save the date: #SMWCon 2023, December 11-13, Paderborn, Germany
Tickets will be available beginning of September, but you can already announce your participation on the above page and think about possible contributions (talks, tutorials, workshops, etc.).
Hope to see you in Paderborn,
Bernhard and Tobias
Wiki Workshop [1 <https://wikiworkshop.org/>] 2023 will be the 10th edition
of Wiki Workshop! \o/ In the spirit of research and experimentation, we
have decided to make some changes for this decade edition event. There are
some changes that we know about now, and some that are work in progress.
Below you can learn more about the high level changes we expect to
*Online or in-person?*
Based on the feedback that we have gathered from Wiki Workshop attendees
over the past few years, a survey of authors of the recent Wiki Workshops,
as well as data about the geographical and gender diversity of Wiki
Workshop attendees (disclosed optionally as part of the registration form,
and aggregated), *we have decided to offer Wiki Workshop 2023 as a fully
Through the authors' survey we also learned that some authors who publish
in Wiki Workshop appreciated the in-person presence of the Wiki Workshop
community as part of the Web Conference [2 <https://www2023.thewebconf.org/>]
(formerly WWW). *We are exploring options to bring the Wikimedia
researchers who will attend TheWebConf 2023 in-person together while some
of us will be in Austin*. More details on this in early 2023.
We expect the workshop to take place some time in April-June 2023. We will
announce the exact date no later than the end of February 2023.
*Publishing and proceedings*
When we surveyed Wiki Workshop authors, those who responded were split
50-50 between whether it is important for them to have their workshop
submission as part of a proceedings. This allowed us to start considering
options other than the Companion Proceedings of WWW (the traditional venue
where a subset of Wiki Workshop papers were published in every year).
I'm very excited to share that we have found a new approach for publishing
Wiki Workshop papers that can allow us to experiment with new models and
keep the two groups of authors happy.
For the 2023 edition, *we will continue with the tradition of receiving
paper submissions for Wiki Workshop* (though we may change the submission
format/length for 2023)* and all accepted papers will appear in the
Wiki Workshop website*, similar to last year's. [3
<https://wikiworkshop.org/2022/#papers>] However, instead of accepting a
subset of the papers to appear in Proceedings of WWW, we are working with
the Editor in Chief of ACM Transactions on the Web (TWEB) [4
<https://dl.acm.org/journal/tweb>] to create a pathway for a subset of the
Wiki Workshop papers (likely after being extended) to be submitted for
review to *a special edition of ACM TWEB*.
There are a lot of details for us to work on to make the TWEB special
edition happen and that means this year you should expect to receive the
Call for Paper for Wiki Workshop some time in late January to middle of
February 2023 (instead of the usual December time-frame).
I am very excited about the opportunity for the work of the Wikimedia
research and Wiki Workshop community to be published as part of ACM
Transactions on the Web and I'm very grateful to Ryen White,
Editor-in-Chief of ACM TWEB, for being welcoming in exploring this idea and
offering a special edition space (details tbd).
There are some other high level schedule changes that we may make for the
2023 edition. If you like to stay informed about these changes at a
granular level and over time, you're welcome to subscribe to the
Phabricator task where these changes will be tracked:
We hope to be back with more updates for you in early 2023.
Leila, Bob and Emily
p.s. Please note that I didn't run the text of this email with Bob and
Emily (cc-ed). We have coordinated and discussed these changes among
ourselves, and they're welcome to add/update as they see fit.
Head of Research
I'm very happy to share  that Kinneret Gordon has joined the Research
team at the Wikimedia Foundation as our Lead Research Community Officer. In
this capacity, Kinneret oversees many of our team's initiatives to serve
the Wikimedia research community and will be the leading voice within the
Wikimedia Foundation to advocate for the needs of this community. All
members of the Research team  will continue dedicating a portion of
their time to the research community (roughly 20% for the coming 12 months).
I encourage you to learn more about Kinneret at  and book one of her
upcoming office hours  if you'd like to get to know her or talk with her
for matters that are related to the Wikimedia research community.
I'm very happy to see that we have the support to continue prioritizing
serving the Wikimedia research community within the Wikimedia Foundation
and our team. I'm looking forward to working with Kinneret, the rest of the
team, and all of you to help further strengthen the Wikimedia research
 Although some of you have already learned about part of this email
Head of Research
*ICCS 2023 – 28th International Conference on Conceptual Structures*
September 11–13, 2023, Berlin, Germany
ICCS will feature exciting *keynotes*:
- Nina Gierasimczuk (Technical University of Denmark):
The Dynamics of True Belief – Learning by Revision and Merge
- Henrik Müller (TU Dortmund University):
What’s in a story? How narratives structure the way we think about
- Camille Roth (French National Centre for Scientific Research, Centre
Semantic graphs and social networks
as well as three *tutorials*:
- Conceptual Structures for the Digital Humanities by Tom Hanika,
Sergei Obiedkov, and Robert Jäschke
- Needs beyond Chat-GPT: Teaching the Concepts of Knowledge
Representation by Filling a Void by Jan Krämer and Lilian Löwenau
- The R package fca-R by Domingo López-Rodríguez
The ICCS organizing committee is looking forward to meeting you in Berlin!
Robert Jäschke (General Chair)
Kai Sauerwald (PC Co-Chair)
Manuel Ojeda Aciego (PC Co-Chair)
The next Research Showcase, focused on *Improving knowledge integrity in
Wikimedia projects*, will be live-streamed Wednesday, July 19, at 9:30 AM
PST / 16:30 UTC. Find your local time here
The event is on the WMF Staff Calendar.
YouTube stream: https://youtube.com/live/_8DevIsi44s?feature=share
You can join the conversation on IRC at #wikimedia-research. You can also
watch our past research showcases here:
This month's presentations:
Assessment of Reference Quality on WikipediaBy *Aitolkyn Baigutanova, KAIST*In
this talk, I will present our research on the reliability of Wikipedia
through the lens of its references. I will primarily discuss our paper on
the longitudinal assessment of reference quality on English Wikipedia,
where we operationalize the notion of reference quality by defining
reference need (RN), i.e., the percentage of sentences missing a citation,
and reference risk (RR), i.e., the proportion of non-authoritative
references. I will share our research findings on two key aspects: (1) the
evolution of reference quality over a 10-year period and (2) factors that
affect reference quality. We discover that the RN score has dropped by 20
percent point, with more than half of verifiable statements now
accompanying references. The RR score has remained below 1% over the years
as a result of the efforts of the community to eliminate unreliable
references. As an extension of this work, we explore how community
initiatives, such as the perennial source list, help with maintaining
reference quality across multiple language editions of Wikipedia. We hope
our work encourages more active discussions within Wikipedia communities to
improve reference quality of the content.
- Paper: Aitolkyn Baigutanova, Jaehyeon Myung, Diego Saez-Trumper,
Ai-Jou Chou, Miriam Redi, Changwook Jung, and Meeyoung Cha. 2023.
Longitudinal Assessment of Reference Quality on Wikipedia. In Proceedings
of the ACM Web Conference 2023 (WWW '23). Association for Computing
Machinery, New York, NY, USA, 2831–2839.
Multilingual approaches to support knowledge integrity in WikipediaBy *Diego
Saez-Trumper & Pablo Aragón, Wikimedia Foundation*Knowledge integrity in
Wikipedia is key to ensure the quality and reliability of information. For
that reason, editors devote a substantial amount of their time in
patrolling tasks in order to detect low-quality or misleading content. In
this talk we will cover recent multilingual approaches to support knowledge
integrity. First, we will present a novel design of a system aimed at
assisting the Wikipedia communities in addressing vandalism. This system
was built by collecting a massive dataset of multiple languages and then
applying advanced filtering and feature engineering techniques, including
multilingual masked language modeling to build the training dataset from
human-generated data. Second, we will showcase the Wikipedia Knowledge
Integrity Risk Observatory, a dashboard that relies on a language-agnostic
version of the former system to monitor high risk content in hundreds of
Wikipedia language editions. We will conclude with a discussion of
different challenges to be addressed in future work.
Trokhymovych, M., Aslam, M., Chou, A. J., Baeza-Yates, R., & Saez-Trumper,
D. (2023). Fair multilingual vandalism detection system for Wikipedia.
arXiv e-prints, arXiv-2306. https://arxiv.org/pdf/2306.01650.pdfAragón, P.,
& Sáez-Trumper, D. (2021). A preliminary approach to knowledge integrity
risk assessment in Wikipedia projects. arXiv preprint arXiv:2106.15940.
Senior Research Community Officer
Wikimedia Foundation <https://wikimediafoundation.org/>
Extended deadline! Papers are due on Thursday, 27 July 2023
The Fourth Wikidata Workshop
Call for Papers
Co-located with the 22nd International Conference on Semantic Web (ISWC
Date: November 7, 2023
In Athens, Greece (in-person event)
The format of the workshop will be announced soon
== Important dates ==
Papers due: Thursday, 27 July 2023 (Extended!)
Notification of accepted papers: Thursday, September 31, 2023
Camera-ready papers due: Thursday, September 7, 2023
Workshop date: November 07, 2023
== Overview ==
Wikidata is an openly available knowledge base hosted by the Wikimedia
Foundation. It can be accessed and edited by both humans and machines and
acts as a common structured data repository for several Wikimedia projects,
including Wikipedia, Wiktionary, and Wikisource. It is used in a variety of
applications by researchers and practitioners alike.
In recent years, we have seen an increase in the number of publications
around Wikidata. While there are several dedicated venues for the broader
Wikidata community to meet, none of them focuses on publishing original,
peer-reviewed research. This workshop fills this gap - we hope to provide a
forum to build this fledgling scientific community and promote novel work
and resources that support it.
The workshop primarily seeks original contributions that address the
opportunities and challenges of creating, contributing to, and using a
global, collaborative, open-domain, multilingual knowledge graph such as
We encourage a range of submissions, including novel research, opinion
pieces, and descriptions of systems and resources which are naturally
linked to Wikidata and its ecosystem or enabled by it. What we are less
interested in are works that use Wikidata alongside or in lieu of other
resources to carry out some computational task - unless the work feeds back
into the Wikidata ecosystem, for instance, by improving or commenting on
some Wikidata aspect, or suggesting new design features, tools, and
This year, we again added a track for already published work. To foster
conversations around the topic of Wikidata, we invite authors of papers
published at other conferences to submit their papers to present at the
workshop. These will not be included in the proceedings but gives a chance
for authors to interact with the community.
We welcome interdisciplinary work, as well as interesting applications that
shed light on the benefits of Wikidata and discuss areas of improvement.
The workshop is planned as an interactive half-day event, in which most of
the time will be dedicated to discussions and exchanges rather than oral
presentations. For this reason, all accepted papers will be presented in
short talks and accompanied by a poster.
== Topics ==
Topics of submissions include, but are not limited to:
- Data quality and vandalism detection in Wikidata
- Referencing in Wikidata
- Anomaly, bias, or novelty detection in Wikidata
- Algorithms for aligning Wikidata with other knowledge graphs
- The Semantic Web and Wikidata
- Community interaction in Wikidata
- Multilingual aspects of Wikidata
- Using LLM with Wikidata
- Innovative uses of AI and NLP applications for Wikidata
- Machine learning approaches to improve data quality in Wikidata
- Tools, bots, and datasets for improving or evaluating Wikidata
- Participation, diversity, and inclusivity aspects in the Wikidata
- Human-bot interaction
- Managing knowledge evolution in Wikidata
- Abstract Wikipedia
== Submission guidelines ==
We welcome the following types of contributions.
= Track 1: Novel Works =
The papers in this track will be peer-reviewed by at least three
researchers using a single-blind review process. Accepted papers will be
published as open-access papers on CEUR (authors can also waive this). We
invite the following types of papers:
- Full research paper: Novel research contributions (7-12 pages)
- Short research paper: Novel research contributions of smaller scope than
full papers (3-6 pages)
- Position paper: Well-argued ideas and opinion pieces, not yet in the
scope of a research contribution (6-8 pages)
- Resource paper: New dataset or other resources directly relevant to
Wikidata, including the publication of that resource (8-12 pages)
- Demo paper: New system critically enabled by Wikidata (6-8 pages)
Submissions must be as PDF or HTML, formatted in the style of the Springer
Publications format for Lecture Notes in Computer Science (LNCS). For
details on the LNCS style, see Springer’s Author Instructions.
Papers have to be submitted through OpenReview(Please add “[NOVEL]” at the
beginning of the title on the submission page so we know that you are
submitting to this track):
= Track 2: Published works =
This track welcomes papers previously published at a peer-reviewed research
venue to be presented and discussed in the workshop. They do not have to
follow the formatting and page limit instructions from Track 1 and can
instead be submitted in the original format.
Previously published papers will be reviewed by the organising committee in
terms of the topical fit and prominence of the publication venue. They will
not be published as part of the proceedings. We invite the following types
- Full research paper: Previously published research contributions
- Resource paper: Previously published datasets or other resources that are
important or interesting to the community
- Demo paper: Presenting a previously published system critically enabled
Papers have to be submitted through OpenReview (please add “[PUBLISHED]” at
the beginning of the title on the submission page so we know that you are
submitting to this track):
== Proceedings ==
The complete set of papers from the Novel Works Track will be published
with the CEUR Workshop Proceedings (CEUR-WS.org).
== Best Paper Award ==
We will recognize the best paper with the best paper award. Reviewers will
be asked to flag papers they deem worthy of a prize. The general chairs
will set up a small panel that will read the papers, consider the
reviewers' comments and assess the talk to determine the winner. The award
comes with a 500 € prize, sponsored by Robert Bosch GmbH.
== Organizing committee ==
Lucie-Aimée Kaffee, Hasso Plattner Institute, Lucie-Aimee.Kaffee[[(a)]]hpi.de
Simon Razniewski, Bosch Center for AI, Simon.Razniewski[[(a)]]de.bosch.com
Kholoud Alghamdi, King's College London, kholoud.alghamdi[[(a)]]kcl.ac.uk
Hiba Arnaout, Max Planck Institute for Informatics,
Pursuant to prior discussions about the need for a research
policy on Wikipedia, WikiProject Research is drafting a
policy regarding the recruitment of Wikipedia users to
participate in studies.
At this time, we have a proposed policy, and an accompanying
group that would facilitate recruitment of subjects in much
the same way that the Bot Approvals Group approves bots.
The policy proposal can be found at:
The Subject Recruitment Approvals Group mentioned in the proposal
is being described at:
Before we move forward with seeking approval from the Wikipedia
community, we would like additional input about the proposal,
and would welcome additional help improving it.
Also, please consider participating in WikiProject Research at:
University of Minnesota
If you are interested in one/some/all of the projects and initiatives that
the Research team  at the Wikimedia Foundation is driving or is heavily
involved with, our bi-annual Research Report is a good place for you to get
a high level update about our work.
We just published our 8th bi-annual report at https://research
.wikimedia.org/report.html which captures the work of the Research team,
our contractors, and our formal collaborators  during January to June
2023. In the report you can also find information about upcoming events
which may be of interest to you, our latest formal collaborators, and
trends we watch.
We hope you engage with parts or all of the report. If you prefer to print
the report, ctrl+p/cmd+p are your friends.
Head of Research
* We apologize if you receive multiple copies of this CFP *
* For the online version of this call, visit:
SEMANTiCS 2023 (20th-22nd September - Leipzig, Germany) is hosting an
enriched collection of three workshops. Please find the relevant
workshops still open for accepting your submissions as long and short
paper contributions below.
# Onto4FAIR: 3rd Workshop on Ontologies for FAIR and FAIR Ontologies
Organizers: Cassia Trojahn (Institut de Recherche en Informatique de
Toulouse, France), Luiz Olavo Bonino da Silva Santos (University of
Twente, Leiden University Medical Centre, the Netherlands), Giancarlo
Guizzardi (University of Twente, the Netherlands), Clement Jonquet
(French National Research Institute for Agriculture, Food and
Environment, Mathematics, Informatics and Statistics for Environment and
Agronomy research unit, Montpellier, France)
# NLP4KGC: 2nd Workshop on Natural Language Processing for Knowledge
Organizers: Edlira Vakaj (Birmingham City University, Bermingham, UK),
Sanju Tiwari (Universidad Autónoma de Tamaulipas, Tamaulipas, Mexico),
Rizou Stamatia (Singular Logic, Athens, Greece), Nandana
Mihindukulasooriya (IBM Research, Dublin, Ireland), Fernando
Ortiz-Rodríguez (Universidad Autónoma de Tamaulipas, Tamaulipas,
Mexico), Ryan Mcgranaghan (NASA Jet Propulsion Laboratory, California,
We are looking forward to your contribution!
Workshop & Tutorial Chairs