Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
-
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732 -
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Thanks Liam!
Great to see such clear and thorough documentation of what this project is about, why we're doing it, and why it's being done in this particular way.
Regards,
Chris / The Land
On Tue, Mar 16, 2021 at 4:03 PM Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l New messages to: Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe
Hi,
Le mar. 16 mars 2021 à 13:51, Chris Keating chriskeatingwiki@gmail.com a écrit :
Thanks Liam!
Great to see such clear and thorough documentation of what this project is about, why we're doing it, and why it's being done in this particular way.
Indeed! Obviously, I'm biased, but I appreciate the level of documentation provided, which makes it easier to have an informed and in-depth discussion (although it's a lot to translate!).
From the Strategic Direction in 2017 (
https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017 ), to the WMF revenue strategy in 2018 ( https://meta.wikimedia.org/wiki/2018_Revenue_strategy/Summary ), to the working group on Revenue Streams in 2019 ( https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen... ), to the final recommendations in 2020 ( https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen... ), and now to this, it's certainly been a long journey, but it's great to see this coming to life. Taking this idea and shepherding it towards implementation while respecting the ethos of the movement is not an easy feat, and the team really seems to take this to heart, which is a good sign.
Nicely done! A model on so many levels. Let's learn from this and find ways to speed and templatize this style and approach. ~~~~
On Tue, Mar 16, 2021 at 12:03 PM Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l New messages to: Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe
I couldn’t agree more. This is beautifully executed.
On Sat, Mar 20, 2021 at 9:10 PM Samuel Klein meta.sj@gmail.com wrote:
Nicely done! A model on so many levels. Let's learn from this and find ways to speed and templatize this style and approach. ~~~~
On Tue, Mar 16, 2021 at 12:03 PM Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l New messages to: Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe
-- Samuel Klein @metasj w:user:sj +1 617 529 4266 _______________________________________________ Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l New messages to: Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe
Dear all, A lot has happened since March when we Introduced the Wikimedia Enterprise API https://diff.wikimedia.org/2021/03/16/introducing-the-wikimedia-enterprise-api/ and began community conversations about the project’s development. Now is an important milestone to give everyone: 1) an update responding to community advice we’ve received; and 2) to describe what is happening next.
The idea of an API for the specific needs of the commercial sector had been discussed for more than a decade https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Where_has_this_previously_been_discussed (both for the purposes of improving user experience, and also to diversify revenue). The announcement in March introducing the Wikimedia Enterprise API generated a lot of Wikimedia-community and mainstream-media attention - most notably in WIRED https://www.wired.com/story/wikipedia-finally-asking-big-tech-to-pay-up/. Since then, the team has been hard at work building the actual product and hosting many conversations (regular public meetings and participation in events including SWAN, Wikimania, EMWCon, Clinic) - as well as a considerable volume of discussions on our meta talkpage https://xtools.wmflabs.org/articleinfo/meta.wikimedia.org/Talk:Wikimedia%20Enterprise. All of this has generated lots of suggestions, which we have endeavoured to incorporate and respond to before the actual commercial launch. On behalf of the whole team, I thank the many many people who have been willing and able to share constructive feedback with us over these months. Links to recordings from those meetings/presentations can be found on our meta homepage:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
1. To that end, here are some updates in response to community advice:
WMF Board statement.
Subsequent to the most recent WMF Board of Trustees meeting, a statement reaffirming their support of the project, and in particular its operating principles relating to its future revenue, has been published. You can find the board Statement here https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikimedia_Foundation_Board_Statement_on_Wikimedia_Enterprise_revenue_principles, and the Enterprise operating principles on Meta here https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/Principles. Consistent community feedback was that our published principles were good and sensible, but for such a new and unusual thing in our movement, an overt statement from the Board of Trustees was requested. This statement affirms that:
- Revenues of the WMF obtained from commercial activities shall not surpass 30% of the total planned revenue via all sources (including donations) in that fiscal year, and no further revenue would be sought beyond that limit; - The Board of Trustees will be notified in advance of any large commercial agreements, giving them time for review - exactly mirroring the procedure for large gifts; - Revenue obtained from Wikimedia Enterprise services is under the oversight and control of procedures for revenue raised by the Wikimedia Foundation and the revenue will not be earmarked for a specific program.
Each of these things were already noted on-wiki, but they were very much worthwhile re-stating formally. Equally it bears repeating: the existing APIs and methods of accessing Wikimedia sites remain. The creation of this optional commercial service, designed for those with specific high data-volume demands, does not change the experience (legally or technically) for anyone else. Relatedy, and also in response to community suggestions, the formal contracts which define the legal relationship of the non-profit Wikimedia Foundation to this commercial activity, have now been published on the governance wiki and linked from the related section on the project’s https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary.
Free technical access for the community.
You will soon be able to access a copy of the Enterprise dataset, refreshed each fortnight, at the Wikimedia dumps portal http://dumps.wikimedia.org/. Furthermore a ‘daily dump + hourly diff’ version is also already available, via Wikimedia Cloud Services https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_Introduction to any users of Toolforge, Cloud VPS, or PAWS. Both of these are provided to anyone, for free (in both ‘gratis’ and ‘libre’ senses of the word). Importantly, and consistent with community feedback, neither of these access methods require any special request process to access them, other than the existing terms of service on those platforms.
Software development updates are published monthly on our page on MediaWiki https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates (as is the API documentation https://www.mediawiki.org/wiki/Wikimedia_Enterprise/Documentation), and the work is coordinated on our Phabricator board https://phabricator.wikimedia.org/tag/wikimedia_enterprise/.
Next public meeting. As mentioned, the team has been holding regular public calls. If you would like to meet with, and ask any questions of, the Enterprise team (a.k.a. “Office hours”):
Friday October 22 @ 1500 UTC on Zoom https://wikimedia.zoom.us/j/88994018553. If you would like to arrange a conversation about this project with a group in the community that you are part of (at a time, language, and meeting-software platform of your choice), please contact me directly.
2. What is happening next:
The launch of the project’s standalone website, denoting the service as “open for business”, will take place early next week.
In parallel we will also be announcing the first customers - both from the commercial and non-profit sectors. We expect this will generate some attention in the media. Despite our best efforts to be visible across the wikiverse, reading about the Wikimedia Enterprise API in the media will probably be the first time that some Wikimedians hear about it - which might be surprising for them. So, next week, if you see any Wikimedians asking about this project on community forums, please notify me by email, on-wiki [as user:LWyatt (WMF) ], and/or direct them to the project FAQ on Meta https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/FAQ (currently available in 7 languages).
Once again, thank you to all who have been involved in the development of, or given feedback to, *Enterprise*. It’s been a long road getting from there to here...
Sincerely,
* Liam Wyatt [Wittylama]*
Program Manager for *Enterprise, WikiCite,* and *Newcomer Experience* Wikimedia Foundation
On Tue, 16 Mar 2021 at 17:02, Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Dear all,
TL;DR: Today the Wikimedia Foundation published a press release[1] about the “Wikimedia Enterprise” API project - announcing our first set of customers, as well as a new self-signup system. This is a significant milestone because it fulfills several promises we have made to ourselves and to the movement. There will be a community open meeting on Thursday 23 June @ 1700 UTC as documented on our Meta page.[2] The text of this email is also published on the talkpage - please centralise any comments/feedback there.[3]
Details
I am writing today with details of the latest developments in the “Wikimedia Enterprise” API project. This follows the project’s community-discussion phase, which began approximately one year ago, focused on Meta [and also this wikimedia-l thread]. Then, this past October, we issued a press release announcing that we were “open for business” on the project’s new site.[4] This wikimedia-l email thread contains the details of those previous phases.
Now is the third and final major announcement in this journey from “idea” to “reality”. Today’s press release,[1] and associated story on the project’s new “news” page,[5] states that:
-
Two well known organisations will be announced as the first customers of the project. One is a major social/search corporation [Google], as our first official paying customer. This also means that the project is now covering its current operating costs. The other is a movement partner and nonprofit organization [The Internet Archive] that will receive access at no cost. -
Anyone will be able to sign up for an account and use/access the service [but not at a commercial scale] for free. Furthermore, payments for usage above that threshold will be calculated simply and publicly based on the number of API requests and gigabytes of data used. (Other free access methods for the dataset continue to exist, as documented on our Meta FAQ)[6] -
The API’s metadata has been expanded to include the beta version of what we are calling “credibility signals”. This is already public information (such as pageviews, edit-rates, and page-protection status changes) packaged within the single data feed to help users make more informed decisions about when they should refresh their copy of the dataset. (Emphasis on ‘beta’, as this is not available on all versions of the product yet.)
This announcement is a significant milestone because it fulfills several promises we have made to ourselves and to the movement, namely that:
-
We have built something that commercial organisations who are already heavy users of Wikimedia content and Wikimedia Foundation services are willing to invest in. The pricing is based on estimated usage, resulting in a more manageable and transparent cost structure. The project is now covering its current operating expenses. In addition, we requested and received a public affirmation/support letter from the Board for the project’s financial operating principles, ensuring that commercial revenue will only ever be a minority of the total and their oversight for any future high value contracts.[7] -
The nonprofit partner will receive access at no cost, demonstrating a first practical example of how this project supports the mission of knowledge access while also providing a new revenue stream. -
The ‘trial’ tier of the service is primarily designed to allow potential customers to determine whether they want to use it in commercial production environments, but it also allows anyone to see what is ‘in’ the API. Moreover, it will allow volunteers or researchers to access the service for free at a non-commercial scale. If those people have a mission-relevant use-case that requires them to continue to use the Enterprise API above that scale (i.e. that isn’t viable using other APIs/dumps), we will continue to provide them with free access. -
The ‘credibility signals’ concept means that vandalism and errors should appear less often and/or be removed more quickly in downstream services such as search engines. [Note, how and when customers incorporate features is their own decision].
While we are proud to announce these customers, it is important to note that our market research has identified a significant gap in our movement’s ability to have Wikimedia knowledge used. The world’s largest companies are already using Wikimedia; we’re just providing a better way for them to do so. But for everyone else, it is often too hard and they do not have the resources (financial, technical, and human) to incorporate Wikimedia information – even though they want to. In short: simply providing legally-reusable knowledge is insufficient to enable reuse for a very large portion of society.
And so, we are focusing a lot of our future product development on this Knowledge as a Service model - consistent with the Movement Strategy’s “strategic direction”.[8] This is what OpenFuture.eu’s interview with the Enterprise team referred to as our attempt at “lowering the playing field” – a term we quite like.[9]
We are increasingly realising that the future of Wikimedia Enterprise is much more nuanced than merely “making big tech pay”, but is about enabling access to the many companies who want to use Wikimedia knowledge in their own products but currently can’t. These organisations are willing to pay us to find ways to better support their specific use of Wikimedia content, both through more accessible technology, contractual guarantees of service availability, and professional services to help them make the best use of our content in their systems. As per our enumerated Principles,[10] all customers get the same product - there are no exclusive or bespoke features - they only pay for the volume of usage. This will allow smaller companies to compete and will ensure that Wikimedia knowledge is more widely available. Our goal is for the future business model of Enterprise to resemble “many paying a little” rather than “few paying a lot” – an approach similar to our movement’s “many small donors” fundraising methodology.
Still to come later this year will be:
-
Exploring options to integrate Wikidata in the dataset, which is a common customer request. We are working closely with Wikimedia-Deutschland to discuss how to best do this. -
Small, and non-U.S. based customers. This is crucial to demonstrating the Knowledge as a Service value of the project. We already work with relevant Chapters when we have a potential ‘local’ customer who has expressed strong interest. -
Publishing aggregate revenue/expense data, but only after there’s enough aggregate financial data collected, over a sufficient period of time, and with enough customers to be informative. -
The “news” page on the Enterprise website itself will be where future software updates, customer case-studies, etc. will be published. This ensures that the information is available, while not detracting from community-focused places like the Diff blog. The first post on that news page is available today.[5]
In order to not distract from community-focused discussions, and of course unless there’s something important for the community to know, in the future we will announce new customers product updates etc. on the project website’s news page and on Meta rather than on this mailing list etc. - but we felt it was important to do it this time.
Finally, I would also like to ask you to keep your eyes and ears open for anyone in your corner of the Wikimedia community who has questions or concerns about the project. Please ask them to read and comment on our Meta FAQ,[6] to contact me directly, or to attend the public community open meeting on Thursday, which is already announced on Meta on the project’s page & the mainpage calendar.
Sincerely, and on behalf of the Wikimedia Enterprise team,[11]
* Liam Wyatt [Wittylama]*
Program Manager for *Enterprise,* *Newcomer Experience, & WikiCite* Wikimedia Foundation
[1] https://wikimediafoundation.org/news/2022/06/21/wikimedia-enterprise-announc...
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
[3] https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#Update:_First_cust...
[4] https://enterprise.wikimedia.com/
[5] https://enterprise.wikimedia.com/news/hello-world/
[6] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Will_the_community_...
[7] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikim...
[8] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017#Our_strateg...
[9] https://openfuture.eu/blog/wikimedia-enterprise/
[10] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles [11] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise#Team
On Mon, 11 Oct 2021 at 19:01, Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all, A lot has happened since March when we Introduced the Wikimedia Enterprise API https://diff.wikimedia.org/2021/03/16/introducing-the-wikimedia-enterprise-api/ and began community conversations about the project’s development. Now is an important milestone to give everyone:
- an update responding to community advice we’ve received; and
- to describe what is happening next.
The idea of an API for the specific needs of the commercial sector had been discussed for more than a decade https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Where_has_this_previously_been_discussed (both for the purposes of improving user experience, and also to diversify revenue). The announcement in March introducing the Wikimedia Enterprise API generated a lot of Wikimedia-community and mainstream-media attention - most notably in WIRED https://www.wired.com/story/wikipedia-finally-asking-big-tech-to-pay-up/. Since then, the team has been hard at work building the actual product and hosting many conversations (regular public meetings and participation in events including SWAN, Wikimania, EMWCon, Clinic) - as well as a considerable volume of discussions on our meta talkpage https://xtools.wmflabs.org/articleinfo/meta.wikimedia.org/Talk:Wikimedia%20Enterprise. All of this has generated lots of suggestions, which we have endeavoured to incorporate and respond to before the actual commercial launch. On behalf of the whole team, I thank the many many people who have been willing and able to share constructive feedback with us over these months. Links to recordings from those meetings/presentations can be found on our meta homepage:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
- To that end, here are some updates in response to community advice:
WMF Board statement.
Subsequent to the most recent WMF Board of Trustees meeting, a statement reaffirming their support of the project, and in particular its operating principles relating to its future revenue, has been published. You can find the board Statement here https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikimedia_Foundation_Board_Statement_on_Wikimedia_Enterprise_revenue_principles, and the Enterprise operating principles on Meta here https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/Principles. Consistent community feedback was that our published principles were good and sensible, but for such a new and unusual thing in our movement, an overt statement from the Board of Trustees was requested. This statement affirms that:
- Revenues of the WMF obtained from commercial activities shall not
surpass 30% of the total planned revenue via all sources (including donations) in that fiscal year, and no further revenue would be sought beyond that limit;
- The Board of Trustees will be notified in advance of any large
commercial agreements, giving them time for review - exactly mirroring the procedure for large gifts;
- Revenue obtained from Wikimedia Enterprise services is under the
oversight and control of procedures for revenue raised by the Wikimedia Foundation and the revenue will not be earmarked for a specific program.
Each of these things were already noted on-wiki, but they were very much worthwhile re-stating formally. Equally it bears repeating: the existing APIs and methods of accessing Wikimedia sites remain. The creation of this optional commercial service, designed for those with specific high data-volume demands, does not change the experience (legally or technically) for anyone else. Relatedy, and also in response to community suggestions, the formal contracts which define the legal relationship of the non-profit Wikimedia Foundation to this commercial activity, have now been published on the governance wiki and linked from the related section on the project’s https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary.
Free technical access for the community.
You will soon be able to access a copy of the Enterprise dataset, refreshed each fortnight, at the Wikimedia dumps portal http://dumps.wikimedia.org/. Furthermore a ‘daily dump + hourly diff’ version is also already available, via Wikimedia Cloud Services https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_Introduction to any users of Toolforge, Cloud VPS, or PAWS. Both of these are provided to anyone, for free (in both ‘gratis’ and ‘libre’ senses of the word). Importantly, and consistent with community feedback, neither of these access methods require any special request process to access them, other than the existing terms of service on those platforms.
Software development updates are published monthly on our page on MediaWiki https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates (as is the API documentation https://www.mediawiki.org/wiki/Wikimedia_Enterprise/Documentation), and the work is coordinated on our Phabricator board https://phabricator.wikimedia.org/tag/wikimedia_enterprise/.
Next public meeting. As mentioned, the team has been holding regular public calls. If you would like to meet with, and ask any questions of, the Enterprise team (a.k.a. “Office hours”):
Friday October 22 @ 1500 UTC on Zoom https://wikimedia.zoom.us/j/88994018553. If you would like to arrange a conversation about this project with a group in the community that you are part of (at a time, language, and meeting-software platform of your choice), please contact me directly.
- What is happening next:
The launch of the project’s standalone website, denoting the service as “open for business”, will take place early next week.
In parallel we will also be announcing the first customers - both from the commercial and non-profit sectors. We expect this will generate some attention in the media. Despite our best efforts to be visible across the wikiverse, reading about the Wikimedia Enterprise API in the media will probably be the first time that some Wikimedians hear about it - which might be surprising for them. So, next week, if you see any Wikimedians asking about this project on community forums, please notify me by email, on-wiki [as user:LWyatt (WMF) ], and/or direct them to the project FAQ on Meta https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/FAQ (currently available in 7 languages).
Once again, thank you to all who have been involved in the development of, or given feedback to, *Enterprise*. It’s been a long road getting from there to here...
Sincerely,
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise, WikiCite,* and *Newcomer Experience* Wikimedia Foundation
On Tue, 16 Mar 2021 at 17:02, Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Beautiful work. ~ Are there plans to make the credibility signals visible somehow (in sparklines? in the header?) to readers who visit articles? ~ As you add wikidata, please consider also working with dbpedia (which has expanded its range of source material) to see how we can make their integration flows easier.
On Tue, Jun 21, 2022 at 12:12 PM Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all,
TL;DR: Today the Wikimedia Foundation published a press release[1] about the “Wikimedia Enterprise” API project - announcing our first set of customers, as well as a new self-signup system. This is a significant milestone because it fulfills several promises we have made to ourselves and to the movement. There will be a community open meeting on Thursday 23 June @ 1700 UTC as documented on our Meta page.[2] The text of this email is also published on the talkpage - please centralise any comments/feedback there.[3]
Details
I am writing today with details of the latest developments in the “Wikimedia Enterprise” API project. This follows the project’s community-discussion phase, which began approximately one year ago, focused on Meta [and also this wikimedia-l thread]. Then, this past October, we issued a press release announcing that we were “open for business” on the project’s new site.[4] This wikimedia-l email thread contains the details of those previous phases.
Now is the third and final major announcement in this journey from “idea” to “reality”. Today’s press release,[1] and associated story on the project’s new “news” page,[5] states that:
Two well known organisations will be announced as the first customers of the project. One is a major social/search corporation [Google], as our first official paying customer. This also means that the project is now covering its current operating costs. The other is a movement partner and nonprofit organization [The Internet Archive] that will receive access at no cost.
Anyone will be able to sign up for an account and use/access the service [but not at a commercial scale] for free. Furthermore, payments for usage above that threshold will be calculated simply and publicly based on the number of API requests and gigabytes of data used. (Other free access methods for the dataset continue to exist, as documented on our Meta FAQ)[6]
The API’s metadata has been expanded to include the beta version of what we are calling “credibility signals”. This is already public information (such as pageviews, edit-rates, and page-protection status changes) packaged within the single data feed to help users make more informed decisions about when they should refresh their copy of the dataset. (Emphasis on ‘beta’, as this is not available on all versions of the product yet.)
This announcement is a significant milestone because it fulfills several promises we have made to ourselves and to the movement, namely that:
We have built something that commercial organisations who are already heavy users of Wikimedia content and Wikimedia Foundation services are willing to invest in. The pricing is based on estimated usage, resulting in a more manageable and transparent cost structure. The project is now covering its current operating expenses. In addition, we requested and received a public affirmation/support letter from the Board for the project’s financial operating principles, ensuring that commercial revenue will only ever be a minority of the total and their oversight for any future high value contracts.[7]
The nonprofit partner will receive access at no cost, demonstrating a first practical example of how this project supports the mission of knowledge access while also providing a new revenue stream.
The ‘trial’ tier of the service is primarily designed to allow potential customers to determine whether they want to use it in commercial production environments, but it also allows anyone to see what is ‘in’ the API. Moreover, it will allow volunteers or researchers to access the service for free at a non-commercial scale. If those people have a mission-relevant use-case that requires them to continue to use the Enterprise API above that scale (i.e. that isn’t viable using other APIs/dumps), we will continue to provide them with free access.
The ‘credibility signals’ concept means that vandalism and errors should appear less often and/or be removed more quickly in downstream services such as search engines. [Note, how and when customers incorporate features is their own decision].
While we are proud to announce these customers, it is important to note that our market research has identified a significant gap in our movement’s ability to have Wikimedia knowledge used. The world’s largest companies are already using Wikimedia; we’re just providing a better way for them to do so. But for everyone else, it is often too hard and they do not have the resources (financial, technical, and human) to incorporate Wikimedia information – even though they want to. In short: simply providing legally-reusable knowledge is insufficient to enable reuse for a very large portion of society.
And so, we are focusing a lot of our future product development on this Knowledge as a Service model - consistent with the Movement Strategy’s “strategic direction”.[8] This is what OpenFuture.eu’s interview with the Enterprise team referred to as our attempt at “lowering the playing field” – a term we quite like.[9]
We are increasingly realising that the future of Wikimedia Enterprise is much more nuanced than merely “making big tech pay”, but is about enabling access to the many companies who want to use Wikimedia knowledge in their own products but currently can’t. These organisations are willing to pay us to find ways to better support their specific use of Wikimedia content, both through more accessible technology, contractual guarantees of service availability, and professional services to help them make the best use of our content in their systems. As per our enumerated Principles,[10] all customers get the same product - there are no exclusive or bespoke features
- they only pay for the volume of usage. This will allow smaller
companies to compete and will ensure that Wikimedia knowledge is more widely available. Our goal is for the future business model of Enterprise to resemble “many paying a little” rather than “few paying a lot” – an approach similar to our movement’s “many small donors” fundraising methodology.
Still to come later this year will be:
Exploring options to integrate Wikidata in the dataset, which is a common customer request. We are working closely with Wikimedia-Deutschland to discuss how to best do this.
Small, and non-U.S. based customers. This is crucial to demonstrating the Knowledge as a Service value of the project. We already work with relevant Chapters when we have a potential ‘local’ customer who has expressed strong interest.
Publishing aggregate revenue/expense data, but only after there’s enough aggregate financial data collected, over a sufficient period of time, and with enough customers to be informative.
The “news” page on the Enterprise website itself will be where future software updates, customer case-studies, etc. will be published. This ensures that the information is available, while not detracting from community-focused places like the Diff blog. The first post on that news page is available today.[5]
In order to not distract from community-focused discussions, and of course unless there’s something important for the community to know, in the future we will announce new customers product updates etc. on the project website’s news page and on Meta rather than on this mailing list etc. - but we felt it was important to do it this time.
Finally, I would also like to ask you to keep your eyes and ears open for anyone in your corner of the Wikimedia community who has questions or concerns about the project. Please ask them to read and comment on our Meta FAQ,[6] to contact me directly, or to attend the public community open meeting on Thursday, which is already announced on Meta on the project’s page & the mainpage calendar.
Sincerely, and on behalf of the Wikimedia Enterprise team,[11]
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise,* *Newcomer Experience, & WikiCite* Wikimedia Foundation
[1] https://wikimediafoundation.org/news/2022/06/21/wikimedia-enterprise-announc...
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
[3] https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#Update:_First_cust...
[4] https://enterprise.wikimedia.com/
[5] https://enterprise.wikimedia.com/news/hello-world/
[6] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Will_the_community_...
[7] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikim...
[8] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017#Our_strateg...
[9] https://openfuture.eu/blog/wikimedia-enterprise/
[10] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles [11] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise#Team
On Mon, 11 Oct 2021 at 19:01, Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all, A lot has happened since March when we Introduced the Wikimedia Enterprise API https://diff.wikimedia.org/2021/03/16/introducing-the-wikimedia-enterprise-api/ and began community conversations about the project’s development. Now is an important milestone to give everyone:
- an update responding to community advice we’ve received; and
- to describe what is happening next.
The idea of an API for the specific needs of the commercial sector had been discussed for more than a decade https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Where_has_this_previously_been_discussed (both for the purposes of improving user experience, and also to diversify revenue). The announcement in March introducing the Wikimedia Enterprise API generated a lot of Wikimedia-community and mainstream-media attention - most notably in WIRED https://www.wired.com/story/wikipedia-finally-asking-big-tech-to-pay-up/. Since then, the team has been hard at work building the actual product and hosting many conversations (regular public meetings and participation in events including SWAN, Wikimania, EMWCon, Clinic) - as well as a considerable volume of discussions on our meta talkpage https://xtools.wmflabs.org/articleinfo/meta.wikimedia.org/Talk:Wikimedia%20Enterprise. All of this has generated lots of suggestions, which we have endeavoured to incorporate and respond to before the actual commercial launch. On behalf of the whole team, I thank the many many people who have been willing and able to share constructive feedback with us over these months. Links to recordings from those meetings/presentations can be found on our meta homepage:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
- To that end, here are some updates in response to community advice:
WMF Board statement.
Subsequent to the most recent WMF Board of Trustees meeting, a statement reaffirming their support of the project, and in particular its operating principles relating to its future revenue, has been published. You can find the board Statement here https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikimedia_Foundation_Board_Statement_on_Wikimedia_Enterprise_revenue_principles, and the Enterprise operating principles on Meta here https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/Principles. Consistent community feedback was that our published principles were good and sensible, but for such a new and unusual thing in our movement, an overt statement from the Board of Trustees was requested. This statement affirms that:
- Revenues of the WMF obtained from commercial activities shall not
surpass 30% of the total planned revenue via all sources (including donations) in that fiscal year, and no further revenue would be sought beyond that limit;
- The Board of Trustees will be notified in advance of any large
commercial agreements, giving them time for review - exactly mirroring the procedure for large gifts;
- Revenue obtained from Wikimedia Enterprise services is under the
oversight and control of procedures for revenue raised by the Wikimedia Foundation and the revenue will not be earmarked for a specific program.
Each of these things were already noted on-wiki, but they were very much worthwhile re-stating formally. Equally it bears repeating: the existing APIs and methods of accessing Wikimedia sites remain. The creation of this optional commercial service, designed for those with specific high data-volume demands, does not change the experience (legally or technically) for anyone else. Relatedy, and also in response to community suggestions, the formal contracts which define the legal relationship of the non-profit Wikimedia Foundation to this commercial activity, have now been published on the governance wiki and linked from the related section on the project’s https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary.
Free technical access for the community.
You will soon be able to access a copy of the Enterprise dataset, refreshed each fortnight, at the Wikimedia dumps portal http://dumps.wikimedia.org/. Furthermore a ‘daily dump + hourly diff’ version is also already available, via Wikimedia Cloud Services https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_Introduction to any users of Toolforge, Cloud VPS, or PAWS. Both of these are provided to anyone, for free (in both ‘gratis’ and ‘libre’ senses of the word). Importantly, and consistent with community feedback, neither of these access methods require any special request process to access them, other than the existing terms of service on those platforms.
Software development updates are published monthly on our page on MediaWiki https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates (as is the API documentation https://www.mediawiki.org/wiki/Wikimedia_Enterprise/Documentation), and the work is coordinated on our Phabricator board https://phabricator.wikimedia.org/tag/wikimedia_enterprise/.
Next public meeting. As mentioned, the team has been holding regular public calls. If you would like to meet with, and ask any questions of, the Enterprise team (a.k.a. “Office hours”):
Friday October 22 @ 1500 UTC on Zoom https://wikimedia.zoom.us/j/88994018553. If you would like to arrange a conversation about this project with a group in the community that you are part of (at a time, language, and meeting-software platform of your choice), please contact me directly.
- What is happening next:
The launch of the project’s standalone website, denoting the service as “open for business”, will take place early next week.
In parallel we will also be announcing the first customers - both from the commercial and non-profit sectors. We expect this will generate some attention in the media. Despite our best efforts to be visible across the wikiverse, reading about the Wikimedia Enterprise API in the media will probably be the first time that some Wikimedians hear about it - which might be surprising for them. So, next week, if you see any Wikimedians asking about this project on community forums, please notify me by email, on-wiki [as user:LWyatt (WMF) ], and/or direct them to the project FAQ on Meta https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/FAQ (currently available in 7 languages).
Once again, thank you to all who have been involved in the development of, or given feedback to, *Enterprise*. It’s been a long road getting from there to here...
Sincerely,
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise, WikiCite,* and *Newcomer Experience* Wikimedia Foundation
On Tue, 16 Mar 2021 at 17:02, Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Thank you SJ! To your questions in order: 1) This is all metadata that is already publicly available (e.g. ORES, page-protection status change, high % pageviews changes...). Crucially - it is not creating some "value judgement" about an article or particular edit but taking the information that Wikimedians (and therefore readers) *already have access to* and helping API users make informed choices about how to use the data. If the service proves effective, useful, and there's community interest - anything's possible - but I will re-emphasise though that this is in beta and how we grow/improve/incorporate this concept is still in flux. General technical documentation at our MediaWiki page https://www.mediawiki.org/wiki/Wikimedia_Enterprise API documentation on the project's website: https://enterprise.wikimedia.com/docs/
2) Indeed, we have already met with the DBpedia team. We've been, unsurprisingly, focused on launching v1.0 but we can and will now return to some of those conversations.
- Liam Wyatt
On Tue, 21 Jun 2022 at 18:47, Samuel Klein meta.sj@gmail.com wrote:
Beautiful work. ~ Are there plans to make the credibility signals visible somehow (in sparklines? in the header?) to readers who visit articles? ~ As you add wikidata, please consider also working with dbpedia (which has expanded its range of source material) to see how we can make their integration flows easier.
On Tue, Jun 21, 2022 at 12:12 PM Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all,
TL;DR: Today the Wikimedia Foundation published a press release[1] about the “Wikimedia Enterprise” API project - announcing our first set of customers, as well as a new self-signup system. This is a significant milestone because it fulfills several promises we have made to ourselves and to the movement. There will be a community open meeting on Thursday 23 June @ 1700 UTC as documented on our Meta page.[2] The text of this email is also published on the talkpage - please centralise any comments/feedback there.[3]
Details
I am writing today with details of the latest developments in the “Wikimedia Enterprise” API project. This follows the project’s community-discussion phase, which began approximately one year ago, focused on Meta [and also this wikimedia-l thread]. Then, this past October, we issued a press release announcing that we were “open for business” on the project’s new site.[4] This wikimedia-l email thread contains the details of those previous phases.
Now is the third and final major announcement in this journey from “idea” to “reality”. Today’s press release,[1] and associated story on the project’s new “news” page,[5] states that:
Two well known organisations will be announced as the first customers of the project. One is a major social/search corporation [Google], as our first official paying customer. This also means that the project is now covering its current operating costs. The other is a movement partner and nonprofit organization [The Internet Archive] that will receive access at no cost.
Anyone will be able to sign up for an account and use/access the service [but not at a commercial scale] for free. Furthermore, payments for usage above that threshold will be calculated simply and publicly based on the number of API requests and gigabytes of data used. (Other free access methods for the dataset continue to exist, as documented on our Meta FAQ)[6]
The API’s metadata has been expanded to include the beta version of what we are calling “credibility signals”. This is already public information (such as pageviews, edit-rates, and page-protection status changes) packaged within the single data feed to help users make more informed decisions about when they should refresh their copy of the dataset. (Emphasis on ‘beta’, as this is not available on all versions of the product yet.)
This announcement is a significant milestone because it fulfills several promises we have made to ourselves and to the movement, namely that:
We have built something that commercial organisations who are already heavy users of Wikimedia content and Wikimedia Foundation services are willing to invest in. The pricing is based on estimated usage, resulting in a more manageable and transparent cost structure. The project is now covering its current operating expenses. In addition, we requested and received a public affirmation/support letter from the Board for the project’s financial operating principles, ensuring that commercial revenue will only ever be a minority of the total and their oversight for any future high value contracts.[7]
The nonprofit partner will receive access at no cost, demonstrating a first practical example of how this project supports the mission of knowledge access while also providing a new revenue stream.
The ‘trial’ tier of the service is primarily designed to allow potential customers to determine whether they want to use it in commercial production environments, but it also allows anyone to see what is ‘in’ the API. Moreover, it will allow volunteers or researchers to access the service for free at a non-commercial scale. If those people have a mission-relevant use-case that requires them to continue to use the Enterprise API above that scale (i.e. that isn’t viable using other APIs/dumps), we will continue to provide them with free access.
The ‘credibility signals’ concept means that vandalism and errors should appear less often and/or be removed more quickly in downstream services such as search engines. [Note, how and when customers incorporate features is their own decision].
While we are proud to announce these customers, it is important to note that our market research has identified a significant gap in our movement’s ability to have Wikimedia knowledge used. The world’s largest companies are already using Wikimedia; we’re just providing a better way for them to do so. But for everyone else, it is often too hard and they do not have the resources (financial, technical, and human) to incorporate Wikimedia information – even though they want to. In short: simply providing legally-reusable knowledge is insufficient to enable reuse for a very large portion of society.
And so, we are focusing a lot of our future product development on this Knowledge as a Service model - consistent with the Movement Strategy’s “strategic direction”.[8] This is what OpenFuture.eu’s interview with the Enterprise team referred to as our attempt at “lowering the playing field” – a term we quite like.[9]
We are increasingly realising that the future of Wikimedia Enterprise is much more nuanced than merely “making big tech pay”, but is about enabling access to the many companies who want to use Wikimedia knowledge in their own products but currently can’t. These organisations are willing to pay us to find ways to better support their specific use of Wikimedia content, both through more accessible technology, contractual guarantees of service availability, and professional services to help them make the best use of our content in their systems. As per our enumerated Principles,[10] all customers get the same product - there are no exclusive or bespoke features - they only pay for the volume of usage. This will allow smaller companies to compete and will ensure that Wikimedia knowledge is more widely available. Our goal is for the future business model of Enterprise to resemble “many paying a little” rather than “few paying a lot” – an approach similar to our movement’s “many small donors” fundraising methodology.
Still to come later this year will be:
Exploring options to integrate Wikidata in the dataset, which is a common customer request. We are working closely with Wikimedia-Deutschland to discuss how to best do this.
Small, and non-U.S. based customers. This is crucial to demonstrating the Knowledge as a Service value of the project. We already work with relevant Chapters when we have a potential ‘local’ customer who has expressed strong interest.
Publishing aggregate revenue/expense data, but only after there’s enough aggregate financial data collected, over a sufficient period of time, and with enough customers to be informative.
The “news” page on the Enterprise website itself will be where future software updates, customer case-studies, etc. will be published. This ensures that the information is available, while not detracting from community-focused places like the Diff blog. The first post on that news page is available today.[5]
In order to not distract from community-focused discussions, and of course unless there’s something important for the community to know, in the future we will announce new customers product updates etc. on the project website’s news page and on Meta rather than on this mailing list etc. - but we felt it was important to do it this time.
Finally, I would also like to ask you to keep your eyes and ears open for anyone in your corner of the Wikimedia community who has questions or concerns about the project. Please ask them to read and comment on our Meta FAQ,[6] to contact me directly, or to attend the public community open meeting on Thursday, which is already announced on Meta on the project’s page & the mainpage calendar.
Sincerely, and on behalf of the Wikimedia Enterprise team,[11]
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise,* *Newcomer Experience, & WikiCite* Wikimedia Foundation
[1] https://wikimediafoundation.org/news/2022/06/21/wikimedia-enterprise-announc...
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
[3] https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#Update:_First_cust...
[4] https://enterprise.wikimedia.com/
[5] https://enterprise.wikimedia.com/news/hello-world/
[6] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Will_the_community_...
[7] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikim...
[8] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017#Our_strateg...
[9] https://openfuture.eu/blog/wikimedia-enterprise/
[10] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles [11] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise#Team
On Mon, 11 Oct 2021 at 19:01, Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all, A lot has happened since March when we Introduced the Wikimedia Enterprise API https://diff.wikimedia.org/2021/03/16/introducing-the-wikimedia-enterprise-api/ and began community conversations about the project’s development. Now is an important milestone to give everyone:
- an update responding to community advice we’ve received; and
- to describe what is happening next.
The idea of an API for the specific needs of the commercial sector had been discussed for more than a decade https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Where_has_this_previously_been_discussed (both for the purposes of improving user experience, and also to diversify revenue). The announcement in March introducing the Wikimedia Enterprise API generated a lot of Wikimedia-community and mainstream-media attention - most notably in WIRED https://www.wired.com/story/wikipedia-finally-asking-big-tech-to-pay-up/. Since then, the team has been hard at work building the actual product and hosting many conversations (regular public meetings and participation in events including SWAN, Wikimania, EMWCon, Clinic) - as well as a considerable volume of discussions on our meta talkpage https://xtools.wmflabs.org/articleinfo/meta.wikimedia.org/Talk:Wikimedia%20Enterprise. All of this has generated lots of suggestions, which we have endeavoured to incorporate and respond to before the actual commercial launch. On behalf of the whole team, I thank the many many people who have been willing and able to share constructive feedback with us over these months. Links to recordings from those meetings/presentations can be found on our meta homepage:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
- To that end, here are some updates in response to community advice:
WMF Board statement.
Subsequent to the most recent WMF Board of Trustees meeting, a statement reaffirming their support of the project, and in particular its operating principles relating to its future revenue, has been published. You can find the board Statement here https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikimedia_Foundation_Board_Statement_on_Wikimedia_Enterprise_revenue_principles, and the Enterprise operating principles on Meta here https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/Principles. Consistent community feedback was that our published principles were good and sensible, but for such a new and unusual thing in our movement, an overt statement from the Board of Trustees was requested. This statement affirms that:
- Revenues of the WMF obtained from commercial activities shall not
surpass 30% of the total planned revenue via all sources (including donations) in that fiscal year, and no further revenue would be sought beyond that limit;
- The Board of Trustees will be notified in advance of any large
commercial agreements, giving them time for review - exactly mirroring the procedure for large gifts;
- Revenue obtained from Wikimedia Enterprise services is under the
oversight and control of procedures for revenue raised by the Wikimedia Foundation and the revenue will not be earmarked for a specific program.
Each of these things were already noted on-wiki, but they were very much worthwhile re-stating formally. Equally it bears repeating: the existing APIs and methods of accessing Wikimedia sites remain. The creation of this optional commercial service, designed for those with specific high data-volume demands, does not change the experience (legally or technically) for anyone else. Relatedy, and also in response to community suggestions, the formal contracts which define the legal relationship of the non-profit Wikimedia Foundation to this commercial activity, have now been published on the governance wiki and linked from the related section on the project’s https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary.
Free technical access for the community.
You will soon be able to access a copy of the Enterprise dataset, refreshed each fortnight, at the Wikimedia dumps portal http://dumps.wikimedia.org/. Furthermore a ‘daily dump + hourly diff’ version is also already available, via Wikimedia Cloud Services https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_Introduction to any users of Toolforge, Cloud VPS, or PAWS. Both of these are provided to anyone, for free (in both ‘gratis’ and ‘libre’ senses of the word). Importantly, and consistent with community feedback, neither of these access methods require any special request process to access them, other than the existing terms of service on those platforms.
Software development updates are published monthly on our page on MediaWiki https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates (as is the API documentation https://www.mediawiki.org/wiki/Wikimedia_Enterprise/Documentation), and the work is coordinated on our Phabricator board https://phabricator.wikimedia.org/tag/wikimedia_enterprise/.
Next public meeting. As mentioned, the team has been holding regular public calls. If you would like to meet with, and ask any questions of, the Enterprise team (a.k.a. “Office hours”):
Friday October 22 @ 1500 UTC on Zoom https://wikimedia.zoom.us/j/88994018553. If you would like to arrange a conversation about this project with a group in the community that you are part of (at a time, language, and meeting-software platform of your choice), please contact me directly.
- What is happening next:
The launch of the project’s standalone website, denoting the service as “open for business”, will take place early next week.
In parallel we will also be announcing the first customers - both from the commercial and non-profit sectors. We expect this will generate some attention in the media. Despite our best efforts to be visible across the wikiverse, reading about the Wikimedia Enterprise API in the media will probably be the first time that some Wikimedians hear about it - which might be surprising for them. So, next week, if you see any Wikimedians asking about this project on community forums, please notify me by email, on-wiki [as user:LWyatt (WMF) ], and/or direct them to the project FAQ on Meta https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/FAQ (currently available in 7 languages).
Once again, thank you to all who have been involved in the development of, or given feedback to, *Enterprise*. It’s been a long road getting from there to here...
Sincerely,
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise, WikiCite,* and *Newcomer Experience* Wikimedia Foundation
On Tue, 16 Mar 2021 at 17:02, Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
-- Samuel Klein @metasj w:user:sj +1 617 529 4266 _______________________________________________ Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Dear Liam,
There seem to be (at least) two types of presentations on Wikimedia Enterprise here: a PR-optimised one for public consumption, given here, and an internal one. I'd like the difference between the two to be smaller, ideally, and for the community (also) to be given the internal one, as found in Advancement's Q3 "tuning session" (quarterly review):
https://commons.wikimedia.org/w/index.php?title=File:Wikimedia_Foundation_Tu...
This says:
----------
*The situation * Although we successfully closed an initial set of paying customers for Wikimedia Enterprise at the end of the last calendar year, and have continued to have ongoing sales conversations with additional potential customers, we have been unable to close additional customers as quickly as we projected due to unanticipated legal and product requirements, and will not hit the revenue target for FY21/22.
*The impact * We are developing a clearer picture of what is required to successfully scale sales of the Wikimedia Enterprise product within our non-profit context. In particular, we need to redefine, and better articulate, the relationship between our free and paid APIs, so that we can successfully explain why they would choose our paid, commercial-grade services rather than our free APIs.
*Recommendation * We are working with the legal team to develop a contractual structure that allows us to sell to a wider set of countries, and with the product team to better delineate the relationship between our free and paid API services, so that by the end of this calendar year there will be a clear value proposition that drives commercial customers to pay for the Enterprise APIs.
----------
Note that this tuning session presentation, too, is marked "PUBLIC", so presumably there is a non-public version of that file as well.
I find all of this (which I doubt is your decision, so please don't take it as a criticism of you personally) lamentable. The community is the WMF's partner in all of this. Why not speak openly to us? We are not paying customers who need to be wooed, or wowed.
And no – the solution is not to stop publishing the quarterly reviews, or to delay their publication even more.
Best, Andreas
On Tue, Jun 21, 2022 at 5:11 PM Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all,
TL;DR: Today the Wikimedia Foundation published a press release[1] about the “Wikimedia Enterprise” API project - announcing our first set of customers, as well as a new self-signup system. This is a significant milestone because it fulfills several promises we have made to ourselves and to the movement. There will be a community open meeting on Thursday 23 June @ 1700 UTC as documented on our Meta page.[2] The text of this email is also published on the talkpage - please centralise any comments/feedback there.[3]
Details
I am writing today with details of the latest developments in the “Wikimedia Enterprise” API project. This follows the project’s community-discussion phase, which began approximately one year ago, focused on Meta [and also this wikimedia-l thread]. Then, this past October, we issued a press release announcing that we were “open for business” on the project’s new site.[4] This wikimedia-l email thread contains the details of those previous phases.
Now is the third and final major announcement in this journey from “idea” to “reality”. Today’s press release,[1] and associated story on the project’s new “news” page,[5] states that:
Two well known organisations will be announced as the first customers of the project. One is a major social/search corporation [Google], as our first official paying customer. This also means that the project is now covering its current operating costs. The other is a movement partner and nonprofit organization [The Internet Archive] that will receive access at no cost.
Anyone will be able to sign up for an account and use/access the service [but not at a commercial scale] for free. Furthermore, payments for usage above that threshold will be calculated simply and publicly based on the number of API requests and gigabytes of data used. (Other free access methods for the dataset continue to exist, as documented on our Meta FAQ)[6]
The API’s metadata has been expanded to include the beta version of what we are calling “credibility signals”. This is already public information (such as pageviews, edit-rates, and page-protection status changes) packaged within the single data feed to help users make more informed decisions about when they should refresh their copy of the dataset. (Emphasis on ‘beta’, as this is not available on all versions of the product yet.)
This announcement is a significant milestone because it fulfills several promises we have made to ourselves and to the movement, namely that:
We have built something that commercial organisations who are already heavy users of Wikimedia content and Wikimedia Foundation services are willing to invest in. The pricing is based on estimated usage, resulting in a more manageable and transparent cost structure. The project is now covering its current operating expenses. In addition, we requested and received a public affirmation/support letter from the Board for the project’s financial operating principles, ensuring that commercial revenue will only ever be a minority of the total and their oversight for any future high value contracts.[7]
The nonprofit partner will receive access at no cost, demonstrating a first practical example of how this project supports the mission of knowledge access while also providing a new revenue stream.
The ‘trial’ tier of the service is primarily designed to allow potential customers to determine whether they want to use it in commercial production environments, but it also allows anyone to see what is ‘in’ the API. Moreover, it will allow volunteers or researchers to access the service for free at a non-commercial scale. If those people have a mission-relevant use-case that requires them to continue to use the Enterprise API above that scale (i.e. that isn’t viable using other APIs/dumps), we will continue to provide them with free access.
The ‘credibility signals’ concept means that vandalism and errors should appear less often and/or be removed more quickly in downstream services such as search engines. [Note, how and when customers incorporate features is their own decision].
While we are proud to announce these customers, it is important to note that our market research has identified a significant gap in our movement’s ability to have Wikimedia knowledge used. The world’s largest companies are already using Wikimedia; we’re just providing a better way for them to do so. But for everyone else, it is often too hard and they do not have the resources (financial, technical, and human) to incorporate Wikimedia information – even though they want to. In short: simply providing legally-reusable knowledge is insufficient to enable reuse for a very large portion of society.
And so, we are focusing a lot of our future product development on this Knowledge as a Service model - consistent with the Movement Strategy’s “strategic direction”.[8] This is what OpenFuture.eu’s interview with the Enterprise team referred to as our attempt at “lowering the playing field” – a term we quite like.[9]
We are increasingly realising that the future of Wikimedia Enterprise is much more nuanced than merely “making big tech pay”, but is about enabling access to the many companies who want to use Wikimedia knowledge in their own products but currently can’t. These organisations are willing to pay us to find ways to better support their specific use of Wikimedia content, both through more accessible technology, contractual guarantees of service availability, and professional services to help them make the best use of our content in their systems. As per our enumerated Principles,[10] all customers get the same product - there are no exclusive or bespoke features
- they only pay for the volume of usage. This will allow smaller
companies to compete and will ensure that Wikimedia knowledge is more widely available. Our goal is for the future business model of Enterprise to resemble “many paying a little” rather than “few paying a lot” – an approach similar to our movement’s “many small donors” fundraising methodology.
Still to come later this year will be:
Exploring options to integrate Wikidata in the dataset, which is a common customer request. We are working closely with Wikimedia-Deutschland to discuss how to best do this.
Small, and non-U.S. based customers. This is crucial to demonstrating the Knowledge as a Service value of the project. We already work with relevant Chapters when we have a potential ‘local’ customer who has expressed strong interest.
Publishing aggregate revenue/expense data, but only after there’s enough aggregate financial data collected, over a sufficient period of time, and with enough customers to be informative.
The “news” page on the Enterprise website itself will be where future software updates, customer case-studies, etc. will be published. This ensures that the information is available, while not detracting from community-focused places like the Diff blog. The first post on that news page is available today.[5]
In order to not distract from community-focused discussions, and of course unless there’s something important for the community to know, in the future we will announce new customers product updates etc. on the project website’s news page and on Meta rather than on this mailing list etc. - but we felt it was important to do it this time.
Finally, I would also like to ask you to keep your eyes and ears open for anyone in your corner of the Wikimedia community who has questions or concerns about the project. Please ask them to read and comment on our Meta FAQ,[6] to contact me directly, or to attend the public community open meeting on Thursday, which is already announced on Meta on the project’s page & the mainpage calendar.
Sincerely, and on behalf of the Wikimedia Enterprise team,[11]
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise,* *Newcomer Experience, & WikiCite* Wikimedia Foundation
[1] https://wikimediafoundation.org/news/2022/06/21/wikimedia-enterprise-announc...
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
[3] https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#Update:_First_cust...
[4] https://enterprise.wikimedia.com/
[5] https://enterprise.wikimedia.com/news/hello-world/
[6] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Will_the_community_...
[7] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikim...
[8] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017#Our_strateg...
[9] https://openfuture.eu/blog/wikimedia-enterprise/
[10] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles [11] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise#Team
On Mon, 11 Oct 2021 at 19:01, Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all, A lot has happened since March when we Introduced the Wikimedia Enterprise API https://diff.wikimedia.org/2021/03/16/introducing-the-wikimedia-enterprise-api/ and began community conversations about the project’s development. Now is an important milestone to give everyone:
- an update responding to community advice we’ve received; and
- to describe what is happening next.
The idea of an API for the specific needs of the commercial sector had been discussed for more than a decade https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Where_has_this_previously_been_discussed (both for the purposes of improving user experience, and also to diversify revenue). The announcement in March introducing the Wikimedia Enterprise API generated a lot of Wikimedia-community and mainstream-media attention - most notably in WIRED https://www.wired.com/story/wikipedia-finally-asking-big-tech-to-pay-up/. Since then, the team has been hard at work building the actual product and hosting many conversations (regular public meetings and participation in events including SWAN, Wikimania, EMWCon, Clinic) - as well as a considerable volume of discussions on our meta talkpage https://xtools.wmflabs.org/articleinfo/meta.wikimedia.org/Talk:Wikimedia%20Enterprise. All of this has generated lots of suggestions, which we have endeavoured to incorporate and respond to before the actual commercial launch. On behalf of the whole team, I thank the many many people who have been willing and able to share constructive feedback with us over these months. Links to recordings from those meetings/presentations can be found on our meta homepage:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
- To that end, here are some updates in response to community advice:
WMF Board statement.
Subsequent to the most recent WMF Board of Trustees meeting, a statement reaffirming their support of the project, and in particular its operating principles relating to its future revenue, has been published. You can find the board Statement here https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikimedia_Foundation_Board_Statement_on_Wikimedia_Enterprise_revenue_principles, and the Enterprise operating principles on Meta here https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/Principles. Consistent community feedback was that our published principles were good and sensible, but for such a new and unusual thing in our movement, an overt statement from the Board of Trustees was requested. This statement affirms that:
- Revenues of the WMF obtained from commercial activities shall not
surpass 30% of the total planned revenue via all sources (including donations) in that fiscal year, and no further revenue would be sought beyond that limit;
- The Board of Trustees will be notified in advance of any large
commercial agreements, giving them time for review - exactly mirroring the procedure for large gifts;
- Revenue obtained from Wikimedia Enterprise services is under the
oversight and control of procedures for revenue raised by the Wikimedia Foundation and the revenue will not be earmarked for a specific program.
Each of these things were already noted on-wiki, but they were very much worthwhile re-stating formally. Equally it bears repeating: the existing APIs and methods of accessing Wikimedia sites remain. The creation of this optional commercial service, designed for those with specific high data-volume demands, does not change the experience (legally or technically) for anyone else. Relatedy, and also in response to community suggestions, the formal contracts which define the legal relationship of the non-profit Wikimedia Foundation to this commercial activity, have now been published on the governance wiki and linked from the related section on the project’s https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary.
Free technical access for the community.
You will soon be able to access a copy of the Enterprise dataset, refreshed each fortnight, at the Wikimedia dumps portal http://dumps.wikimedia.org/. Furthermore a ‘daily dump + hourly diff’ version is also already available, via Wikimedia Cloud Services https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_Introduction to any users of Toolforge, Cloud VPS, or PAWS. Both of these are provided to anyone, for free (in both ‘gratis’ and ‘libre’ senses of the word). Importantly, and consistent with community feedback, neither of these access methods require any special request process to access them, other than the existing terms of service on those platforms.
Software development updates are published monthly on our page on MediaWiki https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates (as is the API documentation https://www.mediawiki.org/wiki/Wikimedia_Enterprise/Documentation), and the work is coordinated on our Phabricator board https://phabricator.wikimedia.org/tag/wikimedia_enterprise/.
Next public meeting. As mentioned, the team has been holding regular public calls. If you would like to meet with, and ask any questions of, the Enterprise team (a.k.a. “Office hours”):
Friday October 22 @ 1500 UTC on Zoom https://wikimedia.zoom.us/j/88994018553. If you would like to arrange a conversation about this project with a group in the community that you are part of (at a time, language, and meeting-software platform of your choice), please contact me directly.
- What is happening next:
The launch of the project’s standalone website, denoting the service as “open for business”, will take place early next week.
In parallel we will also be announcing the first customers - both from the commercial and non-profit sectors. We expect this will generate some attention in the media. Despite our best efforts to be visible across the wikiverse, reading about the Wikimedia Enterprise API in the media will probably be the first time that some Wikimedians hear about it - which might be surprising for them. So, next week, if you see any Wikimedians asking about this project on community forums, please notify me by email, on-wiki [as user:LWyatt (WMF) ], and/or direct them to the project FAQ on Meta https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/FAQ (currently available in 7 languages).
Once again, thank you to all who have been involved in the development of, or given feedback to, *Enterprise*. It’s been a long road getting from there to here...
Sincerely,
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise, WikiCite,* and *Newcomer Experience* Wikimedia Foundation
On Tue, 16 Mar 2021 at 17:02, Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Andreas,
Relax.
There are three slides in that deck about Enterprise, much less detailed than the summary Liam just shared. There is no contradiction involved, and the transparency of sharing quarterly slides is all I could imagine wanting. In its context, they focus on OKRs and specific metrics, which are less relevant to this conversation (and were arbitrary in the first place).
If you constantly cry wolf, valid concerns will not be heard. Meanwhile you are making this list less pleasant and less useful for normal, undramatic discussion.
SJ
On Tue, Jun 21, 2022 at 3:55 PM Andreas Kolbe jayen466@gmail.com wrote:
Dear Liam,
There seem to be (at least) two types of presentations on Wikimedia Enterprise here: a PR-optimised one for public consumption, given here, and an internal one. I'd like the difference between the two to be smaller, ideally, and for the community (also) to be given the internal one, as found in Advancement's Q3 "tuning session" (quarterly review):
https://commons.wikimedia.org/w/index.php?title=File:Wikimedia_Foundation_Tu...
This says:
*The situation * Although we successfully closed an initial set of paying customers for Wikimedia Enterprise at the end of the last calendar year, and have continued to have ongoing sales conversations with additional potential customers, we have been unable to close additional customers as quickly as we projected due to unanticipated legal and product requirements, and will not hit the revenue target for FY21/22.
*The impact * We are developing a clearer picture of what is required to successfully scale sales of the Wikimedia Enterprise product within our non-profit context. In particular, we need to redefine, and better articulate, the relationship between our free and paid APIs, so that we can successfully explain why they would choose our paid, commercial-grade services rather than our free APIs.
*Recommendation * We are working with the legal team to develop a contractual structure that allows us to sell to a wider set of countries, and with the product team to better delineate the relationship between our free and paid API services, so that by the end of this calendar year there will be a clear value proposition that drives commercial customers to pay for the Enterprise APIs.
Note that this tuning session presentation, too, is marked "PUBLIC", so presumably there is a non-public version of that file as well.
I find all of this (which I doubt is your decision, so please don't take it as a criticism of you personally) lamentable. The community is the WMF's partner in all of this. Why not speak openly to us? We are not paying customers who need to be wooed, or wowed.
And no – the solution is not to stop publishing the quarterly reviews, or to delay their publication even more.
Best, Andreas
On Tue, Jun 21, 2022 at 5:11 PM Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all,
TL;DR: Today the Wikimedia Foundation published a press release[1] about the “Wikimedia Enterprise” API project - announcing our first set of customers, as well as a new self-signup system. This is a significant milestone because it fulfills several promises we have made to ourselves and to the movement. There will be a community open meeting on Thursday 23 June @ 1700 UTC as documented on our Meta page.[2] The text of this email is also published on the talkpage - please centralise any comments/feedback there.[3]
Details
I am writing today with details of the latest developments in the “Wikimedia Enterprise” API project. This follows the project’s community-discussion phase, which began approximately one year ago, focused on Meta [and also this wikimedia-l thread]. Then, this past October, we issued a press release announcing that we were “open for business” on the project’s new site.[4] This wikimedia-l email thread contains the details of those previous phases.
Now is the third and final major announcement in this journey from “idea” to “reality”. Today’s press release,[1] and associated story on the project’s new “news” page,[5] states that:
Two well known organisations will be announced as the first customers of the project. One is a major social/search corporation [Google], as our first official paying customer. This also means that the project is now covering its current operating costs. The other is a movement partner and nonprofit organization [The Internet Archive] that will receive access at no cost.
Anyone will be able to sign up for an account and use/access the service [but not at a commercial scale] for free. Furthermore, payments for usage above that threshold will be calculated simply and publicly based on the number of API requests and gigabytes of data used. (Other free access methods for the dataset continue to exist, as documented on our Meta FAQ)[6]
The API’s metadata has been expanded to include the beta version of what we are calling “credibility signals”. This is already public information (such as pageviews, edit-rates, and page-protection status changes) packaged within the single data feed to help users make more informed decisions about when they should refresh their copy of the dataset. (Emphasis on ‘beta’, as this is not available on all versions of the product yet.)
This announcement is a significant milestone because it fulfills several promises we have made to ourselves and to the movement, namely that:
We have built something that commercial organisations who are already heavy users of Wikimedia content and Wikimedia Foundation services are willing to invest in. The pricing is based on estimated usage, resulting in a more manageable and transparent cost structure. The project is now covering its current operating expenses. In addition, we requested and received a public affirmation/support letter from the Board for the project’s financial operating principles, ensuring that commercial revenue will only ever be a minority of the total and their oversight for any future high value contracts.[7]
The nonprofit partner will receive access at no cost, demonstrating a first practical example of how this project supports the mission of knowledge access while also providing a new revenue stream.
The ‘trial’ tier of the service is primarily designed to allow potential customers to determine whether they want to use it in commercial production environments, but it also allows anyone to see what is ‘in’ the API. Moreover, it will allow volunteers or researchers to access the service for free at a non-commercial scale. If those people have a mission-relevant use-case that requires them to continue to use the Enterprise API above that scale (i.e. that isn’t viable using other APIs/dumps), we will continue to provide them with free access.
The ‘credibility signals’ concept means that vandalism and errors should appear less often and/or be removed more quickly in downstream services such as search engines. [Note, how and when customers incorporate features is their own decision].
While we are proud to announce these customers, it is important to note that our market research has identified a significant gap in our movement’s ability to have Wikimedia knowledge used. The world’s largest companies are already using Wikimedia; we’re just providing a better way for them to do so. But for everyone else, it is often too hard and they do not have the resources (financial, technical, and human) to incorporate Wikimedia information – even though they want to. In short: simply providing legally-reusable knowledge is insufficient to enable reuse for a very large portion of society.
And so, we are focusing a lot of our future product development on this Knowledge as a Service model - consistent with the Movement Strategy’s “strategic direction”.[8] This is what OpenFuture.eu’s interview with the Enterprise team referred to as our attempt at “lowering the playing field” – a term we quite like.[9]
We are increasingly realising that the future of Wikimedia Enterprise is much more nuanced than merely “making big tech pay”, but is about enabling access to the many companies who want to use Wikimedia knowledge in their own products but currently can’t. These organisations are willing to pay us to find ways to better support their specific use of Wikimedia content, both through more accessible technology, contractual guarantees of service availability, and professional services to help them make the best use of our content in their systems. As per our enumerated Principles,[10] all customers get the same product - there are no exclusive or bespoke features - they only pay for the volume of usage. This will allow smaller companies to compete and will ensure that Wikimedia knowledge is more widely available. Our goal is for the future business model of Enterprise to resemble “many paying a little” rather than “few paying a lot” – an approach similar to our movement’s “many small donors” fundraising methodology.
Still to come later this year will be:
Exploring options to integrate Wikidata in the dataset, which is a common customer request. We are working closely with Wikimedia-Deutschland to discuss how to best do this.
Small, and non-U.S. based customers. This is crucial to demonstrating the Knowledge as a Service value of the project. We already work with relevant Chapters when we have a potential ‘local’ customer who has expressed strong interest.
Publishing aggregate revenue/expense data, but only after there’s enough aggregate financial data collected, over a sufficient period of time, and with enough customers to be informative.
The “news” page on the Enterprise website itself will be where future software updates, customer case-studies, etc. will be published. This ensures that the information is available, while not detracting from community-focused places like the Diff blog. The first post on that news page is available today.[5]
In order to not distract from community-focused discussions, and of course unless there’s something important for the community to know, in the future we will announce new customers product updates etc. on the project website’s news page and on Meta rather than on this mailing list etc. - but we felt it was important to do it this time.
Finally, I would also like to ask you to keep your eyes and ears open for anyone in your corner of the Wikimedia community who has questions or concerns about the project. Please ask them to read and comment on our Meta FAQ,[6] to contact me directly, or to attend the public community open meeting on Thursday, which is already announced on Meta on the project’s page & the mainpage calendar.
Sincerely, and on behalf of the Wikimedia Enterprise team,[11]
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise,* *Newcomer Experience, & WikiCite* Wikimedia Foundation
[1] https://wikimediafoundation.org/news/2022/06/21/wikimedia-enterprise-announc...
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
[3] https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#Update:_First_cust...
[4] https://enterprise.wikimedia.com/
[5] https://enterprise.wikimedia.com/news/hello-world/
[6] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Will_the_community_...
[7] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikim...
[8] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017#Our_strateg...
[9] https://openfuture.eu/blog/wikimedia-enterprise/
[10] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles [11] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise#Team
On Mon, 11 Oct 2021 at 19:01, Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all, A lot has happened since March when we Introduced the Wikimedia Enterprise API https://diff.wikimedia.org/2021/03/16/introducing-the-wikimedia-enterprise-api/ and began community conversations about the project’s development. Now is an important milestone to give everyone:
- an update responding to community advice we’ve received; and
- to describe what is happening next.
The idea of an API for the specific needs of the commercial sector had been discussed for more than a decade https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Where_has_this_previously_been_discussed (both for the purposes of improving user experience, and also to diversify revenue). The announcement in March introducing the Wikimedia Enterprise API generated a lot of Wikimedia-community and mainstream-media attention - most notably in WIRED https://www.wired.com/story/wikipedia-finally-asking-big-tech-to-pay-up/. Since then, the team has been hard at work building the actual product and hosting many conversations (regular public meetings and participation in events including SWAN, Wikimania, EMWCon, Clinic) - as well as a considerable volume of discussions on our meta talkpage https://xtools.wmflabs.org/articleinfo/meta.wikimedia.org/Talk:Wikimedia%20Enterprise. All of this has generated lots of suggestions, which we have endeavoured to incorporate and respond to before the actual commercial launch. On behalf of the whole team, I thank the many many people who have been willing and able to share constructive feedback with us over these months. Links to recordings from those meetings/presentations can be found on our meta homepage:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
- To that end, here are some updates in response to community advice:
WMF Board statement.
Subsequent to the most recent WMF Board of Trustees meeting, a statement reaffirming their support of the project, and in particular its operating principles relating to its future revenue, has been published. You can find the board Statement here https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikimedia_Foundation_Board_Statement_on_Wikimedia_Enterprise_revenue_principles, and the Enterprise operating principles on Meta here https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/Principles. Consistent community feedback was that our published principles were good and sensible, but for such a new and unusual thing in our movement, an overt statement from the Board of Trustees was requested. This statement affirms that:
- Revenues of the WMF obtained from commercial activities shall not
surpass 30% of the total planned revenue via all sources (including donations) in that fiscal year, and no further revenue would be sought beyond that limit;
- The Board of Trustees will be notified in advance of any large
commercial agreements, giving them time for review - exactly mirroring the procedure for large gifts;
- Revenue obtained from Wikimedia Enterprise services is under the
oversight and control of procedures for revenue raised by the Wikimedia Foundation and the revenue will not be earmarked for a specific program.
Each of these things were already noted on-wiki, but they were very much worthwhile re-stating formally. Equally it bears repeating: the existing APIs and methods of accessing Wikimedia sites remain. The creation of this optional commercial service, designed for those with specific high data-volume demands, does not change the experience (legally or technically) for anyone else. Relatedy, and also in response to community suggestions, the formal contracts which define the legal relationship of the non-profit Wikimedia Foundation to this commercial activity, have now been published on the governance wiki and linked from the related section on the project’s https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary.
Free technical access for the community.
You will soon be able to access a copy of the Enterprise dataset, refreshed each fortnight, at the Wikimedia dumps portal http://dumps.wikimedia.org/. Furthermore a ‘daily dump + hourly diff’ version is also already available, via Wikimedia Cloud Services https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_Introduction to any users of Toolforge, Cloud VPS, or PAWS. Both of these are provided to anyone, for free (in both ‘gratis’ and ‘libre’ senses of the word). Importantly, and consistent with community feedback, neither of these access methods require any special request process to access them, other than the existing terms of service on those platforms.
Software development updates are published monthly on our page on MediaWiki https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates (as is the API documentation https://www.mediawiki.org/wiki/Wikimedia_Enterprise/Documentation), and the work is coordinated on our Phabricator board https://phabricator.wikimedia.org/tag/wikimedia_enterprise/.
Next public meeting. As mentioned, the team has been holding regular public calls. If you would like to meet with, and ask any questions of, the Enterprise team (a.k.a. “Office hours”):
Friday October 22 @ 1500 UTC on Zoom https://wikimedia.zoom.us/j/88994018553. If you would like to arrange a conversation about this project with a group in the community that you are part of (at a time, language, and meeting-software platform of your choice), please contact me directly.
- What is happening next:
The launch of the project’s standalone website, denoting the service as “open for business”, will take place early next week.
In parallel we will also be announcing the first customers - both from the commercial and non-profit sectors. We expect this will generate some attention in the media. Despite our best efforts to be visible across the wikiverse, reading about the Wikimedia Enterprise API in the media will probably be the first time that some Wikimedians hear about it - which might be surprising for them. So, next week, if you see any Wikimedians asking about this project on community forums, please notify me by email, on-wiki [as user:LWyatt (WMF) ], and/or direct them to the project FAQ on Meta https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/FAQ (currently available in 7 languages).
Once again, thank you to all who have been involved in the development of, or given feedback to, *Enterprise*. It’s been a long road getting from there to here...
Sincerely,
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise, WikiCite,* and *Newcomer Experience* Wikimedia Foundation
On Tue, 16 Mar 2021 at 17:02, Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Thank you SJ, I think you've said it better than I could.
As I hope everyone can appreciate - different audiences are interested in different pieces of information and look for that information in different places. Today's 'press release' is differently formatted to, and with different focus from, the message I've sent here (and Meta). And those are different again from the (also public) 'tuning session' quarterly update slides. Equally, for example, technical roadmap updates about this project are published on its MediaWiki page https://www.mediawiki.org/wiki/Wikimedia_Enterprise and the code is on its GitHub page https://github.com/wikimedia/OKAPI - both of which have also received substantial updates recently that I did not mention in my earlier email because they were less relevant to this audience. But, since we're talking about the different interests of different audiences I'm happy to link them here now too.
For the benefit of the wider community here, it should be noted that I've replied to Andres' comments about these quarterly update slides, with relation to the Enterprise project, when he first raised them the 15th of June on the Meta talkpage https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#How_are_we_doing? and also on the WikipediaWeekly facebook group the same day https://www.facebook.com/groups/wikipediaweekly/permalink/5144372348943888/ .
Sincerely, - Liam Peace, Love & Metadata.
On Tue, 21 Jun 2022 at 22:40, Samuel Klein meta.sj@gmail.com wrote:
Andreas,
Relax.
There are three slides in that deck about Enterprise, much less detailed than the summary Liam just shared. There is no contradiction involved, and the transparency of sharing quarterly slides is all I could imagine wanting. In its context, they focus on OKRs and specific metrics, which are less relevant to this conversation (and were arbitrary in the first place).
If you constantly cry wolf, valid concerns will not be heard. Meanwhile you are making this list less pleasant and less useful for normal, undramatic discussion.
SJ
On Tue, Jun 21, 2022 at 3:55 PM Andreas Kolbe jayen466@gmail.com wrote:
Dear Liam,
There seem to be (at least) two types of presentations on Wikimedia Enterprise here: a PR-optimised one for public consumption, given here, and an internal one. I'd like the difference between the two to be smaller, ideally, and for the community (also) to be given the internal one, as found in Advancement's Q3 "tuning session" (quarterly review):
https://commons.wikimedia.org/w/index.php?title=File:Wikimedia_Foundation_Tu...
This says:
*The situation * Although we successfully closed an initial set of paying customers for Wikimedia Enterprise at the end of the last calendar year, and have continued to have ongoing sales conversations with additional potential customers, we have been unable to close additional customers as quickly as we projected due to unanticipated legal and product requirements, and will not hit the revenue target for FY21/22.
*The impact * We are developing a clearer picture of what is required to successfully scale sales of the Wikimedia Enterprise product within our non-profit context. In particular, we need to redefine, and better articulate, the relationship between our free and paid APIs, so that we can successfully explain why they would choose our paid, commercial-grade services rather than our free APIs.
*Recommendation * We are working with the legal team to develop a contractual structure that allows us to sell to a wider set of countries, and with the product team to better delineate the relationship between our free and paid API services, so that by the end of this calendar year there will be a clear value proposition that drives commercial customers to pay for the Enterprise APIs.
Note that this tuning session presentation, too, is marked "PUBLIC", so presumably there is a non-public version of that file as well.
I find all of this (which I doubt is your decision, so please don't take it as a criticism of you personally) lamentable. The community is the WMF's partner in all of this. Why not speak openly to us? We are not paying customers who need to be wooed, or wowed.
And no – the solution is not to stop publishing the quarterly reviews, or to delay their publication even more.
Best, Andreas
On Tue, Jun 21, 2022 at 5:11 PM Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all,
TL;DR: Today the Wikimedia Foundation published a press release[1] about the “Wikimedia Enterprise” API project - announcing our first set of customers, as well as a new self-signup system. This is a significant milestone because it fulfills several promises we have made to ourselves and to the movement. There will be a community open meeting on Thursday 23 June @ 1700 UTC as documented on our Meta page.[2] The text of this email is also published on the talkpage - please centralise any comments/feedback there.[3]
Details
I am writing today with details of the latest developments in the “Wikimedia Enterprise” API project. This follows the project’s community-discussion phase, which began approximately one year ago, focused on Meta [and also this wikimedia-l thread]. Then, this past October, we issued a press release announcing that we were “open for business” on the project’s new site.[4] This wikimedia-l email thread contains the details of those previous phases.
Now is the third and final major announcement in this journey from “idea” to “reality”. Today’s press release,[1] and associated story on the project’s new “news” page,[5] states that:
Two well known organisations will be announced as the first customers of the project. One is a major social/search corporation [Google], as our first official paying customer. This also means that the project is now covering its current operating costs. The other is a movement partner and nonprofit organization [The Internet Archive] that will receive access at no cost.
Anyone will be able to sign up for an account and use/access the service [but not at a commercial scale] for free. Furthermore, payments for usage above that threshold will be calculated simply and publicly based on the number of API requests and gigabytes of data used. (Other free access methods for the dataset continue to exist, as documented on our Meta FAQ)[6]
The API’s metadata has been expanded to include the beta version of what we are calling “credibility signals”. This is already public information (such as pageviews, edit-rates, and page-protection status changes) packaged within the single data feed to help users make more informed decisions about when they should refresh their copy of the dataset. (Emphasis on ‘beta’, as this is not available on all versions of the product yet.)
This announcement is a significant milestone because it fulfills several promises we have made to ourselves and to the movement, namely that:
We have built something that commercial organisations who are already heavy users of Wikimedia content and Wikimedia Foundation services are willing to invest in. The pricing is based on estimated usage, resulting in a more manageable and transparent cost structure. The project is now covering its current operating expenses. In addition, we requested and received a public affirmation/support letter from the Board for the project’s financial operating principles, ensuring that commercial revenue will only ever be a minority of the total and their oversight for any future high value contracts.[7]
The nonprofit partner will receive access at no cost, demonstrating a first practical example of how this project supports the mission of knowledge access while also providing a new revenue stream.
The ‘trial’ tier of the service is primarily designed to allow potential customers to determine whether they want to use it in commercial production environments, but it also allows anyone to see what is ‘in’ the API. Moreover, it will allow volunteers or researchers to access the service for free at a non-commercial scale. If those people have a mission-relevant use-case that requires them to continue to use the Enterprise API above that scale (i.e. that isn’t viable using other APIs/dumps), we will continue to provide them with free access.
The ‘credibility signals’ concept means that vandalism and errors should appear less often and/or be removed more quickly in downstream services such as search engines. [Note, how and when customers incorporate features is their own decision].
While we are proud to announce these customers, it is important to note that our market research has identified a significant gap in our movement’s ability to have Wikimedia knowledge used. The world’s largest companies are already using Wikimedia; we’re just providing a better way for them to do so. But for everyone else, it is often too hard and they do not have the resources (financial, technical, and human) to incorporate Wikimedia information – even though they want to. In short: simply providing legally-reusable knowledge is insufficient to enable reuse for a very large portion of society.
And so, we are focusing a lot of our future product development on this Knowledge as a Service model - consistent with the Movement Strategy’s “strategic direction”.[8] This is what OpenFuture.eu’s interview with the Enterprise team referred to as our attempt at “lowering the playing field” – a term we quite like.[9]
We are increasingly realising that the future of Wikimedia Enterprise is much more nuanced than merely “making big tech pay”, but is about enabling access to the many companies who want to use Wikimedia knowledge in their own products but currently can’t. These organisations are willing to pay us to find ways to better support their specific use of Wikimedia content, both through more accessible technology, contractual guarantees of service availability, and professional services to help them make the best use of our content in their systems. As per our enumerated Principles,[10] all customers get the same product - there are no exclusive or bespoke features - they only pay for the volume of usage. This will allow smaller companies to compete and will ensure that Wikimedia knowledge is more widely available. Our goal is for the future business model of Enterprise to resemble “many paying a little” rather than “few paying a lot” – an approach similar to our movement’s “many small donors” fundraising methodology.
Still to come later this year will be:
Exploring options to integrate Wikidata in the dataset, which is a common customer request. We are working closely with Wikimedia-Deutschland to discuss how to best do this.
Small, and non-U.S. based customers. This is crucial to demonstrating the Knowledge as a Service value of the project. We already work with relevant Chapters when we have a potential ‘local’ customer who has expressed strong interest.
Publishing aggregate revenue/expense data, but only after there’s enough aggregate financial data collected, over a sufficient period of time, and with enough customers to be informative.
The “news” page on the Enterprise website itself will be where future software updates, customer case-studies, etc. will be published. This ensures that the information is available, while not detracting from community-focused places like the Diff blog. The first post on that news page is available today.[5]
In order to not distract from community-focused discussions, and of course unless there’s something important for the community to know, in the future we will announce new customers product updates etc. on the project website’s news page and on Meta rather than on this mailing list etc. - but we felt it was important to do it this time.
Finally, I would also like to ask you to keep your eyes and ears open for anyone in your corner of the Wikimedia community who has questions or concerns about the project. Please ask them to read and comment on our Meta FAQ,[6] to contact me directly, or to attend the public community open meeting on Thursday, which is already announced on Meta on the project’s page & the mainpage calendar.
Sincerely, and on behalf of the Wikimedia Enterprise team,[11]
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise,* *Newcomer Experience, & WikiCite* Wikimedia Foundation
[1] https://wikimediafoundation.org/news/2022/06/21/wikimedia-enterprise-announc...
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
[3] https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#Update:_First_cust...
[4] https://enterprise.wikimedia.com/
[5] https://enterprise.wikimedia.com/news/hello-world/
[6] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Will_the_community_...
[7] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikim...
[8] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2017#Our_strateg...
[9] https://openfuture.eu/blog/wikimedia-enterprise/
[10] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles [11] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise#Team
On Mon, 11 Oct 2021 at 19:01, Liam Wyatt lwyatt@wikimedia.org wrote:
Dear all, A lot has happened since March when we Introduced the Wikimedia Enterprise API https://diff.wikimedia.org/2021/03/16/introducing-the-wikimedia-enterprise-api/ and began community conversations about the project’s development. Now is an important milestone to give everyone:
- an update responding to community advice we’ve received; and
- to describe what is happening next.
The idea of an API for the specific needs of the commercial sector had been discussed for more than a decade https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Where_has_this_previously_been_discussed (both for the purposes of improving user experience, and also to diversify revenue). The announcement in March introducing the Wikimedia Enterprise API generated a lot of Wikimedia-community and mainstream-media attention - most notably in WIRED https://www.wired.com/story/wikipedia-finally-asking-big-tech-to-pay-up/. Since then, the team has been hard at work building the actual product and hosting many conversations (regular public meetings and participation in events including SWAN, Wikimania, EMWCon, Clinic) - as well as a considerable volume of discussions on our meta talkpage https://xtools.wmflabs.org/articleinfo/meta.wikimedia.org/Talk:Wikimedia%20Enterprise. All of this has generated lots of suggestions, which we have endeavoured to incorporate and respond to before the actual commercial launch. On behalf of the whole team, I thank the many many people who have been willing and able to share constructive feedback with us over these months. Links to recordings from those meetings/presentations can be found on our meta homepage:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise
- To that end, here are some updates in response to community advice:
WMF Board statement.
Subsequent to the most recent WMF Board of Trustees meeting, a statement reaffirming their support of the project, and in particular its operating principles relating to its future revenue, has been published. You can find the board Statement here https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Board_noticeboard/Wikimedia_Foundation_Board_Statement_on_Wikimedia_Enterprise_revenue_principles, and the Enterprise operating principles on Meta here https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/Principles. Consistent community feedback was that our published principles were good and sensible, but for such a new and unusual thing in our movement, an overt statement from the Board of Trustees was requested. This statement affirms that:
- Revenues of the WMF obtained from commercial activities shall not
surpass 30% of the total planned revenue via all sources (including donations) in that fiscal year, and no further revenue would be sought beyond that limit;
- The Board of Trustees will be notified in advance of any large
commercial agreements, giving them time for review - exactly mirroring the procedure for large gifts;
- Revenue obtained from Wikimedia Enterprise services is under the
oversight and control of procedures for revenue raised by the Wikimedia Foundation and the revenue will not be earmarked for a specific program.
Each of these things were already noted on-wiki, but they were very much worthwhile re-stating formally. Equally it bears repeating: the existing APIs and methods of accessing Wikimedia sites remain. The creation of this optional commercial service, designed for those with specific high data-volume demands, does not change the experience (legally or technically) for anyone else. Relatedy, and also in response to community suggestions, the formal contracts which define the legal relationship of the non-profit Wikimedia Foundation to this commercial activity, have now been published on the governance wiki and linked from the related section on the project’s https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ#Why_is_this_being_run_by_a_subsidiary.
Free technical access for the community.
You will soon be able to access a copy of the Enterprise dataset, refreshed each fortnight, at the Wikimedia dumps portal http://dumps.wikimedia.org/. Furthermore a ‘daily dump + hourly diff’ version is also already available, via Wikimedia Cloud Services https://wikitech.wikimedia.org/wiki/Help:Cloud_Services_Introduction to any users of Toolforge, Cloud VPS, or PAWS. Both of these are provided to anyone, for free (in both ‘gratis’ and ‘libre’ senses of the word). Importantly, and consistent with community feedback, neither of these access methods require any special request process to access them, other than the existing terms of service on those platforms.
Software development updates are published monthly on our page on MediaWiki https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates (as is the API documentation https://www.mediawiki.org/wiki/Wikimedia_Enterprise/Documentation), and the work is coordinated on our Phabricator board https://phabricator.wikimedia.org/tag/wikimedia_enterprise/.
Next public meeting. As mentioned, the team has been holding regular public calls. If you would like to meet with, and ask any questions of, the Enterprise team (a.k.a. “Office hours”):
Friday October 22 @ 1500 UTC on Zoom https://wikimedia.zoom.us/j/88994018553. If you would like to arrange a conversation about this project with a group in the community that you are part of (at a time, language, and meeting-software platform of your choice), please contact me directly.
- What is happening next:
The launch of the project’s standalone website, denoting the service as “open for business”, will take place early next week.
In parallel we will also be announcing the first customers - both from the commercial and non-profit sectors. We expect this will generate some attention in the media. Despite our best efforts to be visible across the wikiverse, reading about the Wikimedia Enterprise API in the media will probably be the first time that some Wikimedians hear about it - which might be surprising for them. So, next week, if you see any Wikimedians asking about this project on community forums, please notify me by email, on-wiki [as user:LWyatt (WMF) ], and/or direct them to the project FAQ on Meta https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_Enterprise/FAQ (currently available in 7 languages).
Once again, thank you to all who have been involved in the development of, or given feedback to, *Enterprise*. It’s been a long road getting from there to here...
Sincerely,
- Liam Wyatt [Wittylama]*
Program Manager for *Enterprise, WikiCite,* and *Newcomer Experience* Wikimedia Foundation
On Tue, 16 Mar 2021 at 17:02, Liam Wyatt lwyatt-ctr@wikimedia.org wrote:
Dear all,
Over the last few months, a small team at the Wikimedia Foundation has been working on a project that has been discussed by many people in our movement for many years: building ‘enterprise grade’ services for the high-volume commercial reusers of Wikimedia content. I am pleased to say that in a remarkably short amount of time (considering the complexity of the issues: technical, strategic, legal, and financial) we now have something worthy of showing to the community, and we are asking for your feedback. Allow me to introduce you to the Wikimedia Enterprise API project – formerly codenamed “okapi”.
While the general idea for Wikimedia Enterprise predates the current movement strategy process, its recommendations identify an enterprise API as one possible solution to both “Increase the sustainability of our movement” and “Improve User Experience.”[0] That is, to simultaneously create a new revenue stream to protect Wikimedia’s sustainability, and improve the quality and quantity of Wikimedia content available to our many readers who do not visit our websites directly (including more consistent attribution). Moreover, it does so in a way that is true to our movement’s culture: with open source software, financial transparency, non-exclusive contracts or content, no restrictions on existing services, and free access for Wikimedia volunteers who need it.
The team believes we are on target to achieve those goals and so we have written a lot of documentation to get your feedback about our progress and where it could be further improved before the actual product is ‘launched’ in the next few months. We have been helped in this process over the last several months by approximately 100 individual volunteers (from many corners of the wikiverse) and representatives of affiliate organisations who have reviewed our plans and provided invaluable direction, pointing out weaknesses and opportunities, or areas lacking clarity and documentation in our drafts. Thank you to everyone who has shared your time and expertise to help prepare this new initiative.
A essay describing the “why?” and the “how?” of this project is now on Meta:
https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Essay
Also now published on Meta are an extensive FAQ, operating principles, and technical documentation on MediaWiki.org. You can read these at [1] [2] and [3] respectively. Much of this documentation is already available in French, German, Italian, and Spanish.
The Wikimedia Enterprise team is particularly interested in your feedback on how we have designed the checks and balances to this project - to ensure it is as successful as possible at achieving those two goals described above while staying true to the movement’s values and culture. For example: Is everything covered appropriately in the “Principles” list? Is the technical documentation on MediaWiki.org clear? Are the explanations in the “FAQ” about free-access for community, or project’s legal structure, or the financial transparency (etc.) sufficiently detailed?
Meet the team and Ask Us Anything:
The central place to provide written feedback about the project in general is on the talkpage of the documentation on Meta at: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise
On this Friday (March 19) we will be hosting two “Office hours” conversations where anyone can come and give feedback or ask questions:
13:00 UTC via Zoom at https://wikimedia.zoom.us/j/95580273732
22:00 UTC via Zoom at https://wikimedia.zoom.us/j/92565175760 (note: this is Saturday in Asia/Oceania)
Other “office hours” meetings can be arranged on-request on a technical platform of your choosing; and we will organise more calls in the future.
We will also be attending the next SWAN meetings (on March 21) https://meta.wikimedia.org/wiki/Strategic_Wikimedia_Affiliates_Network, and also the next of the Wikimedia Clinics https://meta.wikimedia.org/wiki/Wikimedia_Clinics
Moreover, we would be very happy to accept any invitation to attend an existing group call that would like to discuss this topic (e.g. an affiliate’s members’ meeting).
On behalf of the Wikimedia Enterprise team,
Peace, Love & Metadata -- Liam Wyatt [Wittylama], Wikimedia Enterprise project community liaison.
[0] https://meta.wikimedia.org/wiki/Strategy/Wikimedia_movement/2018-20/Recommen...
[1] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ
[2] https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles
[3] https://www.mediawiki.org/wiki/Wikimedia_Enterprise
*Liam Wyatt [Wittylama]* WikiCite https://meta.wikimedia.org/wiki/WikiCite Program Manager & Wikimedia Enterprise https://meta.wikimedia.org/wiki/Okapi Community Liaison Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
-- Samuel Klein @metasj w:user:sj +1 617 529 4266 _______________________________________________ Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Dear all,
Following the initial announcement and project launch in 2021, and press release about first customers in 2022, the Wikimedia Enterprise team has today published the *first financial report* and a summary of a forthcoming *product update*.
This has been published today on the Diff blog, here: https://diff.wikimedia.org/2023/02/07/wikimedia-enterprise-financial-report-... [also available in German https://diff.wikimedia.org/de/2023/02/07/wikimedia-enterprise-finanzbericht-und-produktupdates/ ]
One of the principles https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles of the Wikimedia Enterprise project has been “the publication of overall revenue and expenses, differentiated from those of the Wikimedia Foundation in general, at least annually”. We are therefore proud to present the inaugural edition of the Wikimedia Enterprise financial report – covering the calendar-year 2022, its first year of operations.
The update also includes a description of some of the API features that have been under development. While the primary use-case is companies which consistently require very high-speed updates of very large amounts of Wikimedia content, it is important to note that there are several free-access methods.
If you have written questions or comments about the update, please share them on the project’s talkpage https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise on Meta. As described in the blogpost, we consider this report covering the 2022 calendar year to be a “beta” version. We are actively seeking feedback about how its structure, content, and explanations can be improved for the next edition in late 2023, which will cover the 2022-23 fiscal year.
If you prefer real-time conversation: A public meeting will be hosted by the Enterprise team this Friday, February 10 @1900 UTC to discuss this announcement - details on the project homepage https://meta.wikimedia.org/wiki/Wikimedia_Enterprise.
If you have any other questions please consult the FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ.
Sincerely,
* Liam Wyatt [Wittylama]*
Senior Program Manager for *Enterprise,* *Campaigns, & WikiCite* Wikimedia Foundation
Thanks Liam! That looks admirably clear and very thorough - would be great to see this level of detail and transparency in other aspects of the WMF's work
Chris/ The Land
On Tue, 7 Feb 2023, 14:35 Liam Wyatt, lwyatt@wikimedia.org wrote:
Dear all,
Following the initial announcement and project launch in 2021, and press release about first customers in 2022, the Wikimedia Enterprise team has today published the *first financial report* and a summary of a forthcoming *product update*.
This has been published today on the Diff blog, here:
https://diff.wikimedia.org/2023/02/07/wikimedia-enterprise-financial-report-... [also available in German https://diff.wikimedia.org/de/2023/02/07/wikimedia-enterprise-finanzbericht-und-produktupdates/ ]
One of the principles https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles of the Wikimedia Enterprise project has been “the publication of overall revenue and expenses, differentiated from those of the Wikimedia Foundation in general, at least annually”. We are therefore proud to present the inaugural edition of the Wikimedia Enterprise financial report – covering the calendar-year 2022, its first year of operations.
The update also includes a description of some of the API features that have been under development. While the primary use-case is companies which consistently require very high-speed updates of very large amounts of Wikimedia content, it is important to note that there are several free-access methods.
If you have written questions or comments about the update, please share them on the project’s talkpage https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise on Meta. As described in the blogpost, we consider this report covering the 2022 calendar year to be a “beta” version. We are actively seeking feedback about how its structure, content, and explanations can be improved for the next edition in late 2023, which will cover the 2022-23 fiscal year.
If you prefer real-time conversation: A public meeting will be hosted by the Enterprise team this Friday, February 10 @1900 UTC to discuss this announcement - details on the project homepage https://meta.wikimedia.org/wiki/Wikimedia_Enterprise.
If you have any other questions please consult the FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ.
Sincerely,
- Liam Wyatt [Wittylama]*
Senior Program Manager for *Enterprise,* *Campaigns, & WikiCite* Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Thanks too for the German translation of the very detailed and transparent report! Best,DerHexer Am Dienstag, 7. Februar 2023 um 16:16:31 MEZ hat Chris Keating chriskeatingwiki@gmail.com Folgendes geschrieben:
Thanks Liam! That looks admirably clear and very thorough - would be great to see this level of detail and transparency in other aspects of the WMF's work Chris/ The Land On Tue, 7 Feb 2023, 14:35 Liam Wyatt, lwyatt@wikimedia.org wrote:
Dear all,
Following the initial announcement and project launch in 2021, and press release about first customers in 2022, the Wikimedia Enterprise team has today published the first financial report and a summary of a forthcoming product update.
This has been published today on the Diff blog, here: https://diff.wikimedia.org/2023/02/07/wikimedia-enterprise-financial-report-... [also available in German]
One of the principles of the Wikimedia Enterprise project has been “the publication of overall revenue and expenses, differentiated from those of the Wikimedia Foundation in general, at least annually”. We are therefore proud to present the inaugural edition of the Wikimedia Enterprise financial report – covering the calendar-year 2022, its first year of operations.
The update also includes a description of some of the API features that have been under development. While the primary use-case is companies which consistently require very high-speed updates of very large amounts of Wikimedia content, it is important to note that there are several free-access methods.
If you have written questions or comments about the update, please share them on the project’s talkpage on Meta. As described in the blogpost, we consider this report covering the 2022 calendar year to be a “beta” version. We are actively seeking feedback about how its structure, content, and explanations can be improved for the next edition in late 2023, which will cover the 2022-23 fiscal year.
If you prefer real-time conversation: A public meeting will be hosted by the Enterprise team this Friday, February 10 @1900 UTC to discuss this announcement - details on the project homepage.
If you have any other questions please consult the FAQ.
Sincerely,
|
| Liam Wyatt [Wittylama]
| Senior Program Manager for Enterprise, Campaigns, & WikiCite
Wikimedia Foundation |
|
_______________________________________________ Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org _______________________________________________ Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Chris - My thoughts exactly. A satisfying report: useful, informative, densely linked.
TLDR: revenue at 2% of the WMF total; projected to be cashflow positive this year. 9 FTEs, up-to-date landing page https://meta.wikimedia.org/wiki/Wikimedia_Enterprise, even headshot photos for a majority of the team. (And a subtle reminder that we should consider doing something awesome with a community-led merch store!)
Liam - for the product update, I'm curious how hosting costs + usage have changed over the year (and implications for what we learn to optimize)
SJ
On Tue, Feb 7, 2023 at 10:16 AM Chris Keating chriskeatingwiki@gmail.com wrote:
Thanks Liam! That looks admirably clear and very thorough - would be great to see this level of detail and transparency in other aspects of the WMF's work
Chris/ The Land
On Tue, 7 Feb 2023, 14:35 Liam Wyatt, lwyatt@wikimedia.org wrote:
Dear all,
Following the initial announcement and project launch in 2021, and press release about first customers in 2022, the Wikimedia Enterprise team has today published the *first financial report* and a summary of a forthcoming *product update*.
This has been published today on the Diff blog, here:
https://diff.wikimedia.org/2023/02/07/wikimedia-enterprise-financial-report-... [also available in German https://diff.wikimedia.org/de/2023/02/07/wikimedia-enterprise-finanzbericht-und-produktupdates/ ]
One of the principles https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles of the Wikimedia Enterprise project has been “the publication of overall revenue and expenses, differentiated from those of the Wikimedia Foundation in general, at least annually”. We are therefore proud to present the inaugural edition of the Wikimedia Enterprise financial report – covering the calendar-year 2022, its first year of operations.
The update also includes a description of some of the API features that have been under development. While the primary use-case is companies which consistently require very high-speed updates of very large amounts of Wikimedia content, it is important to note that there are several free-access methods.
If you have written questions or comments about the update, please share them on the project’s talkpage https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise on Meta. As described in the blogpost, we consider this report covering the 2022 calendar year to be a “beta” version. We are actively seeking feedback about how its structure, content, and explanations can be improved for the next edition in late 2023, which will cover the 2022-23 fiscal year.
If you prefer real-time conversation: A public meeting will be hosted by the Enterprise team this Friday, February 10 @1900 UTC to discuss this announcement - details on the project homepage https://meta.wikimedia.org/wiki/Wikimedia_Enterprise.
If you have any other questions please consult the FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ.
Sincerely,
- Liam Wyatt [Wittylama]*
Senior Program Manager for *Enterprise,* *Campaigns, & WikiCite* Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Hello Sam, thank you for the kind words.
And also thank you to Chris and Martin for yours.
With regards to the “optimizations” mentioned in the product update: usage change over the course of 2022 wasn’t really the motivating factor here (given it’s only been one year so we’re fully expecting fluctuations), It’s more about trying to increase the system’s efficiency and limit areas where things could break at scale - in preparation for future demand. There has been some increase in costs over the 2022 calendar year, as shown in the finance report’s bar-graph and associated paragraph, but that was primarily due to staffing changes, not hosting costs.
Our initial system architecture focused heavily on Wikipedia database dumps and now we’re focusing on expanding the “realtime” data feeds. We decided to rebuild the architecture to look more like an event-based system, to work alongside exported-data products, instead of adding on more services on top of the dump generation.
As mentioned in the product update, for those interested in this topic there are quarterly summaries of the technical work on the project’s MediaWiki page: https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates But, if you’d like to talk through the implementation details and the thinking behind it, then the best format is a real-time conversation. I encourage you to come to the “office hours” public meeting this Friday - etails at the top of the project page on Meta. Even if you can’t make it to that, we’ll make sure to discuss the product update and I’ll be uploading the recording afterwards to Commons, with a timecoded summary of the conversation.
Sincerely,
Liam
On Tue, 7 Feb 2023 at 23:29, Samuel Klein meta.sj@gmail.com wrote:
Chris - My thoughts exactly. A satisfying report: useful, informative, densely linked.
TLDR: revenue at 2% of the WMF total; projected to be cashflow positive this year. 9 FTEs, up-to-date landing page https://meta.wikimedia.org/wiki/Wikimedia_Enterprise, even headshot photos for a majority of the team. (And a subtle reminder that we should consider doing something awesome with a community-led merch store!)
Liam - for the product update, I'm curious how hosting costs + usage have changed over the year (and implications for what we learn to optimize)
SJ
On Tue, Feb 7, 2023 at 10:16 AM Chris Keating chriskeatingwiki@gmail.com wrote:
Thanks Liam! That looks admirably clear and very thorough - would be great to see this level of detail and transparency in other aspects of the WMF's work
Chris/ The Land
On Tue, 7 Feb 2023, 14:35 Liam Wyatt, lwyatt@wikimedia.org wrote:
Dear all,
Following the initial announcement and project launch in 2021, and press release about first customers in 2022, the Wikimedia Enterprise team has today published the *first financial report* and a summary of a forthcoming *product update*.
This has been published today on the Diff blog, here:
https://diff.wikimedia.org/2023/02/07/wikimedia-enterprise-financial-report-... [also available in German https://diff.wikimedia.org/de/2023/02/07/wikimedia-enterprise-finanzbericht-und-produktupdates/ ]
One of the principles https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles of the Wikimedia Enterprise project has been “the publication of overall revenue and expenses, differentiated from those of the Wikimedia Foundation in general, at least annually”. We are therefore proud to present the inaugural edition of the Wikimedia Enterprise financial report – covering the calendar-year 2022, its first year of operations.
The update also includes a description of some of the API features that have been under development. While the primary use-case is companies which consistently require very high-speed updates of very large amounts of Wikimedia content, it is important to note that there are several free-access methods.
If you have written questions or comments about the update, please share them on the project’s talkpage https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise on Meta. As described in the blogpost, we consider this report covering the 2022 calendar year to be a “beta” version. We are actively seeking feedback about how its structure, content, and explanations can be improved for the next edition in late 2023, which will cover the 2022-23 fiscal year.
If you prefer real-time conversation: A public meeting will be hosted by the Enterprise team this Friday, February 10 @1900 UTC to discuss this announcement - details on the project homepage https://meta.wikimedia.org/wiki/Wikimedia_Enterprise.
If you have any other questions please consult the FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ.
Sincerely,
- Liam Wyatt [Wittylama]*
Senior Program Manager for *Enterprise,* *Campaigns, & WikiCite* Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
-- Samuel Klein @metasj w:user:sj +1 617 529 4266 _______________________________________________ Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Followup: As previously mentioned, the public conversation "office hours" for the Wikimedia Enterprise API project's *2022 Financial report & product update, *was held yesterday.
For those who were interested but unable to attend, a recording of this 1h40m meeting - including timecodes for all questions/topics discussed - is now available on on Commons and embedded in the project's talkpage: https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise#February_2023_Comm...
Thank you to all who participated.
* Liam Wyatt [Wittylama]*
Senior Program Manager for *Enterprise,* *Campaigns, & WikiCite* Wikimedia Foundation
On Wed, 8 Feb 2023 at 14:21, Liam Wyatt lwyatt@wikimedia.org wrote:
Hello Sam, thank you for the kind words.
And also thank you to Chris and Martin for yours.
With regards to the “optimizations” mentioned in the product update: usage change over the course of 2022 wasn’t really the motivating factor here (given it’s only been one year so we’re fully expecting fluctuations), It’s more about trying to increase the system’s efficiency and limit areas where things could break at scale - in preparation for future demand. There has been some increase in costs over the 2022 calendar year, as shown in the finance report’s bar-graph and associated paragraph, but that was primarily due to staffing changes, not hosting costs.
Our initial system architecture focused heavily on Wikipedia database dumps and now we’re focusing on expanding the “realtime” data feeds. We decided to rebuild the architecture to look more like an event-based system, to work alongside exported-data products, instead of adding on more services on top of the dump generation.
As mentioned in the product update, for those interested in this topic there are quarterly summaries of the technical work on the project’s MediaWiki page: https://www.mediawiki.org/wiki/Wikimedia_Enterprise#Updates But, if you’d like to talk through the implementation details and the thinking behind it, then the best format is a real-time conversation. I encourage you to come to the “office hours” public meeting this Friday - etails at the top of the project page on Meta. Even if you can’t make it to that, we’ll make sure to discuss the product update and I’ll be uploading the recording afterwards to Commons, with a timecoded summary of the conversation.
Sincerely,
Liam
On Tue, 7 Feb 2023 at 23:29, Samuel Klein meta.sj@gmail.com wrote:
Chris - My thoughts exactly. A satisfying report: useful, informative, densely linked.
TLDR: revenue at 2% of the WMF total; projected to be cashflow positive this year. 9 FTEs, up-to-date landing page https://meta.wikimedia.org/wiki/Wikimedia_Enterprise, even headshot photos for a majority of the team. (And a subtle reminder that we should consider doing something awesome with a community-led merch store!)
Liam - for the product update, I'm curious how hosting costs + usage have changed over the year (and implications for what we learn to optimize)
SJ
On Tue, Feb 7, 2023 at 10:16 AM Chris Keating chriskeatingwiki@gmail.com wrote:
Thanks Liam! That looks admirably clear and very thorough - would be great to see this level of detail and transparency in other aspects of the WMF's work
Chris/ The Land
On Tue, 7 Feb 2023, 14:35 Liam Wyatt, lwyatt@wikimedia.org wrote:
Dear all,
Following the initial announcement and project launch in 2021, and press release about first customers in 2022, the Wikimedia Enterprise team has today published the *first financial report* and a summary of a forthcoming *product update*.
This has been published today on the Diff blog, here:
https://diff.wikimedia.org/2023/02/07/wikimedia-enterprise-financial-report-... [also available in German https://diff.wikimedia.org/de/2023/02/07/wikimedia-enterprise-finanzbericht-und-produktupdates/ ]
One of the principles https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/Principles of the Wikimedia Enterprise project has been “the publication of overall revenue and expenses, differentiated from those of the Wikimedia Foundation in general, at least annually”. We are therefore proud to present the inaugural edition of the Wikimedia Enterprise financial report – covering the calendar-year 2022, its first year of operations.
The update also includes a description of some of the API features that have been under development. While the primary use-case is companies which consistently require very high-speed updates of very large amounts of Wikimedia content, it is important to note that there are several free-access methods.
If you have written questions or comments about the update, please share them on the project’s talkpage https://meta.wikimedia.org/wiki/Talk:Wikimedia_Enterprise on Meta. As described in the blogpost, we consider this report covering the 2022 calendar year to be a “beta” version. We are actively seeking feedback about how its structure, content, and explanations can be improved for the next edition in late 2023, which will cover the 2022-23 fiscal year.
If you prefer real-time conversation: A public meeting will be hosted by the Enterprise team this Friday, February 10 @1900 UTC to discuss this announcement - details on the project homepage https://meta.wikimedia.org/wiki/Wikimedia_Enterprise.
If you have any other questions please consult the FAQ https://meta.wikimedia.org/wiki/Wikimedia_Enterprise/FAQ.
Sincerely,
- Liam Wyatt [Wittylama]*
Senior Program Manager for *Enterprise,* *Campaigns, & WikiCite* Wikimedia Foundation
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
-- Samuel Klein @metasj w:user:sj +1 617 529 4266 _______________________________________________ Wikimedia-l mailing list -- wikimedia-l@lists.wikimedia.org, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l Public archives at https://lists.wikimedia.org/hyperkitty/list/wikimedia-l@lists.wikimedia.org/... To unsubscribe send an email to wikimedia-l-leave@lists.wikimedia.org
wikimedia-l@lists.wikimedia.org