Hello all,
While cleaning (reviewing and rewriting) the code of Wikidata and Wikimedia
Commons backend in October 2019, The Wikidata team at WMDE together with
WMF worked on reducing the loading time of pages. We managed to reduce the
loading time of every Wikidata page by about 0.1-0.2 seconds. This is due
to a reduction of the modules (sets of code responsible for a certain
function) that need to be loaded every time a page is opened by someone.
Instead of 260 modules, which needed to be loaded before, only 85 modules
need to be loaded now when the page is called. By doing so, it is easier to
load Wikidata pages for people who only have a slow internet connection.
Link to picture on Commons:
https://commons.wikimedia.org/wiki/File:Reduced_loading_times_cut.png
Description: Size decrease of the initialization loader on Wikidata pages (see
on Grafana
<https://grafana.wikimedia.org/d/BvWJlaDWk/startup-manifest-size?orgId=1&fro…>
)
Reducing the amount of modules called when loading the page equals a
reduction of about 130 GB of network traffic for all users every day, or
47TB per year. The reduction of network traffic translates into a reduction
of electricity use, thus, this change is also good for the environment.
Additionally, the interdependencies between the modules were reduced from
4MB to 1MB, which improved the loading time per page as well.
Many thanks to everyone involved in this improvement! If you want to get
more details about the actions we performed, you can have a look at the
Phabricator board
<https://phabricator.wikimedia.org/project/board/4268/query/all/>.
If you are developing scripts or tools on top of the Wikidata UI, some
documentation will walk you through the architecture of RessourceLoader
<https://www.mediawiki.org/wiki/ResourceLoader/Architecture>, what’s page
load performance
<https://www.mediawiki.org/wiki/Wikimedia_Performance_Team/Page_load_perform…>
and how to create module bundles with ResourceLoader
<https://www.mediawiki.org/wiki/ResourceLoader/Developing_with_ResourceLoader>.
For further questions or feedback, feel free to contact us on this page
<https://www.wikidata.org/wiki/Wikidata:Contact_the_development_team>.
Cheers,
Max for the Wikidata team
--
Max Klemm
Working Student Community Communication for Technical Wishes
Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Phone: +49 (0)30 219 158 26-0https://wikimedia.de
Imagine a world in which every single human being can freely share in
the sum of all knowledge. Help us to achieve our
vision!https://spenden.wikimedia.de
Wikimedia Deutschland – Gesellschaft zur Förderung Freien Wissens e.
V. Eingetragen im Vereinsregister des Amtsgerichts
Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig
anerkannt durch das Finanzamt für Körperschaften I Berlin,
Steuernummer 27/029/42207.
FYI, this is related to Wikidata/Wikibase as well. Please check your tools
in case your code uses the API error codes.
---------- Forwarded message ---------
From: Brad Jorsch (Anomie) <bjorsch(a)wikimedia.org>
Date: Tue, 4 Feb 2020 at 19:30
Subject: [Wikitech-l] BREAKING CHANGES to Action API parameter validation
To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
This notice is being sent to wikitech-l for the benefit of technical
subscribers who aren't subscribed to that list, due to concern that these
changes may affect many API clients. For notification of all breaking
changes to the Action API, please subscribe at
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce.
Error codes for parameter validation errors are changing. Among others,
"noX" becomes "missingparam" and "unknown_X" becomes "badvalue". See the
full announcement at
https://lists.wikimedia.org/pipermail/mediawiki-api-announce/2020-February/…
for details.
Various unusual values for integer-type parameters will no longer be
accepted, basically anything that isn't an optional ASCII sign ('+' or '-')
followed by ASCII digits. See
https://lists.wikimedia.org/pipermail/mediawiki-api-announce/2020-February/…
for details.
Both of these changes will most likely go out to Wikimedia wikis with
1.35.0-wmf.19. See https://www.mediawiki.org/wiki/MediaWiki_1.35/Roadmap
for a schedule.
--
Brad Jorsch (Anomie)
Senior Software Engineer
Wikimedia Foundation
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
--
Léa Lacroix
Project Manager Community Communication for Wikidata
Wikimedia Deutschland e.V.
Tempelhofer Ufer 23-24
10963 Berlin
www.wikimedia.de
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/029/42207.