Hello, The externallinks table https://www.mediawiki.org/wiki/Manual:Externallinks_table in MediaWiki is among the largest in Wikimedia production. It's the second largest database table in Wikimedia Commons (and will soon claim the first place, after templatelinks normalization https://phabricator.wikimedia.org/T299417 completes).
There is a proposal to redesign this table. You can read more about it in T312666 https://phabricator.wikimedia.org/T312666. If you use this table or have some feedback about this proposal, please comment on the ticket.
Also, this means its schema and data will change soon. Be prepared to update your tools and reports if you depend on the externallinks table.
Providing technical support to Wikimedia Commons is one of the official goals of Wikimedia Foundation for this fiscal year, [1] and this redesign will help address long-standing storage and database capacity issues of this important project.
[1]: From the annual plan https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2022-2023: "Deepen our commitment to Knowledge as a Service by strengthening how we prioritize and allocate product and tech support to 740+ Wikimedia projects, starting with Wikimedia Commons and Wikidata."
Best