Agree! Looking at downstream use is certainly something that could be particularly useful..
s
On Wed, 12 Jun 2024 at 18:39, Andrew Lih andrew.lih@gmail.com wrote:
Thanks for that paper, it would be interesting to see a followup study now that it's been 10 years!
On Mon, Jun 10, 2024 at 10:41 AM Sara Thomas sara.thomas@wikimedia.org.uk wrote:
An interesting question, and one which I was discussing recently with Kristofer Erikson of https://www.create.ac.uk/ https://eu-west-1.protection.sophos.com?d=create.ac.uk&u=aHR0cHM6Ly93d3cuY3JlYXRlLmFjLnVrLw==&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=dDNoOVdKMW1iZzhlMFhQaGpMZi84MDBSWlZLVGt1U3cvZW1JSlpDazl3az0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E. He pointed me in the direction of this paper which he co-authored in 2018: https://dl.acm.org/doi/10.1145/3233391.3233533 https://eu-west-1.protection.sophos.com?d=acm.org&u=aHR0cHM6Ly9kbC5hY20ub3JnL2RvaS8xMC4xMTQ1LzMyMzMzOTEuMzIzMzUzMw==&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=cG1CNjRvdmZGNlVHanJSTkdzdGRsOVA1K3hscGhmSnpQODVzZmxmMUsvMD0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E - (abstract below), which folks here may find interesting if you've not come across it before. My understanding is that Kris would be open to further work in this area.
*The Wikimedia Commons (WC) is a peer-produced repository of freely licensed images, videos, sounds and interactive media, containing more than 45 million files. This paper attempts to quantify the societal value of the WC by tracking the downstream use of images found on the platform. We take a random sample of 10,000 images from WC and apply an automated reverse-image search to each, recording when and where they are used 'in the wild'. We detect 54,758 downstream uses of the initial sample and we characterise these at the level of generic and country-code top-level domains (TLDs). We analyse the impact of specific variables on the odds that an image is used. The random sampling technique enables us to estimate overall value of all images contained on the platform. Drawing on the method employed by Heald et al (2015), we find a potential contribution of USD $28.9 billion from downstream use of Wikimedia Commons images over the lifetime of the project.*
Sara Thomas Programme Manager, Wikimedia UK
On Mon, 10 Jun 2024 at 15:17, Andrew Lih andrew.lih@gmail.com wrote:
Hi all,
This was posed as a question on the GLAM Wiki Global Telegram group, but I thought I'd send it to the WREN list for thoughts and comments. Feel free to respond in email or at the original thread: https://t.me/c/1723589369/4942 https://eu-west-1.protection.sophos.com?d=t.me&u=aHR0cHM6Ly90Lm1lL2MvMTcyMzU4OTM2OS80OTQy&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=VzRENHlmMUo3UjluYnFxK1JRdTliUGtWMGh6L3pGOTNKRldEQ3MyTUVHVT0=&h=d1b2ecafe3ba428f96c5679fd3ac9be9&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E
This was in response to the current draft of the annual plan, and a discussion around Selena Deckelmann's (WMF CPTO) response to resourcing Wikimedia Commons.
Thanks. -Andrew
I'd like to put out a question that may be key to understanding the debate seen around "knowledge dissemination," as was mentioned in Selena Deckelmann's response to the resourcing Commons statement: https://commons.wikimedia.org/wiki/Commons_talk:Media_knowledge_beyond_Wikip... https://eu-west-1.protection.sophos.com?d=wikimedia.org&u=aHR0cHM6Ly9jb21tb25zLndpa2ltZWRpYS5vcmcvd2lraS9Db21tb25zX3RhbGs6TWVkaWFfa25vd2xlZGdlX2JleW9uZF9XaWtpcGVkaWEjUmVzcG9uc2VfZnJvbV90aGVfU2VsZW5hX0RlY2tlbG1hbm4sX0NQVE9fYXRfdGhlX1dpa2ltZWRpYV9Gb3VuZGF0aW9u&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=TUxnWHFRVzJVY2ZCR3FvOWdOZlhuT2kzTm1lTkM5R1RCSHEwSFZVVko3dz0=&h=d1b2ecafe3ba428f96c5679fd3ac9be9&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E
How do you evaluate or measure the impact of open content?
By its very nature, open content (text, data, code, media) is out of the control of its originator. The editor, uploader, file host makes it available, and others copy it and use it somewhere down the path of replication. Therefore, evaluating the use and impact of any open content can be extremely hard – free/libre content encourages dissemination, but removes the ability to measure it. It may be possible through secondary indicators (e.g. Github stars) or best-effort research (e.g. Google search for image credits, hopefully finding mentions of Commons or a user). However, all too often measuring impact is a qualitative educated guess. This is not a new problem. But I believe this lack of sound methodology for evaluating impact, and our lack of evolving our thinking, has become a blocker in multiple ways.
Some questions to ponder:
- Some GLAM partners have mentioned this problem specifically, and it
would be interesting to hear if others heard the same issues. For example, Cleveland Museum of Art were early adopters of open access, uploading Commons images and creating Wikidata items, but are finding it hard to justify more activity without understanding the impact of these efforts. How might we do better to discover the impact of these GLAM engagements outside of our limited Commons/Wikipedia metrics?
- We know that both Commons and Wikidata have superlatives of their
own – Wiki Loves Monuments is the world's largest public photo contest and Wikidata has been the project that racks up the most edits of all the Wikimedia projects. But outside of our Wikimedia servers, it's hard to tell. We know anecdotally that libraries and archives use Wikidata extensively now for linked open data, with organizations like LD4 and IFLA asking for more Wikidata engagement. All major library databases in the world use Wikidata Q identifiers. But how might we capture that impact better, and on a regular basis?
- Finally, we come to the essay and Talk page mentioned above. My
concern is that since Wikipedia metrics are so easily available and are of such huge magnitude, the appeal to be fixated on them is overwhelming. It's easy to put Commons and Wikidata in a lesser corner as we don't have good methods to estimate their downstream impact. Much of the value of Commons and Wikidata are not people visiting the Commons image page, or the Wikidata item page, but rather the linkages and re-use in the open ecosystem – federated search, authority control records, multimedia visualizations. And because that's hard to measure, we risk always putting Commons and Wikidata into second-class status, when they should be seen as a different beast.
Apologies for the long-winded examples, but it does come down to this:
How might we make a more complete evaluation of the impact of Wikimedia's open content, so we can make better decisions for the future?
Wren mailing list -- wren@lists.wikimedia.org To unsubscribe send an email to wren-leave@lists.wikimedia.org
-- Dr Sara Thomas Programme Manager, Wikimedia UK 07803 505 172 https://wikimedia.org.uk/home/scotland/ https://eu-west-1.protection.sophos.com?d=wikimedia.org.uk&u=aHR0cHM6Ly93aWtpbWVkaWEub3JnLnVrL3dpa2kvV2lraW1lZGlhX2luX1Njb3RsYW5k&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=LytGRlU3d29DRlVVRmpqeVdnL3hsbTBMd0F1QjRFVUQ3KzZ1TE9sLzhKYz0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E
https://eu-west-1.protection.sophos.com?d=wikimedia.org.uk&u=aHR0cHM6Ly9kb25hdGUud2lraW1lZGlhLm9yZy51ay8=&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=dVJVVUpLZ1F2V3UzTU9HUVk0UmdtTzBobkE0UUNPUGNCdDRlbVgxdEgvMD0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E *I work part time, my usual days are Monday - Thursday.*
*Wikimedia UK* https://eu-west-1.protection.sophos.com?d=wikimedia.org.uk&u=aHR0cHM6Ly93aWtpbWVkaWEub3JnLnVrLw==&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=eXI4K0szdGlmcDE4TzJvUHc3TVJMKyt2Smt0U1VmaGVKbFpBK2srV1cvWT0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E is the national chapter for the global Wikimedia open knowledge movement.
Follow us on Twitter https://eu-west-1.protection.sophos.com?d=twitter.com&u=aHR0cHM6Ly90d2l0dGVyLmNvbS93aWtpbWVkaWF1aw==&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=Q3ZHYUEycDFjTjBackZaYVpkME5aU2ZvcDZmMTJPeXI3UUplSkxIeTFIcz0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E, Facebook https://eu-west-1.protection.sophos.com?d=facebook.com&u=aHR0cHM6Ly93d3cuZmFjZWJvb2suY29tL1dpa2ltZWRpYVVL&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=RVBhNVhlMmsrMU9IQ1hiT2RSWk91bmpLOWR2bGtSY3JYYTkrTjY2Rkt1az0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E, LinkedIn https://eu-west-1.protection.sophos.com?d=linkedin.com&u=aHR0cHM6Ly93d3cubGlua2VkaW4uY29tL2NvbXBhbnkvNDk2MTE5&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=VzRhZTgwRHpMYk5Eb0lMM0NOQWZ6NWdLRXhYbHNHSWdqNCs2SWF1dXl0az0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E, and Instagram https://eu-west-1.protection.sophos.com?d=instagram.com&u=aHR0cHM6Ly93d3cuaW5zdGFncmFtLmNvbS93aWtpbWVkaWF1ay8=&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=Y3dISnFYMTFrb0FnVGpuTVc0eFUwMnpGRjY4L2laTE1VNW93clZJWTRmUT0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E .
Wikimedia UK is a Registered Charity No.1144513 (England & Wales) SC048644 (Scotland). Company Limited by Guarantee registered in England and Scotland, Registered No. 6741827.
Registered Office Ground Floor, Europoint, 5 - 11 Lavington Street, London SE1 0NZ https://eu-west-1.protection.sophos.com?d=google.com&u=aHR0cHM6Ly9tYXBzLmdvb2dsZS5jb20vP3E9NSstKzExK0xhdmluZ3RvbitTdHJlZXQsK0xvbmRvbitTRTErME5aJmVudHJ5PWdtYWlsJnNvdXJjZT1n&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=NTQyMGxuVmt0c0JxUzBncXc4TWduWUJWcTVrYTFEQi9tMEdjNUVUNld0OD0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E .
Wikimedia UK is the UK chapter of a global Wikimedia movement. The Wikimedia projects are run by the Wikimedia Foundation (who operate Wikipedia, amongst other projects).
*Wikimedia UK is an independent non-profit charity with no legal control over Wikipedia nor responsibility for its contents.* _______________________________________________ Wren mailing list -- wren@lists.wikimedia.org To unsubscribe send an email to wren-leave@lists.wikimedia.org
-- -Andrew Lih Smithsonian Institution - Wikimedian at Large Metropolitan Museum of Art - Wikimedia strategist Previously: professor of journalism and communications, American University, Columbia University, University of Southern California
Email: andrew.lih@gmail.com, andrew@andrewlih.com WEB: https://muckrack.com/fuzheado https://eu-west-1.protection.sophos.com?d=muckrack.com&u=aHR0cHM6Ly9tdWNrcmFjay5jb20vZnV6aGVhZG8=&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=MnRMVHlxWUQzb09KYTlIRC9SQW85THBpMnA2Q3NvYm5zakt0WFJlRDllcz0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E PROJECT: Wikipedia Space: http://en.wikipedia.org/wiki/WP:WPSPACE https://eu-west-1.protection.sophos.com?d=wikipedia.org&u=aHR0cDovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9XUDpXUFNQQUNF&i=NjVhZmE0ZjY3MDExZmY1Y2Q3NDE3Yjkx&t=VUJ4aGxSMlFrR3MzMyt3S3J2OGFMWUdqeFNQSytkU0I2UzZ5SlZ3eVNuND0=&h=d66531452229495b8c2c91a2f769596f&s=AVNPUEhUT0NFTkNSWVBUSVYH9BwpN1vq0wfWrM95H--uNoJkZSu-S-SEneaeW0G6uP_c8mPWnSChQva98tFLw1E
Wren mailing list -- wren@lists.wikimedia.org To unsubscribe send an email to wren-leave@lists.wikimedia.org