Yes it's certainly a first draft!! :-) Thanks for trying it out. With the disambig pages, can you suggest how to detect them?

Ah, there's a couple of other bugs here: The page https://fr.wikisource.org/wiki/Accroupissements actually already has a WIkidata ID, but the ws-search database didn't know about it :-( probably because it was failing for a while on some weird problems. I've re-run the scraper, and now that work is showing up with it's proper Q-number: https://tools.wmflabs.org/ws-search/?title=Accroupissements&author=&… fr The idea with the quickstatements is that it'll only show it for works that are *not yet* linked to wikidata. This is where the disambig problem comes in, because there doesn't seem to be a simple way to determine what's an edition and what's a work without resorting to Wikidata. We could look at categories? Is it a truth universally acknowledged that pages in the categories defined as https://www.wikidata.org/wiki/Q15939659 are all disambiguation pages? That could work...

We want the disambiguation pages on Wikisource - I checked a few of these and there are a lot of women and "younger sons" in them that we want. Also, many can be connected to existing "family of ..." pages or name disambiguation pages - they definitely help enrich our understanding of the problems of disambiguation over time.

Sorry, I am much more of a Wikidatan than a Wikisourcerer! I was referring to items like this one https://www.wikidata.org/wiki/Q21125368

Le 31 oct. 2017 à 16:14, Thomas Pellissier Tanon <thomas(a)pellissier-tanon.fr> a écrit : Hello Sam, Thank you for this nice feature! I have created a few months ago a prototype of Wikisource to Wikidata importation tool for the French Wikisource based on the schema.org annotation I have added to the main header template (I definitely think we should move from our custom microformat to this schema.org markup that could be much more structured). It's not yet ready but I plan to move it forward in the coming weeks. A beginning of frontend to add to your Wikidata common.js is here: https://www.wikidata.org/wiki/User:Tpt/ws2wd.js We should probably find a way to merge the two projects. Cheers, Thomas _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

For the "work" concept, Italian Wikisource decided to create a real and new namespace, "Opera" (which means work). It's the one page where we store the links to multiple editions of a certain book we have. It's not a disambiguation page in the sense that a disambiguation page works with different books from different authors with the same title e.g. "Poems"... Aubrey

For the "work" concept, Italian Wikisource decided to create a real and new namespace, "Opera" (which means work).> It's the one page where we store the links to multiple editions of a certain book we have.> It's not a disambiguation page in the sense that a disambiguation page works with different books from different authors with the same title> e.g. "Poems"... Aubrey On Tue, Oct 31, 2017 at 4:17 PM, Thomas Pellissier Tanon <thomas@pellissier- tanon.fr> wrote:>> An other point: here is a link to your 'Wikidata project" on the _________________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Yes I think you're definitely right! The easier way to send Wikisource data to Wikidata is going to be a clever gadget that reads the microformat or schema'd info in each page. My hack was just a quick and easy test at getting some things added. :) Ultimately, I'm actually not that excited about working on the tools that we need to transfer the data. No no I don't mean that! Well, just that the end point we're aiming at is that a bunch of info *won't be* at all in Wikisource, but will be pulled from Wikidata, and so I am much more interested in making better tools for working with the data in Wikidata. :-) If you see what I mean. My idea with ws-search is that it will progressively pull more and more data from Wikidata, and only resort to HTML scraping where the data is missing from Wikidata. I'm attempting to encapsulate this logic in the `wikisource/api` PHP library. On Tue, 31 Oct 2017, at 11:14 PM, Thomas Pellissier Tanon wrote: that a écrit : referring to items like this one is even better (I totally forgot this kind of case). sure what this tools can even do for this). _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Yup, still true. We do at least have a common goal of structured HTML, as defined by http://schema.org/CreativeWork It sounds like Tpt's scraper will do wonders, if a Wikisource just complies to that. I think that's one of the next steps we need to take. I sort of figure from the English Wikisource point of view that we should do more on bringing data *in* from Wikidata, in our {{header}}, rather than working on making it easier to extract data *out* with microformats/structured-HTML. Well, we should do both, of course! :-) But my feeling from the process of getting Author data in from Wikidata is that the whole Wikidata integration becomes so much more worthwhile and clearer (and we sort out the various edge cases) when we're actively using it for real. But of course, each Wikisource is in a similar position. :-( And are we to all be developing the Lua scripts and templates in isolation? Indeed no! :-) We shall put them all toegther in our brave new Wikisource extension! :) —sam On Wed, 1 Nov 2017, at 04:03 PM, Andrea Zanni wrote: @Sam, Tpt, my personal experience is too that HTML is the way to pull out the Wikisource important metadata, but it's also that every Wikisource has sort of a different way to show them, meaning that you need to tweak your scraper for each Wikisource. Is that still true? Last time I did it was more than one year ago, but I need to try it again soon. Aubrey On Wed, Nov 1, 2017 at 1:00 AM, Sam Wilson &lt;sam(a)samwilson.id.au&gt; wrote: Yes I think you're definitely right! The easier way to send Wikisource data to Wikidata is going to be a clever gadget that reads the microformat or schema'd info in each page. My hack was just a quick and easy test at getting some things added. :) Ultimately, I'm actually not that excited about working on the tools that we need to transfer the data. No no I don't mean that! Well, just that the end point we're aiming at is that a bunch of info *won't be* at all in Wikisource, but will be pulled from Wikidata, and so I am much more interested in making better tools for working with the data in Wikidata. :-) If you see what I mean. My idea with ws-search is that it will progressively pull more and more data from Wikidata, and only resort to HTML scraping where the data is missing from Wikidata. I'm attempting to encapsulate this logic in the `wikisource/api` PHP library. On Tue, 31 Oct 2017, at 11:14 PM, Thomas Pellissier Tanon wrote: that a écrit : referring to items like this one is even better (I totally forgot this kind of case). sure what this tools can even do for this). _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l *_______________________________________________* Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Authors from Italian Wikisource have already a lot (if not all) metadata on Wikidata:> authors are *easy* compared to books (don't have the whole work- edition issue),> so I think that users Candalua, Alex brollo and others solved this problem long ago.> When you've copied all the metadata from WS authors to WD items (phase 1),> you then need a system in place to * pull the data from WD and put it in WS (Lua templates or something)> * maintain it (the templates need to remind the user to go to WD and update the information)> This is phase 2. Unfortunately, for books we're always pre-phase 1 :-( Aubrey On Wed, Nov 1, 2017 at 10:15 AM, Jane Darnell &lt;jane023(a)gmail.com&gt; wrote:>> Yes you definitely need this flow of useful&visible interproject _________________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Hey everyone, I seize the opportunity of this planed import to make you aware that I started a project research on Wikiversity about Wikidata and its license : https://fr.wikiversity.org/wiki/Recherche:La_licence_CC- 0_de_Wikidata,_origine_du_choix,_enjeux,_et_prospections_sur_les_aspects_ de_gouvernance_communautaire_et_d%E2%80%99%C3%A9quit%C3%A9_contributive Admittedly, a driving force behind the launch of this project is an intuitive aversion against CC0, and the will of the Wikidata team to launch their lexicological solution with, without, or even against Wiktionary communities. But as intuition is never as useful as when feeding hypotheses of rational inquiry whose conclusions might reject it, I thought preferable to make such a research project so I could stand on a firmer vision of implications of this choice. Also, whatever one might ethically feel about this topic is one thing, legal issues is a really different matter. So far, I have didn't found any evidence of a serious inquiry of letting people make mass import of data within Wikidata. But hopefully I'll soon be given links showing such an inquiry was indeed performed. Not requiring source and evidence of a free license covering imported data is a great way to put at risk of massive legal infraction, not only the Wikidata project, but anyone who reuse its data. I welcome any source that you might judge valuable for the research project evoked above. That is anything speaking about how the license was chose, opinion of the community regarding this choice, ins and outs of the reuse ability, what notable partnership was ease or prevented due to the license, how external reusers do or do not give back through one form (better curated or enlarged set of data), or an other (technical advises, institutional promotion, funds…), and anything you think worth mentioning regarding Wikidata license. It would be kind to check it is not already in the list of sources I fetched so far, see https://fr.wikiversity.org/ wiki/Recherche:La_licence_CC-0_de_Wikidata,_origine_du_choix,_enjeux,_et_ prospections_sur_les_aspects_de_gouvernance_communautaire_ et_d%E2%80%99%C3%A9quit%C3%A9_contributive/Wikidata_:_les_ origines_du_choix_de_CC-0#Notes_et_r.C3.A9ferences Also let me know if you would be interested with a translation. So far I'm writing it in my native language to hasten the draft outcome and I don't necessarily expect huge interest for the subject beyond myself. But if people show interest, or even would like to contribute, I can switch to Esperanto, or even the less likely demand of an English version. ;) Inquirely, psychoslave Le 31/10/2017 à 16:14, Thomas Pellissier Tanon a écrit : Hello Sam, Thank you for this nice feature! I have created a few months ago a prototype of Wikisource to Wikidata importation tool for the French Wikisource based on the schema.org annotation I have added to the main header template (I definitely think we should move from our custom microformat to this schema.org markup that could be much more structured). It's not yet ready but I plan to move it forward in the coming weeks. A beginning of frontend to add to your Wikidata common.js is here: https://www.wikidata.org/wiki/User:Tpt/ws2wd.js We should probably find a way to merge the two projects. Cheers, Thomas Le 31 oct. 2017 à 15:10, Nicolas VIGNERON &lt;vigneron.nicolas(a)gmail.com&gt; &lt;vigneron.nicolas(a)gmail.com&gt; a écrit : 2017-10-31 13:16 GMT+01:00 Jane Darnell &lt;jane023(a)gmail.com&gt; &lt;jane023(a)gmail.com&gt;om>: Sorry, I am much more of a Wikidatan than a Wikisourcerer! I was referring to items like this onehttps://www.wikidata.org/wiki/Q21125368 No need to be sorry, that is actually a good question and this example is even better (I totally forgot this kind of case). For now, this is probably better to deal with it by hands (and I'm not sure what this tools can even do for this). Cdlt, ~nicolas _______________________________________________ Wikisource-l mailing listWikisource-l@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikisource-l _______________________________________________ Wikisource-l mailing listWikisource-l@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikisource-l _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l