Wikisource-l

wikisource-l@lists.wikimedia.org

2 participants
1306 discussions

Re: [Wikisource-l] Do we have tools for offline collaboration?
by mathieu stumpf guntz 13 Apr '18

13 Apr '18

Good to know. I consulted the website of ABBYY and it say one option is an "Open license for local use on workstations", but I guess it's not a FLOSS license, unfortunately. By the way, what is the state of the affair regarding Indic languages? Do we have a central page documenting existing OCR pipeline used by the wikisource community? What should I say to a contributor which come to me asking "I have this old PD book in my personnal library that I would like to digitalize, share and proofread in Wikisource, where should I start?". Do we have an online service, for example on tool labs, which enable to either upload or simply input url of a facsimile and that launch the OCR for example backed on tesseract? Shouldn't we update our roadmap[1], or is there a more up to date document elsewhere? [1] https://meta.wikimedia.org/wiki/Wikisource_roadmap Le 13/04/2018 à 08:28, Nahum Wengrov a écrit : > I use ABBYY Finereader, don't remember the exact version (probably 12 > or 11). I bought it a few years ago and it works perfectly for my > language (Hebrew). > > On Fri, Apr 13, 2018 at 2:22 AM, mathieu stumpf guntz > <psychoslave(a)culture-libre.org <mailto:psychoslave@culture-libre.org>> > wrote: > > Thank you Nahum, > > Could you indicate which OCR solution you are using? > > > Le 26/03/2018 à 17:27, Nahum Wengrov a écrit : >> I frequently work offline on he.wikisource. I download the entire >> pdf file from commons to my hard drive, and OCR the page I need >> myself. One can use the OCR of wikisource and download the text >> too, I guess, page by page. Then I proof the text in a Word >> document, open to the lower half of my screen, with the pdf open >> on the upper half of the screen, where I go to the page I need >> with acrobat reader, and scroll both windows down or up as needed. >> >> On Mon, Mar 26, 2018 at 11:21 AM, mathieu stumpf guntz >> <psychoslave(a)culture-libre.org >> <mailto:psychoslave@culture-libre.org>> wrote: >> >> Le 24/03/2018 à 16:22, billinghurst a écrit : >>> Though that would defeat the purpose of online proofreading >>> with account verification. Some of the true value of our >>> online process is that contribution builds a level of trust >>> and knowledge and that is reflected in both our patrolling >>> and the allocation of autopatrolled status. >> How providing tools to make batch work offline would >> interfere in anyway with that? Once the work is done, it can >> be uploaded to Wikisource with whichever account the user want. >> >> Actually, to my mind, the main benefit of the online aspect >> is the peer to peer production model. Also there is no need >> of a central node carrying accounts to take into account the >> trust given to a particular contributor. There is digital >> signature technologies such as gpg for example. Having a >> central node with a web interface just makes things easier >> for most users, it doesn't improve the trustability of the >> environment. On the contrary, with a single point of failure, >> we actually rely on a weaker solution on this regard. >> >>> Also how would you have access to templates, and components >>> like that from off-line? >> Well, that just show how innefecient are this tools to >> continue to contribute while being offline. It's allways >> possible to install Mediawiki and download required >> templates, but currently this process seems way to >> complicated, doesn't it. >> >>> >>> Also we generally cannot download the images separately as >>> that is usually part of the later clean-up where people have >>> the technical skills. >> I'm afraid the term "image" misguided your answer. It's seems >> you interpreted that as picture elements from files, while I >> was talking about this files themselves. >> >>> So yes, there is the capacity to have the text and proofread >>> the text, that actual checking the text against the image is >>> not the sole component of proofreading, and further it would >>> not be at all helpful for validation. >> There is nothing magic about working directly in a browser. >> People do download and upload all the required material >> anyway, but on a page per page base. The result is just as >> valid as it is done when transactions are operated on a file >> repository level. >> >> Cheers >> >> _______________________________________________ >> Wikisource-l mailing list >> Wikisource-l(a)lists.wikimedia.org >> <mailto:Wikisource-l@lists.wikimedia.org> >> https://lists.wikimedia.org/mailman/listinfo/wikisource-l >> <https://lists.wikimedia.org/mailman/listinfo/wikisource-l> >> >> >> >> >> _______________________________________________ >> Wikisource-l mailing list >> Wikisource-l(a)lists.wikimedia.org >> <mailto:Wikisource-l@lists.wikimedia.org> >> https://lists.wikimedia.org/mailman/listinfo/wikisource-l >> <https://lists.wikimedia.org/mailman/listinfo/wikisource-l> > >

3 2

Do we have tools for offline collaboration?
by mathieu stumpf guntz 13 Apr '18

13 Apr '18

Hello, A person in a local Wikisource workshop asked me if we could download all material of a specific work to proofread it offline. So download both the pictures and the OCRed text. Additionaly I think it would be good to provide tool to at least have side by side plain text and pictures. So, are you aware of anything close to such a tool? :) Cheers

4 5

Bold try running into it.source
by Alex Brollo 11 Apr '18

11 Apr '18

We are testing a trick, useful for IA items where there's no djvu file but there's a _djvu.xml file. _djvu.xml file is splitted into pages and uploaded "as it is" as page text. An jQuery script can parse xml and convert it into an excellent plain text. The same trick runs both in djvu and in pdf based Index pages. Another advantage is that mapped text is saved as first version of page content and that it can be recovered and used with no external tool. While parsing xml, the same script can fix too some FineReader severe mistakes from wrong analysis of text layout (wrong splitting of text into columns/regions) using words coordinates. Alex brollo

1 0

Pages where template include size is exceeded
by balaji 07 Apr '18

07 Apr '18

Hi, I have created a transclusion page in ta.wikisource where some pages are not displayed. A localised category which in English means "Pages where template include size is exceeded" https://translatewiki.net/wiki/MediaWiki:Post-expand-template-inclusion-cat… https://translatewiki.net/wiki/MediaWiki:Post-expand-template-inclusion-cat… The page is https://ta.wikisource.org/s/8wuc What to be done for all the pages to be displayed. Regards, J. Balaji (User:Balajijagadesh)

2 1

Re: [Wikisource-l] Pages where template include size is exceeded
by ankry.wiki 07 Apr '18

07 Apr '18

Hi, Unfortunately, MediaWiki has some strict limits which are easily hit if creating large pages or ineffective code. You can see parser profiling data (and limits currently set) in the bottom of a preview page. We encounter this problem in plwikisource on some really large pages, like: https://pl.wikisource.org/wiki/Faraon/ca%C5%82o%C5%9B%C4%87 where there is a lot of transcluded text; and out solution here was to use substitution (see the code on the talk page of this page) and handle updates of substituted pages by bot. But this is not your case. IMO, your problem is that templates you use on the transcluded pages multiple times should be as simple as possible, avoiding calling other templates (especially if they also call templates, calling templates, ...). As you can see previewing this page in wikicode mode: https://ta.wikisource.org/w/index.php?title=பக்கம்:எனது_நாடகவாழ்க்கை.pdf/19… it generates over 110kB of transcluded code. A lot. And I can see two possible solutions here: - simplify the TOC templates (actually, it is more effective to use many simple dedicated templates than a single combo), or - use a LUA module to process all necessary parameters and generate expected wikicode avoiding transferring parameters multiple times. The latter solution is used in fr.ws & pl.ws; see https://pl.wikisource.org/wiki/Szablon:SpisPozycja and https://pl.wikisource.org/wiki/Modu%C5%82:Spis (based on: https://fr.wikisource.org/wiki/Module:Table ) In higly-used templates even removal of a not necessary space, semicolon, as well as shortening HTML ids, style names, template names or parameters names gives sometimes a significant effect. Ankry W dniu 2018-04-07 08:04:20 użytkownik balaji <balajijagadesh(a)gmail.com> napisał: Hi, I have created a transclusion page in ta.wikisource where some pages are not displayed. A localised category which in English means "Pages where template include size is exceeded" https://translatewiki.net/wiki/MediaWiki:Post-expand-template-inclusion-cat… https://translatewiki.net/wiki/MediaWiki:Post-expand-template-inclusion-cat… The page is https://ta.wikisource.org/s/8wuc What to be done for all the pages to be displayed. Regards, J. Balaji (User:Balajijagadesh)

1 0

Wikidata property for non-fiction characters
by Bodhisattwa Mandal 06 Apr '18

06 Apr '18

Hi, is there any Wikidata property for characters depicted in non-fiction literatures? I found Properties like characters (P674) for fictions, depicts (P180) for works like paintings, main subject (P921) for primary topic of a work, but couldn't find something for non-fictions. Am I missing something? -- Bodhisattwa

3 4

Djvu format fate
by Alex Brollo 06 Apr '18

06 Apr '18

As you know, djvu format is an excellent and open format, but its fate is uncertain since it is overwhelmed by pdf, surely excellent, but closed and very difficult to manage. Even if a small part of djvu features are used by mediawiki, djvu in a necessary tool for wikisource work. Unluckily, there's no sufficient work about djvu, and I see that recently ABBYY discontinued the support of djvu format as output in its OCR engines. This is probably the cause of discontinuation of djvu files output bi Internet Archive. Is it possible to encourage MediaWiki to devoid sufficient energies to save djvu format to its fate? Alex brollo

5 5

Re: [Wikisource-l] [WMCON18] Organizational profile for Wikisource Community User Group
by Nicolas VIGNERON 05 Apr '18

05 Apr '18

Hi wikisourcerers, Hi Balaji, For the Wikimedia Conference in 10 days we need to fill a short profil summary for our group (here some photos of the last year's pofiles: https://commons.wikimedia.org/wiki/Category:Wikimedia_Conference_2017_–_Org… ). Here is the questions : https://etherpad.wikimedia.org/p/WS-WMCON What would *you* answer? (I made some suggestions but I'd like to hear from you). Cheers, ~nicolas

1 0

Re: [Wikisource-l] Frankenstein's 200th birthday
by ankry.wiki 05 Apr '18

05 Apr '18

The oldest Polish translation was published in 1958. As the translator death date is unknown (he may be still alive), we cannot publish it in plwikisource before 2099. Ankry W dniu 2018-04-05 01:09:41 użytkownik billinghurst <billinghurstwiki(a)gmail.com> napisał: A thought bubble that I shared on enWS was whether the broader Wikisource community had an interest in getting English language and available translations online in 2018. I thought it would be a bit of a wikimedia talking point if we could do soemthing for such an iconic work. For non-English languages are there scans available of public domain translations? I know that enWS and frWS have 1831 editions, though not scan-supported. Regards, Billinghurst

3 2

Frankenstein's 200th birthday
by billinghurst 05 Apr '18

05 Apr '18

A thought bubble that I shared on enWS was whether the broader Wikisource community had an interest in getting English language and available translations online in 2018. I thought it would be a bit of a wikimedia talking point if we could do soemthing for such an iconic work. For non-English languages are there scans available of public domain translations? I know that enWS and frWS have 1831 editions, though not scan-supported. Regards, Billinghurst

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

Wikisource-l