Wikisource related projects - Wikisource-l

Jayanta Nath

4 Dec 4 Dec

12:24 a.m.

This is great!!! Sometimes its impossible to every time download from AI, Google books 100MB file and again upload to commons 100MB file. I am from India, internet is very slow!!! It will help me lots!! On Wed, Dec 4, 2013 at 1:37 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote:

...

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813 https://bugzilla.wikimedia.org/show_bug.cgi?id=57812 Feel free to CC yourself, or even better to work/find someone willing to work on them :-) Aubrey _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Reply

Jayanta Nath

2:49 a.m.

Hi Zanni, On Indian context of Indian pint of view, Books are not readily available in Archive.org or google book. We have a great resource at Digital Library of India] ( All Indic language books available). As like others India Govt website , this site same issue about poor Navigations, Online reading, downloading, Server error/down etc. They have just dump as tif file. So we can't do better proofread as like EN.WS. I know this not the right place to state, can any developers works for us, to upload books from Digital Library of India to commons or Wikimedia WS project domain? I am using https://toolserver.org/~tpt/iaUploadBot/step1.php and https://tools.wmflabs.org/url2commons/ both. Fist one is only for DJVU file. Some of our Indic language books not available in DJVU file in Archive.org. 1) http://www.dli.ernet.in/ Jayanta On Wed, Dec 4, 2013 at 2:13 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote:

...

Hi Jayanta, have you ever tried to use this tool from our beloved wizard Tpt? https://toolserver.org/~tpt/iaUploadBot/step1.php It is very simple and useful. Aubrey On Wed, Dec 4, 2013 at 9:24 AM, Jayanta Nath <jayantanth(a)gmail.com> wrote:

This is great!!! Sometimes its impossible to every time download from AI, Google books 100MB file and again upload to commons 100MB file. I am from India, internet is very slow!!! It will help me lots!! On Wed, Dec 4, 2013 at 1:37 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote:

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813 https://bugzilla.wikimedia.org/show_bug.cgi?id=57812 Feel free to CC yourself, or even better to work/find someone willing to work on them :-) Aubrey _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

_______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Reply

Jayanta Nath

4:20 a.m.

Hi Aubrey Unfortunately I , myself on board in Wikimedia Chapter ( Executive committee Member!). Personally I am very much attached with Wikimedia movement in India. Actually that's not a big deal. I follow the below workflow... 1) Download books from Digital Library of India ( single page single tif file). 2) Upload as PDF (You can put them in a zipped file and upload everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is good for me.) Let's try next time. But when I upload as PDF , I cannot find any DJVU file. 3)Transfer file in commons. https://toolserver.org/~tpt/iaUploadBot/step1.php this utility is only for upload DJVU file. ( If I upload "FILENAME_images.zip" at archive.org, Are they converted as DJVU?) Jayanta On Wed, Dec 4, 2013 at 5:08 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote:

...

Hi Jayanta, I now understand you have a deeper problem than I thought. My advice would be to seek for a collaboration with the Digital Library of India, or with Wikimedia India (http://wiki.wikimedia.in/Main_Page) and ask them to help you in transferring those file. I still think the better workflow is to 1. upload the files in Internet Archive. If you have tiff files, this is perfect. You can put them in a zipped file and upload everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is very good as Internet Archive is great at converting files, doing OCR and stuff like that. You can find the instructions here too: https://en.wikisource.org/wiki/Help:DjVu_files#The_Internet_Archive 2. when everything is ready (all the files are created), go with https://toolserver.org/~tpt/iaUploadBot/step1.php : you put the id inside, and it will upload the file on Commons. 3. you're set: you go on Wikisource and create the Index. Aubrey On Wed, Dec 4, 2013 at 11:49 AM, Jayanta Nath <jayantanth(a)gmail.com>wrote;wrote:

Hi Zanni, On Indian context of Indian pint of view, Books are not readily available in Archive.org or google book. We have a great resource at Digital Library of India] ( All Indic language books available). As like others India Govt website , this site same issue about poor Navigations, Online reading, downloading, Server error/down etc. They have just dump as tif file. So we can't do better proofread as like EN.WS. I know this not the right place to state, can any developers works for us, to upload books from Digital Library of India to commons or Wikimedia WS project domain? I am using https://toolserver.org/~tpt/iaUploadBot/step1.php and https://tools.wmflabs.org/url2commons/ both. Fist one is only for DJVU file. Some of our Indic language books not available in DJVU file in Archive.org. 1) http://www.dli.ernet.in/ Jayanta On Wed, Dec 4, 2013 at 2:13 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote:

Hi Jayanta, have you ever tried to use this tool from our beloved wizard Tpt? https://toolserver.org/~tpt/iaUploadBot/step1.php It is very simple and useful. Aubrey On Wed, Dec 4, 2013 at 9:24 AM, Jayanta Nath <jayantanth(a)gmail.com>wrote;wrote:

This is great!!! Sometimes its impossible to every time download from AI, Google books 100MB file and again upload to commons 100MB file. I am from India, internet is very slow!!! It will help me lots!! On Wed, Dec 4, 2013 at 1:37 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote: > Here there are 2 bugs related to Wikisource: > https://bugzilla.wikimedia.org/show_bug.cgi?id=57813 > > https://bugzilla.wikimedia.org/show_bug.cgi?id=57812 > > Feel free to CC yourself, or even better to work/find someone willing > to work on them :-) > > Aubrey > > _______________________________________________ > Wikisource-l mailing list > Wikisource-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikisource-l > > _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

_______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Reply

Jayanta Nath

4:43 a.m.

Many Many thanks its help me lots. Our GLAM project initiated , but we have big Red-tape in our Govt Departments! Just I have uploaded in Archive.org https://archive.org/details/OneHundredPoemsKabir1915 On Wed, Dec 4, 2013 at 5:58 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote:

...

Unfortunately I , myself on board in Wikimedia Chapter ( Executive

committee Member!). Personally I am very much attached with Wikimedia movement in India. Actually that's not a big deal. :-)

Well, you could contact as Wikimedia India the DLI, and try to set up a partnership.

I follow the below workflow... 1) Download books from Digital Library of India ( single page single tif file).

Maybe you can use a script to download all the TIFF files of a book. Put them in a single folder, sorted. Zip that folder as I said (FILENAME_images.zip). The IA software will do all the rest: it will make you a PDF, a DJVU, everything by itself. the trick is giving him all the single images in a zip folder with that name.

2) Upload as PDF (You can put them in a zipped file and upload everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is good for me.) Let's try next time. But when I upload as PDF , I cannot find any DJVU file. 3)Transfer file in commons. https://toolserver.org/~tpt/iaUploadBot/step1.php this utility is only for upload DJVU file. ( If I upload "FILENAME_images.zip" at archive.org, Are they converted as DJVU?)

Then, as IA has finished, you take the id (not of the djvu, but of the book itself on IA: for example, here ( https://archive.org/details/fioannisnauarrog00nava) the id is " fioannisnauarrog00nava<https://archive.org/details/fioannisnauarrog00nav… ". Then everything is ok. Aubrey

Jayanta On Wed, Dec 4, 2013 at 5:08 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote:

Hi Jayanta, I now understand you have a deeper problem than I thought. My advice would be to seek for a collaboration with the Digital Library of India, or with Wikimedia India (http://wiki.wikimedia.in/Main_Page) and ask them to help you in transferring those file. I still think the better workflow is to 1. upload the files in Internet Archive. If you have tiff files, this is perfect. You can put them in a zipped file and upload everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is very good as Internet Archive is great at converting files, doing OCR and stuff like that. You can find the instructions here too: https://en.wikisource.org/wiki/Help:DjVu_files#The_Internet_Archive 2. when everything is ready (all the files are created), go with https://toolserver.org/~tpt/iaUploadBot/step1.php : you put the id inside, and it will upload the file on Commons. 3. you're set: you go on Wikisource and create the Index. Aubrey On Wed, Dec 4, 2013 at 11:49 AM, Jayanta Nath <jayantanth(a)gmail.com>wrote;wrote:

Hi Zanni, On Indian context of Indian pint of view, Books are not readily available in Archive.org or google book. We have a great resource at Digital Library of India] ( All Indic language books available). As like others India Govt website , this site same issue about poor Navigations, Online reading, downloading, Server error/down etc. They have just dump as tif file. So we can't do better proofread as like EN.WS. I know this not the right place to state, can any developers works for us, to upload books from Digital Library of India to commons or Wikimedia WS project domain? I am using https://toolserver.org/~tpt/iaUploadBot/step1.php and https://tools.wmflabs.org/url2commons/ both. Fist one is only for DJVU file. Some of our Indic language books not available in DJVU file in Archive.org. 1) http://www.dli.ernet.in/ Jayanta On Wed, Dec 4, 2013 at 2:13 PM, Andrea Zanni <zanni.andrea84(a)gmail.com>wrote;wrote: > Hi Jayanta, > have you ever tried to use this tool from our beloved wizard Tpt? > https://toolserver.org/~tpt/iaUploadBot/step1.php > It is very simple and useful. > > Aubrey > > > On Wed, Dec 4, 2013 at 9:24 AM, Jayanta Nath <jayantanth(a)gmail.com>wrote;wrote: > >> This is great!!! Sometimes its impossible to every time download from >> AI, Google books 100MB file and again upload to commons 100MB file. I am >> from India, internet is very slow!!! It will help me lots!! >> >> >> On Wed, Dec 4, 2013 at 1:37 PM, Andrea Zanni < >> zanni.andrea84(a)gmail.com> wrote: >> >>> Here there are 2 bugs related to Wikisource: >>> https://bugzilla.wikimedia.org/show_bug.cgi?id=57813 >>> >>> https://bugzilla.wikimedia.org/show_bug.cgi?id=57812 >>> >>> Feel free to CC yourself, or even better to work/find someone >>> willing to work on them :-) >>> >>> Aubrey >>> >>> _______________________________________________ >>> Wikisource-l mailing list >>> Wikisource-l(a)lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/wikisource-l >>> >>> >> >> _______________________________________________ >> Wikisource-l mailing list >> Wikisource-l(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikisource-l >> >> > > _______________________________________________ > Wikisource-l mailing list > Wikisource-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikisource-l > > _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

_______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Reply

Pierre Yves Beaudouin

8:41 a.m.

You should activate 2 things in the preference : - Mostra barra degli strumenti di modifica [Show edit toolbar] - Abilita barra degli strumenti di modifica avanzata [Enable enhanced editing toolbar] Pyb 2013/12/4 Andrea Zanni <zanni.andrea84(a)gmail.com>

...

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813 https://bugzilla.wikimedia.org/show_bug.cgi?id=57812 Feel free to CC yourself, or even better to work/find someone willing to work on them :-) Aubrey _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Reply

Yann Forget

2:14 p.m.

2013/12/5 Jayanta Nath <jayantanth(a)gmail.com>

...

Hi Yann, Thank you for sharing this add-on and website. This site may very useful for sa.wikisource.org.

Yes, I will upload some of these books and tell them.

...

I am working on my native wikisource bengali. Can you help us to develop OCR for Bengali?

Unfortunately, Bengali may not even exist in commercial software, although I know a French company which is making OCR for Indian languages, it will take some time. Bengali is not available in Abby FineReader 11 Professional Editon, which is the leading world software for OCR. However several dozens of languages are available: all European languages, Latin, Greek, Russian, Chinese, Japanese, Korean, Arabic, several African languages, etc., but no Indian language is available in the list. It is what Internet Archive uses. Developing OCR is a very long and complex work. And I don't speak Bengali, so I can't help much. However I can help creating PDF and/or DJVU files, and uploading them. Best regards, Yann

Reply

Jayanta Nath

10:31 p.m.

Hi Asaf , Thank you for helping us. Presently I am personally working this for my native Bengali Wikisource. There some program (1,2,3,4) available on web to download Books from DLI website. It may help for you too! Sometimes I am facing the big issue with this utility from service side not available or down for few moments. 1) http://sanskritdocuments.org/scannedbooks/dlidownloader/ 2) http://dlidownloader.wordpress.com/ 3) http://code.google.com/p/dli-downloader/ 4) http://techstunted.blogspot.in/2013/03/downloading-books-from-digital-libra… Another issue I found at Internet Archive, I have uploaded some books in PDF format in AI here [1], but no boos have converted to DJVU , because, they are saying that A DjVu can only be made if the language of the book is OCRable. At this time we are not able to OCR Bengali. I know PDF will also accepted format in WS, but I would preferred DJVU. 1) https://archive.org/search.php?query=uploader%3A%22jayantanth%40gmail.com%2… I shall send a mail for download list to you off-list. Jayanta On Fri, Dec 6, 2013 at 4:49 AM, Asaf Bartov <abartov(a)wikimedia.org> wrote:

...

Jayanta, I'm also happy to help, if bandwidth is a problem. If you send me a list of URLs of books at the DLI that you'd like me to download and upload to the Internet Archive for you, I'm happy to do it. A. On Wed, Dec 4, 2013 at 2:14 PM, Yann Forget <yannfo(a)gmail.com> wrote:

2013/12/5 Jayanta Nath <jayantanth(a)gmail.com>

Hi Yann, Thank you for sharing this add-on and website. This site may very useful for sa.wikisource.org.

Yes, I will upload some of these books and tell them.

I am working on my native wikisource bengali. Can you help us to develop OCR for Bengali?

Unfortunately, Bengali may not even exist in commercial software, although I know a French company which is making OCR for Indian languages, it will take some time. Bengali is not available in Abby FineReader 11 Professional Editon, which is the leading world software for OCR. However several dozens of languages are available: all European languages, Latin, Greek, Russian, Chinese, Japanese, Korean, Arabic, several African languages, etc., but no Indian language is available in the list. It is what Internet Archive uses. Developing OCR is a very long and complex work. And I don't speak Bengali, so I can't help much. However I can help creating PDF and/or DJVU files, and uploading them. Best regards, Yann _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

-- Asaf Bartov Wikimedia Foundation <http://www.wikimediafoundation.org> Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! https://donate.wikimedia.org _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Reply

Pierre Yves Beaudouin

4 Dec 4 Dec

11:46 a.m.

oups wrong thread 2013/12/4 Pierre Yves Beaudouin <pierre.beaudouin(a)gmail.com>

...

You should activate 2 things in the preference : - Mostra barra degli strumenti di modifica [Show edit toolbar] - Abilita barra degli strumenti di modifica avanzata [Enable enhanced editing toolbar] Pyb 2013/12/4 Andrea Zanni <zanni.andrea84(a)gmail.com>

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813 https://bugzilla.wikimedia.org/show_bug.cgi?id=57812 Feel free to CC yourself, or even better to work/find someone willing to work on them :-) Aubrey _______________________________________________ Wikisource-l mailing list Wikisource-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Reply