Hi Jayanta, have you ever tried to use this tool from our beloved wizard Tpt? https://toolserver.org/~tpt/iaUploadBot/step1.php It is very simple and useful.

Aubrey

On Wed, Dec 4, 2013 at 9:24 AM, Jayanta Nath jayantanth@gmail.com wrote:

This is great!!! Sometimes its impossible to every time download from AI, Google books 100MB file and again upload to commons 100MB file. I am from India, internet is very slow!!! It will help me lots!!

On Wed, Dec 4, 2013 at 1:37 PM, Andrea Zanni zanni.andrea84@gmail.comwrote:

...

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813

https://bugzilla.wikimedia.org/show_bug.cgi?id=57812

Feel free to CC yourself, or even better to work/find someone willing to work on them :-)

Aubrey

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Hi Jayanta, I now understand you have a deeper problem than I thought.

My advice would be to seek for a collaboration with the Digital Library of India, or with Wikimedia India (http://wiki.wikimedia.in/Main_Page) and ask them to help you in transferring those file.

I still think the better workflow is to

1. upload the files in Internet Archive. If you have tiff files, this is perfect. You can put them in a zipped file and upload everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is very good as Internet Archive is great at converting files, doing OCR and stuff like that. You can find the instructions here too: https://en.wikisource.org/wiki/Help:DjVu_files#The_Internet_Archive

2. when everything is ready (all the files are created), go with https://toolserver.org/~tpt/iaUploadBot/step1.php : you put the id inside, and it will upload the file on Commons.

3. you're set: you go on Wikisource and create the Index.

Aubrey

On Wed, Dec 4, 2013 at 11:49 AM, Jayanta Nath jayantanth@gmail.com wrote:

Hi Zanni,

On Indian context of Indian pint of view, Books are not readily available in Archive.org or google book. We have a great resource at Digital Library of India] ( All Indic language books available). As like others India Govt website , this site same issue about poor Navigations, Online reading, downloading, Server error/down etc. They have just dump as tif file. So we can't do better proofread as like EN.WS. I know this not the right place to state, can any developers works for us, to upload books from Digital Library of India to commons or Wikimedia WS project domain?

I am using https://toolserver.org/~tpt/iaUploadBot/step1.php and https://tools.wmflabs.org/url2commons/ both. Fist one is only for DJVU file. Some of our Indic language books not available in DJVU file in Archive.org.

1. http://www.dli.ernet.in/

Jayanta

On Wed, Dec 4, 2013 at 2:13 PM, Andrea Zanni zanni.andrea84@gmail.comwrote:

...

Hi Jayanta, have you ever tried to use this tool from our beloved wizard Tpt? https://toolserver.org/~tpt/iaUploadBot/step1.php It is very simple and useful.

Aubrey

On Wed, Dec 4, 2013 at 9:24 AM, Jayanta Nath jayantanth@gmail.comwrote:

...

This is great!!! Sometimes its impossible to every time download from AI, Google books 100MB file and again upload to commons 100MB file. I am from India, internet is very slow!!! It will help me lots!!

On Wed, Dec 4, 2013 at 1:37 PM, Andrea Zanni zanni.andrea84@gmail.comwrote:

...

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813

https://bugzilla.wikimedia.org/show_bug.cgi?id=57812

Feel free to CC yourself, or even better to work/find someone willing to work on them :-)

Aubrey

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Unfortunately I , myself on board in Wikimedia Chapter ( Executive committee Member!). Personally I am very much attached with Wikimedia movement in India. Actually that's not a big deal.

:-)

Well, you could contact as Wikimedia India the DLI, and try to set up a partnership.

I follow the below workflow...

1. Download books from Digital Library of India ( single page single tif

file).

Maybe you can use a script to download all the TIFF files of a book. Put them in a single folder, sorted. Zip that folder as I said (FILENAME_images.zip). The IA software will do all the rest: it will make you a PDF, a DJVU, everything by itself. the trick is giving him all the single images in a zip folder with that name.

2. Upload as PDF (You can put them in a zipped file and upload

everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is good for me.) Let's try next time. But when I upload as PDF , I cannot find any DJVU file.

3)Transfer file in commons. https://toolserver.org/~tpt/iaUploadBot/step1.php this utility is only for upload DJVU file. ( If I upload "FILENAME_images.zip" at archive.org, Are they converted as DJVU?)

Then, as IA has finished, you take the id (not of the djvu, but of the book itself on IA: for example, here ( https://archive.org/details/fioannisnauarrog00nava) the id is " fioannisnauarrog00nava https://archive.org/details/fioannisnauarrog00nava ". Then everything is ok.

Aubrey

Jayanta

On Wed, Dec 4, 2013 at 5:08 PM, Andrea Zanni zanni.andrea84@gmail.comwrote:

...

Hi Jayanta, I now understand you have a deeper problem than I thought.

My advice would be to seek for a collaboration with the Digital Library of India, or with Wikimedia India (http://wiki.wikimedia.in/Main_Page) and ask them to help you in transferring those file.

I still think the better workflow is to

1. upload the files in Internet Archive. If you have tiff files, this is

perfect. You can put them in a zipped file and upload everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is very good as Internet Archive is great at converting files, doing OCR and stuff like that. You can find the instructions here too: https://en.wikisource.org/wiki/Help:DjVu_files#The_Internet_Archive

2. when everything is ready (all the files are created), go with

https://toolserver.org/~tpt/iaUploadBot/step1.php : you put the id inside, and it will upload the file on Commons.

3. you're set: you go on Wikisource and create the Index.

Aubrey

On Wed, Dec 4, 2013 at 11:49 AM, Jayanta Nath jayantanth@gmail.comwrote:

...

Hi Zanni,

On Indian context of Indian pint of view, Books are not readily available in Archive.org or google book. We have a great resource at Digital Library of India] ( All Indic language books available). As like others India Govt website , this site same issue about poor Navigations, Online reading, downloading, Server error/down etc. They have just dump as tif file. So we can't do better proofread as like EN.WS. I know this not the right place to state, can any developers works for us, to upload books from Digital Library of India to commons or Wikimedia WS project domain?

I am using https://toolserver.org/~tpt/iaUploadBot/step1.php and https://tools.wmflabs.org/url2commons/ both. Fist one is only for DJVU file. Some of our Indic language books not available in DJVU file in Archive.org.

1. http://www.dli.ernet.in/

Jayanta

On Wed, Dec 4, 2013 at 2:13 PM, Andrea Zanni zanni.andrea84@gmail.comwrote:

...

Hi Jayanta, have you ever tried to use this tool from our beloved wizard Tpt? https://toolserver.org/~tpt/iaUploadBot/step1.php It is very simple and useful.

Aubrey

On Wed, Dec 4, 2013 at 9:24 AM, Jayanta Nath jayantanth@gmail.comwrote:

...

This is great!!! Sometimes its impossible to every time download from AI, Google books 100MB file and again upload to commons 100MB file. I am from India, internet is very slow!!! It will help me lots!!

On Wed, Dec 4, 2013 at 1:37 PM, Andrea Zanni <zanni.andrea84@gmail.com

...

wrote:

...

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813

https://bugzilla.wikimedia.org/show_bug.cgi?id=57812

Feel free to CC yourself, or even better to work/find someone willing to work on them :-)

Aubrey

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Hello,

Do you this site? http://www.wilbourhall.org/index.html It has complete PDF of Sanskrit books. You can also use Chunked Uploads. Add

importScript('User:Rillke/bigChunkedUpload.js');

in your https://commons.wikimedia.org/wiki/User:USERNAME/common.js I can help making DJVU and OCR.

Regards, Yann, from Ahmedabad

2013/12/4 Jayanta Nath jayantanth@gmail.com

Hi Aubrey

Unfortunately I , myself on board in Wikimedia Chapter ( Executive committee Member!). Personally I am very much attached with Wikimedia movement in India. Actually that's not a big deal.

I follow the below workflow...

1. Download books from Digital Library of India ( single page single tif

file).

2. Upload as PDF (You can put them in a zipped file and upload

everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is good for me.) Let's try next time. But when I upload as PDF , I cannot find any DJVU file.

3)Transfer file in commons. https://toolserver.org/~tpt/iaUploadBot/step1.php this utility is only for upload DJVU file. ( If I upload "FILENAME_images.zip" at archive.org, Are they converted as DJVU?)

Jayanta

On Wed, Dec 4, 2013 at 5:08 PM, Andrea Zanni zanni.andrea84@gmail.comwrote:

...

Hi Jayanta, I now understand you have a deeper problem than I thought.

My advice would be to seek for a collaboration with the Digital Library of India, or with Wikimedia India (http://wiki.wikimedia.in/Main_Page) and ask them to help you in transferring those file.

I still think the better workflow is to

1. upload the files in Internet Archive. If you have tiff files, this is

perfect. You can put them in a zipped file and upload everything on Internet Archive with the namefile "FILENAME_images.zip". Then the software will do everything by itself. This is very good as Internet Archive is great at converting files, doing OCR and stuff like that. You can find the instructions here too: https://en.wikisource.org/wiki/Help:DjVu_files#The_Internet_Archive

2. when everything is ready (all the files are created), go with

https://toolserver.org/~tpt/iaUploadBot/step1.php : you put the id inside, and it will upload the file on Commons.

3. you're set: you go on Wikisource and create the Index.

Aubrey

On Wed, Dec 4, 2013 at 11:49 AM, Jayanta Nath jayantanth@gmail.comwrote:

...

Hi Zanni,

On Indian context of Indian pint of view, Books are not readily available in Archive.org or google book. We have a great resource at Digital Library of India] ( All Indic language books available). As like others India Govt website , this site same issue about poor Navigations, Online reading, downloading, Server error/down etc. They have just dump as tif file. So we can't do better proofread as like EN.WS. I know this not the right place to state, can any developers works for us, to upload books from Digital Library of India to commons or Wikimedia WS project domain?

I am using https://toolserver.org/~tpt/iaUploadBot/step1.php and https://tools.wmflabs.org/url2commons/ both. Fist one is only for DJVU file. Some of our Indic language books not available in DJVU file in Archive.org.

1. http://www.dli.ernet.in/

Jayanta

On Wed, Dec 4, 2013 at 2:13 PM, Andrea Zanni zanni.andrea84@gmail.comwrote:

...

Hi Jayanta, have you ever tried to use this tool from our beloved wizard Tpt? https://toolserver.org/~tpt/iaUploadBot/step1.php It is very simple and useful.

Aubrey

On Wed, Dec 4, 2013 at 9:24 AM, Jayanta Nath jayantanth@gmail.comwrote:

...

This is great!!! Sometimes its impossible to every time download from AI, Google books 100MB file and again upload to commons 100MB file. I am from India, internet is very slow!!! It will help me lots!!

On Wed, Dec 4, 2013 at 1:37 PM, Andrea Zanni <zanni.andrea84@gmail.com

...

wrote:

...

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813

https://bugzilla.wikimedia.org/show_bug.cgi?id=57812

Feel free to CC yourself, or even better to work/find someone willing to work on them :-)

Aubrey

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Hi Yann,

Thank you for sharing this add-on and website. This site may very useful for sa.wikisource.org. I am working on my native wikisource bengali. Can you help us to develop OCR for Bengali?

On Wed, Dec 4, 2013 at 10:11 PM, Pierre Yves Beaudouin < pierre.beaudouin@gmail.com> wrote:

You should activate 2 things in the preference :

• Mostra barra degli strumenti di modifica [Show edit toolbar]
• Abilita barra degli strumenti di modifica avanzata [Enable enhanced

editing toolbar]

Pyb

2013/12/4 Andrea Zanni zanni.andrea84@gmail.com

...

Here there are 2 bugs related to Wikisource: https://bugzilla.wikimedia.org/show_bug.cgi?id=57813

https://bugzilla.wikimedia.org/show_bug.cgi?id=57812

Feel free to CC yourself, or even better to work/find someone willing to work on them :-)

Aubrey

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Jayanta, I'm also happy to help, if bandwidth is a problem. If you send me a list of URLs of books at the DLI that you'd like me to download and upload to the Internet Archive for you, I'm happy to do it.

A.

On Wed, Dec 4, 2013 at 2:14 PM, Yann Forget yannfo@gmail.com wrote:

2013/12/5 Jayanta Nath jayantanth@gmail.com

...

Hi Yann,

Thank you for sharing this add-on and website. This site may very useful for sa.wikisource.org.

Yes, I will upload some of these books and tell them.

...

I am working on my native wikisource bengali. Can you help us to develop OCR for Bengali?

Unfortunately, Bengali may not even exist in commercial software, although I know a French company which is making OCR for Indian languages, it will take some time. Bengali is not available in Abby FineReader 11 Professional Editon, which is the leading world software for OCR. However several dozens of languages are available: all European languages, Latin, Greek, Russian, Chinese, Japanese, Korean, Arabic, several African languages, etc., but no Indian language is available in the list. It is what Internet Archive uses. Developing OCR is a very long and complex work. And I don't speak Bengali, so I can't help much.

However I can help creating PDF and/or DJVU files, and uploading them.

Best regards,

Yann

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

Hi Jayanta,

I would also suggest that you make a list of books you would like to be uploaded to Commons. If the PDF is not easily available on the Internet, you can upload it to Commons, then I will make a DJVU. BTW, I checked another OCR software (Caminova Document Express 7.5 Enterprise, with Asian languages), but there is no Indian language available in it. Only Chinese, Japanese, Korean, etc.

Regards,

Yann

2013/12/6 Jayanta Nath jayantanth@gmail.com

Hi Asaf ,

Thank you for helping us.

Presently I am personally working this for my native Bengali Wikisource. There some program (1,2,3,4) available on web to download Books from DLI website. It may help for you too! Sometimes I am facing the big issue with this utility from service side not available or down for few moments.

1. http://sanskritdocuments.org/scannedbooks/dlidownloader/
2. http://dlidownloader.wordpress.com/
3. http://code.google.com/p/dli-downloader/

http://techstunted.blogspot.in/2013/03/downloading-books-from-digital-librar...

Another issue I found at Internet Archive, I have uploaded some books in PDF format in AI here [1], but no boos have converted to DJVU , because, they are saying that A DjVu can only be made if the language of the book is OCRable. At this time we are not able to OCR Bengali. I know PDF will also accepted format in WS, but I would preferred DJVU.

https://archive.org/search.php?query=uploader%3A%22jayantanth%40gmail.com%22...

I shall send a mail for download list to you off-list.

Jayanta

On Fri, Dec 6, 2013 at 4:49 AM, Asaf Bartov abartov@wikimedia.org wrote:

...

Jayanta, I'm also happy to help, if bandwidth is a problem. If you send me a list of URLs of books at the DLI that you'd like me to download and upload to the Internet Archive for you, I'm happy to do it.

A.

On Wed, Dec 4, 2013 at 2:14 PM, Yann Forget yannfo@gmail.com wrote:

...

2013/12/5 Jayanta Nath jayantanth@gmail.com

...

Hi Yann,

Thank you for sharing this add-on and website. This site may very useful for sa.wikisource.org.

Yes, I will upload some of these books and tell them.

...

I am working on my native wikisource bengali. Can you help us to develop OCR for Bengali?

Unfortunately, Bengali may not even exist in commercial software, although I know a French company which is making OCR for Indian languages, it will take some time. Bengali is not available in Abby FineReader 11 Professional Editon, which is the leading world software for OCR. However several dozens of languages are available: all European languages, Latin, Greek, Russian, Chinese, Japanese, Korean, Arabic, several African languages, etc., but no Indian language is available in the list. It is what Internet Archive uses. Developing OCR is a very long and complex work. And I don't speak Bengali, so I can't help much.

However I can help creating PDF and/or DJVU files, and uploading them.

Best regards,

Yann

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

-- Asaf Bartov Wikimedia Foundation http://www.wikimediafoundation.org

Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us make it a reality! https://donate.wikimedia.org

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l

---

Wikisource-l mailing list Wikisource-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikisource-l