Offline-l April 2010

offline-l@lists.wikimedia.org

9 participants
19 discussions

[openZIM dev-l] [Bug 18] New: debian needs an init.d script
by bugzilla-daemon＠openzim.org 02 Sep '11

02 Sep '11

http://bugs.openzim.org/show_bug.cgi?id=18 Summary: debian needs an init.d script Product: openZIM Version: unspecified Platform: PC OS/Version: Linux Status: NEW Severity: enhancement Priority: P5 Component: zimreader AssignedTo: tommi(a)tntnet.org ReportedBy: andyr(a)wizzy.com CC: dev-l(a)openzim.org Estimated Hours: 0.0 One attached. -- Configure bugmail: http://bugs.openzim.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

1 4

[openZIM dev-l] [Bug 21] New: Zimlib should allow to get/unpack only a part of a content
by bugzilla-daemon＠openzim.org 27 Sep '10

27 Sep '10

http://bugs.openzim.org/show_bug.cgi?id=21 Summary: Zimlib should allow to get/unpack only a part of a content Product: openZIM Version: unspecified Platform: PC OS/Version: Windows Status: NEW Severity: enhancement Priority: P5 Component: zimlib AssignedTo: tommi(a)tntnet.org ReportedBy: emmanuel(a)engelhart.org CC: dev-l(a)openzim.org Estimated Hours: 0.0 The zimlib needs to fully unpack a content before giving delivering it to a third part software. This has many disadvantages especially if the content is big, a video for example: * This will need pretty much memory * This will take time * You do not have a random access (necessary to seek in an HTML5 video) It would be a really good usability improvement to have a method which delivers only a part of any content. -- Configure bugmail: http://bugs.openzim.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

1 2

[openZIM dev-l] a DVD with the Spanish Wikipedia (was [Argentina] WikiBrowse improvements)
by Alejandro J. Cura 14 Sep '10

14 Sep '10

Hi everyone, we need your help. We are from Python Argentina, and we are working on adapting our cdpedia project to make a DVD together with educ.ar and Wikimedia Foundation, holding the entire Spanish Wikipedia that will be sent soon to Argentinian schools. Hernán and Diego are the two interns tasked with updating the data that cdpedia uses to make the cd (it currently uses a static html dump dated June 2008), but they are encountering some problems while trying to make an up to date static html es-wikipedia dump. I'm ccing this list of people, because I'm sure you've faced similar issues when making your offline wikipedias, or because maybe you know someone who can help us. Following is an email from Hernán describing the problems he's found. thanks! -- alecu - Python Argentina 2010/4/30 Hernan Olivera <lholivera(a)gmail.com>: Hi everybody, I've been working on making an up to date static html dump for the spanish wikipedia, to use as a basis for the DVD. I've followed the procedures detailed in the pages below, that were used to generate the current (and out of date) static html dumps: 1) installing and setting up a mediawiki instance 2) importing the xml from [6] with mwdumper 3) exporting the static html with mediawiki's tool The procedure finishes without throwing any errors, but the xml import produces malformed html pages that have visible wikimarkup. We would really need to have a successful import from the spanish xmls to a mediawiki instance so we can produce the up to date static html dump. Links to the info I used: [0] http://www.mediawiki.org/wiki/Manual:Installation_guide/es [1] http://www.mediawiki.org/wiki/Manual:Running_MediaWiki_on_Ubuntu [2] http://en.wikipedia.org/wiki/Wikipedia_database [3] http://www.mediawiki.org/wiki/Manual:Importing_XML_dumps [4] http://meta.wikimedia.org/wiki/Importing_a_Wikipedia_database_dump_into_Med… [5] http://meta.wikimedia.org/wiki/Data_dumps [6] http://dumps.wikimedia.org/eswiki/20100331/ [7] http://www.mediawiki.org/wiki/Alternative_parsers (among others) Cheers, -- Hernan Olivera PS: unluckily I didn't write down every step in detail. I did a lot more tests than what I wrote here. To make a detailed report I'd like to go thru the procedure again writing down every option (and to check if I missed something). I'm finishing installing a server just for this, because this processes take forever and they blocked other tasks while making this tests. 2009/10/23 Samuel Klein <meta.sj(a)gmail.com>: > Jimbo - thanks for the spur to clean up the existing work. > > All - Let's start by cleaning up the mailing lists and setting a few > short-term goals :-) It's a good sign that we have both charity and love > converging to make something happen. > > * For all-platform all-purpose wikireaders, let's use > offline-l(a)lists.wikimedia, as we discussed a month ago in the aftermath of > Wikimania (Erik, were you going to set this up? I think we agreed to > deprecate wiki-offline-reader-l and replace it with offline-l.) > > * For wikireaders such as WikiBrowse and Infoslicer on the XO, please > continue to use wikireader(a)lists.laptop > > > I would like to see WikiBrowse become the 'sugarized' version of a reader > that combines the best of that and the openZim work. A standalone DVD or > USB drive that comes with its own search tools would be another version of > the same. As far as merging codebases goes, I don't think the WikiBrowse > developers are invested in the name. > > I think we have a good first cut at selecting articles, weeding out stubs, > and including thumbnail images. Maybe someone working on openZim can > suggest how to merge the search processes, and that file format seems > unambiguously better. > > Kul - perhaps part of the work you've been helping along for standalone > usb-key snapshots would be useful here. > > > Please continue to update this page with your thoughts and progress! > http://meta.wikimedia.org/wiki/Offline_readers > > SJ > > > 2009/10/23 Iris Fernández <irisfernandez(a)gmail.com> >> >> On Fri, Oct 23, 2009 at 1:37 PM, Jimmy Wales <jwales(a)wikia-inc.com> wrote: >> > >> > My dream is quite simple: a DVD that can be shipped to millions of >> > people with an all-free-software solution for reading Wikipedia in Spanish. >> > It should have a decent search solution, doesn't have to be perfect, but it >> > should be full-text. It should be reasonably fast, but super-perfect is not >> > a consideration. >> > >> >> Hello! I am an educator, not a programmer. I can help selecting >> articles or developing categories related to school issues. > > Iris - you know the main page of WikiBrowse that you see when the reader > first loads? You could help with a new version of that page. Madeleine > (copied here) worked on the first one, but your thoughts on improving it > would be welcome. > > >

10 13

[openZIM dev-l] Ben NanoNote and Vido on Linux.com - well done!
by Manuel Schneider 04 Jun '10

04 Jun '10

Hi, as a member of the Linux Foundation I just received a newsletter which pointed me at an article on Linux.com concerning the Ben NanoNote. I was very happy to find out that - beneath many other things in this detailed article - Vido was mentioned as Wikipedia reader. Here is the article: http://www.linux.com/news/embedded-mobile/netbooks/296251:a-review-ben-nano… See the paragraph "Software": ... A wide variety of user applications are under development by the community, including some that lean towards embedded device usage (such as the Rockbox digital music player and Vido offline-Wikipedia reader) and some flashier options, such as Quake and Doom. As always I have put a link to this article in our media section on our main page. Thanks for your work! /Manuel -- Regards Manuel Schneider Wikimedia CH - Verein zur Förderung Freien Wissens Wikimedia CH - Association for the advancement of free knowledge www.wikimedia.ch

2 5

[openZIM dev-l] [Bug 19] New: Windows+MSVisualStudio: Zimlib is unable to deal with ZIM files larger than 2GB
by bugzilla-daemon＠openzim.org 05 May '10

05 May '10

http://bugs.openzim.org/show_bug.cgi?id=19 Summary: Windows+MSVisualStudio: Zimlib is unable to deal with ZIM files larger than 2GB Product: openZIM Version: unspecified Platform: PC OS/Version: Windows Status: NEW Severity: blocker Priority: P1 Component: zimlib AssignedTo: tommi(a)tntnet.org ReportedBy: emmanuel(a)engelhart.org CC: dev-l(a)openzim.org Estimated Hours: 0.0 Compiling zimlib under Windows with Visual Studio works and it runs well. But only as long you have "small" zim files because the zimlib fails to deal with large files (>2GB). The root cause is the seekg() in fileimpl.cpp just before reading the cluster. http://svn.openzim.org/viewvc.cgi/trunk/zimlib/src/fileimpl.cpp?revision=30… zimFile.seekg(clusterOffset); zimFile >> cluster; If the required cluster is over the 2GB limit then the seekg() does not go to the right offset and the decompression fails. Until now I have no solution/workaround. Ideas? -- Configure bugmail: http://bugs.openzim.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

1 5

Re: [openZIM dev-l] EOVERFLOW
by emmanuel＠engelhart.org 26 Apr '10

26 Apr '10

I will release an alpha2 version this evening... and replace the files on sourceforge. Regards Emmanuel Le lun 26/04/10 16:37, Andy Rabagliati andyr(a)wizzy.com a écrit: > On Mon, 26 Apr 2010, Andy Rabagliati wrote: > > > On Mon, 26 Apr 2010, emmanu > el(a)engelhart.org wrote: > > > > Hallo Andy, > > > > > > I think I have fixed the issue. > > > > I pulled it from svn, recompiled, and it works fine > now. > Can you delete, or replace, the deb on sourceforge ? > > Cheers, Andy! > _______________________________________________ > dev-l mailing list > dev-l@openz > im.org https://intern.openzim.org/mailman/listinfo/dev-l > >

1 0

Re: [openZIM dev-l] EOVERFLOW
by Andy Rabagliati 26 Apr '10

26 Apr '10

On Mon, 26 Apr 2010, Andy Rabagliati wrote: > On Mon, 26 Apr 2010, emmanuel(a)engelhart.org wrote: > > > Hallo Andy, > > > > I think I have fixed the issue. > > I pulled it from svn, recompiled, and it works fine now. Can you delete, or replace, the deb on sourceforge ? Cheers, Andy!

1 0

Re: [openZIM dev-l] EOVERFLOW
by emmanuel＠engelhart.org 26 Apr '10

26 Apr '10

I can reproduce the bug. This only occurs on 32b GNU/Linux and with large files (>2GB). I have open a bug on Kiwix's side here: https://sourceforge.net/tracker/?func=detail&aid=2992289&group_id=175508&at… I invite you to add any potential comment here. Thx a lot for this valuable bug report Andy Cheers Emmanuel Le lun 26/04/10 10:23, "Andy Rabagliati" andyr(a)wizzy.com a écrit: > On Mon, 26 Apr 2010, emmanu > el(a)engelhart.org wrote: > > Le lun 26/04/10 09:15, "Andy Rabagliati" andyr(a)wizzy.c > om a ??crit: > > On Sun, 25 Apr 2010, Emmanuel Engelhart > wrote: > > > > > > Have also uploaded a deb, which works > with > > 10.04: > > > https://sourceforge.net/projects/kiwix/files/ > >> > > > > > I also get the EOVERFLOW problem with your > deb. > > > Do you get this error with each ZIM > file? > I do not have that many to hand. > > I do not get this error for either > wikipedia_en_wp1_0.5_2000+_03_2007_rc2.zim nor the snippet of the > Italian wikipedia (Harvey Milk) you once sent me. > > I have an older one, from pt wikipedia, but I think the format > changed. > My copy of wikipedia_en_wp1_0.7_30000+_05_2009_beta3.zim, has an > md5sum of 0ce042ae2d1b8d4a1fade15c9de2dee2, that has worked before. > > Cheers, Andy! > _______________________________________________ > dev-l mailing list > dev-l@openz > im.org https://intern.openzim.org/mailman/listinfo/dev-l > >

1 0

[openZIM dev-l] Status
by emmanuel＠engelhart.org 26 Apr '10

26 Apr '10

Hi, they are a few thoughts I want to share we you and maybe few of them will trigger a discussion: * Neither Tommi nor someone from Q-Hardware want to/can attend the next dev. meeting planned in May. Consequently I think this does not make sense to have this meeting (in May). * Next meeting is the Linux-tag in Berlin which I hope will be a success like last year. But, I hope also that the Linux-tag won't be an occasion to take strategical decisions, this was not the case last year and that is a reason why I don't attend. * We have a lack of ZIM files, I will work in the next weeks to provide ASAP full ZIM files for WP de: fr: es: pt: zh:... pl: would also not bad... isn't it? These will be draft ZIM files (do not await high quality.. but the most important will be there). * Will also provide an Kiwix 0.9 alpha2 which will fix the few issues already detected in the Kiwix 0.9 alpha1 release... So we will have a prefect solution to read ZIM files under Windows. * Still on the roadmap we have category handling and stuff releated to Meta-data and diff/patch. IMO most of these features should be implemented, tested and integrated before starting discussing deeply about other features. * The next challenge is I think to easily build ZIM files. My question is: Do we have make progress on that question at the MWCON? * Additional question: what is the agenda during Wikimania concerning openZIM and offline readers? The question if I should attend is still open in my mind. Cheers Emmanuel

1 0

Re: [openZIM dev-l] compile error for Intrpid
by emmanuel＠engelhart.org 26 Apr '10

26 Apr '10

Le lun 26/04/10 09:15, "Andy Rabagliati" andyr(a)wizzy.com a écrit: > On Sun, 25 Apr 2010, Emmanuel Engelhart wrote: > > > Have also uploaded a deb, which works with > 10.04: > https://sourceforge.net/projects/kiwix/files/ > > > I also get the EOVERFLOW problem with your deb. Do you get this error with each ZIM file? Regards Emmanuel

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Offline-l April 2010