http://bugs.openzim.org/show_bug.cgi?id=11
Summary: Dynamic mime-types
Product: openZIM
Version: unspecified
Platform: All
OS/Version: All
Status: NEW
Severity: enhancement
Priority: P3
Component: zimlib
AssignedTo: tommi(a)tntnet.org
ReportedBy: emmanuel(a)engelhart.org
CC: dev-l(a)openzim.org
Estimated Hours: 0.0
Currently, the ZIM format can only support a limited and predefined set of
document mime-types.
You can get the list of supported mime-types here:
http://www.openzim.org/ZIM_File_Format#Mime_types
Mime-types are represented by a number in a ZIM file, and the mapping is done
statically by the zimlib.
This means than you can not store document with custom mime-type.
This is a problem for me because I have people who use Kiwix and deal with
other mime-types, for example: archives or binaries.
I think, this is a necessary improvement to make this mime-type table dynamic.
I see two solutions :
* The ZIM file creator specify it manually during the creation process.
* It goes automatically (also during the creation process).
--
Configure bugmail: http://bugs.openzim.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.
Jimbo - thanks for the spur to clean up the existing work.
All - Let's start by cleaning up the mailing lists and setting a few
short-term goals :-) It's a good sign that we have both charity and love
converging to make something happen.
* For all-platform all-purpose wikireaders, let's use
offline-l(a)lists.wikimedia, as we discussed a month ago in the aftermath of
Wikimania (Erik, were you going to set this up? I think we agreed to
deprecate wiki-offline-reader-l and replace it with offline-l.)
* For wikireaders such as WikiBrowse and Infoslicer on the XO, please
continue to use wikireader(a)lists.laptop
I would like to see WikiBrowse become the 'sugarized' version of a reader
that combines the best of that and the openZim work. A standalone DVD or
USB drive that comes with its own search tools would be another version of
the same. As far as merging codebases goes, I don't think the WikiBrowse
developers are invested in the name.
I think we have a good first cut at selecting articles, weeding out stubs,
and including thumbnail images. Maybe someone working on openZim can
suggest how to merge the search processes, and that file format seems
unambiguously better.
Kul - perhaps part of the work you've been helping along for standalone
usb-key snapshots would be useful here.
Please continue to update this page with your thoughts and progress!
http://meta.wikimedia.org/wiki/Offline_readers
SJ
2009/10/23 Iris Fernández <irisfernandez(a)gmail.com>
> On Fri, Oct 23, 2009 at 1:37 PM, Jimmy Wales <jwales(a)wikia-inc.com> wrote:
> >
> > My dream is quite simple: a DVD that can be shipped to millions of people
> with an all-free-software solution for reading Wikipedia in Spanish. It
> should have a decent search solution, doesn't have to be perfect, but it
> should be full-text. It should be reasonably fast, but super-perfect is not
> a consideration.
> >
>
> Hello! I am an educator, not a programmer. I can help selecting
> articles or developing categories related to school issues.
>
Iris - you know the main page of WikiBrowse that you see when the reader
first loads? You could help with a new version of that page. Madeleine
(copied here) worked on the first one, but your thoughts on improving it
would be welcome.
http://bugs.openzim.org/show_bug.cgi?id=9
Summary: optimize cluster size (small devices limitations)
Product: openZIM
Version: unspecified
Platform: All
OS/Version: All
Status: NEW
Severity: enhancement
Priority: P5
Component: zimwriter
AssignedTo: tommi(a)tntnet.org
ReportedBy: manuel.schneider(a)wikimedia.ch
CC: dev-l(a)openzim.org
Estimated Hours: 0.0
Small devices don't have much memory. Through built-in article clustering ZIM
optimizes the compression ratio of the article texts.
Currently the cluster size can be determined at ZIM-build-time by the
ZIM-creator.
We must do some research to find out which cluster size is at maximum possible
so the reader still works on a small device and communicate the requirements -
such as "8 MB at least". This cluster size should then be the default at
zimwriter.
If we not do so it can happen that a ZIM-creator chooses as cluster size which
does not work on small devices, so these files can not be read there.
--
Configure bugmail: http://bugs.openzim.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.
http://bugs.openzim.org/show_bug.cgi?id=10
Summary: caching on low memory devices
Product: openZIM
Version: unspecified
Platform: PC
OS/Version: All
Status: NEW
Severity: enhancement
Priority: P5
Component: zimreader
AssignedTo: tommi(a)tntnet.org
ReportedBy: mirko(a)qi-hardware.com
CC: dev-l(a)openzim.org
Estimated Hours: 0.0
We have a problem with memory usage on the Ben NanoNote. It comes with 32MB
SDRAM. The ZimReader uses more than that. We get an "out of memory" kernel
message.
Our guess is, that it is connected to the caching that is being done.
It would be great if there was an option to enable a "low memory" version so
that the ZimReader runs smoothly on devices such as the Ben.
--
Configure bugmail: http://bugs.openzim.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
I have the new postgres 8.4 and the zimwriter generates a new error message:
DBI connect('dbname=1256936274','kiwix',...) failed: n'a pas pu se
connecter au serveur : Aucun fichier ou dossier de ce type
Le serveur est-il actif localement et accepte-t-il les
connexions sur la
socket Unix « /var/run/postgresql/.s.PGSQL.5432 » ? at
../classes//Kiwix/ZimWriter.pm line 760
I think that the root cause is that the postgres default port is now
5433 and not 5432 anymore. Would be maybe better to have per default the
good port in the zimwriter.
Regards
Emmanuel
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iEYEARECAAYFAkrr9TIACgkQn3IpJRpNWtOgjgCgv9X0rpUamq2vOS+fqSZZ0gCn
60IAniDprTmcWUhP6uXMHhK5Omq6Dvbb
=+hcQ
-----END PGP SIGNATURE-----
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
compiling the zimlib with --with-cxxtols=no and removing in configure.in
the necessary to compile only the libzim (and not the zimDump and the
tests) I get this error:
libtool: compile: g++ -DHAVE_CONFIG_H -I. -I../include -g -O2 -MT
uuid.lo -MD -MP -MF .deps/uuid.Tpo -c uuid.cpp -fPIC -DPIC -o .libs/uuid.o
uuid.cpp: In static member function ‘static zim::Uuid
zim::Uuid::generate()’:
uuid.cpp:80: erreur: cast from ‘zim::Uuid*’ to ‘int32_t’ loses precision
Is there something wrong?
Regards
Emmanuel
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iEYEARECAAYFAkrpYa4ACgkQn3IpJRpNWtP8BACcC3hOj2itFWO03eghMLkbXVBd
J/gAnikOa+nPySKld0UCvNmPByVyoX4U
=sxgt
-----END PGP SIGNATURE-----
Forwarding to the offline list. SJ
---------- Forwarded message ----------
From: Facundo Batista <facundobatista(a)gmail.com>
Date: Sat, Oct 24, 2009 at 7:34 AM
Subject: Re: Fwd: [Argentina] WikiBrowse improvements
To: "Alejandro J. Cura" <alecura(a)gmail.com>
Cc: Jimmy Wales <jwales(a)wikia-inc.com>, Samuel Klein <meta.sj(a)gmail.com>,
cjb(a)laptop.org, ibarrags(a)gmail.com, irisfernandez(a)gmail.com,
tfinc(a)wikimedia.org, godiard(a)gmail.com
On Fri, Oct 23, 2009 at 4:09 PM, Alejandro J. Cura <alecura(a)gmail.com>
wrote:
> cdpedia does most of it's work trying to select which Wikipedia
> articles to include --and more important: which to trim-- using a
Well... note that is is very good for the CD version, where we could
fit ~ 85 thousand articles.
But for the DVD version, we put *all* the articles in there, :) (with
"article" I don't mean "page", because a lot of information (like
discussions about an article) ar trimmed off at the begin of the
process).
If you want, you can easily check which namespaces were included and
which not, here:
http://code.google.com/p/cdpedia/source/browse/trunk/config.py
(search for NAMESPACES)
Regards,
--
. Facundo
-----------------------
As soon as you can start adding issues in the tracker [0], the better, ;)
With "issues" I don't only mean bugs if you find them, but also
desired functionality, and all.
Note that the project is all in Spanish, but feel free to add tickets
in English, it's ok.
Regards,
[0] http://code.google.com/p/cdpedia/issues/list
--
. Facundo
Blog: http://www.taniquetil.com.ar/plog/
PyAr: http://www.python.org/ar/
Dear offline wikihackers, if you are interested in general discussions about
offline reading and editing, please join the new offline-l mailing list. It
is intended for offline use of mediawiki collections, but for those working
on other wiki backends, I expect that much of the work and tools will be
wiki-neutral.
https://lists.wikimedia.org/mailman/listinfo/offline-l
In particular, I expect the recent discussion about how best to get Spanish
Wikipedia to the students in offline schools in Latin America will move
there (so we can stop cc:ing so many people and lists :) - so please
subscribe if you want to follow that thread.
(Alejandro: por favor difundir este mensaje -- debates en español también
son bienvenidos en la nueva lista.)
Regards,
Sam.
---------- Forwarded message ----------
From: Erik Moeller <erik(a)wikimedia.org>
Date: Fri, Oct 23, 2009 at 9:17 PM
Subject: [Wiki-offline-reader-l] New list: offline-l
To: wiki-offline-reader-l(a)lists.wikimedia.org
After some discussion with WMF staff and people working on wiki
offline tools, we wanted to make sure we have an official
WMF-designated forum to discuss both offline reader and editor
technologies for Wikimedia Foundation projects and other MediaWikis.
We felt the list name "wiki-offline-reader" didn't reflect
appropriately the need for offline editing and sharing tools, and have
therefore created a new list called offline-l:
https://lists.wikimedia.org/mailman/listinfo/offline-l
We'll advertise this new list in the next couple of weeks in various
places. If you're interested in offline discussions, I strongly
encourage you to subscribe there.
Because wiki-offline-reader-l hasn't been very active, I haven't moved
the archives over, but this list won't be deleted for now (I added a
deprecation notice to the list info page).
Thanks and all best,
Erik
--
Erik Möller
Deputy Director, Wikimedia Foundation
Support Free Knowledge: http://wikimediafoundation.org/wiki/Donate
wiki-offline-reader-l(a)lists.wikimedia.org
_______________________________________________
Wiki-offline-reader-l mailing list
Wiki-offline-reader-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wiki-offline-reader-l
Hey there,
Manuel and I have worked on a short text about openZIM as a project to
spread the news and attract more attention.
You can find the text in the openZIM wiki [1]. If you have time please
review it and comment etc. We are also not quite certain on the heading yet,
so if you have a ideas, let's hear them :)
The idea is then to push it out on as many places as we can cover, so if you
have ideas about where to put it up great!
Regards,
/mirko
[1] http://www.openzim.org/2009-10-22_Blog_Post_on_Project_Paroli
Thank you Tommi.
I came to the same conclusions.
Have also updated a little bit the documentation:
https://openzim.org/index.php?title=ZIM_File_Format&diff=568&oldid=504
Le mar 20/10/09 14:52, "Tommi Mäkitalo" tommi(a)tntnet.org a écrit:
> On Dienstag, 20. Oktober 2009 13:57:08 emmanu
> el(a)engelhart.org wrote:
> Hi,
> >
> > I help currently someone wanting to build his own
> ZIM parser.
> I know this is not necessary... but he wants to do
> it and I find this is
> interesting to have someone trying to do
> that.
>
> > I have remarked that on the wiki nothing is written
> about the compression:
> * How do we know if a cluster is compressed or not
> ?
> * What are the possible value (for different
> compression methods) ?
>
> > Regards
> > Emmanuel
> >
> >
> _______________________________________________
> dev-l mailing list
> > dev-l@openz
> im.org
> https://intern.openzim.org/mailman/listinfo/dev-l
> >Hi,
>
> unfortunately there are several areas, which are not specified completely.
> But
luckily this compression flag is at least partly ;-)
>
> The first byte in a cluster specifies the compression. The value is:
> 0 default (no compression)
> 1 none (also no compression, I don't know, why vlado specified this in
> zeno,
but I take ist over to zim)
> 2 zip (zlib)
> 3 bzip2 (currently used in writer)
> 4 lzma (not implemented in reader or writer due to lack of compression
>
library)
>
> You can find the flag here: http://openzim.org/ZIM_File_Format#Clusters. The
>
actual values are not documentated but can be found in the header zim/zim.h
> as
a enum.
>
> It is really no necessary to implement a parser but it does not hurt. It
> helps
discussing ideas for improvements. And it helps pushing zim as a standard,
> if
we encourage people to work with it.
>
>
> Tommi
>
>
>