Hi,
this is with a great joy that I can announce to you: We have finally released the major version 7.0.0 of the libzim.
This is one of the biggest libzim releases we have ever made: * Almost one year of effort * ~100 tickets https://github.com/openzim/libzim/milestone/2?closed=1 * Code coverage increased from 50% to 85% * 15K lines of code changed
This new release brings: * A strongly rewritten new API: search engine, suggestions, creator, ... * Most notable change is that now namespaces are "hidden" by the API * Ability to add hints to articles * New index with only the user visible/front articles * Backward and forward compatibility is secured * Other bug fixes and improvements, check https://github.com/openzim/libzim/blob/master/ChangeLog
The ZIM file format specification has itself only changed a little, see: https://wiki.openzim.org/w/index.php?title=ZIM_file_format&type=revision...
A cascade of new releases will be done in the next weeks to bring all the benefits of this latest libzim in both openZIM scrapers and Kiwix readers.
I use the opportunity of this release to send a particular "Thank you!" to the Wikimedia Foundation which has been supporting us for many years now. This hard work on a low level library like the libzim would not have been possible without its support.
For the Kiwix team Kelson
Le dim. 10 oct. 2021 à 17:11, Emmanuel Engelhart kelson@kiwix.org a écrit :
Hi,
this is with a great joy that I can announce to you: We have finally released the major version 7.0.0 of the libzim.
This is one of the biggest libzim releases we have ever made:
- Almost one year of effort
- ~100 tickets https://github.com/openzim/libzim/milestone/2?closed=1
- Code coverage increased from 50% to 85%
- 15K lines of code changed
This new release brings:
- A strongly rewritten new API: search engine, suggestions, creator, ...
- Most notable change is that now namespaces are "hidden" by the API
- Ability to add hints to articles
- New index with only the user visible/front articles
- Backward and forward compatibility is secured
- Other bug fixes and improvements, check
https://github.com/openzim/libzim/blob/master/ChangeLog
The ZIM file format specification has itself only changed a little, see:
https://wiki.openzim.org/w/index.php?title=ZIM_file_format&type=revision...
A cascade of new releases will be done in the next weeks to bring all the benefits of this latest libzim in both openZIM scrapers and Kiwix readers.
I use the opportunity of this release to send a particular "Thank you!" to the Wikimedia Foundation which has been supporting us for many years now. This hard work on a low level library like the libzim would not have been possible without its support.
For the Kiwix team
That is great ! I did not look at linked page yet. What are hints ?
Le 10/10/2021 à 21:38, Amirouche Boubekki a écrit :
That is great ! I did not look at linked page yet. What are hints ?
Hi,
"Hints" is a generic system to allow the scraper to pass ... hints to the creator when we create a zim file. Hints are information for the creator only. They may change the way the entries are stored but they are not stored in the zim file and readers cannot access them.
For now we support only two hints: - COMPRESS : Force the creator to compress or not the content (if not given, use default heuristics based on mimetype) - FRONT_ARTICLE : Tell the item/redirection is a entry intended to be displayed to the user as a article (to oppose to resources as image/css/js) Random articles or suggestion use front articles only (when possible).
COMPRESS is not really important but FRONT_ARTICLE is somehow mandatory as we have no other way to differentiate articles from resources (as we don't have namespace now)
On 11.10.21 10:07, Matthieu Gautier wrote:
Le 10/10/2021 à 21:38, Amirouche Boubekki a écrit :
That is great ! I did not look at linked page yet. What are hints ?
Hi,
"Hints" is a generic system to allow the scraper to pass ... hints to the creator when we create a zim file. Hints are information for the creator only. They may change the way the entries are stored but they are not stored in the zim file and readers cannot access them.
For now we support only two hints:
- COMPRESS : Force the creator to compress or not the content (if not
given, use default heuristics based on mimetype)
- FRONT_ARTICLE : Tell the item/redirection is a entry intended to be
displayed to the user as a article (to oppose to resources as image/css/js) Random articles or suggestion use front articles only (when possible).
COMPRESS is not really important but FRONT_ARTICLE is somehow mandatory as we have no other way to differentiate articles from resources (as we don't have namespace now)
Important other point: the documentation has been seriously improved. There is even a migration documentation. Look at https://libzim.readthedocs.io/