http://bugs.openzim.org/show_bug.cgi?id=18
Summary: debian needs an init.d script
Product: openZIM
Version: unspecified
Platform: PC
OS/Version: Linux
Status: NEW
Severity: enhancement
Priority: P5
Component: zimreader
AssignedTo: tommi(a)tntnet.org
ReportedBy: andyr(a)wizzy.com
CC: dev-l(a)openzim.org
Estimated Hours: 0.0
One attached.
--
Configure bugmail: http://bugs.openzim.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.
http://bugs.openzim.org/show_bug.cgi?id=26
Summary: CRC check
Product: openZIM
Version: unspecified
Platform: All
OS/Version: All
Status: NEW
Severity: enhancement
Priority: P3
Component: zimlib
AssignedTo: tommi(a)tntnet.org
ReportedBy: emmanuel(a)engelhart.org
CC: dev-l(a)openzim.org
Estimated Hours: 0.0
Downloaded ZIM files are unfortunately not always fully valid at the end of the
download stage. Consequently users may have a bad user experience without
having a chance to easily check if the file is valid.
It would be great to provide in the zimwriter/zimlib a way to check the zim
file integrity easily.
A way to achieve that could be:
* At the end of the ZIM file creation process (file is created) compute and
append at the end of the file a CRC (md5sum, sha1)
* In the zimlib add a method checkIntegrity() or something similar able to
compute the CRC from the file (excepting the CRC hash at the end) and make the
comparison.
Hash algorithm should be fast and reliable (md5?).
--
Configure bugmail: http://bugs.openzim.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Hi,
For many reason, it's necessary to have a mime-type for ZIM file/content.
I propose "application/zim".
Emmanuel
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAk1lZ9YACgkQn3IpJRpNWtP+sQCgqYlgvHhd1poD8xnkX+RT5BVI
PwIAnitUXYM4SEwemtTG5spl4qZdZw/G
=RZfB
-----END PGP SIGNATURE-----
---------- Forwarded message ----------
From: Nikhil Sheth <nikhil.js(a)gmail.com>
Date: Thu, Jan 20, 2011 at 7:21 AM
Subject: troubleshooting Wikipedia for schools project
To: info(a)soschildren.org
Cc: wikimedia-in-mum <wikimedia-in-mum(a)lists.wikimedia.org>
HI,
I'm trying to spread wikipedia for schools offline edition in my
city/country. Got some interested people to join in the project at the
wikipedia
10th anniversary meetup at Mumbai,
India.<http://en.wikipedia.org/wiki/Wikipedia:Meetup/Mumbai/WikipediaDay2011>,
i've included them in cc.
I've set up a mirror website hosting the large file in parts because several
people had complained they couldn't download the original thing.
http://wikipediaforschools.4shared.com
I wasn't aware of your webpage back then so used a .ZIM file that I found on
http://www.kiwix.org : schools-wikipedia-full-20081023-rc5.zim
I hope I'm not hosting the wrong file??
Could you please give me this info:
In the press releas<http://www.soschildrensvillages.org.uk/charity-news/archive/2008/10/2008-wi…>e,
a .Torrent file is linked :
http://www.soschildrensvillages.org.uk/static/schools-wikipedia-full-200810…
I need to know what are the contents of this .tar.gz file.
Is it for windows or for linux? Is it the same .zim file only? Is it using
kiwix or something else? Is it pre-indexed?
On a blog post I created for this, someone posted a link to a large .zip
saying this is a pre-indexed packaged version:
http://download.kiwix.org/portable/wikipedia_en_for_schools.zip
So is that the one I should be going with? The current one I'm hosting needs
a small first-run procedure that has to be done on every computer I put it
in, of opening the .zim file from kiwix and then indexing it. Also, I had
problems with some older computers - the indexing never took off and we are
limited to click-browsing on those computers.
Moving on from the downloading aspect, I want to set up a wiki page that
will track the proliferation of Wikipedia for Schools. But I can't figure
out where to create it, what name to give it and other things. So need a
little help there. (wikipedians, you can help?)
And finally, could you connect me with more people in India who are
associated with this project or may be interested in networking on it? Is
there a facebook page on this? Mind if I set one up?
Cheers,
Nikhil Sheth
+91-966-583-1250
Teach For India Fellow 2011-13
Pune, India
www.nikhilsheth.tk
Find me on: Twitter <http://twitter.com/nikhiljs> |
Facebook<http://www.facebook.com/nikjs>|
LinkedIn <http://in.linkedin.com/in/nikhiljs> | Google
<http://www.google.com/profiles/nikhil.js>|
RangDe<http://www.rangde.org/investor/nikhilsheth>
Join me on: Pune Documentary
Club<http://www.facebook.com/group.php?gid=138497769525636>| Let's
Do it Pune <http://www.facebook.com/pages/Lets-do-it-Pune/103857326346659> |
Toastmasters in
Pune<http://www.facebook.com/pages/Toastmasters-in-Pune/148767611833746>
---------- Forwarded message ----------
From: Nikhil Sheth <nikhil.js(a)gmail.com>
Date: Wed, Jan 19, 2011 at 11:00 AM
Subject: Re: Nikhil, a news tip
To: Simon Owens <simon.bloggasm(a)gmail.com>
Hi Simon,
Great job done!!
This video already got posted in the main blog
post<http://technosophi.blogspot.com/2011/01/10th-anniversary-of-wikipedia-mumba…>that
reported on this event and I'll share this too, as did something else
I've set up and would need some help in:
Wikipedia For Schools - offline version
We want to put wikipedia for schools offline version in each and every
school and non-internet-connected computer in India. I've implemented it at
one under-resourced school for poor kids in Pune (my hometown) and the
results are amazing - kids who have never seen the internet are suddenly
surfing through all sorts of articles using this - it's empowering in a way
that has never happened before.
Many people were having problems downloading the 2.6 GB Wikipedia for
Schools .ZIM file from Kiwix, so after the meetup, I've split it into 100MB
parts and uploaded here. Also made a torrent which I'm hosting (need more
seeders!)
http://wikipediaforschools.4shared.com
The README file there has instructions on how to go about it.
So I need help in spreading the word. I want to set up a website (preferably
a wiki only) where people can enlist the schools where they pledge to
install this, and then come back and confirm when the deed is done. I also
want to reach out to computer vendors to install it in all computers that
they sell or repair. I'd start off with India but this can go international
as well.
Let me know if you can help with this project, and feedback if I'm doing
something wrong.
And Kudos for the amazing video again!
Cheers,
Nikhil Sheth
+91-966-583-1250
Pune, India
www.nikhilsheth.tk
Find me on: Twitter <http://twitter.com/nikhiljs> |
Facebook<http://www.facebook.com/nikjs>|
LinkedIn <http://in.linkedin.com/in/nikhiljs> | Google
<http://www.google.com/profiles/nikhil.js>|
RangDe<http://www.rangde.org/investor/nikhilsheth>
Join me on: Pune Documentary
Club<http://www.facebook.com/group.php?gid=138497769525636>| Let's
Do it Pune <http://www.facebook.com/pages/Lets-do-it-Pune/103857326346659> |
Toastmasters in
Pune<http://www.facebook.com/pages/Toastmasters-in-Pune/148767611833746>
On Wed, Jan 19, 2011 at 3:40 AM, Simon Owens <simon.bloggasm(a)gmail.com>wrote:
> Hey Nikhil,
>
> I read your post the other day mentioning Wikipedia's 10th anniversary. I
> work with a group that teamed up with Jimmy Wales to create a video on the
> state of Wikipedia (Wales narrates the video). We depicted an animated
> history of the site and detailed where Wales would like to see it head in
> the future:
>
> http://www.youtube.com/watch?v=gXD1TRGafQ0
>
> Anyway, I thought this was something you and your readers would find
> interesting.
>
> Take care,
> Simon
>
>
>
> --
> http://bloggasm.com
> http://twitter.com/simonowens
>
Dear all,
as the year is almost over, I have started to write the yearly report of
what the openZIM did in 2010 and how we spent our money that has been
generously donated by Wikimedia CH.
* https://openzim.org/Yearly_Report_2010
This document is still a draft, please add whatever you think should be
included.
Meanwhile I prepared the budget for 2011. Due to our decision to combine
our developers meeting with Wikimania in Haifa and pay travel costs in
order to allow all contributors to participate we need a much higher
budget than this year.
I have based my budget on the assumption that we will have to reimburse
10 participants with flights of 500 EUR each and 100 EUR per night in
the hotel.
* http://openzim.org/Budget_2011
As we didn't have a 3rd Developers Meeting in 2010 we actually spent
less money as in 2009, there are more than 6000 EUR left. The budget for
2011 also provides a lot of room, as I don't want to deny any
contributors to participate at Wikimania due to lack of money or because
flights might get more expensive etc...
You can help saving our budget by registering for Wikimania right
tomorrow and make use of the early bird discount for registration and
hotel accommodation!
Comments are welcome! Please have a great start into 2011!
Thanks,
Manuel
--
Regards
Manuel Schneider
Wikimedia CH - Verein zur Förderung Freien Wissens
Wikimedia CH - Association for the advancement of free knowledge
www.wikimedia.ch
Hello,
I recently discover kiwix and the zim file. It seems a really great
project for offline use, even if there is still a lot of challenges.
For now, as a traveller, I would want to have a recent & usable dump
of some wiki (wikipedia, wikitravel, wiki.couchsurfing, wikivoyage,
...) and find really hard to achieve it.
As a reference, I found
http://en.wikipedia.org/wiki/Wikipedia:Database_downloadhttp://www.kiwix.org/index.php/Main_Pagehttp://wikitravel.org/en/Wikitravel:Offline_Reader_Expeditionhttp://www.wikivoyage.org/tech/Database_dumps
But in most case, the best I have is
* a mediawiki xml archive
* last, need to mirror website with httrack or wget (and ensuring to
copy only one language release: only en, fr, de, ...)
In this case, is there any available scripts to build a zim file ?
I have checked http://www.kiwix.org/index.php/Tools but as I'm in
travel, I don't have time to make each atomic operations, would really
prefer a batch.
Else, thanks a lot for your work.
Can't wait to have it available on different devices (computer,
smartphone, ...) with all wiki :)
Cheers
Julien
Hello, everyone.
I thought it might interest some of you:
http://reagle.org/joseph/2011/01/mw-tutorial.html
Asaf
P.S. Reagle will be a keynote speaker (not about this...) at Wikimania 2011
in Haifa.
--
Asaf Bartov <asaf.bartov(a)gmail.com>
These new APIs may be very useful for offline content developers.
---------- Forwarded message ----------
From: Luca de Alfaro <luca(a)dealfaro.com>
Date: 2011/2/3
Subject: [Toolserver-l] APIs giving origin and author of text ("blame"
maps), and signals on revision vandalism
To: toolserver-l(a)lists.wikimedia.org
Dear All,
We wanted to let you know of three recent APIs we have built for
WikiTrust that may be useful to tool developers. If anyone would like
to build a service on top of these APIs (or have suggestions for other
APIs that we might be able to provide with our data), we would love to
work with you to make it happen.
kind regards,
Luca, Bo, and Ian
VANDALISM API: A request like
http://en.collaborativetrust.com/WikiTrust/RemoteAPI?method=quality&revid=4…
returns the vandalism probability for revision 1234. This is a plain
text floating point number from zero to one, where 1.0 means that the
revision is vandalism.
SELECTION API: A request like
http://en.collaborativetrust.com/WikiTrust/RemoteAPI?method=select&pageid=2…
returns a JSON array of objects describing the top-quality recent
revisions of the page. Each entry consist of a revision_id, and of a
few additional parameters.
TEXT ORIGIN API: A request like
http://en.collaborativetrust.com/WikiTrust/RemoteAPI?method=wikimarkup&page…
returns a JSON object containing a string, consisting of the WikiTrust
text with some additional markup. The markup consists in tags like:
Since {{#t:10,84893431,Habitual gardner}}its inception in
{{#t:10,86765634,Bassemkhalifa}}1928 the movement
which means that the words “its inception in” were written by
“Habitual gardner”, in revision 86765634 (and have trust 10).
---
See http://www.wikitrust.net/vandalism-api for additional information
about these APIs.
_______________________________________________
Toolserver-l mailing list (Toolserver-l(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/toolserver-l
Posting guidelines for this list:
https://wiki.toolserver.org/view/Mailing_list_etiquette
--
Erik Möller
Deputy Director, Wikimedia Foundation
Support Free Knowledge: http://wikimediafoundation.org/wiki/Donate
On 2/1/2011 5:50 AM, Ashwin Baindur wrote:
> To conclude, I do not take it as a given that every thing is hunky
> dorey. Without meaning disrespect for the absolutely wonderful work
> and colossal efforts put in by the SOS Children's village Wikipedia
> team, I personally would like to tweak it so as to suit the Indian
> palate. I too am part of the world movement but I consider it a glocal
> one, not a global one. At this point of the time, I'm looking at how
> to make the world relevant to our locality.
The other albeit obvious thing to note is that beyond perhaps the "local
relevance" of articles, there are vast differences in article QUALITY
cross-languages. That is, certain articles may have been excluded from
the SOS version due to poor quality rather than importance/relevance,
and this of course could and would work both ways across language
projects. So, we need to make sure there are structures in place to
rate article quality within a given language project which we want to
place into the offline versions.
On another note - I STRONGLY agree that creating offline versions in the
native languages is of utmost importance. If we can do this, the
distribution will not only be better received, but could actually be
much more impactful at large. UNESCO wrote a report in 2005 which stated:
/"Denial to access to information in one's mother tongue is equivalent
to a denial of a human right...In terms of pedagogy, how do children
learn best? In their mother tongue."[1]/
The creation of quality-filtered offline materials in many languages is
an incredibly important project and one that Wikimedia is uniquely
positioned to tackle. Glad we are working so actively on figuring this out.
Jessie
[1] http://en.childrenslibrary.org/about/mission.shtml [admission: I've
never been able to find this actual report, although I haven't spent a
significant amount of time looking. I'll track it down soon enough...]
--
Jessie Wild
Special Projects Manager
Global Development
Wikimedia Foundation