Offline-l

offline-l@lists.wikimedia.org

5 participants
691 discussions

[KIWIX] A few good news for February!
by Emmanuel Engelhart 09 Feb '13

09 Feb '13

Hi, The February month starts with two good news for Kiwix and Wikipedia offline in general: * For the first time we have had 100.000 downloads a month of Kiwix. * Kiwix was elected "Project of the Month" at Sourceforge, and published an interview of myself http://sourceforge.net/blog/potm-201302/ Kind regards Emmanuel

5 7

Name collision between openZIM and zim-wiki
by Emmanuel Engelhart 14 Jan '13

14 Jan '13

Hi, We have a name collision between our project openZIM and an other project called Zim-wiki: * Zim-wiki (http://zim-wiki.org/), a local wiki solution * openZIM (http://www.openzim.org), a file format to store offline web content Zim-wiki is a little bit older than openZIM, so it seems to be "our fault". Although this problem is not new, this starts to be a real problem. For example for Debian which currently tries to package our zimlib: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=698111 I would propose the name the package like "libopenzim", but this is more a workaround than a real solution. You have maybe more ideas about how to fix this issue? Kind regards Emmanuel

3 2

Javascript ZIM reader?
by Douglas Crosher 04 Jan '13

04 Jan '13

Hi, Has anyone considered a pure Javascript ZIM file reader and Wikipedia reader? I have made a small start, writing some hack code to open a ZIM file and it gets to the point of needing to uncompress a cluster. A start has been made on the needed XZ decompress code but it's not done yet. If practical then this could provide a portable offline reader that could suit any device with a modern web browser, and provide a reader for Android tablets, and Firefox OS, etc. Perhaps even node.js servers. If someone has already tried this and found the performance to be too poor then please let me know? Btw: has adding thumbnail image support to the ZIM file format been considered? This would be very handy for a ZIM file selector in a tablet or phone UI. Regards Douglas Crosher

5 18

70.000 Kiwix downloads in December 2012!
by Emmanuel Engelhart 04 Jan '13

04 Jan '13

Hi We have reached a new peak in our audience last month! We delivered 70.000 copies of Kiwix from our Website: * 40.000 "nacked" tarballs * 30.000 bundles (with a Wikipedia ZIM file) A few Wikipedia communities put notices and this really helped to advert Wikipedia Offline. We also received thousands of user feedbacks telling us and thanking us for helping them having an encyclopedia although they do not (always) have access to internet. If you have ideas to help us spreading Wikipedia offline, feel free to implement them. Your help is really welcome. Kind regards Emmanuel

4 9

Request for technical help with English Wikipedia release Version 0.9
by Martin A. Walker 31 Dec '12

31 Dec '12

Dear all, Thanks to Emmanuel and others for their work in making Kiwix even better! We need to work on updating content, as suggested here: http://sourceforge.net/p/kiwix/feature-requests/479/ I would really like to work on preparing our next release of the English Wikipedia (called Version 0.9), but I need some technical help in preparing the collection. User:CBM has done this in the past, but he is unable to do this now. Can anyone here help out? I believe that some knowledge of Perl and the WP:1.0 bot may be needed. CBM has offered to help in teaching a new person. Many thanks, Martin (User:Walkerma) Martin A. Walker Department of Chemistry SUNY College at Potsdam Potsdam, NY 13676 USA +1 (315) 267-2271

4 5

Kiwix 0.9 rc2 released!
by Emmanuel Engelhart 29 Dec '12

29 Dec '12

Hi The second release candidate of Kiwix 0.9 (Kiwix 0.9 rc2) is now online! The most important improvements are: * FIXED: kiwix-install crashes * FIXED: kiwix-serve memory leak on ARM (ID: 3538663) * FIXED: Open link in new tab from the right-click contextual menu (ID: 3553735) * FIXED: Problems in creating PDF/HTML from tabs (#362) * FIXED: Kiwix crashes on MS/Windows with "special" files (#317) * FIXED: Indexing progression computation (more accurate) * FIXED: Broken suggestion/search textbox with “syllable input mode” * FIXED: Internet Explorer compatibility issues with kiwix-serve. * FIXED: Sporadically dying (serving big contents) kiwix-serve (#371) * FIXED: kiwix-* console tools do not start on OSX * NEW: New supported user interface languages: Zazaki (diq), Javanese (jv), Khmer (km), Urdu (ur), Burmese (my), South Azerbaijani (azb) * NEW: "Inverted colors" feature (ID: 3551975) * NEW: Start Kiwix from the console with -search cmd line argument (ID: 3538176) * NEW: Search suggestions in kiwix-serve (ID: 2945983) * NEW: Desktop shortcut creation in Windows installer * NEW: kiwix-serve (HTTP server) for MS/Windows (#140) * NEW: Persistent bookmark set over sessions (#188) Detailed changelog may be found at: http://changelog.kiwix.org The most important improvement is the integration/port of kiwix-serve (our ZIM HTTP server) in the Kiwix UI for Windows, OSX and Linux. That means that everybody is now able in a few clicks to share Wikipedia on his LAN. We believe this could be a really practical feature, for example in schools. Download: * Software at https://sourceforge.net/projects/kiwix/files/0.9_rc2/ * Content at http://www.kiwix.org Report bugs and request features at: * http://reportabug.kiwix.org * http://requestafeature.kiwix.org Although Kiwix is already really stable, we think we will need one or two release candidates more. We want to improve a little bit the file/profile/index managements, fix the broken CLucene fulltext backend and a few other things. Stay tuned at: * http://microblog.kiwix.org * http://planet.kiwix.org * http://blog.kiwix.org * https://lists.sourceforge.net/lists/listinfo/kiwix-developer * https://lists.sourceforge.net/lists/listinfo/kiwix-testing Regards Emmanuel

2 1

Images from en-wiki
by wp mirror 21 Dec '12

21 Dec '12

Dear Sanjay, Let me address your question, on how to add images to your local copy of enwiki, in part 4 below. But some preliminaries might be in order: 1) ENWIKI. Building a mirror of <http://en.wikipedia.org/> is the most demanding case. Details on how to do so, can be found in the WP-MIRROR Reference Manual <http://www.nongnu.org/wp-mirror/manual/wp-mirror-0.5.pdf>. The enwiki is still growing, so if you decide to download all the images, then I would suggest purchasing 3T hard drives, rather than 2T. 2) SIMPLEWIKI. If you have not already done so, you may wish to take a look at <http://simple.wikipedia.org/> to see if mirroring the simplewiki meets your needs. Simple English means shorter sentences and is intended for those who learned English as a Second Language (ESL). The most recent dump file <http://dumps.wikimedia.org/simplewiki/20121209/simplewiki-20121209-pages-ar…> has 123k articles, 66k images, and occupies 60G of hard disk space. 3) WP-MIRROR. Wp-mirror is a mirror building utility. It uses MediaWiki and imports the articles into databases managed by MySQL. It downloads full size images. By default, it builds a mirror of the `simple' wikipedia, but it can be configured for any set of wikipedias. It works `out-of-the-box' for GNU/Linux distributions: Debian 7.0 (wheezy) and Ubuntu 12.10 (quantal). Home page <http://www.nongnu.org/wp-mirror/>. As you mentioned that you are `currently running a WAMP solution', I should point out that WP-MIRROR has not been ported to Windows. And now to your question: 4) IMAGES. There is a way to download SOME of the images (rather than all) for the enwiki. Wp-mirror, as part of its duties: 1) splits the dump file into chunks (x-chunks) of 1000 pages each, 2) scrapes each x-chunk to find image file names, and 3) generates a shell script (i-chunk) for downloading the image files referenced in the corresponding x-chunk. This means that you can run just the i-chunks that you want. Example: Running the first 100 i-chunks would download the images for the first 100,000 pages, which are the pages that are the oldest, largest, and most decorated with images. So the method might work as follows: 1) install wp-mirror on a laptop with wheezy or quantal, 2) configure it for enwiki, 3) run it just long enough to generate the i-chunks, 4) abort wp-mirror, 5) run the desired i-chunks manually, and 6) move the images over to your WAMP server. 5) PERFORMANCE. At the suggestion of Jason Skomorowski, the next version of wp-mirror will have a number of performance enhancements. In particular, the i-chunks will make use of HTTP/1.1 persistent connections [RFC2616]. If you are in a hurry, wp-mirror 0.5 should work fine; but, if you can wait a month or so, version 0.6, when released, will download image files with far less latency. Let me know if I can be of any help. Sincererly Yours, Kent

1 0

Fwd: Kiwix 0.9 RC2 pre-release
by Emmanuel Engelhart 21 Dec '12

21 Dec '12

Please help us to test new release! -------- Original Message -------- Subject: Kiwix 0.9 RC2 pre-release Date: Thu, 20 Dec 2012 17:01:34 +0100 From: Emmanuel Engelhart <kelson(a)kiwix.org> To: kiwix-testing(a)lists.sourceforge.net <kiwix-testing(a)lists.sourceforge.net> CC: Mailing list for Wikimedia CH <wikimediach-l(a)lists.wikimedia.org> Dear Kiwix testers After 5 months of work, we have finished the new release candidate (RC3) version of Kiwix 0.9. We plan to release it officially on Monday, but wanted to give us a few days, with your help, to get a chance to detect critical bugs and regressions. All binaries are available here: http://download.kiwix.org/bin/nightly/latest/ You may find the whole changelog there: http://changelog.kiwix.org The most essential features to test *on all OSes* are: * kiwix-serve (HTTP server) integration in UI (menu tools>server) * kiwix-* console tools (particularly kiwix-serve) Thank you in advance for your feedbacks Regards Emmanuel

4 4

Images from en-wiki
by Sanjay Bappudi 20 Dec '12

20 Dec '12

Hi! I have a couple quick questions that I couldn't really find the answer to anywhere online. I'm trying to find the best way to have my local copy of en-wiki be able to have images. 1. The image tarball from your.org for en-wiki ( http://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/fulls/20121201/) is *around 2 terrabytes total!* Thats way too big for me. 2. I'm also considering using *Wikix*, but I couldn't find any recent references to the size of images that would download (everything i found was <2008) 3. And lastly, I'm wondering if there is a way to turn a .ZIM file back into database format to be able to import into mysql (I'm currently running WAMP server solution). The big thing here is I *do not need all of the text of en-wiki* (hence, the .zim consideration) *NOR all of the images*. I want to do this in the most economical way possible. Does anyone have any suggestions?

2 1

New Offline Wikipedia audience measurement tool!
by Emmanuel Engelhart 17 Dec '12

17 Dec '12

Hi We have revamped the audience measurement system of Kiwix. We provide now and easy and practical tool for people who want detailed and accurate data about the offline Wikipedia downloads. Everything is available at: http://stats.kiwix.org It's important to notice that you have two sites (there is a selector at the top-right corner): * www.kiwix.org for the web visitors * download.kiwix.org for the file (ZIM, ZIP, ...) downloads For now, we do not have so much historic data because the tool is new, but you can already use it and have a look to the data of the last days. We can especially see the impact of putting a notice on Wikipedia (currently on the WPAR and WPFA) to advert the existence of Wikipedia offline! I have also made a tech. blog post explaining how it works: http://blog.kiwix.org/post/2012/12/09/Nginx-or-Apache%2C-Mirrorbrain-and-Pi… Kind regards Emmanuel

1 0

← Newer
1
...
29
30
31
32
33
34
35
...
70
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Offline-l