Offline-l

offline-l@lists.wikimedia.org

696 discussions

Kiwix 0.9 rc2 released!
by Emmanuel Engelhart 29 Dec '12

29 Dec '12

Hi The second release candidate of Kiwix 0.9 (Kiwix 0.9 rc2) is now online! The most important improvements are: * FIXED: kiwix-install crashes * FIXED: kiwix-serve memory leak on ARM (ID: 3538663) * FIXED: Open link in new tab from the right-click contextual menu (ID: 3553735) * FIXED: Problems in creating PDF/HTML from tabs (#362) * FIXED: Kiwix crashes on MS/Windows with "special" files (#317) * FIXED: Indexing progression computation (more accurate) * FIXED: Broken suggestion/search textbox with “syllable input mode” * FIXED: Internet Explorer compatibility issues with kiwix-serve. * FIXED: Sporadically dying (serving big contents) kiwix-serve (#371) * FIXED: kiwix-* console tools do not start on OSX * NEW: New supported user interface languages: Zazaki (diq), Javanese (jv), Khmer (km), Urdu (ur), Burmese (my), South Azerbaijani (azb) * NEW: "Inverted colors" feature (ID: 3551975) * NEW: Start Kiwix from the console with -search cmd line argument (ID: 3538176) * NEW: Search suggestions in kiwix-serve (ID: 2945983) * NEW: Desktop shortcut creation in Windows installer * NEW: kiwix-serve (HTTP server) for MS/Windows (#140) * NEW: Persistent bookmark set over sessions (#188) Detailed changelog may be found at: http://changelog.kiwix.org The most important improvement is the integration/port of kiwix-serve (our ZIM HTTP server) in the Kiwix UI for Windows, OSX and Linux. That means that everybody is now able in a few clicks to share Wikipedia on his LAN. We believe this could be a really practical feature, for example in schools. Download: * Software at https://sourceforge.net/projects/kiwix/files/0.9_rc2/ * Content at http://www.kiwix.org Report bugs and request features at: * http://reportabug.kiwix.org * http://requestafeature.kiwix.org Although Kiwix is already really stable, we think we will need one or two release candidates more. We want to improve a little bit the file/profile/index managements, fix the broken CLucene fulltext backend and a few other things. Stay tuned at: * http://microblog.kiwix.org * http://planet.kiwix.org * http://blog.kiwix.org * https://lists.sourceforge.net/lists/listinfo/kiwix-developer * https://lists.sourceforge.net/lists/listinfo/kiwix-testing Regards Emmanuel

2 1

Images from en-wiki
by wp mirror 21 Dec '12

21 Dec '12

Dear Sanjay, Let me address your question, on how to add images to your local copy of enwiki, in part 4 below. But some preliminaries might be in order: 1) ENWIKI. Building a mirror of <http://en.wikipedia.org/> is the most demanding case. Details on how to do so, can be found in the WP-MIRROR Reference Manual <http://www.nongnu.org/wp-mirror/manual/wp-mirror-0.5.pdf>. The enwiki is still growing, so if you decide to download all the images, then I would suggest purchasing 3T hard drives, rather than 2T. 2) SIMPLEWIKI. If you have not already done so, you may wish to take a look at <http://simple.wikipedia.org/> to see if mirroring the simplewiki meets your needs. Simple English means shorter sentences and is intended for those who learned English as a Second Language (ESL). The most recent dump file <http://dumps.wikimedia.org/simplewiki/20121209/simplewiki-20121209-pages-ar…> has 123k articles, 66k images, and occupies 60G of hard disk space. 3) WP-MIRROR. Wp-mirror is a mirror building utility. It uses MediaWiki and imports the articles into databases managed by MySQL. It downloads full size images. By default, it builds a mirror of the `simple' wikipedia, but it can be configured for any set of wikipedias. It works `out-of-the-box' for GNU/Linux distributions: Debian 7.0 (wheezy) and Ubuntu 12.10 (quantal). Home page <http://www.nongnu.org/wp-mirror/>. As you mentioned that you are `currently running a WAMP solution', I should point out that WP-MIRROR has not been ported to Windows. And now to your question: 4) IMAGES. There is a way to download SOME of the images (rather than all) for the enwiki. Wp-mirror, as part of its duties: 1) splits the dump file into chunks (x-chunks) of 1000 pages each, 2) scrapes each x-chunk to find image file names, and 3) generates a shell script (i-chunk) for downloading the image files referenced in the corresponding x-chunk. This means that you can run just the i-chunks that you want. Example: Running the first 100 i-chunks would download the images for the first 100,000 pages, which are the pages that are the oldest, largest, and most decorated with images. So the method might work as follows: 1) install wp-mirror on a laptop with wheezy or quantal, 2) configure it for enwiki, 3) run it just long enough to generate the i-chunks, 4) abort wp-mirror, 5) run the desired i-chunks manually, and 6) move the images over to your WAMP server. 5) PERFORMANCE. At the suggestion of Jason Skomorowski, the next version of wp-mirror will have a number of performance enhancements. In particular, the i-chunks will make use of HTTP/1.1 persistent connections [RFC2616]. If you are in a hurry, wp-mirror 0.5 should work fine; but, if you can wait a month or so, version 0.6, when released, will download image files with far less latency. Let me know if I can be of any help. Sincererly Yours, Kent

1 0

Fwd: Kiwix 0.9 RC2 pre-release
by Emmanuel Engelhart 21 Dec '12

21 Dec '12

Please help us to test new release! -------- Original Message -------- Subject: Kiwix 0.9 RC2 pre-release Date: Thu, 20 Dec 2012 17:01:34 +0100 From: Emmanuel Engelhart <kelson(a)kiwix.org> To: kiwix-testing(a)lists.sourceforge.net <kiwix-testing(a)lists.sourceforge.net> CC: Mailing list for Wikimedia CH <wikimediach-l(a)lists.wikimedia.org> Dear Kiwix testers After 5 months of work, we have finished the new release candidate (RC3) version of Kiwix 0.9. We plan to release it officially on Monday, but wanted to give us a few days, with your help, to get a chance to detect critical bugs and regressions. All binaries are available here: http://download.kiwix.org/bin/nightly/latest/ You may find the whole changelog there: http://changelog.kiwix.org The most essential features to test *on all OSes* are: * kiwix-serve (HTTP server) integration in UI (menu tools>server) * kiwix-* console tools (particularly kiwix-serve) Thank you in advance for your feedbacks Regards Emmanuel

4 4

Images from en-wiki
by Sanjay Bappudi 20 Dec '12

20 Dec '12

Hi! I have a couple quick questions that I couldn't really find the answer to anywhere online. I'm trying to find the best way to have my local copy of en-wiki be able to have images. 1. The image tarball from your.org for en-wiki ( http://ftpmirror.your.org/pub/wikimedia/imagedumps/tarballs/fulls/20121201/) is *around 2 terrabytes total!* Thats way too big for me. 2. I'm also considering using *Wikix*, but I couldn't find any recent references to the size of images that would download (everything i found was <2008) 3. And lastly, I'm wondering if there is a way to turn a .ZIM file back into database format to be able to import into mysql (I'm currently running WAMP server solution). The big thing here is I *do not need all of the text of en-wiki* (hence, the .zim consideration) *NOR all of the images*. I want to do this in the most economical way possible. Does anyone have any suggestions?

2 1

New Offline Wikipedia audience measurement tool!
by Emmanuel Engelhart 17 Dec '12

17 Dec '12

Hi We have revamped the audience measurement system of Kiwix. We provide now and easy and practical tool for people who want detailed and accurate data about the offline Wikipedia downloads. Everything is available at: http://stats.kiwix.org It's important to notice that you have two sites (there is a selector at the top-right corner): * www.kiwix.org for the web visitors * download.kiwix.org for the file (ZIM, ZIP, ...) downloads For now, we do not have so much historic data because the tool is new, but you can already use it and have a look to the data of the last days. We can especially see the impact of putting a notice on Wikipedia (currently on the WPAR and WPFA) to advert the existence of Wikipedia offline! I have also made a tech. blog post explaining how it works: http://blog.kiwix.org/post/2012/12/09/Nginx-or-Apache%2C-Mirrorbrain-and-Pi… Kind regards Emmanuel

1 0

WP-MIRROR 0.5 released
by wp mirror 14 Dec '12

14 Dec '12

Dear list members, I am pleased to announce the release of WP-MIRROR 0.5. The main design objective was this: WP-MIRROR 0.5 should be `feature complete'. It is now deemed beta-ware. Examples of new features are: Concurrency: Adding, building, and dropping wikipedias from the mirror can now we done concurrently. The main use case is this: During the build of the default `simple' wikipedia, one may add additional wikipedias to the mirror. Images: WP-MIRROR 0.5 does a more thorough job of identifying image files to be downloaded. Interwiki links: If the mirror has two or more wikipedias, then Interlanguage links now appear in the Navigation Bar. That is, when browsing an article in one wikipedia, the link to the corresponding article in the other wikipedia appears in the Navigation Bar, so that the user can readily switch between the two. Packaging: The DEB package for WP-MIRROR 0.5 should work `out-of-the-box' with no user configuration for the following distributions: o Debian GNU/Linux 7.0 (wheezy) o Ubuntu 12.10 (quantal) Virtual Host: URL has been changed to <http://simple.wpmirror.site/>. Consistency of naming was the motivation. The web page <http://www.nongnu.org/wp-mirror/> has been updated. Feedback is welcome. Sincerely Yours, Dr. Kent L. Miller

1 0

Nanoscale printing of Wikipedia
by Federico Leva (Nemo) 18 Nov '12

18 Nov '12

Some people are trying to «printing all of Wikipedia onto 6-inch nickel discs [...] 270 discs, each about 1mm thick». <https://en.wikipedia.org/w/index.php?title=Wikipedia:Village_pump_%28techni…> They "only" need all the articles in raster image format, they say. I think their safest bet would be to take an HTML/ZIM dump and then use one of the many tools like http://khtml2png.sourceforge.net/ to get a PNG or other image format, but it would be nice if some of you could give some better informed advice. Nemo

2 4

(no subject)
by wp mirror 14 Nov '12

14 Nov '12

Dear Emmanuel, I compared each of the dependencies of WP-MIRROR 0.4 against recent Ubuntu releases: Ubuntu 12.04 Precise - has most dependencies, but not MediaWiki 1.19. Ubuntu 12.10 Quantal - has all of the dependencies. Please try (or have a friend try) to install WP-MIRROR on Ubuntu 12.10 Quantal. Sincerely Yours, Kent

1 0

(no subject)
by wp mirror 13 Nov '12

13 Nov '12

Dear list members, I am pleased to announce the release of WP-MIRROR 0.4. The main design objective of this version is this: WP-MIRROR 0.4 should work `out-of-the-box' with no user configuration. The web page <http://www.nongnu.org/wp-mirror/> has been updated. Feedback is welcome. Sincerely Yours, Dr. Kent L. Miller

2 1

Building a ZIM file with images
by Jason Skomorowski 30 Oct '12

30 Oct '12

Hi! I would like to build a ZIM file of the Simple English Wikipedia including the full resolution images for educational use in a region without reliable Internet access. So far as I can tell, I would need to: * grab a copy of the current dump and use something like http://meta.wikimedia.org/wiki/Wikix to populate it with images * set it up to be served via HTTP, possibly by importing into a local mediawiki instance ...alternatively: * http://www.nongnu.org/wp-mirror/ And then: * spider the whole thing into html/images using curl/wget * use Zimwriter+buildZimFromDirectory as per here: https://openzim.org/Build_your_ZIM_file Good plan? Better plan? Is there a flag on any of this to limit things to redistributable images so I can add a torrent for the resulting (est. 50-60Gb) file to the kiwix site? Best, Jason Skomorowski

4 8

← Newer
1
...
30
31
32
33
34
35
36
...
70
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

Offline-l