Offline blog post

List overview All Threads
Download

newer

older

Re: [Offline-l] Enable WikiTrust...

[openZIM dev-l] Fwd: Re: Wikimania...

Jessie Wild

17 Mar 2011 17 Mar '11

12:59 a.m.

Just wanted to draw your attention to the blog post that went out today regarding offline: http://blog.wikimedia.org/ Feel free to leave comments either there or on this list! Best, Jessie *** *Update on Offline Wikipedia Projects * The last week was a big week for expanding offline Wikipedia <http://meta.wikimedia.org/wiki/Offline_Projects> work. Right now, /offline/ refers to supporting read access to Wikimedia content without an Internet connection. This increases the reach of the Wikipedia movement by providing more opportunities for people all over the world to access the materials. Some of the recent initiatives surrounding this project were documented in Wikimedia's tech blog <http://techblog.wikimedia.org/2011/01/update-on-offline-wikimedia-projects/> about a month ago (for more detail regarding the purpose for offline work, see the offline strategy <http://strategy.wikimedia.org/wiki/Offline> page). In support of our offline readership work, we're thrilled to announce the launch of a new feature on Wikipedia developed with our partners from PediaPress <http://pediapress.com/>. Last week we enabled openZim <http://openzim.org/Main_Page> (the main file format in which offline materials are stored) export for the existing PediaPress collections extension on English Wikipedia and numerous other wikis. This means that individuals can now use the existing PediaPress Create a book <http://en.wikipedia.org/wiki/Help:Books> tool and download it in a format which can be read offline (via an offline reader, such as Kiwix <http://kiwix.org/index.php/Main_Page>). This is important because it opens new avenues for the creation of offline materials, for example, an openZim library hosting different offline "book" options. Also, the English offline collection Wikipedia 0.8 <http://en.wikipedia.org/wiki/Wikipedia:Version_0.8>was made officially available <http://en.wikipedia.org/wiki/Wikipedia:Version_0.8/downloads>, after much hard work by the Wikipedia 1.0 Editorial Team <http://en.wikipedia.org/wiki/Wikipedia:Version_1.0_Editorial_Team>. This collection is an iteration in the process of developing a vetted collection of offline articles selected based on their quality and topical importance. The main constraint with an offline product is the data size restrictions: the entirety of Wikipedia must somehow be condensed so that it fits on a CD, DVD, or USB stick. Wikipedia 1.0 aims at creating the highest quality and most valuable subset of Wikipedia to meet those size requirements, and v0.8 is a precursor. Wikipedia 0.8 is a general collection of just under 50K articles, It is available for Mac, PC, or Linux with a Linux or Okawix reader; some mobile phone versions will be available later this month as well. More updates are sure to come on this offline front: Wikimedians around the world are actively assisting in the development of offline collections as well as distribution. We are excited to support and document the momentum going forward. Jessie Wild, Global Development

Attachments:

attachment.htm (text/html — 4.0 KB)

Show replies by thread

Martin A. Walker

17 Mar 17 Mar

4:40 a.m.

Thanks a lot! Martin Jessie Wild wrote:

...

Manuel Schneider

8:20 a.m.

Thanks Jessie for the blog post and sharing it with us! I have put a link on our openzim.org webpage. /Manuel On 16.03.2011 23:59, Jessie Wild wrote:

...

Just wanted to draw your attention to the blog post that went out today regarding offline: http://blog.wikimedia.org/ Feel free to leave comments either there or on this list! Best, Jessie *** *Update on Offline Wikipedia Projects * The last week was a big week for expanding offline Wikipedia <http://meta.wikimedia.org/wiki/Offline_Projects> work. Right now, /offline/ refers to supporting read access to Wikimedia content without an Internet connection. This increases the reach of the Wikipedia movement by providing more opportunities for people all over the world to access the materials. Some of the recent initiatives surrounding this project were documented in Wikimedia’s tech blog <http://techblog.wikimedia.org/2011/01/update-on-offline-wikimedia-projects/> about a month ago (for more detail regarding the purpose for offline work, see the offline strategy <http://strategy.wikimedia.org/wiki/Offline> page). In support of our offline readership work, we're thrilled to announce the launch of a new feature on Wikipedia developed with our partners from PediaPress <http://pediapress.com/>. Last week we enabled openZim <http://openzim.org/Main_Page> (the main file format in which offline materials are stored) export for the existing PediaPress collections extension on English Wikipedia and numerous other wikis. This means that individuals can now use the existing PediaPress Create a book <http://en.wikipedia.org/wiki/Help:Books> tool and download it in a format which can be read offline (via an offline reader, such as Kiwix <http://kiwix.org/index.php/Main_Page>). This is important because it opens new avenues for the creation of offline materials, for example, an openZim library hosting different offline “book” options. Also, the English offline collection Wikipedia 0.8 <http://en.wikipedia.org/wiki/Wikipedia:Version_0.8>was made officially available <http://en.wikipedia.org/wiki/Wikipedia:Version_0.8/downloads>, after much hard work by the Wikipedia 1.0 Editorial Team <http://en.wikipedia.org/wiki/Wikipedia:Version_1.0_Editorial_Team>. This collection is an iteration in the process of developing a vetted collection of offline articles selected based on their quality and topical importance. The main constraint with an offline product is the data size restrictions: the entirety of Wikipedia must somehow be condensed so that it fits on a CD, DVD, or USB stick. Wikipedia 1.0 aims at creating the highest quality and most valuable subset of Wikipedia to meet those size requirements, and v0.8 is a precursor. Wikipedia 0.8 is a general collection of just under 50K articles, It is available for Mac, PC, or Linux with a Linux or Okawix reader; some mobile phone versions will be available later this month as well. More updates are sure to come on this offline front: Wikimedians around the world are actively assisting in the development of offline collections as well as distribution. We are excited to support and document the momentum going forward. Jessie Wild, Global Development _______________________________________________ Offline-l mailing list Offline-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/offline-l

-- Regards Manuel Schneider Wikimedia CH - Verein zur Förderung Freien Wissens Wikimedia CH - Association for the advancement of free knowledge www.wikimedia.ch

Pascal Martin

9:52 a.m.

Bonjour Could you please add a link to http://www.okawix.com ? We have also writing an article : http://blog.wikiwix.com/en/2011/03/15/archives-de-la-version-0-8-de-wikiped…; Cordialement Pascal Martin 06 13 89 77 32 02 32 40 23 69 ----- Original Message ----- From: Jessie Wild To: Using Wikimedia projects and MediaWiki offline ; WikimediaAnnounce-l(a)lists.wikimedia.org Sent: Wednesday, March 16, 2011 11:59 PM Subject: [Offline-l] Offline blog post Just wanted to draw your attention to the blog post that went out today regarding offline: http://blog.wikimedia.org/ Feel free to leave comments either there or on this list! Best, Jessie *** Update on Offline Wikipedia Projects The last week was a big week for expanding offline Wikipedia work. Right now, offline refers to supporting read access to Wikimedia content without an Internet connection. This increases the reach of the Wikipedia movement by providing more opportunities for people all over the world to access the materials. Some of the recent initiatives surrounding this project were documented in Wikimedia's tech blog about a month ago (for more detail regarding the purpose for offline work, see the offline strategy page). In support of our offline readership work, we're thrilled to announce the launch of a new feature on Wikipedia developed with our partners from PediaPress. Last week we enabled openZim (the main file format in which offline materials are stored) export for the existing PediaPress collections extension on English Wikipedia and numerous other wikis. This means that individuals can now use the existing PediaPress Create a book tool and download it in a format which can be read offline (via an offline reader, such as Kiwix). This is important because it opens new avenues for the creation of offline materials, for example, an openZim library hosting different offline "book" options. Also, the English offline collection Wikipedia 0.8 was made officially available, after much hard work by the Wikipedia 1.0 Editorial Team. This collection is an iteration in the process of developing a vetted collection of offline articles selected based on their quality and topical importance. The main constraint with an offline product is the data size restrictions: the entirety of Wikipedia must somehow be condensed so that it fits on a CD, DVD, or USB stick. Wikipedia 1.0 aims at creating the highest quality and most valuable subset of Wikipedia to meet those size requirements, and v0.8 is a precursor. Wikipedia 0.8 is a general collection of just under 50K articles, It is available for Mac, PC, or Linux with a Linux or Okawix reader; some mobile phone versions will be available later this month as well. More updates are sure to come on this offline front: Wikimedians around the world are actively assisting in the development of offline collections as well as distribution. We are excited to support and document the momentum going forward. Jessie Wild, Global Development ------------------------------------------------------------------------------ _______________________________________________ Offline-l mailing list Offline-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/offline-l

Samuel Klein

28 Apr 28 Apr

2:12 a.m.

Is there a list of ZIM collections people have made? Or some standard way to name a collection on Wikipedia so that it can be found by others? The page for publishing these on openzim is empty. http://www.openzim.org/Publish_your_ZIM_File Some developers in Boston are working on an offline wikiwriter and I wonder about the best place to post resulting collections. Also, is there any current effort to make an online interface to create an offline snapshot, and export it in various formats? Warmly, SJ

Jessie Wild

3:05 a.m.

A stab at these questions: On Wed, Apr 27, 2011 at 4:12 PM, Samuel Klein <meta.sj(a)gmail.com> wrote:

...

This sort of search & discovery is exactly the type of thing that would be great to have. The Offline Projects page has a very small library of links, and then links up to the Kiwix homepage which has the big language openZIM dumps. You could download any of the books within the PediaPress Book Creator space too: * http://meta.wikimedia.org/wiki/Offline_Projects/Library * http://www.kiwix.org/index.php/Main_Page#Wikipedia_files * http://en.wikipedia.org/wiki/Category:Wikipedia_books_%28community_books%29 There is some search & discovery work going on via kiwix: http://www.kiwix.org/index.php/WMF_UX_Improvement_Effort (see the mysterious #XX in the 2nd phase :)), but this would be a library navigable via Kiwix. Some developers in Boston are working on an offline wikiwriter and I

...

wonder about the best place to post resulting collections. I'd propose:

http://meta.wikimedia.org/wiki/Offline_Projects/Library/OpenZIM_Content_Lib… Also, is there any current effort to make an online interface to

...

create an offline snapshot, and export it in various formats? Sorry just so I understand: do you mean as is offered via the PediaPress

book creator on Wikipedia? Where you can select articles or a book collection and download it as openZIM, PDF, ODT? Hope this helps some - Jessie -- *Jessie Wild Global Development, Manager Wikimedia Foundation *

Tomasz Finc

3:40 a.m.

On Wed, Apr 27, 2011 at 4:12 PM, Samuel Klein <meta.sj(a)gmail.com> wrote:

...

Kiwix.org has the most concise list right now. http://kiwix.org/index.php/Main_Page . Were working with the lead dev right now to build out a repot that will act as the official WMF home for openZim files. You can follow our progress here http://www.kiwix.org/index.php/WMF_UX_Improvement_Effort

...

Some developers in Boston are working on an offline wikiwriter and I wonder about the best place to post resulting collections.

Awesome!

...

Also, is there any current effort to make an online interface to create an offline snapshot, and export it in various formats?

Yup, the collections extension does just that. It can export to openZim. -- tomasz

Kul Wadhwa

3:47 a.m.

<snip>

...

Some developers in Boston are working on an offline wikiwriter and I

wonder about the best place to post resulting collections.

Awesome! SJ - is there info posted somewhere so we can learn more about this offline

wikiwriter? --Kul

Samuel Klein

8:42 a.m.

Thanks, Jessie and Tomasz.

...

I'd propose: http://meta.wikimedia.org/wiki/Offline_Projects/Library/OpenZIM_Content_Lib…

Ok, that sounds good for more significant projects collections. I am still unsure about smaller ones. For instance, say I make a curated collection of a hundred spanish + simple english wikipedia articles, wikitravel pages, and wiktionary entries.

...

* http://en.wikipedia.org/wiki/Category:Wikipedia_books_%28community_books%29

Or say I make a wikipedia book, export it as a zim file, edit that file, and want to publish and rename the revised collection.

...

http://www.kiwix.org/index.php/WMF_UX_Improvement_Effort (see the mysterious #XX in the 2nd phase :)), but this would be a library navigable via Kiwix.

A library / modulestore of thousands of available modules (zim files) would be nice.

...

Also, is there any current effort to make an online interface to create an offline snapshot, and export it in various formats?

Sorry just so I understand: do you mean as is offered via the PediaPress book creator on Wikipedia? Where you can select articles or a book collection and download it as openZIM, PDF, ODT?

Yes, that is an important step in this direction. I was thinking of larger snapshots and the range of standard wikireader formats -- the sorts of projects that teams of people currently spend a lot of time creating, partly by hand. For instance: "snapshot type" (wiktionary, abridged wikipedia, wikipedia by category, wikisource, other/custom ...) ~~ "language[s]" "articles" (trusted only, by popularity, by wp1.0 score, all) "article stubs" (yes, no, only popular ones) "article length" (1st para, lede, summary, full) "image size" (none, thumbnails, full) "target size" (<50M, 200M, 1G, 4G, 16G, 64G, any size) "image % of total" (none, 20%, 50%, 80%) "templates" (yes, no, never) ~~ "export format" (zim, wikireader, woip, mw-xml, pdf, odt) Some of these choices may limit the selection available for the others. An option to browse existing snapshots could replace the first two sets of choices. 'WP by category' could include some of the larger sorts of snapshots that can currently be generated as books - especially if one can update those automatically with page-scoring and wikitrust data. New custom snapshots could start from existing snapshots, combining them or extending them to a different set of languages. SJ

Samuel Klein

8:56 a.m.

On Thu, Apr 28, 2011 at 12:47 AM, Kul Wadhwa <kwadhwa(a)wikimedia.org> wrote:

...

<snip>

Some developers in Boston are working on an offline wikiwriter and I wonder about the best place to post resulting collections.

Awesome!

SJ - is there info posted somewhere so we can learn more about this offline wikiwriter?

It is based on the wikibrowse code, which currently supports a separate local directory of edited files. (in wikimarkup) http://wiki.laptop.org/go/WikiBrowse_Editing To be usable for sharing it needs better support for tracking revisions I'll update this list when there is a separate project page for the editor (which will not be called wikibrowse) and something to look at. -- SJ

Manuel Schneider

9:45 a.m.

Hi, thanks SJ for starting this thread, because this is something laying on my desk. Unfortunately I am currently busy so can't really take care of it (having internet at home would be a first start to fix this situation :-) ). On 28.04.2011 07:42, Samuel Klein wrote:

...

A library / modulestore of thousands of available modules (zim files) would be nice.

That's what http://openzim.org/ZIM_File_Archive is intended to be. Currently still a wiki page, which I thought is for start good enough before we come up with the shiny perfect solution. My intentions are to combine several things: * use the experience we got by mirroring / distributing the german Wikipedia DVD (pre-openZIM), see http://dvd.wikimedia.org/ * give a central place to easily find ZIM files for users - should also invite more people to use ZIM * give ZIM publishers an easy way to publish / distribute / mirror their files The way it was intended to work ("the final version"): 1) a publisher provides us with a ZIM file (sends us a link, uploads it, whatever - maybe we could have a neat webinterface where publishers can register and maintain their files) 2) the file will be put into our archive (filesystem) and categorisation (database) 3) the whole archive is being mirrored to several sites 4) users can use our webinterface to browse the categories and search files, downloads will link to random mirrors in order to distribute load Recently, Emmanuel / Kelson (Kiwix) has introduced a favicon.ico in ZIM (URL: /-/favicon.ico) to be used in such systems. Meta Data is also available (Dublin Core) in ZIM files which can be read from namespace M. A minimal set of attributes have been defined: http://openzim.org/Metadata

...

"snapshot type" (wiktionary, abridged wikipedia, wikipedia by category, wikisource, other/custom ...) ~~ "language[s]" "articles" (trusted only, by popularity, by wp1.0 score, all) "article stubs" (yes, no, only popular ones) "article length" (1st para, lede, summary, full) "image size" (none, thumbnails, full) "target size" (<50M, 200M, 1G, 4G, 16G, 64G, any size) "image % of total" (none, 20%, 50%, 80%) "templates" (yes, no, never) ~~ "export format" (zim, wikireader, woip, mw-xml, pdf, odt)

This is a very helpful listing which would help us to design the "final version" of the ZIM Archive. /Manuel -- Regards Manuel Schneider Wikimedia CH - Verein zur Förderung Freien Wissens Wikimedia CH - Association for the advancement of free knowledge www.wikimedia.ch

4741

days inactive

4784

days old

offline-l@lists.wikimedia.org

Manage subscription

10 comments

7 participants

tags (0)

participants (7)

Jessie Wild
Kul Wadhwa
Manuel Schneider
Martin A. Walker
Pascal Martin
Samuel Klein
Tomasz Finc