FYI
-------- Messaggio inoltrato -------- Oggetto: [Xmldatadumps-l] Your comments needed (long term dumps rewrite?) Data: Thu, 19 Feb 2015 12:30:01 +0200 Mittente: Ariel Glenn WMF ariel@wikimedia.org A: Xmldatadumps-l@lists.wikimedia.org
The MediaWiki Core team has opened a discussion about getting more involved in and maybe redoing the dumps infrastructure. A good starting point is to understand how folks use the dumps already or want to use them but can't, and some questions about that are listed here: https://www.mediawiki.org/wiki/Wikimedia_MediaWiki_Core_Team/Backlog/Improve...
I've added some notes but please go weigh in. Don't be shy about what you do/what you need, this is the time to get it all on the table.
Ariel
Hi
Thank you Nemo for adverting that interesting page about how to improve Wikimedia dumping processes. This topic is of course a primary concern for the Kiwix developer team.
Here my contribution: https://www.mediawiki.org/w/index.php?title=Wikimedia_MediaWiki_Core_Team%2F...
Hope to see things going forward on this, I will help as much as I can.
Regards Emmanuel
On 21.02.2015 08:44, Federico Leva (Nemo) wrote:
FYI
-------- Messaggio inoltrato -------- Oggetto: [Xmldatadumps-l] Your comments needed (long term dumps rewrite?) Data: Thu, 19 Feb 2015 12:30:01 +0200 Mittente: Ariel Glenn WMF ariel@wikimedia.org A: Xmldatadumps-l@lists.wikimedia.org
The MediaWiki Core team has opened a discussion about getting more involved in and maybe redoing the dumps infrastructure. A good starting point is to understand how folks use the dumps already or want to use them but can't, and some questions about that are listed here: https://www.mediawiki.org/wiki/Wikimedia_MediaWiki_Core_Team/Backlog/Improve...
I've added some notes but please go weigh in. Don't be shy about what you do/what you need, this is the time to get it all on the table.
Ariel
Offline-l mailing list Offline-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/offline-l
I also added some Hadoop based used cases to that document.
https://www.mediawiki.org/w/index.php?title=Wikimedia_MediaWiki_Core_Team%2F...
On Feb 21, 2015, at 05:03, Emmanuel Engelhart kelson@kiwix.org wrote:
Hi
Thank you Nemo for adverting that interesting page about how to improve Wikimedia dumping processes. This topic is of course a primary concern for the Kiwix developer team.
Here my contribution: https://www.mediawiki.org/w/index.php?title=Wikimedia_MediaWiki_Core_Team%2F...
Hope to see things going forward on this, I will help as much as I can.
Regards Emmanuel
On 21.02.2015 08:44, Federico Leva (Nemo) wrote:
FYI
-------- Messaggio inoltrato -------- Oggetto: [Xmldatadumps-l] Your comments needed (long term dumps rewrite?) Data: Thu, 19 Feb 2015 12:30:01 +0200 Mittente: Ariel Glenn WMF ariel@wikimedia.org A: Xmldatadumps-l@lists.wikimedia.org
The MediaWiki Core team has opened a discussion about getting more involved in and maybe redoing the dumps infrastructure. A good starting point is to understand how folks use the dumps already or want to use them but can't, and some questions about that are listed here: https://www.mediawiki.org/wiki/Wikimedia_MediaWiki_Core_Team/Backlog/Improve...
I've added some notes but please go weigh in. Don't be shy about what you do/what you need, this is the time to get it all on the table.
Ariel
Offline-l mailing list Offline-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/offline-l
-- Kiwix - Wikipedia Offline & more
- Web: http://www.kiwix.org
- Twitter: https://twitter.com/KiwixOffline
- more: http://www.kiwix.org/wiki/Communication
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Thanks for doing that Andrew!
On Tue, Feb 24, 2015 at 1:41 PM, Andrew Otto aotto@wikimedia.org wrote:
I also added some Hadoop based used cases to that document.
https://www.mediawiki.org/w/index.php?title=Wikimedia_MediaWiki_Core_Team%2F...
On Feb 21, 2015, at 05:03, Emmanuel Engelhart kelson@kiwix.org wrote:
Hi
Thank you Nemo for adverting that interesting page about how to improve
Wikimedia dumping processes. This topic is of course a primary concern for the Kiwix developer team.
Here my contribution:
https://www.mediawiki.org/w/index.php?title=Wikimedia_MediaWiki_Core_Team%2F...
Hope to see things going forward on this, I will help as much as I can.
Regards Emmanuel
On 21.02.2015 08:44, Federico Leva (Nemo) wrote:
FYI
-------- Messaggio inoltrato -------- Oggetto: [Xmldatadumps-l] Your comments needed (long term dumps rewrite?) Data: Thu, 19 Feb 2015 12:30:01 +0200 Mittente: Ariel Glenn WMF ariel@wikimedia.org A: Xmldatadumps-l@lists.wikimedia.org
The MediaWiki Core team has opened a discussion about getting more involved in and maybe redoing the dumps infrastructure. A good starting point is to understand how folks use the dumps already or want to use them but can't, and some questions about that are listed here:
https://www.mediawiki.org/wiki/Wikimedia_MediaWiki_Core_Team/Backlog/Improve...
I've added some notes but please go weigh in. Don't be shy about what you do/what you need, this is the time to get it all on the table.
Ariel
Offline-l mailing list Offline-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/offline-l
-- Kiwix - Wikipedia Offline & more
- Web: http://www.kiwix.org
- Twitter: https://twitter.com/KiwixOffline
- more: http://www.kiwix.org/wiki/Communication
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
Thank you very much for the forward, Nemo.
Ariel, could you please post to these lists if/when you're having IRC discussions on this topic? It's of the highest importance to me and Aaron Halfaker at least, and to many others. I have written down some ideas in the article that I would like to defend in meetings / debates.
On Saturday, February 21, 2015, Federico Leva (Nemo) nemowiki@gmail.com wrote:
FYI
-------- Messaggio inoltrato -------- Oggetto: [Xmldatadumps-l] Your comments needed (long term dumps rewrite?) Data: Thu, 19 Feb 2015 12:30:01 +0200 Mittente: Ariel Glenn WMF ariel@wikimedia.org A: Xmldatadumps-l@lists.wikimedia.org
The MediaWiki Core team has opened a discussion about getting more involved in and maybe redoing the dumps infrastructure. A good starting point is to understand how folks use the dumps already or want to use them but can't, and some questions about that are listed here: https://www.mediawiki.org/wiki/Wikimedia_MediaWiki_Core_ Team/Backlog/Improve_dumps I've added some notes but please go weigh in. Don't be shy about what you do/what you need, this is the time to get it all on the table.
Ariel