Dear Gnosygnu,
I would like to thank you very much for your e-mail of 2014-Jan-11. It was very helpful and I have made much progress towards WP-MIRROR 0.7.
0) Status
Using dump files from http://ftpmirror.your.org/, WP-MIRROR 0.7 now builds a mirror of `simplewiki', `simplewiktionary', and `wikidata'. In the process, WP-MIRROR installs and configures `mediawiki 1.23' and about 40 extensions. A page rendered by the mirror now looks very similar to the same page rendered by WMF.
1) Problems
There are a couple of anomalies.
1.1) Wikidata
Infoboxes are now rendered. The property fields are populated with data drawn from http://www.wikidata.site. However, in the navigation bar, under the ``In other languages'' link, the expected list of interlanguage links still does not appear.
Here is the portion of `LocalSettings.php' that pertains to `wikidata'.
# Wikidata putenv( "MW_INSTALL_PATH=$IP" ); #define( 'WB_EXPERIMENTAL_FEATURES', true ); $wgEnableWikibaseRepo = true; $wgEnableWikibaseClient = true; $wmgUseWikibaseRepo = true; $wmgUseWikibaseClient = true; require_once( "$IP/extensions/Wikidata/Wikidata.php" ); require_once( "$IP/extensions/Wikidata/extensions/Wikibase/repo/ExampleSettings.php" ); $wgWBSettings['repoUrl'] = 'http://www.wikidata.site'; $wgWBSettings['repoScriptPath'] = '/w'; $wgWBSettings['repoArticlePath'] = '/wiki/$1'; $wgWBSettings['siteGlobalID'] = $wgDBname; $wgWBSettings['siteGroup'] = $project; $wgWBSettings['sort'] = 'code'; $wgWBSettings['sortPrepend'] = array ( 'en', 'simple', ); $wgWBSettings['repoDatabase'] = 'wikidatawiki'; $wgWBSettings['changesDatabase'] = 'wikidatawiki';
1.2) Gadgets
Under http://simple.wikipedia.site/wiki/Special:Gadgets there is no list of gadgets. I can see that the underlying database does have them (or rather links to WMF where they can be found).
The relevant portion of `LocalSettings.php' is:
require_once( "$IP/extensions/Gadgets/Gadgets.php" );
2) Advance news
WP-MIRROR 0.7 will be released (probably this month) as a DEB package. It will not depend upon the DEB package for `mediawiki 1.19' LTS as did WP-MIRROR 0.6. Rather it will depend upon a new DEB package of the latest development version (currently 1.23).
To that end, I have set up a tool chain that `pull's from the GIT repositories at https://gerrit.wikimedia.org/r/p/mediawiki/ and generates four DEB packages:
`wp-mirror-mediawiki_1.23-1_all.deb' `wp-mirror-mediawiki-extensions_1.23-1_all.deb'. `wp-mirror-mediawiki-extensions-math-texvc_1.23-1_amd64.deb' `wp-mirror-mediawiki-extensions-scribunto-lua_1.23-1_amd64.deb'
The second of these packages contains over forty of the extensions listed on http://en.wikipedia.org/wiki/Special:Version.
Every effort has been made to avoid stepping on the namespace of the DEB packages currently distributed by Debian. For example, the first two packages install into `/usr/share/wp-mirror-mediawiki/' rather than into `/usr/share/mediawiki/'.
I have set up a Debian repository hosted by Free Software Foundation.
3) Help requested
Any advice concerning the above mentioned bugs would be appreciated.
Sincerely Yours, Kent
I would like to thank you very much for your e-mail of 2014-Jan-11. It was very helpful and I have made much progress towards WP-MIRROR 0.7.
My pleasure. Glad to help out.
However, in the navigation bar, under the ``In other languages'' link, the expected list of interlanguage links still does not appear.
As a disclaimer, I've not set up Wikibase on my machine (XOWA parses the json directly for interlanguage links)
That said, have you downloaded the wb_items_per_site table?: http://dumps.wikimedia.org/wikidatawiki/20140226/wikidatawiki-20140226-wb_it...
I looked at the Wikibase code now, and it appears that links are retrieved from there. See: /Wikibase/lib/includes/store/sql/SiteLinkTable.php
there is no list of gadgets.
Special:Gadgets depends mainly on the Gadget pages in the MediaWiki namespace. Specifically simple.wikipedia.org/wiki/MediaWiki:Gadgets-definition, and related gadget pages (for example, MediaWiki:Gadget-Edittools and MediaWiki:Gadget-Edittools.css).
These pages look fine in my simplewiki dump: http://dumps.wikimedia.org/simplewiki/20140308/simplewiki-20140308-pages-art...
Offhand, I'd guess that the pages don't exist in your simplewiki instance. I know your last email said that you pruned the MediaWiki ns from the title: http://lists.wikimedia.org/pipermail/xmldatadumps-l/2014-February/001000.htm...
Could you check your table just in case?
SELECT page_namespace, Cast(page_title AS CHAR) FROM page WHERE page_namespace = 8 ORDER BY 2;
I would expect rows like the following
8 Gadget-Edittools 8 Gadget-Edittools.css 8 Gadgets-definition
If they do exist, go to MediaWiki:Gadgets-definition and reduce the list down to one gadget (Gadget-Edittools). See if that loads.
Hope this helps, and good luck with WP-MIRROR 0.7.
On Sun, Mar 9, 2014 at 7:11 PM, wp mirror wpmirrordev@gmail.com wrote:
Dear Gnosygnu,
I would like to thank you very much for your e-mail of 2014-Jan-11. It was very helpful and I have made much progress towards WP-MIRROR 0.7.
- Status
Using dump files from http://ftpmirror.your.org/, WP-MIRROR 0.7 now builds a mirror of `simplewiki', `simplewiktionary', and `wikidata'. In the process, WP-MIRROR installs and configures `mediawiki 1.23' and about 40 extensions. A page rendered by the mirror now looks very similar to the same page rendered by WMF.
- Problems
There are a couple of anomalies.
1.1) Wikidata
Infoboxes are now rendered. The property fields are populated with data drawn from http://www.wikidata.site. However, in the navigation bar, under the ``In other languages'' link, the expected list of interlanguage links still does not appear.
Here is the portion of `LocalSettings.php' that pertains to `wikidata'.
# Wikidata putenv( "MW_INSTALL_PATH=$IP" ); #define( 'WB_EXPERIMENTAL_FEATURES', true ); $wgEnableWikibaseRepo = true; $wgEnableWikibaseClient = true; $wmgUseWikibaseRepo = true; $wmgUseWikibaseClient = true; require_once( "$IP/extensions/Wikidata/Wikidata.php" ); require_once( "$IP/extensions/Wikidata/extensions/Wikibase/repo/ExampleSettings.php" ); $wgWBSettings['repoUrl'] = 'http://www.wikidata.site'; $wgWBSettings['repoScriptPath'] = '/w'; $wgWBSettings['repoArticlePath'] = '/wiki/$1'; $wgWBSettings['siteGlobalID'] = $wgDBname; $wgWBSettings['siteGroup'] = $project; $wgWBSettings['sort'] = 'code'; $wgWBSettings['sortPrepend'] = array ( 'en', 'simple', ); $wgWBSettings['repoDatabase'] = 'wikidatawiki'; $wgWBSettings['changesDatabase'] = 'wikidatawiki';
1.2) Gadgets
Under http://simple.wikipedia.site/wiki/Special:Gadgets there is no list of gadgets. I can see that the underlying database does have them (or rather links to WMF where they can be found).
The relevant portion of `LocalSettings.php' is:
require_once( "$IP/extensions/Gadgets/Gadgets.php" );
- Advance news
WP-MIRROR 0.7 will be released (probably this month) as a DEB package. It will not depend upon the DEB package for `mediawiki 1.19' LTS as did WP-MIRROR 0.6. Rather it will depend upon a new DEB package of the latest development version (currently 1.23).
To that end, I have set up a tool chain that `pull's from the GIT repositories at https://gerrit.wikimedia.org/r/p/mediawiki/ and generates four DEB packages:
`wp-mirror-mediawiki_1.23-1_all.deb' `wp-mirror-mediawiki-extensions_1.23-1_all.deb'. `wp-mirror-mediawiki-extensions-math-texvc_1.23-1_amd64.deb' `wp-mirror-mediawiki-extensions-scribunto-lua_1.23-1_amd64.deb'
The second of these packages contains over forty of the extensions listed on http://en.wikipedia.org/wiki/Special:Version.
Every effort has been made to avoid stepping on the namespace of the DEB packages currently distributed by Debian. For example, the first two packages install into `/usr/share/wp-mirror-mediawiki/' rather than into `/usr/share/mediawiki/'.
I have set up a Debian repository hosted by Free Software Foundation.
- Help requested
Any advice concerning the above mentioned bugs would be appreciated.
Sincerely Yours, Kent
xmldatadumps-l@lists.wikimedia.org