Dear Ariel,
0) Context
I am working towards the next release for WP-MIRROR (0.8) and that entails updating `mwxml2sql' from 1.24 to 1.26.
1) Database Schema for `page' table
There are three fields in the `page' table that require attention: `page_counter', `page_no_title_convert', and `page_lang'.
These fields are present (YES) or not (NO) in three different places:
MediaWiki 1.26: (shell) less maintenance/table.sql `page_counter' NO `page_no_title_convert' NO `page_lang' YES
XML Dump: (shell) zless simplewiki-20150603-page.sql.gz `page_counter' YES `page_no_title_convert' YES `page_lang' NO
mwxml2sql: (shell) mwxml2sql -m 1.24 -s simplewiki-20150603-stub-articles.sql.gz ... (shell) less simplewiki-20150603-page.sql-1.24.gz `page_counter' YES `page_no_title_convert' NO `page_lang' NO
2) XML Dumps
Are there plans to remove `page_counter' and `page_no_title_convert' from the XML dumps? Are there plans to add `page_lang' to the XML dumps?
3) mwxml2sql
Do you have any suggestions for how I should update `mwxml2sql' for MediaWiki 1.26?
Sincerely Yours, Kent
Hey Kent,
I haven't had a chance to verify all three of the fields as wrong, only the first one (which certainly is gone from MW core and should therefore be gone from the rest). But yes I'd say these should be added/changed in Export.php. I should check to see what our production databases have going right now.
Would you mind opening a Phabricator task for this so I can get some other eyeballs on it? Thanks,
Ariel
Στις 18-06-2015, ημέρα Πεμ, και ώρα 14:40 -0400, ο/η wp mirror έγραψε:
Dear Ariel,
- Context
I am working towards the next release for WP-MIRROR (0.8) and that entails updating `mwxml2sql' from 1.24 to 1.26.
- Database Schema for `page' table
There are three fields in the `page' table that require attention: `page_counter', `page_no_title_convert', and `page_lang'.
These fields are present (YES) or not (NO) in three different places:
MediaWiki 1.26: (shell) less maintenance/table.sql `page_counter' NO `page_no_title_convert' NO `page_lang' YES
XML Dump: (shell) zless simplewiki-20150603-page.sql.gz `page_counter' YES `page_no_title_convert' YES `page_lang' NO
mwxml2sql: (shell) mwxml2sql -m 1.24 -s simplewiki-20150603-stub-articles.sql.gz ... (shell) less simplewiki-20150603-page.sql-1.24.gz `page_counter' YES `page_no_title_convert' NO `page_lang' NO
- XML Dumps
Are there plans to remove `page_counter' and `page_no_title_convert' from the XML dumps? Are there plans to add `page_lang' to the XML dumps?
- mwxml2sql
Do you have any suggestions for how I should update `mwxml2sql' for MediaWiki 1.26?
Sincerely Yours, Kent
Dear Ariel,
I have filed the following Phabricator tasks: https://phabricator.wikimedia.org/T103564, https://phabricator.wikimedia.org/T103571, https://phabricator.wikimedia.org/T103575, https://phabricator.wikimedia.org/T103579, and https://phabricator.wikimedia.org/T103583.
This should cover the most obvious database schemata inconsistencies.
Sincerely Yours, Kent
On Tue, Jun 23, 2015 at 1:59 AM, Ariel T. Glenn aglenn@wikimedia.org wrote:
Hey Kent,
I haven't had a chance to verify all three of the fields as wrong, only the first one (which certainly is gone from MW core and should therefore be gone from the rest). But yes I'd say these should be added/changed in Export.php. I should check to see what our production databases have going right now.
Would you mind opening a Phabricator task for this so I can get some other eyeballs on it? Thanks,
Ariel
Στις 18-06-2015, ημέρα Πεμ, και ώρα 14:40 -0400, ο/η wp mirror έγραψε:
Dear Ariel,
- Context
I am working towards the next release for WP-MIRROR (0.8) and that entails updating `mwxml2sql' from 1.24 to 1.26.
- Database Schema for `page' table
There are three fields in the `page' table that require attention: `page_counter', `page_no_title_convert', and `page_lang'.
These fields are present (YES) or not (NO) in three different places:
MediaWiki 1.26: (shell) less maintenance/table.sql `page_counter' NO `page_no_title_convert' NO `page_lang' YES
XML Dump: (shell) zless simplewiki-20150603-page.sql.gz `page_counter' YES `page_no_title_convert' YES `page_lang' NO
mwxml2sql: (shell) mwxml2sql -m 1.24 -s simplewiki-20150603-stub-articles.sql.gz ... (shell) less simplewiki-20150603-page.sql-1.24.gz `page_counter' YES `page_no_title_convert' NO `page_lang' NO
- XML Dumps
Are there plans to remove `page_counter' and `page_no_title_convert' from the XML dumps? Are there plans to add `page_lang' to the XML dumps?
- mwxml2sql
Do you have any suggestions for how I should update `mwxml2sql' for MediaWiki 1.26?
Sincerely Yours, Kent
Thanks for those, I will be poking at them this week. You'll be able to see what gets done as it gets done.
Ariel
Στις 23-06-2015, ημέρα Τρι, και ώρα 15:19 -0400, ο/η wp mirror έγραψε:
Dear Ariel,
I have filed the following Phabricator tasks: https://phabricator.wikimedia.org/T103564, https://phabricator.wikimedia.org/T103571, https://phabricator.wikimedia.org/T103575, https://phabricator.wikimedia.org/T103579, and https://phabricator.wikimedia.org/T103583.
This should cover the most obvious database schemata inconsistencies.
Sincerely Yours, Kent
On Tue, Jun 23, 2015 at 1:59 AM, Ariel T. Glenn <aglenn@wikimedia.org
wrote: Hey Kent,
I haven't had a chance to verify all three of the fields as wrong, only the first one (which certainly is gone from MW core and should therefore be gone from the rest). But yes I'd say these should be added/changed in Export.php. I should check to see what our production databases have going right now.
Would you mind opening a Phabricator task for this so I can get some other eyeballs on it? Thanks,
Ariel
Στις 18-06-2015, ημέρα Πεμ, και ώρα 14:40 -0400, ο/η wp mirror έγραψε:
Dear Ariel,
- Context
I am working towards the next release for WP-MIRROR (0.8) and
that
entails updating `mwxml2sql' from 1.24 to 1.26.
- Database Schema for `page' table
There are three fields in the `page' table that require
attention:
`page_counter', `page_no_title_convert', and `page_lang'.
These fields are present (YES) or not (NO) in three different
places:
MediaWiki 1.26: (shell) less maintenance/table.sql `page_counter' NO `page_no_title_convert' NO `page_lang' YES
XML Dump: (shell) zless simplewiki-20150603-page.sql.gz `page_counter' YES `page_no_title_convert' YES `page_lang' NO
mwxml2sql: (shell) mwxml2sql -m 1.24 -s simplewiki-20150603-stub
-articles.sql.gz
... (shell) less simplewiki-20150603-page.sql-1.24.gz `page_counter' YES `page_no_title_convert' NO `page_lang' NO
- XML Dumps
Are there plans to remove `page_counter' and
`page_no_title_convert'
from the XML dumps? Are there plans to add `page_lang' to the XML dumps?
- mwxml2sql
Do you have any suggestions for how I should update `mwxml2sql'
for
MediaWiki 1.26?
Sincerely Yours, Kent
xmldatadumps-l@lists.wikimedia.org