On 22/12/10 11:43, Anthony wrote:
On Tue, Dec 21, 2010 at 10:02 AM, Tim Starling
<tstarling(a)wikimedia.org> wrote:
I've uploaded my latest attempt at converting
the backup to XML:
http://noc.wikimedia.org/~tstarling/wikipedia-2001-08-xml.7z
The archive contains an invalid XML file, with control characters
preserved, and a valid XML file, with control characters filtered.
Which control
characters? Aren't control characters allowed in XML 1.1?
I did: tr -d '\000-\010\013-\037'
In XML 1.1:
"Definition: A character is an atomic unit of text as specified by
ISO/IEC 10646:2000 [ISO/IEC 10646]. Legal characters are tab, carriage
return, line feed, and the legal characters of Unicode and ISO/IEC 10646.
"Char ::= #x9 | #xA | #xD | [#x20-#xD7FF] |
[#xE000-#xFFFD] | [#x10000-#x10FFFF] /* any Unicode character,
excluding the surrogate blocks, FFFE, and FFFF. */"
Without this change, importDump.php gives a fatal error.
-- Tim Starling