Foreign language text in an english wiki?

List overview All Threads
Download

newer

older

error message MediaWiki 1.7 at...

Re: [Mediawiki-l] [Maybe Spam] ...

Glen Faires

10 Aug 2006 10 Aug '06

6:45 a.m.

I'm trying to set up MediaWiki, and as part of that I am attempting to import a couple thousand text files into the program. I think I've worked out how to batch convert them into the proper XML for the 'Import Pages' setup to work, but I've run into a small problem. While most of the text files are in English, there are a handful in German or French. The 'Import Pages' code bails as soon as it hits one of these pages, with the following error: Import failed: XML import parse failure at line 575, col 1 (byte 23795; "</text> </revis"): Invalid character The line mentioned is the closing tag for the foreign-language text in the file. I don't need (or want) three separate wikis, or for the interface to be in any language other than English, I just want to find a way to automate the process of moving these files into the wiki, preferably without having to go through and manually weed out the problem files in advance. Can anyone here help?

Show replies by date

Hínandil

10 Aug 10 Aug

7:54 a.m.

New subject: [Mediawiki-l] Foreign language text in an english wiki?

Glen Faires wrote:

...

I'm trying to set up MediaWiki, and as part of that I am attempting to import a couple thousand text files into the program. [SNIP!] The 'Import Pages' code bails as soon as it hits one of these pages, with the following error: Import failed: XML import parse failure at line 575, col 1 (byte 23795; "</text> </revis"): Invalid character

It looks like the line is truncated. Perhaps try splitting up the XML file you are importing into smaller files, or try increasing the size limits for uploads in php.ini. Hínandil

Glen Faires

9:28 a.m.

New subject: [Mediawiki-l] Foreign language text in an english wiki?

Nope, took one of the German characters (ß), moved it to the first file, and now it bails on the first file. (Note: This particular file uploads perfectly without that one character.) Import failed: XML import parse failure at line 160, col 1 (byte 7067; "</text> </revis"): Invalid character -----Original Message----- From: mediawiki-l-bounces(a)Wikimedia.org [mailto:mediawiki-l-bounces@Wikimedia.org] On Behalf Of Hínandil Sent: Thursday, August 10, 2006 12:54 AM To: MediaWiki announcements and site admin list Subject: Re: [Mediawiki-l] Foreign language text in an english wiki? Glen Faires wrote:

...

I'm trying to set up MediaWiki, and as part of that I am attempting to import a couple thousand text files into the program. [SNIP!] The

'Import

...

Pages' code bails as soon as it hits one of these pages, with the

following

...

error: Import failed: XML import parse failure at line 575, col 1 (byte 23795; "</text> </revis"): Invalid character

It looks like the line is truncated. Perhaps try splitting up the XML file you are importing into smaller files, or try increasing the size limits for uploads in php.ini. Hínandil _______________________________________________ MediaWiki-l mailing list MediaWiki-l(a)Wikimedia.org http://mail.wikipedia.org/mailman/listinfo/mediawiki-l

wiki＠avenarius.sk

9:35 a.m.

New subject: [Mediawiki-l] Foreign language text in an english wiki?

On Thursday, 10th August 2006 at 02:28:51 (GMT -0700), Glen Faires wrote:

...

Nope, took one of the German characters (ß), moved it to the first file, and now it bails on the first file. (Note: This particular file uploads perfectly without that one character.)

Glen Faires

10:05 a.m.

New subject: [Mediawiki-l] Foreign language text in an english wiki?

They're plain text files. They were HTML, but all HTML has been stripped from them, the vital bits replaced with wiki markup tags, and the whole lot wrapped up with the XML. I've attached a sample that works perfectly without the foreign language character, but breaks with the character. -----Original Message----- From: mediawiki-l-bounces(a)Wikimedia.org [mailto:mediawiki-l-bounces@Wikimedia.org] On Behalf Of wiki(a)avenarius.sk Sent: Thursday, August 10, 2006 2:36 AM To: mediawiki-l(a)Wikimedia.org Subject: Re: [Mediawiki-l] Foreign language text in an english wiki? On Thursday, 10th August 2006 at 02:28:51 (GMT -0700), Glen Faires wrote:

...

Nope, took one of the German characters (ß), moved it to the first file, and now it bails on the first file. (Note: This particular file uploads perfectly without that one character.)

And what's the encoding of the files you're trying to upload? You've never mentioned this. -- Yours, Alex. [processed by "The Bat!", Version 3.80.06] (MediaWiki: 1.6.8 / PHP: 4.4.1 (cgi) / MySQL: 4.1.19-standard) _______________________________________________ MediaWiki-l mailing list MediaWiki-l(a)Wikimedia.org http://mail.wikipedia.org/mailman/listinfo/mediawiki-l

wiki＠avenarius.sk

10:11 a.m.

New subject: [Mediawiki-l] Foreign language text in an english wiki?

On Thursday, 10th August 2006 at 03:05:07 (GMT +0200), Glen Faires wrote:

...

>> Nope, took one of the German characters (ß), moved it to the first file, >> and now it bails on the first file. (Note: This particular file >> uploads perfectly without that one character.)

...

> And what's the encoding of the files you're trying to upload? > You've never mentioned this.

...

They're plain text files.

Even plain text files have their encodings! If you're trying to save German language characters properly, your plain text file *must* be encoded either in UTF-8 (preferable) or in the legacy ISO-8859-1 encoding.

...

I've attached a sample that works perfectly without the foreign language character, but breaks with the character.

Your sample is *not* encoded in either UTF-8 or ISO-8859-1, so it cannot work if you insert distinctive German characters into it. Try inserting the German characters into the file, then save the plain text file in UTF-8 or ISO-8859-1, then upload it. (I use the superb EditPlus editor, www.editplus.com , for converting between UTF-8 and all the other encodings.) -- Yours, Alex. [processed by "The Bat!", Version 3.80.06] (MediaWiki: 1.6.8 / PHP: 4.4.1 (cgi) / MySQL: 4.1.19-standard)

Glen Faires

10:19 a.m.

New subject: [Mediawiki-l] Foreign language text in an english wiki?

I hereby thank you for your great wisdom. I had been slamming my head against the wall for over a week now attempting to figure this one out. Your help is most appreciated. -----Original Message----- From: mediawiki-l-bounces(a)Wikimedia.org [mailto:mediawiki-l-bounces@Wikimedia.org] On Behalf Of wiki(a)avenarius.sk Sent: Thursday, August 10, 2006 3:11 AM To: mediawiki-l(a)Wikimedia.org Subject: Re: [Mediawiki-l] Foreign language text in an english wiki? On Thursday, 10th August 2006 at 03:05:07 (GMT +0200), Glen Faires wrote:

...

>> Nope, took one of the German characters (ß), moved it to the first file, >> and now it bails on the first file. (Note: This particular file >> uploads perfectly without that one character.)

...

> And what's the encoding of the files you're trying to upload? > You've never mentioned this.

...

They're plain text files.

...

I've attached a sample that works perfectly without the foreign language character, but breaks with the character.

6476

days inactive

6476

days old

mediawiki-l@lists.wikimedia.org

Manage subscription

6 comments

3 participants

tags (0)

participants (3)

Glen Faires
Hínandil
wiki＠avenarius.sk