As far as push translation goes, there are languages where it could almost work and where it couldn't. (Consider the experience of the Google team with the Bengali Wikipedia - http://googletranslate.blogspot.com/2010/07/translating-wikipedia.html ) Bence

Bence, that's a different topic - MAT (Machine Aided Translation), and in the case of Bengali, I believe simply the use of a translation memory system. Some of the comments on that page seem to be quite misinformed, ranging from people who thought Google was inserting unrevised machine translations into Wikipedia articles (that would be a disaster), to people suggesting (begging?) Google allow the user community to localize their UI (they already do - Facebook took the idea from Google!). Oh, also, somebody protesting the fact that the Spanish language was not mentioned in the post and suggesting that such an omission must mean Google hates Spain. I only saw one comment on that page that didn't make me want to bang my head on the keyboard (but such is the Internet, right?) -m. On Sat, Jul 24, 2010 at 1:31 PM, Bence Damokos <bdamokos(a)gmail.com> wrote:

2010/7/24 Casey Brown <lists(a)caseybrown.org>rg>: Also don't forget that the same subject can be treated very differently among different cultures (even if they are not distant, think to French and English). An article in the English Wikipedia can be a very good basis to start a new article, but I don't think that an automated "flooding" of the other Wikipedias is a good thing in *any* way. Cristian

Wikipedias are not for _cultures_, they are for languages. If I and 1,000 other Americans suddenly learnt French (to the point of native-level fluency) and decided to read and edit the French Wikipedia, it would "belong" to us just as much as to anybody else. This came up recently in the debate about the Acehnese Wikipedia. Some people said that all Acehnese were Muslim (not true - there is a small community of Acehnese Christians). They said that if anyone is Christian, they'd be ejected from Acehnese society and therefore no longer Acehnese. However, they'd not stop speaking the Acehnese language. Nobody claims the English WP is for US/Commonwealth cultures only... this is reasonable when a Wiki is tiny, but as it grows large it's important that NPOV mean "neutral point of view for EVERYBODY", not just "a point of view that everybody in OUR country can agree upon", etc. -m. On Sat, Jul 24, 2010 at 4:06 PM, Cristian Consonni <kikkocristian(a)gmail.com> wrote:

On Sat, Jul 24, 2010 at 11:03 PM, Casey Brown <lists(a)caseybrown.org> wrote: Casey, that's nothing new, nor is it anything I was unaware of. The debate about whether language influences thought (or vice versa) has long been a debate within the scholarly community. Please see http://en.wikipedia.org/wiki/Linguistic_relativity for a more detailed treatment of the subject - there's still no consensus. Nobody's arguing here that language and culture have no relationship. What I'm saying is that language does not equal culture. Many people speak French who are not part of the culture of France, for example the cities of Libreville and Abidjan in Africa. Many (many!) people who speak English are not part of the culture of England (or even the rest of the UK, the United States, Canada, Australia or New Zealand), including hundreds of thousands, if not millions, of native speakers. Languages are certainly cultural artifacts, but that does not mean that they are equivalent. Imagine tomorrow morning everybody in Japan spoke French and only French and that all Japanese literature and text suddenly was printed only in French. Would Japanese culture cease to exist? Not at all. The customs, attitudes, rituals, beliefs and even the food would not be changed (attitudes is debatable perhaps, but I'm not a believer of the Sapir-Whorf hypothesis). Yes, something great would be lost, an irreplaceable _part_ of the Japanese culture, but cultures have sometimes persisted in spite language death. Ritual prayers are sometimes translated to the new language, other times fossilized in a language now rendered incomprehensible by time, same goes for geographic and personal names... I think it's pretty clear at this point that, for example, all 4 of the regular users of ace.wp are offended by certain images on en.wp. I don't think it would be a stretch to say that many - probably the vast majority - of Acehnese speakers would find those images similarly offensive. Now let's say I've got a toddler and he has an Acehnese caretaker. This caretaker is monolingual in Acehnese, but they've been expressly forbidden from mentioning religion. When this toddler grows up, he'll probably be good enough at Acehnese and have spoken it early enough in life to be considered a native speaker... but will he automatically have any inclinations one way or another about the pictures? Of course not. So, just because the vast majority of speakers of a language share a cultural background does NOT mean that the language could only ever be spoken by people who belong to that culture. Wikipedia versions are very clearly for languages. the Estonian Wikipedia is the Wikipedia in the Estonian language, not the Wikipedia for Estonian Culture. As an example of this, I have a good friend who grew up speaking Akan, having had a nanny from West Africa. Is my friend a member of the Akan culture? Not really... does that mean she couldn't be a productive member of the Akan Wikipedia (if she wanted to be :-( )? No. If Wikipedias were for cultures, the edits of Macedonians, Chinese, Italians or Congolese people to en.wp would be somehow less valid that those of native speakers of English in predominantly Anglophone societies. Of course, this is not the case. That's one of the things I like about en.wp - the fact that people who do not speak English as their primary language form a large portion of our editors means that things are likely to come out a bit more balanced. Argentine editors can edit [[Falkland Islands]], for example. In my humble opinion, this is the way it should be. Language is a troublesome barrier. Who is to ensure that Turkish or Greek articles about Cyprus are neutral? I'm not an advocate of a one-world language, but if we had perfect MT tech, I would be in favor of everybody collaborating on one massive international WP. I'll ignore your "probably" here for the time being. However, I don't see any good reason that different Wikis need to have different contents. Different communities have agreed on different policies, articles are allowed on en.wp that would be speedily deleted on de.wp, but these policies are not necessarily based on some intrinsic aspect of the language, but rather the opinions of the people who make up that particular community. Please, please, please note that I am not saying everybody should follow the same policy, I'm just saying that policy differences or differences in article content are not a result of some sort of intrinsic property of the language in which they are written. A _good_ translation of any _good_ article from any language into any other language should be perfectly acceptable, with allowances for local policy differences (which again are set by the Wiki community, NOT by every single speaker of that language). -m.

I would like to add to this that I think the worst part of this idea is the assumption that other languages should take articles from en.wp. I would be in favor of an international, language-free Wikipedia if/when perfect (or 99.99% accurate) MT software exists, but that is not currently the case. My point here is that rather than forcing English articles on other languages, everybody everywhere speaking any language should be able to modify the same article and view it in their native language. -m. On Sun, Jul 25, 2010 at 2:59 AM, Ray Saintonge <saintonge(a)telus.net> wrote:

"The idea is that most of en.wp's articles are well-enough written, and written in accord with NPOV to a sufficient degree to overcome any such criticism of 'imperial encyclopedism.' - really? It's a) not particularly well-written, mostly and b) referenced overwhelmingly to English-language sources, most of which are, you guessed it.. Western in nature. On Mon, Jul 26, 2010 at 3:43 AM, stevertigo <stvrtg(a)gmail.com> wrote:

Shiju Alex, Stevertigo is just one en.wikipedian. As far as using exact copies goes, I don't know about the policy at your home wiki, but in many Wikipedias this sort of back-and-forth translation and trading and sharing of articles has been going on since day one, not just with English but with other languages as well. If I see a good article on any Wikipedia in a language I understand that is lacking in another, I'll happily translate it. I have never seen this cause problems provided I use proper spelling and grammar and do not use templates or images that leave red links. I started out at en.wp in 2001, so I don't think it's unreasonable to call myself an English Wikipedian (although I'd prefer to think of myself as an international Wikipedian, with lots of edits at wikis such as Serbo-Croatian, Spanish, Navajo, Haitian and Moldovan). I am not at all in favor of pushing any sort of articles on anybody, if a community discusses and reaches consensus to disallow translations (even ones made by humans, including professionals), that is absolutely their right, although I don't think it's wise to disallow people from using material from other Wikipedias. Google Translator Toolkit is particularly problematic because it messes up the existing article formatting (one example, it messes up internal links by putting punctuation marks before double brackets when they should be after) and it includes incompatible formatting such as redlinked templates. It also doesn't help that many editors don't stick around to fix their articles afterwards. -m. On Mon, Jul 26, 2010 at 9:04 PM, Shiju Alex <shijualexonline(a)gmail.com> wrote:

Yes this is one of the main issue of *Google Translator Tool Kit* (GTTK). There are many points raised by Ravi regarding GTTK in his presentation at WikiMania. http://docs.google.com/present/view?id=ddpg3qwc_279ghm7kbhs Not all wikipedias work/create articles in the same way as English Wikipedia or some other big wikipedias does. Many of the active wiki communities does not like the word-to-word translation of the English Wikipedia articles. But that doesn't mean that while developing an article, they won't refer English Wikipedia. English wikipedia article is their first point of reference most of the time. The problem starts when some one start forcing English Wikipedia articles in a language wikipedia. Here it is Google, using the Google Translate Tool Kit (GTTK) . Most of the active wiki communities (especially non-Latin wikis) are not interested in the word-to-word translation of the English Wikipedia articles. Also many of them are not willing to to go through the big articles (with lot of issues) created using GTTK and rewrite the entire article to bring it to the wiki style. They will better prefer to start the article from the scratch. One of the main issue is that the Google/Google translators are not communicating with the wiki community (of each language) before they start the project in a wikipedia. For example, Tamil wikipedia community came to know about Google efforts only 6 months after they started the project in that wiki. Wiki communities like the biological growth of the wikipedia articles in their wiki. Why English Wikipedia did not start building wikipedia articles using *Encyclopedia Britannica 1911* edition which was available in the public domain? Personally, I am not against GTTK or against Google. At least this effort is good for the online version of a language (even if some argue that it is not good for wikipedia). But this effort needs to be executed in a different way so that wikipedia of that language will benefit from it. Some of the solutions that are coming to my mind: 1. Ban the project of Google as done by the Bengali wiki community (Bad solution, and I am personally against this solution) 2. Ask Google to engage wiki community (As happened in the case of Tamil) to find out a working solution. But if there is no active wiki community what Google can do. But does this mean that Google can continue with the project as they want? (Very difficult solution if there is no active wiki community) 3. Find some other solution. For example, Is it possible to upload the translated articles in a separate name space, for example, Google: Let the community decides what needs to be taken to the main/article namespace. 4. ......... If some solution is not found soon, Google's effort is going to create problem in many language wikipedias. The worst result of this effort would be the rift between the wiki community and the Google translators (speakers of the same language) :( Shiju On Tue, Jul 27, 2010 at 8:39 AM, Mark Williamson <node.ue(a)gmail.com> wrote: > Shiju Alex, > > Stevertigo is just one en.wikipedian. > > As far as using exact copies goes, I don't know about the policy at > your home wiki, but in many Wikipedias this sort of back-and-forth > translation and trading and sharing of articles has been going on > since day one, not just with English but with other languages as well. > If I see a good article on any Wikipedia in a language I understand > that is lacking in another, I'll happily translate it. I have never > seen this cause problems provided I use proper spelling and grammar > and do not use templates or images that leave red links. > > I started out at en.wp in 2001, so I don't think it's unreasonable to > call myself an English Wikipedian (although I'd prefer to think of > myself as an international Wikipedian, with lots of edits at wikis > such as Serbo-Croatian, Spanish, Navajo, Haitian and Moldovan). I am > not at all in favor of pushing any sort of articles on anybody, if a > community discusses and reaches consensus to disallow translations > (even ones made by humans, including professionals), that is > absolutely their right, although I don't think it's wise to disallow > people from using material from other Wikipedias. > -m. > > On Mon, Jul 26, 2010 at 9:04 PM, Shiju Alex <shijualexonline(a)gmail.com> > wrote: > >> > >> really? It's a) not > >> particularly well-written, mostly and b) referenced overwhelmingly to > >> > >>> English-language sources, most of which are, you guessed it.. Western > in > >>> > >> nature. > >> > > > > Very much true. Now English Wikipedians want some one to translate and > use > > the exact copy of en:wp in all other language wikipedias. And they have > the > > support of Google for that. > > > > > > > > > > > > > > On Tue, Jul 27, 2010 at 5:52 AM, Oliver Keyes <scire.facias(a)gmail.com > >wrote: > > > >> "The idea is that most of en.wp's articles are well-enough written, and > >> written in accord with NPOV to a sufficient degree to overcome any > >> such criticism of 'imperial encyclopedism.' - really? It's a) not > >> particularly well-written, mostly and b) referenced overwhelmingly to > >> English-language sources, most of which are, you guessed it.. Western in > >> nature. > >> > >> On Mon, Jul 26, 2010 at 3:43 AM, stevertigo <stvrtg(a)gmail.com> wrote: > >> > >> > Mark Williamson <node.ue(a)gmail.com> wrote: > >> > > I would like to add to this that I think the worst part of this idea > >> > > is the assumption that other languages should take articles from > >> > > en.wp. > >> > > >> > The idea is that most of en.wp's articles are well-enough written, and > >> > written in accord with NPOV to a sufficient degree to overcome any > >> > such criticism of 'imperial encyclopedism.' > >> > > >> > Mark Williamson <node.ue(a)gmail.com> wrote: > >> > > Nobody's arguing here that language and culture have no > relationship. > >> > > What I'm saying is that language does not equal culture. Many people > >> > > speak French who are not part of the culture of France, for example > >> > > the cities of Libreville and Abidjan in Africa. > >> > > >> > Africa is an unusual case given that it was so linguistically diverse > >> > to begin with, and that its even moreso in the post-colonial era, when > >> > Arabic, French, English, and Dutch remain prominent marks of > >> > imperialistic influence. > >> > > >> > Ray Saintonge <saintonge(a)telus.net> wrote: > >> > > This is well suited for the dustbin of terrible ideas. It ranks > right > >> > > up there with the notion that the European colonization of Africa > was > >> > > for the sole purpose of civilizing the savages. > >> > > >> > This is the 'encyclopedic imperialism' counterargument. I thought I'd > >> > throw it out there. As Bendt noted above, Google has already been > >> > working on it for two years and has had both success and failure. It > >> > bears mentioning that their tools have been improving quite steadily. > >> > A simple test such as /English -> Arabic -> English/ will show that. > >> > > >> > Note that colonialism isnt the issue. It still remains for example a > >> > high priority to teach English in Africa, for the simple reason that > >> > language is almost entirely a tool for communication, and English is > >> > quite good for that purpose. Its notable that the smaller colonial > >> > powers such as the French were never going to be successful at > >> > linguistic imperialism in Africa, for the simple reason that French > >> > has not actually been the lingua franca for a long time now. > >> > > >> > > Key to the growth of Wikipedias in minority languages is respect for > >> the > >> > > cultures that they encompass, not flooding them with the First-World > >> > > Point of View. What might be a Neutral Point of View on the English > >> > > Wikipedia is limited by the contributions of English writers. Those > >> who > >> > > do not understand English may arrive at a different neutrality. We > >> have > >> > > not yet arrived at a Metapedia that would synthesize a single > >> neutrality > >> > > from all projects. > >> > > >> > I strongly disagree. Neutral point of view has worked on en.wp because > >> > its a universalist concept. The cases where other language wikis > >> > reject English content appear to come due to POV, and thus a violation > >> > of NPOV, not because - as you seem to suggest - the POV in such > >> > countries must be considered "NPOV." > >> > > >> > Casey Brown <lists(a)caseybrown.org> wrote: > >> > > I'm surprised to hear that coming from someone who I thought to be a > >> > > student of languages. I think you might want to read an > >> > > article from today's Wall Street Journal, about how language > >> > > influences culture (and, one would extrapolate, Wikipedia articles). > >> > > >> > I had just a few days ago read Boroditsky's piece in Edge, and it > >> > covers a lot of interesting little bits of evidence. As Mark was > >> > saying, linguistic relativity (or the Sapir-Whorf hypothesis) has been > >> > around for most of a century, and its wider conjectures were strongly > >> > contradicted by Chomsky et al. Yes there is compelling evidence that > >> > language does "channel" certain kinds of thought, but this should not > >> > be overstated. Like in other sciences, linguistics can sometimes make > >> > the mistake of making *qualitative judgments based on a field of > >> > *quantitative evidence. This was essentially important back in the > >> > 40s and 50s when people were still putting down certain > >> > quasi-scientific conjectures from the late 1800s. > >> > > >> > Still there are cultures which claim their languages to be superior in > >> > certain ways simply because they are more sonorous or emotive, or > >> > otherwise expressive, and that's the essential paradigm that some > >> > linguists are working in. > >> > > >> > -SC > >> > > >> > _______________________________________________ > >> > foundation-l mailing list > >> > foundation-l(a)lists.wikimedia.org > >> > Unsubscribe: > https://lists.wikimedia.org/mailman/listinfo/foundation-l > >> > > >> _______________________________________________ > >> foundation-l mailing list > >> foundation-l(a)lists.wikimedia.org > >> Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l > >> > > _______________________________________________ > > foundation-l mailing list > > foundation-l(a)lists.wikimedia.org > > Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l > > > > _______________________________________________ > foundation-l mailing list > foundation-l(a)lists.wikimedia.org > Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l >

On Tue, Jul 27, 2010 at 11:42 AM, Mark Williamson <node.ue(a)gmail.com> wrote: This list will automatically come if Google engage the wiki community for their project for a particular language. But for some wikipedias there is no active wiki community. So how this issue can be solved? Selection of the articles for translation is an important part for this project. Definitely http://en.wikipedia.org/wiki/Wikipedia:Vital_articles is a good choice for this. Community might also be interested in some other important articles (important with respect to the social/ cultural/geography of the speakers of that language). So engaging local wiki community is most important ~Shiju

Aphaia, Shiju Alex and I are referring to Google Translator Toolkit, not Google Translate. If the person using the Toolkit uses it as it was _meant_ to be used, the results should be as good as a human translation because they've been reviewed and corrected by a human. -m. On Tue, Jul 27, 2010 at 12:42 PM, Aphaia <aphaia(a)gmail.com> wrote:

Ah, I omitted T, and I meant Toolkit. A toolkit with garbage could be called toolkit, but it doesn't change it is useless; it cannot deal with syntax properly, i.e. conjugation etc. at this moment. Intended to be "reviewed and corrected by a human" doesn't assure it was really "reviewed and corrected by a human" to a sufficient extent. It could be enough for your target language, but not for mine. Thanks. On Wed, Jul 28, 2010 at 5:15 AM, Casey Brown <lists(a)caseybrown.org> wrote: -- KIZU Naoko http://d.hatena.ne.jp/Britty (in Japanese) Quote of the Day (English): http://en.wikiquote.org/wiki/WQ:QOTD

Mass machine translations ("pushing" them onto other projects that may or may not want them) is a very bad idea. Beginning in 2004-05, a non-native speaker on en.wp decided that he should import slightly-cleaned babelfish translations of foreign language articles that did not have articles on the English wikipedia. They were almost uniformly horrid, and required many volunteer hours to clean up (I believe some were simply deleted). The user had to be restrained from importing additional articles in this manner. I would not want to impose cleanup jobs upon users who did not volunteer for them. In other words, I think the "pull" method of translation is not a bug--it's a feature--it ensures that a competent native speaker is willing and able to satisfactorily port an article to a different language. That said, if someone wants to develop a tool to aid "pullers" by making a first-pass translation of the wikitext of an article, I think that would be an unambiguously good thing. Frank

Дана Friday 30 July 2010 02:31:44 Andreas Kolbe написа: Interestingly, I have had a completely opposite experiences. When reading a Google translation, it is easy for me to decipher what does it mean even if it is not gramatically correct. When translating, I often hang on deciding what sentence structure to use, or on remembering how a specific words translates. GTT solves both problems. My estimate is that I retain half and rewrite half of every sentence it produces.

--- On Sat, 31/7/10, Nikola Smolenski <smolensk(a)eunet.rs> wrote: I'm afraid if that is how you proceed, you are already up the creek without a paddle. You say, "When reading a Google translation, it is easy for me to decipher what does it mean even if it is not gramatically correct." If you are translating, you should not be able to decipher what the Google output means, you should be able to decipher what the *original* says, *from looking at the original*. Because the Google Translator Toolkit, at times, translates "there is one such system" as "there is no such system", or it translates "A is governed by B" as "A governs B". Don't ask me why, it does. Even in mainstream language pairs like English and German. I shudder to think what it does in Hindi and Tamil. So when you are working on a text about maths, or physics, that is supposed to go into an encyclopedia, deducing the meaning of the original from the Google translation is really quite fatal. And to someone who is fully fluent in the source language, and wants to compose a text in the target language, Google Translator Toolkit is, at present, worthless. Word-processing the Google output to arrive at a readable, written text creates more work than it saves. Remember, we are talking translation here: that means composing a well-written, correctly formatted text for others to read. We are not talking about "figuring out what it probably means." If Google want to build up their translation memory, I suggest they pay publishers for permission to analyse existing, published translations, and read those into their memory. This will give them a database of translations that the market judged good enough to publish, written by people who (presumably) understood the subject matter they were working in. This seems a much better idea than to pay for and collect memories from haphazard Wikipedia translations done by amateurs which, judging by the feedback from the relevant Wikipedia communities, are garbage. Why feed that garbage into the system? There should be alarm bells ringing at Google here. A.

On 08/07/2010 02:23 AM, Andreas Kolbe wrote: This is where our experience differs. I'm working faster with the Google Translator Toolkit than without. If we forget Google for a while, this is actually something that we could do on our own. There are enough texts in Wikisource (out of copyright books) that are available in more than one language. In some cases, we will run into old spelling and use of language, but it will be better than nothing. The result could be good input to Wiktionary. Here is the Norwegian original of Nansen's Eskimoliv, http://no.wikisource.org/wiki/Indeks:Nansen-Eskimoliv.djvu And here is the Swedish translation, both from 1891, http://sv.wikisource.org/wiki/Index:Eskimålif.djvu Norwegian: Grønland er paa en eiendommelig vis knyttet til vort land og folk. Swedish: Grönland är på ett egendomligt sätt knutet till vårt land och vårt folk. As you can see, there is one difference already in this first sentence: The original ends "to our country and people", while the translation ends "to our country and our people". Is there any good free software for aligning parallel texts and extracting translations? Looking around, I found NAtools, TagAligner, and Bitextor, but they require texts to be marked up already. Are these the best and most modern tools available? -- Lars Aronsson (lars(a)aronsson.se) Aronsson Datateknik - http://aronsson.se

[citation needed] -m.

I read that thread and noticed a lot of confusion. One translator admitted she never even tried it, but still had lots of negative stuff to say; more than one person said they found it useful (see Esperantisto's response), and other people seemed to not realize there was a difference between Google Translate and Google Translator Toolkit. As I said before, I make my living as a translator, these are not foreign concepts to me. I use GTTK every day in my work and find it to be very useful. Perhaps you don't find it useful, alright, but some of us have used it to increase efficiency. -m. On Sun, Aug 8, 2010 at 5:50 PM, Andreas Kolbe <jayen466(a)yahoo.com> wrote:

P.S. Chatting to Mark off-list about GTTK, and having experimented with other languages, it appears that GTTK quality varies widely depending on the language pair, and probably the source/target direction. German, Hindi and Japanese are definitely handled poorly; some other language combinations seem to do much better. A. --- On Mon, 9/8/10, Andreas Kolbe <jayen466(a)yahoo.com> wrote:

On Wed, Jul 28, 2010 at 7:26 AM, Michael Snow <wikipedia(a)verizon.net> wrote: True, but this thread is concerning to "push" articles with machine translation? And it implies to have others clean it up, not "work in areas they understand" as you suggested, so I'd like to point out it should never happen at least at this moment. I don't oppose node_ue or others use those Google product just for their use (it's upon them anyway), but if they recommend them (either Google Translation Toolkit or Google Translation), I would like to stress it's no snake oil for every language at this moment, and for people like stevertigo, who think Google Translation is enough, it's quite opposite of the truth. It may happen to work in some cases, but generally cleaning up Google Translation results is nothing recommendable for volunteers. Note that even Google themselves don't use Google Translation for their Wikipedia translation project. Cheers, Cheers, -- KIZU Naoko http://d.hatena.ne.jp/Britty (in Japanese) Quote of the Day (English): http://en.wikiquote.org/wiki/WQ:QOTD

Is anyone from Google reading this thread? Because of this thread i tried to play with the Google Translator Toolkit a little and found some technical problems. When i tried to send bug reports about them through the "Contact us" form, i received after a few minutes a "bounce" message from the translation-editor-support(a)google.com address. I love reporting bugs, and developers are supposed to love reading them, but it looks like i'm stuck here... 2010/7/27 Mark Williamson <node.ue(a)gmail.com> אָמִיר אֱלִישָׁע אַהֲרוֹנִי Amir Elisha Aharoni http://aharoni.wordpress.com "We're living in pieces, I want to live in peace." - T. Moore

2010/7/29 Mark Williamson <node.ue(a)gmail.com> Bugzilla is difficult enough :) The thing that i love the most in Free Software projects is that when you report a bug, you know exactly where it went. At OTRS a small bunch of volunteer Wikipedians deals quite successfully with tons of pretty delusional email. Surely Google could at least give people an email that doesn't bounce. This problem may be one of the things that makes this translation project misunderstood. -- אָמִיר אֱלִישָׁע אַהֲרוֹנִי Amir Elisha Aharoni http://aharoni.wordpress.com "We're living in pieces, I want to live in peace." - T. Moore

Muhammad Yahia <shipmaster(a)gmail.com> wrote: You raise some important points. The understanding of community-building is a key insight, and I think everyone here appreciates it. I understand that it's not enough to just "push" an article over to Swahili, for example, if 1) the translation is not sufficiently understandable on its own, if 2) the receiving language editors aren't practiced in how to handle such content, or if 3) the sender doesn't leave a note in a "lingua franca" explaining what its purpose is. Note that the idea is not that only English language articles will "push" over to other languages - the idea is that other languages may have articles about topics which could be "pushed" over to English as well. There has been perhaps a natural sense that there is some kind of encyclopedic imperialism inherent to the idea. There is also an assumption among many here that language is always relativistic and of cultural essence, or that English Wikipedia's 3.4 million articles are just out of the scope of relevance to other languages. I'd like to dispel those notions, but that would be out of scope for this particular email. -SC

On Tue, Jul 27, 2010 at 11:42 AM, David Gerard <dgerard(a)gmail.com> wrote: At least for some entries... http://en.wikipedia.org/wiki/Special:WhatLinksHere/Template:1911

stevertigo wrote: Suppose for a minute that your proposal were implemented, and all the machine translation problems were overcome. Would English NPOV be so good that community members in the target language would be incapable of making substantive improvements? And if they did make substantive change, how would you reconcile the divergence when both versions were subsequently edited? I'm disinclined to accept your universalist conjecture. It sounds too much like intelligent design for linguistics. When I visit the bookstores in another country I am struck by the difference in emphasis that they put on different topics. This alone is bound to lead to different neutralities. Ray

Hello all, I am a heavy translator on WikiMedia projects. I would say more than 95% of my contributions on content is translation. But I am against a blind translation. For example mostly I would translate british or north american related content from en-wp to zh-wp, and not from other languages. I would translate german or general european related articles mostly from de-wp to zh-wp. French related articles I try to translate from fr-wp to zh-wp, mostly I would make a test beforehand that the language in the article is enough comprehensible for me, since my French is by far not on the lever of my German or English. But I would never translate a Japanese related article because I don't think quite trust what the German or other english speaking people write about Japan. I never translate a China related article because I am very sure that at some point they have a not correct context. Even if there is no article in zh-wp about that particular entity I would rather wait a zh-wp user who has more understanding to start an article on it. (Or, ocasionally I would do research myself and start an article from scrap.) Natural science related articles are sort of universal, although reading through different languages you can also find here tremendous differences between different language versions. I used to select the (in my subjective opinion) more better version (before 2006 more en-wp, in the last two three years de-wp or en-wp about half half), or I would combine both versions. Backward, I would only translate China related article from zh-wp into de-wp, because I think the deficiency in de-wp in this area is the biggest. And some zh-wp articles, especially the excellent aritcles, are really very well written and researched and source. I don't see any sense to translate a German related article from zh-wp to de-wp. Translation should never be blind. For example en-wp articles about american towns and cities could get very detailed, down to neighbourhoods. I mostly omit too detailed parts one because I would start to do original research beginning to invent Chinese transcriptions for the names and second I think they are not really interesting for a Chinese user. You can also find all kinds of failures in the original article, if you are doing a blind translation, in the best case the failures remain in the original article, in the worst case you propagate those failures into language versions that maybe have no resource to check those facts. For example in the article I am currently working on [[:en:Mumbai culture]] there was the failure that the city has three World Heritage (actually there are only two on its territory). Most failures are wrong links because of articles got moved or disambigged and the links didn't got corrected. For example in the article mentioned above in the section Cinema Multiplex was linked to [[:en:Multiplexing]], the correct link should be [[:en:Multiplex (movie theater)]]. Such errors are quite common. Doing more careful and considered translation can help both language versions, more than simply doing a translation. Greetings Ting

Aphaia, 27/07/2010 21:33: It's not only a matter of NPOV. There's even a policy for this: http://en.wikipedia.org/wiki/Wikipedia:Verifiability#Non-English_sources Obviously you can expect other language version to want the same for their language. Nemo

On 08/05/2010 03:12 PM, Michael Galvez wrote: This is an unusual and most welcome step for Google. When I first learned about GTTK in June 2009, I used it to translate a handful of articles from English to Swedish. I'm glad that it's now also possible to translate into English, but some of the errors are still there. It's a great tool, and should be used more. We have a common interest in improving it. But for this, wikipedians need feedback. Which language pairs are most active? What words or phrases does GTTK find problematic, and can we somehow improve that? Google could benefit so much from collaborating with wikipedians. Ultimately, Google could share some translation dictionaries, so we could include them in Wiktionary, the free dictionary. Users of Gmail or Google Apps want their privacy, but users who translate Wikipedia articles are already sharing their results, so Google could help us to find each other and make us collaborate. Translations that start from a Wikipedia article could by default be put in a shared pool where other wikipedians can find them. To some details: I need a way to mark in the original text that a phrase is a quote, book title or noun proper that shouldn't be translated, but copied literally. And in the statistics, those words should not be counted as untranslated and block me from publishing the result. Optimally, GTTK would learn over time where such literal phrases occur, e.g. text in italics under the ==Bibliography== section. English ==References== corresponds to Swedish ==Källor==, even though the two words are not direct translations. GTTK was pretty quick to pick this up. However, the different styles we use for the opening paragraph of biographic articles, using parenthesis around the birth and death dates in the English Wikipedia, but not in some other languages, is something GTTK has not yet learned. Categories should not be translated, but GTTK should follow the interwiki links for categories. If none exist, perhaps suggest a parent category. Even for articles that already exist in the target language, we often need to translate another section. For example, the Swedish Wikipedia might have an article about Afghanistan with a good section about its geography, but the history section needs improvement, and could be translated from another language. The work-around is to begin a translation of the whole article, but only translate the relevant part and then cut-and-paste into the target without submitting through GTTK. Perhaps GTTK could bring up both articles side by side and suggest which sections are in most dire need of improvement? -- Lars Aronsson (lars(a)aronsson.se) Aronsson Datateknik - http://aronsson.se

Michael Galvez wrote: I'm guessing that few communities will find it particularly valuable to keep a translation in sync, except possibly for language pairs that have close affinity and parallel evolution (approaching the point that some people would regard them as "merely" dialects). So maybe for a situation like translating French articles into Picard, at most. But even supposing the Tamil community, as an example, might find it helpful to boost their content with translations of English articles, once that's been done I can't imagine them wanting those articles perpetually reharmonized with changes in the English version. The point of seed content is to provide a basis for new life and growth, which by necessity must outgrow and cast off the shell in which the seed came. At that point, trying to maintain or recreate the shell doesn't particularly help further development. --Michael Snow

On 6 August 2010 18:47, Michael Galvez <michaelcg(a)gmail.com> wrote: And the data that GTTK gathers from its use in Wikipedia translations? What would need to happen for that to start coming back, in a usable form? As I vaguely recall from someone posting study results on the question, not all interwiki links are good, but ones that are a 1:1 match generally seem to be. (I frequently use Wikipedia interwiki links as a guide to translating single words casually.) - d.

On Fri, Aug 13, 2010 at 4:28 PM, Michael Galvez <michaelcg(a)gmail.com> wrote: If GTTK goes away next year, will the data gathered from these translations go away also? I had thought the translation memory from Wikipedia translations was freely available for reuse (at least in principle). However, this isn't yet the case. As I understand it, Wikipedia translations are bundled together with all other public submissions to Google's global public translation memory, which produces the default translations you see online. This TM is not currently available for query, export or download. That is my impression as well. SJ

On 08/06/2010 07:47 PM, Michael Galvez wrote: Google, as any large company, uses many sources. For example, Google Maps used to buy all its maps, but later started to drive around to build its own maps (and street images). With time, I'm certain you will use Google Books as a parallel corpus and derive translations of words and phrases from translated books, and some day you might be able to build Google Translate without relying on external dictionary sources. I don't know if this is one month or one year away, but it should take less than one decade. Expecting this development, you could keep collaboration with open content movements, such as Wikipedia/Wiktionary in mind. There is no such tag, unfortunately. But in the GTTK user interface, it would be useful to have a way to mark where in the original text (left-hand side) those tags should have been. If it is any help to the pretranslator, other kinds of marks could also be manually added, such as whether a phrase is a figure of speech or should be read literally. If the text says "kill two birds with one stone", that should be translated into Swedish as "hit two flies with one swat". But if David slays Goliath with a stone, that should remain a stone. But when you have two or more candidates, each with a reasonable probability, the choice could be presented to the human translator. This means you do recognize some wiki markup, such as [[links]] and ==headings==. But recognition of that markup is apparently hard-wired and takes place before any learning. Now, consider the case when '''John Doe''' (May 1, 1733 - April 5, 1799) was a British colonel is translated, according to our manual of style, as: '''John Doe,''' född 1 maj 1733, död 5 april 1799, var en brittisk överste where the parentheses are replaced with commas and the words född (born) and död (died) have been added. It would be nice if the translation memory could learn not only the words (colonel = överste) but also to recognize this transformation of style. It is very context sensitive (this example only applies to the opening paragraph of biographic articles) and would need lots of translations to provide good results. And including dashes, commas and parentheses along with words as the elements of translated phrases is perhaps a major shift in what machine translation is supposed to do. (But it could open the door to translating template calls.) I think you should keep it as it is, until you get around to do that "bit of work". -- Lars Aronsson (lars(a)aronsson.se) Aronsson Datateknik - http://aronsson.se

I would say to force spellcheck before publication, which does not seem to be the case currently. I think this would be enough - perhaps a warning as well. I don't know about preventing publication, although that might work too. Well, many translators do fix such problems, but I was just thinking of some of the problems that I've heard so far with people who do "drive-by" translations, dropping it on a project and then disappearing. If translators are careful and do all the work themselves, templates are an annoyance rather than a real problem. I'm not sure if this project was separate from the Swahili Wikipedia Challenge, but I'm assuming it was after seeing articles such as http://sw.wikipedia.org/wiki/Maduka_ya_United_Cigar_Stores (about a defunct chain of cigar stores in the US) which I doubt were popular searches in East Africa. One more idea: Automatically add existing Interwikis links to the new article. Also, as far as Indic languages go, I would ask if there's any chance you have any Oriya speakers - with 637 articles, the Oriya Wikipedia is by far the most anemic of Indic-language Wikipedias, in spite of a speaker population of 31 million. -m.

Dear Michael, I also thank you for joining the discussion. See my question below. 2010/8/6 Michael Galvez <michaelcg(a)gmail.com>om>: How do you decide, in general, with which languages to work? If i understand correctly, until now you worked with Arabic, Swahili and several Indian languages. But there are also languages in other parts of the world, Wikipedias in which could profit from such a project. For example, the Greek Wikipedia is surprisingly small with only 54,500 articles (13 million speakers); Armenian has only 10,000 articles (6.7 million speakers); Georgian has 42,000 articles (4 million speakers). AFAIK, these language communities are largely monolingual, that is, speakers of these languages may know English or Russian, but they usually prefer to speak and write their own, unlike, for example, speakers of Native American languages, many of whom use English, Spanish or Portuguese online. What has to happen so that a collaboration with Google Translation will begin in these languages? Do their representatives have to approach Google or is it usually Google's decision? -- אָמִיר אֱלִישָׁע אַהֲרוֹנִי Amir Elisha Aharoni http://aharoni.wordpress.com "We're living in pieces,  I want to live in peace." - T. Moore

That sounds great to me. Unfortunately, there is currently not even an Oriya Wikipedia community. I think such a project would need to be managed a bit differently - seeking to either create a community (no reason participants can't start a community), or to be relatively limited in scope, or else to have more stringent controls on content quality. I would love to help with that myself in any way possible. Another option with a bit more community but still very underdeveloped is the Punjabi Wikipedia, with 1919 pages. I would recommend contacting Gman124 or Sukh at that project on their user talk pages or through the e-mail user function. -m.

Michael Galvez &lt;michaelcg(a)gmail.com&gt; wrote: Thanks for stopping by. A few questions: 1) Does GTTK have a specific API for Mediawiki markup ("wikitext") itself? 2) Can it be opened up for viewing/editing? 3) Does it include the original-language wikitext as <!-- hidden--> in the output wikitext? 0) The main issue here is 'concepts of community,' interaction between communities, and the creation of "community" between different language communities. The more open Google is with us about what it wants and what it proposes to do, the more we can be on board with helping organize community support. -SC

Michael Galvez &lt;michaelcg(a)gmail.com&gt; wrote: I mean that, given that the output is essentially plain wikitext, it might be a good idea to include the original source paragraphs hidden within the body of the output: <machine translated text in language x> <!-- hidden original text in source language --> The output files of course would be larger, and having large amounts of different texts might confuse autodetect.. But the issue is again to aid users in keeping a high fidelity between input and translated output, and keeping source paragraphs close. stevertigo wrote: michael galvez wrote: Are you keeping a page about this on meta.wiki? -SC

On Sat, Aug 7, 2010 at 4:52 AM, Federico Leva (Nemo) &lt;nemowiki(a)gmail.com&gt;wrote;wrote: Here's the list of supported languages: http://mail.google.com/support/bin/answer.py?hl=en&answer=199339933. Not sure if the Gmail team can use those dictionaries but will pass on the link. The languages for the acquired dictionaries are the one listed in http://www.google.com/dictionary. This includes monolingual and bilingual dictionaries. I believe all of them are on limited licenses, although the specifics vary depending on the deal.

Same in Ukrainian Wikipedia For time being machine translations are good only as aid to comprehend/grasp articles, pointed by interwiki. On Mon, Jul 26, 2010 at 11:57 AM, Marco Chiesa &lt;chiesa.marco(a)gmail.com&gt; wrote: