Hi Samy,

checkout this api endpoint: https://en.wikipedia.org/w/api.php?action=query&meta=siteinfo&siprop...

Thanks, sounds to go in the right direction...

But I'm not a programmer - I need a format like CSV, or TXT as table, with this columns: - ISO-639-3 short code - name of language in English - name of language local in local writing system

Best regards, Markus

Hi,

I kind of wrongly understood the original question, so I wrote a more general SPARQL query¹ to get this for languages in Wikidata.

Might be of some interest for someone, so I'm posting it anyway:

--- 8< ---

SELECT ?name ?localname ?iso3 WHERE { ?language wdt:P218 ?iso1 ; wdt:P220 ?iso3 ; rdfs:label ?name . FILTER(LANG(?name) IN ("en")) . OPTIONAL { ?language rdfs:label ?localname . FILTER(LANG(?localname) IN (?iso1)) .} } ORDER BY ASC(?iso3)

--- 8< ---

Best regards,

¹ https://query.wikidata.org/

Am 07.09.2016 um 14:50 schrieb Federico Leva (Nemo):

Markus Bärlocher, 07/09/2016 13:27:

...

But I'm not a programmer - I need a format like CSV, or TXT as table, with this columns:

• ISO-639-3 short code
• name of language in English
• name of language local in local writing system

https://meta.wikimedia.org/wiki/Special:SiteMatrix

Thanks Nemo - done, but no ISO-639-3 short code... (only WP-shortcut)

Three errors found:

Local English تۆرکجه تۆرکجه беларуская тарашкевіца‎ (беларуская (тарашкевіца)‎ भोजपुरी भोजपुरी

Best regards, Markus

Hi Nemo,

Do you literally want the ISO-639-3 code even where MediaWiki and Wikimedia use the ISO-639-1 code? If so, what for?

We work on an international dictionary for nautical terms. ISO 639-3 is the international code used for software. I need the relation between ISO 639-3 and WP-shortcuts, because we think about integration to WD/WP.

see https://meta.wikimedia.org/wiki/Special_language_codes for the few inconsistent codes.

Thanks! Markus

What are Wikidata plans to interoperate, for example, https://en.wikipedia.org/wiki/List_of_ISO_639-1_codes with Glottolog's 7943 entries - http://glottolog.org/glottolog/language - in its languages' list, for example ? Is Wikidata basically using the ISO 639-1 list for its 358 languages? Where please are the Wikidata planning pages online for languages' development?

Thanks, Scott

On Wed, Sep 7, 2016 at 8:05 AM, Federico Leva (Nemo) nemowiki@gmail.com wrote:

Markus Bärlocher, 07/09/2016 16:16:

...

I need the relation between ISO 639-3 and WP-shortcuts

I still have no idea what you mean by WP-shortcuts, but if you mean the MediaWiki/Wikimedia language codes then https://www.mediawiki.org/wiki /Language_code has all the pointers you need and https://en.wikipedia.org/wiki/List_of_ISO_639-1_codes has most of the equivalencies between ISO 639-1 and ISO 639-3.

Nemo

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Hi Markus, Nemo and Wikidatans,

In a "[Wikidata] How many languages supports Wikibase/Wikidata?" thread beginning May 26, Jan Macura writes

Hi all,

looking into [1] I read that Wikidata supports 358 languages. Is it still true? For example, I tried to add label in language coded as "nan" (defined in ISO 639-3) and it worked. However it didn't worked for e.g. "arb", which is also part of the ISO 639-3 standard. So how many?

Thanks Jan

[1] VRANDEČIĆ, Denny, KRÖTZSCH, Markus. Wikidata: A Free Collaborative Knowledgebase. *Communications of the ACM*. 2014-10, Vol. 57 No. 10, 7885. DOI 10.1145/2629489. http://cacm.acm.org/magazines/2014/10/178785-wikidata/ fulltext

Thanks for helping to focus these unfolding Wikdaata language development questions, Markus.

Scott

On Sep 7, 2016 12:04 PM, "Markus Bärlocher" markus.baerlocher@lau-net.de wrote:

Hi Nemo,

...

...

I need the relation between ISO 639-3 and WP-shortcuts

I still have no idea what you mean by WP-shortcuts

I'm not a programmer nor a language specialist. Sorry for my Swiss school English...

I have found this: https://de.wikipedia.org/wiki/Spezial:Liste_der_Wikimedia-Wikis?uselang=en Contains 400 languages - but WP says that WP has 293 languages, see: https://de.wikipedia.org/wiki/Wikipedia:Sprachen

From there from column "Language" I extracted two columns

• language name local in local writing system
• language name English :-)

In the first list there are eight columns with Wiki-language-abreviations (2, 3, 6, 7 and 8 characters). But ISO 639-3 should have exact 3 characters?

I don't have a full ISO 639-3 list, and I don't like to try a matching between a such list and the WP-language-abreviations by hand ;-)

...

https://www.mediawiki.org/wiki/Language_code has all the pointers you need and

Here I read that ISO 639-3 is required: https://translatewiki.net/wiki/Translatewiki.net_languages# Policy_on_enabling_translation_into_a_language but I can't find a such list.

...

https://en.wikipedia.org/wiki/List_of_ISO_639-1_codes has most of the equivalencies between ISO 639-1 and ISO 639-3.

Here I count 185 languages. And I have no idea how to merge this with the other tables with 293 or 400 languages...

I hope that there is somewhere in the Wikimedia-space a table of all used 293 WP-languages with:

• ISO 639-3
• language name local in local writing system
• language name English

I hope my needs are more clear now?

Bests, Markus

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Hi all,

In a "[Wikidata] How many languages supports Wikibase/Wikidata?" thread

beginning May 26, Jan Macura writes

Hi all,

looking into [1] I read that Wikidata supports 358 languages. Is it still true? For example, I tried to add label in language coded as "nan" (defined in ISO 639-3) and it worked. However it didn't worked for e.g. "arb", which is also part of the ISO 639-3 standard. So how many?

Thanks Jan

[1] VRANDEČIĆ, Denny, KRÖTZSCH, Markus. Wikidata: A Free Collaborative Knowledgebase. *Communications of the ACM*. 2014-10, Vol. 57 No. 10, 7885. DOI 10.1145/2629489. http://cacm.acm.org/magazines/2014/10/178785- wikidata/fulltext

Thanks for helping to focus these unfolding Wikdaata language development questions, Markus.

Scott

thanks Scott! You reminded me, that I still haven't received appropriate

answer to my original question... ping Markus et al.

Thanks Jan

Uhm, sorry. I meant: is this what you look for?

It's based on the query by Jérémie a few mails back.

http://tinyurl.com/h2zky8p

On Thu, Sep 29, 2016 at 1:13 PM Denny Vrandečić vrandecic@gmail.com wrote:

Is that what yu look for?

On Thu, Sep 29, 2016 at 10:56 AM Markus Bärlocher < markus.baerlocher@lau-net.de> wrote:

...

Back home from a longer trip I would like to try again:

Until now I have a CSV with 294 languages in two columns:

• name of language in English
• name of language local in local writing system

I look for:

• ISO-639-3 short code (corresponding to the names)

Best regards, Markus

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

I apologize but I'm coming into this thread a little late. FWIW, I wanted to mention that this is what we use to generate a list of languages[0] for the Wikipedia Android app.

Less to your question but similar, we also generate localized main page title and site name[1], and namespace titles[2]. There's also a related thread in T121936[3] discussing the localized name of all Wikimedia sites.

[0] https://wikistats.wmflabs.org/api.php?action=dump&table= wikipedias&format=csv&s=good [1] https://es.wikipedia.org/w/api.php?action=query&meta= siteinfo&format=json&siprop=general [2] https://fr.wikipedia.org/w/api.php?action=query&meta= siteinfo&format=json&siprop=namespaces [3] https://phabricator.wikimedia.org/T121936

On Fri, Sep 30, 2016 at 3:21 AM, Markus Bärlocher < markus.baerlocher@lau-net.de> wrote:

Thanks Denny for this:

...

is this what you look for? It's based on the query by Jérémie a few mails back. http://tinyurl.com/h2zky8p

Yes this helps very much :-)

But there are some inconsistencies:

360 WP-languages from your query 294 WP-languages in https://meta.wikimedia.org/wiki/List_of_Wikipedias 277 WP-languages in https://de.wikipedia.org/wiki/Wikipedia:Sprachen

73 'localname' in the query are empty

9 'name' in the query are double (ell, gsw, lzh, mrj, nan, ron, rup, sgs, vro)

There are some problems with characters/charset when I copy&paste the query result to Excel: Burmese, Gothic, Northern Thai, shows only squares as 'local language'

But copying after the squares from Excel to Thunderbird works: Burmese မြန်မာဘာသာစကား mya Gothic language 𐌲𐌿𐍄𐌰𐍂𐌰𐌶𐌳𐌰 got Northern Thai ᨣᩴᩤᨾᩮᩥᩬᨦ nod

All the rest works fine :-)

It would be good to work out a valid and complete table of the WP-languages...

Best regards, Markus

...

    Until now I have a CSV with 294 languages in two columns:
    - name of language in English
    - name of language local in local writing system

    I look for:
    - ISO-639-3 short code (corresponding to the names)

    Best regards,
    Markus


    _______________________________________________
    Wikidata mailing list
    Wikidata@lists.wikimedia.org <mailto:Wikidata@lists.

wikimedia.org>

...

    https://lists.wikimedia.org/mailman/listinfo/wikidata

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Hi Stephen,

in your CSV [1] I count: 312 WP-languages

so WP-languages is between 277, 294, 312 and 360 ;-)

Hi Denny,

use case is the 'Hydrographic Dictionary' (HD) of the 'International Hydrographic Organization' (IHO). 80 nations as members of IHO. Content of HD are nautical terms and a corresponding description/definition.

The idea is to free the HD, and to share it with WD/WP, so crowdsourcing can help to improve and append it, and to translate it to more languages :-)

We prepare an editing tool. For to select a language, we will use a list. This list should contain the WP-languages. The IHO will decide, which of this languages should be prioritized.

My hope is to find a such list... (yes, I knew: the WP-language-list is 'in process' but I hope it is stable for some days/weeks and I find a valid and complete list somewhere in the WM-space)

Best regards, Markus

Am 30.09.2016 um 20:45 schrieb Denny Vrandečić:

Markus, it really depends on what you mean with "a list of all Wikimedia languages". That is why you get different numbers.

Usually, you will have a use case for this list, and depending on that use case you should select the languages you really care about. Besides looking good in some marketing terms, having a complete list from a random collection is barely a real use case. Which languages do you want to list, what is this list for, and what will happen if a specific language is within that list or not?

Just my 2c

On Fri, Sep 30, 2016 at 10:04 AM Stephen Niedzielski <sniedzielski@wikimedia.org mailto:sniedzielski@wikimedia.org> wrote:

I apologize but I'm coming into this thread a little late. FWIW, I
wanted to mention that this is what we use to generate a list of
languages[0] for the Wikipedia Android app.

Less to your question but similar, we also generate localized main
page title and site name[1], and namespace titles[2]. There's also a
related thread in T121936[3] discussing the localized name of all
Wikimedia sites.

[0]
https://wikistats.wmflabs.org/api.php?action=dump&table=wikipedias&format=csv&s=good
[1] https://es.wikipedia.org/w/api.php?action=query&meta=siteinfo&format=json&siprop=general
[2] https://fr.wikipedia.org/w/api.php?action=query&meta=siteinfo&format=json&siprop=namespaces
[3] https://phabricator.wikimedia.org/T121936

On Fri, Sep 30, 2016 at 3:21 AM, Markus Bärlocher
<markus.baerlocher@lau-net.de <mailto:markus.baerlocher@lau-net.de>>
wrote:

    Thanks Denny for this:
    > It's based on the query by Jérémie a few mails back.
    > http://tinyurl.com/h2zky8p

    Yes this helps very much :-)

    But there are some inconsistencies:

    360 WP-languages from your query
    294 WP-languages in
    https://meta.wikimedia.org/wiki/List_of_Wikipedias
    277 WP-languages in https://de.wikipedia.org/wiki/Wikipedia:Sprachen

    73 'localname' in the query are empty

    9 'name' in the query are double
    (ell, gsw, lzh, mrj, nan, ron, rup, sgs, vro)

    There are some problems with characters/charset
    when I copy&paste the query result to Excel:
    Burmese, Gothic, Northern Thai, shows only squares as 'local
    language'

    But copying after the squares from Excel to Thunderbird works:
    Burmese မြန်မာဘာသာစကား  mya
    Gothic language 𐌲𐌿𐍄𐌰𐍂𐌰𐌶𐌳𐌰      got
    Northern Thai   ᨣᩴᩤᨾᩮᩥᩬᨦ        nod

    All the rest works fine :-)

    It would be good to work out a valid and complete table
    of the WP-languages...

    Best regards,
    Markus






    >         Until now I have a CSV with 294 languages in two columns:
    >         - name of language in English
    >         - name of language local in local writing system
    >
    >         I look for:
    >         - ISO-639-3 short code (corresponding to the names)
    >
    >         Best regards,
    >         Markus

Here we go:

http://tinyurl.com/j363hzp

It is adding the variable ?wmlc that was already used to the select statement.

On Tue, Oct 4, 2016 at 1:54 PM Markus Bärlocher < markus.baerlocher@lau-net.de> wrote:

Hi Denny,

may be you can add the WP-language-code to this: http://tinyurl.com/h2zky8p then I hope I can merge some other tables and search and fill empty fields by hand :-)

You are right: the number of WP-languages varies on different questions.

Thanks for your help, Markus

_WP-languages_ 257: with more than 10 articles [1] 031: with 10 or less articles [2] 293: in table of WM projects [3], WD [8] 258: in template of WM projects ordered by code [4] 277: in de:WP [5] 401: the most found [6]

[1] https://stats.wikimedia.org/EN/Sitemap.htm [2] https://stats.wikimedia.org/EN/Sitemap.htm [3] https://meta.wikimedia.org/wiki/Table_of_Wikimedia_projects [4]

https://meta.wikimedia.org/wiki/Template:List_of_language_names_ordered_by_c... [5] https://de.wikipedia.org/wiki/Wikipedia:Sprachen#cite_note-Sprachcode-2 [6] http://tinyurl.com/h2zky8p [7] https://www.wikidata.org/wiki/Q5296#sitelinks-wikipedia

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Hoi, the language codes the WMF uses do not comply with the ISO-639-3. Thanks, GerardM

On 29 September 2016 at 19:56, Markus Bärlocher < markus.baerlocher@lau-net.de> wrote:

Back home from a longer trip I would like to try again:

Until now I have a CSV with 294 languages in two columns:

• name of language in English
• name of language local in local writing system

I look for:

• ISO-639-3 short code (corresponding to the names)

Best regards, Markus

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Hoi, Nothing wrong with the P220 (as far as I know) it is just that there is no one on one relation between this code and what the WMF does in its language codes. Thanks, GerardM

On 29 September 2016 at 22:41, Jan Ainali jan@aina.li wrote:

2016-09-29 22:26 GMT+02:00 Gerard Meijssen gerard.meijssen@gmail.com:

...

Hoi, the language codes the WMF uses do not comply with the ISO-639-3.

Are you saying that P220 is used wrong? (Or are you not replying to Denny's post?)

Best, Jan Ainali

...

Thanks, GerardM

On 29 September 2016 at 19:56, Markus Bärlocher < markus.baerlocher@lau-net.de> wrote:

...

Back home from a longer trip I would like to try again:

Until now I have a CSV with 294 languages in two columns:

• name of language in English
• name of language local in local writing system

I look for:

• ISO-639-3 short code (corresponding to the names)

Best regards, Markus

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

---

Wikidata mailing list Wikidata@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata