I see
https://www.wikidata.org/wiki/Wikidata:Lists/lexemes where last index
is 9001-10000
Wikidata lexemes are in many languages, whereas for Abstract graph is
needed sense of only English lexem (or even only senses independent from
lexems)
Access to lexemes from other Wikiproject can be slower (?) and can be
incoherent.
Abstract Wikipedia can be great basic fro machine translation.
(from my Python post):
Language to language translator without intermediate form need n*(n+1)
language models whereas
translator with intermediate form only 2*n. For 100 languages will be 9900
comparing to 200,for 150 languages will be 22350 comparing to 300.
Intermediate form must not be usual national language but language without
ambiguity, without homonyms.
Let's imagine that we downloads to local computer databases for 5-10
languages, compile c++ binary or use Python script and have local open
translation system without any restrictions. Moreover, intermediate form is
intelligent and it means understanding the text and can be analysed.
Main problem is WSD (word sense disambiguation):
In
https://github.com/alvations/pywsd
are Lesk algorithm in variety:
- original_lesk
- simple_lesk
- adapted_lesk
- cosine_lesk
Test lesk_simple with sentences from Senseval (
https://www.d.umn.edu/~) :
"The Glenn Miller Orchestra turned back the clock for an evening of solid
gold nostalgia at the Apollo theatre, Oxford, on Saturday."
"From the tune Anchors Away right through to In The Mood the young big band
under the expert direction of band leader Ray McVay perfectly recreated the
Miller sound."
"The voices of Sarah Gilbertson and Tony Mansell were joined by three more
from the <tag band as the Moonlight Serenaders to give us the cool
harmonies of Miller's original Modernairs."
--> simple an unofficial association of people or groups
sounds pretty sensible, but.. not found any overlap and it is first sense
from Wordnet!
"The victims are Hungarian Jews who arrived at Auschwitz in 1944 to be
murdered &dash. all 400,000 of them in just two months, consumed by the gas
chambers at the rate of 21,000 a day even though the crematoria could not
cope.\
They are dragging to the truck an old man wearing tails and a band around
his arm."
--> adapted a cord-like tissue connecting two larger parts of an anatomical
structure
sounds pretty sensible, but..found band+two, and this was pure accident
because in text is "TWO months" not related to bound something
Comparing words in defiinition with words in context is not enough. Sense
must be defined in some way by set of contexts.
Example:
List of 13 senses from Wordnet for lexem noun “band” + making hierarchy
1. an unofficial association of people or groups
1.1.1 a group of musicians playing popular music for dancing
1.1.2 instrumentalists not including string players
1.1.3 brass ensemble
1.2 group of criminals or evil people<-------added to Wordnet defs
2. a restraint put around something to hold it together
(point 2.1 is too detailed I think)
2.1 a thin flat strip or loop of flexible material that goes around or over
something else, typically to hold it together or as a decoration
2.1.1 a thin flat strip of flexible material that is worn around the body
or one of the limbs (especially to decorate the body)
2.1.2 a cord-like tissue connecting two larger parts of an anatomical
structure
2.2 a stripe or stripes of contrasting color
2.2.1 an adornment consisting of a strip of a contrasting color or material
2.2 a driving belt in machinery
2.3 a strip of material attached to the leg of a bird to identify it (as in
studies of bird migration)
3. jewelry consisting of a circlet of precious metal (often set with
jewels) worn on the finger
4. range ←---- added to Wordnet defs
4.1 a range of frequencies between two limits
senses for entity “brass band”
1 = 1.1.3 of “band”
senses for entity “rubber band”
1 = 2.1 of “band”
Examples (from
https://www.d.umn.edu/~ and Opus100):
1.
Since birth they have had to fit in two hours of physiotherapy daily in
order to survive and their one hope is `a cure" which embryonic research
has brought in reach.
How can a band of vociferous and woolly-minded objectors deny the hope of
life to thousands of young sufferers by stopping this vital research for
the sake of a few unformed embryonic cells?
1.
You just met the band when you were delivering pizza to the studio?
1.1.1
Meanwhile, the show is nearly over and the band strike up `I Love You Love".
1.1.1
The NME succumbed to The Smiths success by parading a lengthy Smiths
interview by Biba Kopf, a writer not known for his enthusiasm for the
Smiths.
Although hardly succeeding in exposing the conflict between the band's
artistic stance and their situation (which was the probable intention), the
dual interview of Morrissey and Marr did, for once, produce worthy quotes.
1.1.2
THE Glenn Miller Orchestra turned back the clock for an evening of solid
gold nostalgia at the Apollo theatre, Oxford, on Saturday.
From the tune Anchors Away right through to In The Mood
the young big band
under the expert direction of band leader Ray McVay perfectly
recreated the
Miller sound.
The voices of Sarah Gilbertson and Tony Mansell were joined by three more
from the band as the Moonlight Serenaders to give us the cool harmonies of
Miller's original Modernairs.
1.1.3
I welcome this project and wish it every success
Meanwhile, men in impeccable dinner suits swapped business cards at a rapid
rate while women sporting glamorous cocktail dresses talked among
themselves.
A regimental brass band played very British tunes as guests enjoyed a
sumptuous five-course banquet for which they paid at least #50 a head.
1.1.3
Oh, what song was the marching band playing, by the way?
1.2
Harukoma's band controls the passage of the village.
1.2
Today, freedom shall ring loud and clear as Olivia Pope's band of
lawbreakers must explain their involvement in the Jeannine Locke cover-up.
1.2
He succumbed to a band of ruffians led by a scoundrel called Lagardère.
1.2
Brylov's band has been reported in the area.
2.
It had a Smallville Savings and Loan band on it.
2.1
Eee-aww! Now, the Alice band has already perished, so I want you to treat
those as though they're made of porcelain.
2.1
And the rubber band on the ball. ←-- this maybe not “band” but “rubber
band” but sense is one, two lexems
2.1.1
The victims are Hungarian Jews who arrived at Auschwitz in 1944 to be
murdered &dash. all 400,000 of them in just two months, consumed by the gas
chambers at the rate of 21,000 a day even though the crematoria could not
cope.
They are dragging to the truck an old man wearing tails and a band around
his arm.
2.2
She stood for a moment before her tiny, packed closet.
The lighter clothes were narrow bands of color randomly distributed in the
woollier press of darker skirts and coats, forming a pattern like a
spectrograph.
2.2.1
Nobody is going to accept a beard and a green band round the turban and a
few pious phrases (or even a lot of them!) as proof.
4
But no judge was unsympathetic to the dilemma in which a natural mother
found herself.
Mr McCormick submitted that if any one of the mother's reasons was possibly
valid then it could not be said that the mother's refusal to consent was
outside the reasonable band.
4. (confusion with 1)
Nothing that emerged from either of these companies ever seemed
particularly daring, imaginative or stirring.
Similarly, after the first wave of enthusiasm for the films from Channel 4
had died down, it was clear that its drama director, David Rose, was more
interested in television drama than cinema.
British filmmakers were working in too narrow an aesthetic band, defined
largely by television and at no point making any connection to the cinema
culture that had last flourished in the late 1940s.
4.1
The example of the police radios shows the relative permanence of being
allocated a piece of spectrum &dash. radios and other broadcasting
equipment, whether for entertainment or communication, are designed to sort
out what it wants to pick up from the rest of the signal.
To perform well it has to be tightly targeted to cope with quite a narrow
band of frequencies.
4.1
As an initial step the levels of emissions in the FM frequency band (76 o
108 MHz) shall be measured at the vehicle broadcast radio antenna with an
average detector.
4.1
Frequency plan for the 169,4 - 169,8125 MHz radio spectrum band
count =1 of “brass band”
Rules (are needed, but difficult to define!)
1. band of, can met
1.1.1 near “strike up”; band's artistic stance
1.1.3 names: big band
1.1.3 names : brass, marching
1.2. band name is people name’s, band of [ruffians, criminals, thiefs,..
2.band on it,
2.1 rubber band,can be perished
2.1.1 around arm
2.2 bands of color
2.1.band round
4 reasonable band,narrow band
4.1 band of frequencies,frequency, radio, spectrum
Translation to Polish (need point to sense, not only lexem)
1.grupa
1.1.1 zespół
1.1.2 band (jazz, swing)
1.1.3 orkiestra
1.2 banda
2 opaska
2.1 opaska.“rubber band” – gumka recepturka
2.2 pasek
2.3 opaska
4. zakres
4.1 pasmo, zakres
Note: rules are better not for senses independent from lexems but
distinguish between definitions for one lexem in many languages (Polish
zamek=castle,lock,zip) Thus, due to rules, is unneeded main dictionary of
senses without lexems, but needed lexems divided to senses and linked to
other senses inside lexems in other languages.
Best regards,
Andrzej
wt., 4 sie 2020 o 00:46 Arthur Smith <arthurpsmith(a)gmail.com> napisał(a):
I'm not sure where you're getting the numbers
from; there are over 200,000
lexemes in Wikidata, with roughly a dozen languages having at least
thousands of entries. Obviously it's incomplete, but quite a lot of effort
has gone into it already. For most nouns, a sense can be linked to a
regular Wikidata item that is about a particular concept (and this has been
done in at least several languages for 10's of thousands of cases now, but
again much more work is needed). One helper tool available to link lexeme
senses and regular conceptual (language-independent) items is MachtSinn:
https://machtsinn.toolforge.org/ - pick a language you know and help out!
Arthur