This is probably not the right place, you would want wikitech-l (where I've cc'ed this reply).
- d.
2009/12/11 Behrang Saeedzadeh behrangsa@gmail.com:
Hi,
I have downloaded enwiki-latest-all-titles-in-ns0.gz and I want to extract main titles and store them in another file. For example, some titles have meta information (e.g. disambiguation etc.) and I want these to be removed. Can I remove all the text between parentheses from the titles to achieve this?
Also some titles start with the "!" character. and some are enclosed between two or three of them such as !Adiso_Amigos!. What is the purpose of "!" in such cases? Also why some titles are enclosed between two double quotes such as "400_Years_of_Telescope"?
Finally, is there a document describing all these conventions?
P.S: Is this the right place to ask such questions?
Cheers, Behrang Saeedzadeh
http://my.opera.com/behrangsa http://twitter.com/behrangsa _______________________________________________ WikiEN-l mailing list WikiEN-l@lists.wikimedia.org To unsubscribe from this mailing list, visit: https://lists.wikimedia.org/mailman/listinfo/wikien-l
Hi,
On Sat, Dec 12, 2009 at 4:35 PM, David Gerard dgerard@gmail.com wrote:
2009/12/11 Behrang Saeedzadeh behrangsa@gmail.com:
Hi,
I have downloaded enwiki-latest-all-titles-in-ns0.gz and I want to
extract
main titles and store them in another file. For example, some titles have meta information (e.g. disambiguation etc.) and I want these to be
removed.
Can I remove all the text between parentheses from the titles to achieve this?
You have to parse it by hand.
Also some titles start with the "!" character. and some are enclosed
between
two or three of them such as !Adiso_Amigos!. What is the purpose of "!"
in
such cases?
It's part of the topic's name (in case of < http://en.wikipedia.org/wiki/%C2%A1Adios_Amigos!%3E, the band's name). The reverse exclamation mark is part of the Spanish language.
Also why some titles are enclosed between two double quotes such as "400_Years_of_Telescope"?
Same case: The " are part of the topic's name (e.g. < http://en.wikipedia.org/wiki/%22Weird_Al%22_Yankovic%3E).
Marco
PS: Next time, please do correct copy&paste so people have a chance to see what you want. Both your supplied examples had to be corrected, the second one was missing a "the": http://en.wikipedia.org/wiki/ "400_Years_of_the_Telescope"
2009/12/11 Behrang Saeedzadeh behrangsa@gmail.com:
Hi,
I have downloaded enwiki-latest-all-titles-in-ns0.gz and I want to extract main titles and store them in another file. For example, some titles have meta information (e.g. disambiguation etc.) and I want these to be removed. Can I remove all the text between parentheses from the titles to achieve this?
Also some titles start with the "!" character. and some are enclosed between two or three of them such as !Adiso_Amigos!. What is the purpose of "!" in such cases? Also why some titles are enclosed between two double quotes such as "400_Years_of_Telescope"?
Finally, is there a document describing all these conventions?
P.S: Is this the right place to ask such questions?
Cheers, Behrang Saeedzadeh
They are already complete. The titles which contain "(disambiguation)" is because there is a page whose title say that. And there is also a page whose name is "!Adios_Amigos!" (in fact a redirect to ¡Adios_Amigos!).
If you want to filter out redirects and disambiguation pages, just enwiki-latest-all-titles-in-ns0 is not enough. On the other hand, enwiki-latest-all-titles-in-ns0 has already filtered all non-article titles, like templates, talks, user pages, pages about wikipedia...
wikitech-l@lists.wikimedia.org