qwikidata: a python package to process Wikidata entities and dumps

List overview All Threads
Download

newer

older

Integrating WordNet in Wikidata...

Re: [Wikidata] [wikicite-discuss]...

Gabriel Altay

11 Apr 2019 11 Apr '19

3:33 p.m.

Hello Wikidata folks, I would like to bring your attention to an open source Python package I've been developing called qwikidata. It is pip installable and has minimal requirements (most limiting is python>=3.6). You can read the docs here ( https://qwikidata.readthedocs.io/en/stable/readme.html). My hope is that it will help people interact with the linked data service, the sparql query service, and the raw JSON dump files. The linked README above provides short examples of each. My design goal was to provide a small set of python classes that handle items, properties, and lexemes (i.e. entities). These entity classes provide methods to access things like labels, claims/statements, snaks, forms, senses, and other data. A more detailed look at one item can be found here (https://qwikidata.readthedocs.io/en/stable/entity.html). I am especially excited about the growing Lexeme dataset and had fun implementing the classes to store that data. Feel free to reach out via email or create issues on the github page of the project. best, -Gabriel

Attachments:

attachment.htm (text/html — 1.4 KB)

Show replies by date

Goran Milovanovic

11 Apr 11 Apr

4:06 p.m.

New subject: qwikidata: a python package to process Wikidata entities and dumps

Wow! - Great contribution @Gabriel Altay, I am gettin ready to test and enjoy immediately! Best, Goran S. Milovanović, PhD Data Scientist, Software Department Wikimedia Deutschland ------------------------------------------------ "It's not the size of the dog in the fight, it's the size of the fight in the dog." - Mark Twain ------------------------------------------------ On Thu, Apr 11, 2019 at 2:34 PM Gabriel Altay <gabriel.altay(a)gmail.com> wrote:

...

Lucas Werkmeister

5:43 p.m.

New subject: qwikidata: a python package to process Wikidata entities and dumps

...

Hello Wikidata folks, I would like to bring your attention to an open source Python package I've been developing called qwikidata. It is pip installable and has minimal requirements (most limiting is python>=3.6). You can read the docs here (https://qwikidata.readthedocs.io/en/stable/readme.html). My hope is that it will help people interact with the linked data service, the sparql query service, and the raw JSON dump files. The linked README above provides short examples of each. My design goal was to provide a small set of python classes that handle items, properties, and lexemes (i.e. entities). These entity classes provide methods to access things like labels, claims/statements, snaks, forms, senses, and other data. A more detailed look at one item can be found here (https://qwikidata.readthedocs.io/en/stable/entity.html). I am especially excited about the growing Lexeme dataset and had fun implementing the classes to store that data. Feel free to reach out via email or create issues on the github page of the project. best, -Gabriel _______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Gabriel Altay

5:48 p.m.

New subject: qwikidata: a python package to process Wikidata entities and dumps

Thanks for the information Lucas, I will look into this. The typing will be the hardest part to back port, but I will figure something out. I would not want it to be unavailable in Toolforge! On Thu, Apr 11, 2019 at 10:44 AM Lucas Werkmeister <mail(a)lucaswerkmeister.de> wrote:

...

That looks very interesting! But the Python 3.6 requirement is quite unfortunate for Wikimedia Toolforge users – the default Python version there is still 3.4, and even the latest image available (not yet available for the 'webservice' comand) has only Python 3.5 (T219091). Would it be difficult to support at least Python 3.5? Cheers, Lucas On 11.04.19 14:33, Gabriel Altay wrote: Hello Wikidata folks, I would like to bring your attention to an open source Python package I've been developing called qwikidata. It is pip installable and has minimal requirements (most limiting is python>=3.6). You can read the docs here ( https://qwikidata.readthedocs.io/en/stable/readme.html). My hope is that it will help people interact with the linked data service, the sparql query service, and the raw JSON dump files. The linked README above provides short examples of each. My design goal was to provide a small set of python classes that handle items, properties, and lexemes (i.e. entities). These entity classes provide methods to access things like labels, claims/statements, snaks, forms, senses, and other data. A more detailed look at one item can be found here (https://qwikidata.readthedocs.io/en/stable/entity.html). I am especially excited about the growing Lexeme dataset and had fun implementing the classes to store that data. Feel free to reach out via email or create issues on the github page of the project. best, -Gabriel _______________________________________________ Wikidata mailing listWikidata@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikidata _______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Gabriel Altay

9:40 p.m.

New subject: qwikidata: a python package to process Wikidata entities and dumps

...

That looks very interesting! But the Python 3.6 requirement is quite unfortunate for Wikimedia Toolforge users – the default Python version there is still 3.4, and even the latest image available (not yet available for the 'webservice' comand) has only Python 3.5 (T219091). Would it be difficult to support at least Python 3.5? Cheers, Lucas On 11.04.19 14:33, Gabriel Altay wrote: Hello Wikidata folks, I would like to bring your attention to an open source Python package I've been developing called qwikidata. It is pip installable and has minimal requirements (most limiting is python>=3.6). You can read the docs here (https://qwikidata.readthedocs.io/en/stable/readme.html). My hope is that it will help people interact with the linked data service, the sparql query service, and the raw JSON dump files. The linked README above provides short examples of each. My design goal was to provide a small set of python classes that handle items, properties, and lexemes (i.e. entities). These entity classes provide methods to access things like labels, claims/statements, snaks, forms, senses, and other data. A more detailed look at one item can be found here (https://qwikidata.readthedocs.io/en/stable/entity.html). I am especially excited about the growing Lexeme dataset and had fun implementing the classes to store that data. Feel free to reach out via email or create issues on the github page of the project. best, -Gabriel _______________________________________________ Wikidata mailing listWikidata@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikidata _______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Lucas Werkmeister

12 Apr 12 Apr

1:51 a.m.

New subject: qwikidata: a python package to process Wikidata entities and dumps

That’s awesome, thank you! On 11.04.19 20:40, Gabriel Altay wrote:

...

@Lucas I have created a new release of qwikidata (v0.4.0) which supports Python 3.5. I hope this helps Wikimedia Toolforge users. Docs and PyPI have been updated https://qwikidata.readthedocs.io/en/stable/readme.html On Thu, Apr 11, 2019 at 10:48 AM Gabriel Altay <gabriel.altay(a)gmail.com <mailto:gabriel.altay@gmail.com>> wrote: Thanks for the information Lucas, I will look into this. The typing will be the hardest part to back port, but I will figure something out. I would not want it to be unavailable in Toolforge! On Thu, Apr 11, 2019 at 10:44 AM Lucas Werkmeister <mail(a)lucaswerkmeister.de <mailto:mail@lucaswerkmeister.de>> wrote: That looks very interesting! But the Python 3.6 requirement is quite unfortunate for Wikimedia Toolforge users – the default Python version there is still 3.4, and even the latest image available (not yet available for the 'webservice' comand) has only Python 3.5 (T219091). Would it be difficult to support at least Python 3.5? Cheers, Lucas On 11.04.19 14:33, Gabriel Altay wrote:

Hello Wikidata folks, I would like to bring your attention to an open source Python package I've been developing called qwikidata. It is pip installable and has minimal requirements (most limiting is python>=3.6). You can read the docs here (https://qwikidata.readthedocs.io/en/stable/readme.html). My hope is that it will help people interact with the linked data service, the sparql query service, and the raw JSON dump files. The linked README above provides short examples of each. My design goal was to provide a small set of python classes that handle items, properties, and lexemes (i.e. entities). These entity classes provide methods to access things like labels, claims/statements, snaks, forms, senses, and other data. A more detailed look at one item can be found here (https://qwikidata.readthedocs.io/en/stable/entity.html). I am especially excited about the growing Lexeme dataset and had fun implementing the classes to store that data. Feel free to reach out via email or create issues on the github page of the project. best, -Gabriel _______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org <mailto:Wikidata@lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/wikidata

_______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org <mailto:Wikidata@lists.wikimedia.org> https://lists.wikimedia.org/mailman/listinfo/wikidata _______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

Suyash Dwivedi

6:19 a.m.

New subject: qwikidata: a python package to process Wikidata entities and dumps

Super excited to test it.Thank you for sharing. Regards, Suyash Dwivedi (U:Suyash.dwivedi) sent from mobile, please consider any typos On Fri, Apr 12, 2019, 4:22 AM Lucas Werkmeister <mail(a)lucaswerkmeister.de> wrote:

...

That’s awesome, thank you! On 11.04.19 20:40, Gabriel Altay wrote: @Lucas I have created a new release of qwikidata (v0.4.0) which supports Python 3.5. I hope this helps Wikimedia Toolforge users. Docs and PyPI have been updated https://qwikidata.readthedocs.io/en/stable/readme.html On Thu, Apr 11, 2019 at 10:48 AM Gabriel Altay <gabriel.altay(a)gmail.com> wrote:

That looks very interesting! But the Python 3.6 requirement is quite unfortunate for Wikimedia Toolforge users – the default Python version there is still 3.4, and even the latest image available (not yet available for the 'webservice' comand) has only Python 3.5 (T219091). Would it be difficult to support at least Python 3.5? Cheers, Lucas On 11.04.19 14:33, Gabriel Altay wrote: Hello Wikidata folks, I would like to bring your attention to an open source Python package I've been developing called qwikidata. It is pip installable and has minimal requirements (most limiting is python>=3.6). You can read the docs here (https://qwikidata.readthedocs.io/en/stable/readme.html). My hope is that it will help people interact with the linked data service, the sparql query service, and the raw JSON dump files. The linked README above provides short examples of each. My design goal was to provide a small set of python classes that handle items, properties, and lexemes (i.e. entities). These entity classes provide methods to access things like labels, claims/statements, snaks, forms, senses, and other data. A more detailed look at one item can be found here (https://qwikidata.readthedocs.io/en/stable/entity.html). I am especially excited about the growing Lexeme dataset and had fun implementing the classes to store that data. Feel free to reach out via email or create issues on the github page of the project. best, -Gabriel _______________________________________________ Wikidata mailing listWikidata@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikidata _______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

_______________________________________________ Wikidata mailing listWikidata@lists.wikimedia.orghttps://lists.wikimedia.org/mailman/listinfo/wikidata _______________________________________________ Wikidata mailing list Wikidata(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata

1835

days inactive

1836

days old

wikidata@lists.wikimedia.org

Manage subscription

6 comments

4 participants

tags (0)

participants (4)

Gabriel Altay
Goran Milovanovic
Lucas Werkmeister
Suyash Dwivedi