On 10/30/14 9:29 AM, Kingsley Idehen wrote:
On 10/30/14 6:32 AM, Cristian Consonni wrote:
Dear all,
I wanted to join in and give my birthday present to Wikidata (I am a little bit late, though!) (also, honestly, I didn't recall it was Wikidata's birthday, but it is a nice occasion :P)
Here it is: http://wikidataldf.com
What is LDF? LDF stands for Linked Data Fragments, they are a new system for query RDF datasets that stands middle way between having a SPARQL endpoint and downloading the whole thing.
More formally LDF is «a publishing method [for RDF datasets] that allows efficient offloading of query execution from servers to clients through a lightweight partitioning strategy. It enables servers to maintain availability rates as high as any regular HTTP server, allowing querying to scale reliably to much larger numbers of clients»[1].
This system was devised Ruben Verborgh, Miel Vander Sande and Pieter Colpaert at Multimedia Lab (Ghent University) in Ghent, Belgium. You can read more about it:http://linkeddatafragments.org/
What is Wikidata LDF? Using the software by Verborgh et al. I have setup the website http://wikidataldf.com that contains:
- an interface to navigate in the RDF data and query them using the
Triple Pattern Fragments client
- a web client where you can compose and execute SPARQL queries
This is not, strictly speaking, a SPARQL endpoint (not all the SPARQL standard is implemented and it is slower, but it should be more reliable, if you are interested in details, please do read more at the link above).
The data are, for the moment, limited to the sitelinks dump but I am working towards adding the other dump. I have taken the Wikidata RDF dumps as of Oct, 13th 2014[2].
To use them I had to convert them in HDT format[3a][3b], using the hdt-cpp library[3c] (devel) (which is taking quite a lot of resources and computing time for the whole dumps, that's the reason why I haven't published the rest yet ^_^).
DBpedia has also this[4]: http://fragments.dbpedia.org/
All the software used is available under the MIT license on the LDF repo on github[5a], and also the (two pages) website is available here[5b].
I would like to thank Ruben for his feedback and his presentation about LDF at SpazioDati in Trento, Italy (here's the slides[6]).
All this said, happy birthday Wikidata.
Cristian
[1]http://linkeddatafragments.org/publications/ldow2014.pdf [2]https://tools.wmflabs.org/wikidata-exports/rdf/exports/ [3a]http://www.rdfhdt.org/ [3b]http://www.w3.org/Submission/HDT-Implementation/ [3c]https://github.com/rdfhdt/hdt-cpp [4]http://sourceforge.net/p/dbpedia/mailman/message/32982329/ [5a] see the Browser.js, Server.js and Client.js repos in https://github.com/LinkedDataFragments [5b]https://github.com/CristianCantoro/wikidataldf [6]http://www.slideshare.net/RubenVerborgh/querying-datasets-on-the-web-with-hi...
Yep! And for publishing some of the information above into the Linked Open Data Cloud, from this thread, via nanotation:
http://wikidataldf.com a schema:WebPage; rdfs:label "Wikidata LDF"; skos:altLabel "Wikidata Linked Data Fragments" ; dcterms:hasPart http://data.wikidataldf.com/, http://client.wikidataldf.com/; xhv:related http://linkeddatafragments.org/, http://fragments.dbpedia.org/ ; rdfs:comment """ I wanted to join in and give my birthday present to Wikidata (I am a little bit late, though!) (also, honestly, I didn't recall it was Wikidata's birthday, but it is a nice occasion :P) """ ;
rdfs:comment """ What is Wikidata LDF? Using the software by Verborgh et al. I have setup the website http://wikidataldf.com that contains: * an interface to navigate in the RDF data and query them using the Triple Pattern Fragments client * a web client where you can compose and execute SPARQL queries
This is not, strictly speaking, a SPARQL endpoint
(not all the SPARQL standard is implemented and it is slower, but it should be more reliable, if you are interested in details, please do read more at the link above).
The data are, for the moment, limited to the
sitelinks dump but I am working towards adding the other dump. I have taken the Wikidata RDF dumps as of Oct, 13th 2014[2].
To use them I had to convert them in HDT
format[3a][3b], using the hdt-cpp library[3c] (devel) (which is taking quite a lot of resources and computing time for the whole dumps, that's the reason why I haven't published the rest yet ^_^). """ ; dcterms:references http://linkeddatafragments.org/publications/ldow2014.pdf, https://tools.wmflabs.org/wikidata-exports/rdf/exports/, http://www.rdfhdt.org/, http://www.w3.org/Submission/HDT-Implementation/, https://github.com/rdfhdt/hdt-cpp, http://sourceforge.net/p/dbpedia/mailman/message/32982329/, https://github.com/LinkedDataFragments, https://github.com/CristianCantoro/wikidataldf, http://www.slideshare.net/RubenVerborgh/querying-datasets-on-the-web-with-high-availability .
Links:
[1] http://linkeddata.uriburner.com/about/%7Burl-of-this-post%7D -- will resolve to a page comprised of the nanotated content above [2] http://linkeddata.uriburner.com/about/html/https/lists.wikimedia.org/piperma... -- Example based on an earlier reply [3] http://linkeddata.uriburner.com/c/9CB36OOJ -- alternative view that offers deeper Linked Open Data follow-your-nose exploration [4] http://linkeddata.uriburner.com/c/9V56JQC -- A reified statement example .
Little correction (which is why #1 above wouldn't have produced the expected result). Adding missing Nanotation markers, as shown here:
## Nanotation Start ##
http://wikidataldf.com a schema:WebPage; rdfs:label "Wikidata LDF"; skos:altLabel "Wikidata Linked Data Fragments" ; dcterms:hasPart http://data.wikidataldf.com/, http://client.wikidataldf.com/; xhv:related http://linkeddatafragments.org/, http://fragments.dbpedia.org/ ; rdfs:comment """ I wanted to join in and give my birthday present to Wikidata (I am a little bit late, though!) (also, honestly, I didn't recall it was Wikidata's birthday, but it is a nice occasion :P) """ ;
rdfs:comment """ What is Wikidata LDF? Using the software by Verborgh et al. I have setup the website http://wikidataldf.com that contains: * an interface to navigate in the RDF data and query them using the Triple Pattern Fragments client * a web client where you can compose and execute SPARQL queries
This is not, strictly speaking, a SPARQL endpoint (not all the SPARQL standard is implemented and it is slower, but it should be more reliable, if you are interested in details, please do read more at the link above).
The data are, for the moment, limited to the sitelinks dump but I am working towards adding the other dump. I have taken the Wikidata RDF dumps as of Oct, 13th 2014[2].
To use them I had to convert them in HDT format[3a][3b], using the hdt-cpp library[3c] (devel) (which is taking quite a lot of resources and computing time for the whole dumps, that's the reason why I haven't published the rest yet ^_^). """ ; dcterms:references http://linkeddatafragments.org/publications/ldow2014.pdf, https://tools.wmflabs.org/wikidata-exports/rdf/exports/, http://www.rdfhdt.org/, http://www.w3.org/Submission/HDT-Implementation/, https://github.com/rdfhdt/hdt-cpp, http://sourceforge.net/p/dbpedia/mailman/message/32982329/, https://github.com/LinkedDataFragments, https://github.com/CristianCantoro/wikidataldf, http://www.slideshare.net/RubenVerborgh/querying-datasets-on-the-web-with-high-availability .
## Nanotation End ##