Wikidata-tech

wikidata-tech@lists.wikimedia.org

1 participants
622 discussions

Wikidata-Toolkit support for concurrent editing
by Miguel Paraz 17 Apr '17

17 Apr '17

Hi! I'm looking to speed up my Wikidata-Toolkit code that updates a lot of statements. Does a single WikibaseDataEditor support multiple updateStatements running in different threads? If not, could I instead create a pool of WikibaseDataEditor instances and then use them separately from different threads Thanks! Miguel

1 0

Wikibase and PostgreSQL
by Denis Rykov 10 Apr '17

10 Apr '17

Hello! It looks like Wikibase extension is not compatible with PostgreSQL backend. There are many MySQL specific code in sql scripts (e.g. auto_increment, varbinary). How about to add this information to Wikibase docs?

2 1

Significant change: new data type for geoshapes
by Léa Lacroix 03 Apr '17

03 Apr '17

Hello all, We’ve been working on a new data type that allows you to link to the *geographical shapes* that are now stored on Commons. This data type will be deployed on Wikidata on *April 17th*. This data type refers to the geographical shapes that are enabled on Wikimedia Commons since the beginning of this year. Here you can find more information about this <https://www.mediawiki.org/wiki/Maps>. The property creators will be able to create properties with this geoshape data type by selecting “Geographical shape” in the data type list. When the property is created, you can use it in statements, and when filling the value, if you start typing a string, you can choose the name of a geoshape in the list of what exists on Commons. [image: Screenshot test geoshape in Wikidata.png] <https://commons.wikimedia.org/wiki/File:Screenshot_test_geoshape_in_Wikidat…> One thing to note: We currently do not export statements that use this datatype to RDF. They can therefore not be queried in the Wikidata Query Service. The reason is that we are still waiting for geoshapes to get stable URIs. This is handled in this ticket <https://phabricator.wikimedia.org/T161527>. Before the deployment, you can test it on http://test.wikidata.org (see for example the property “geotest” on Q22 <https://test.wikidata.org/wiki/Q22>). If you have any question, feel free to ask! Cheers, -- Léa Lacroix Project Manager Community Communication for Wikidata Wikimedia Deutschland e.V. Tempelhofer Ufer 23-24 10963 Berlin www.wikimedia.de Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

3 3

wikidata-query-rdf cannot munge a custom Wikidata instance
by Miguel Paraz 02 Apr '17

02 Apr '17

Hi! I'm interested in using SPARQL for my own Wikibase installation. But, I was getting errors in the munge step. To reproduce the problem, I set up a new Wikibase instance and tried to load it into wikidata-query-rdf. It has only one item, one property, and one statement. First I used the included dumpRdf.php to create the RDF file, attached. Then I did the munge step. It produced the errors, attached. I don't understand why there is "Unrecognized subjects" when the subjects listed do match the patterns, "Expected only sitelinks and subjects starting with http://www.wikidata.org/wiki/Special:EntityData/ and http://www.wikidata.org/entity/" I don't understand what is the revision id it is looking for. What is the proper procedure for indexing? If necessary, I can code in Java and fix the tools. I just need an overview on how this system works. Thanks! Regards, Miguel

2 5

wikidata label service
by Peter F. Patel-Schneider 25 Mar '17

25 Mar '17

I'm trying to figure out whether the Wikidata label service (the stuff that is invoked as SERVICE wikibase:label { bd:serviceParam wikibase:language "en" . } in queries to the Wikidata query service) is something that can be done in SPARQL or whether it is an extension that can't be done in SPARQL. Does anyone know the answer to this? The reason that I ask is that it appears that the service accesses the names of SPARQL variables in solution sets, and I can't think of how it does that using SPARQL facilities. peter

2 2

Wikibase installation foobar
by Magnus Manske 24 Mar '17

24 Mar '17

I am trying to install the (git HEAD) wikibase on a fresh MediaWiki stable (1.28.0) on Tool Labs. MediaWiki is up, but using "Item:" namespace and some "Special:" pages die with a 500 error. Error log says: 2017-03-24 10:58:01: (mod_fastcgi.c.2702) FastCGI-stderr: PHP Catchable fatal error: Argument 1 passed to Wikibase\SqlIdGenerator::__construct() must be an instance of Wikimedia\Rdbms\LoadBalancer, instance of LoadBalancer given, called in /data/project/comprende/public_html/extensions/Wikibase/repo/includes/Store/Sql/SqlStore.php on line 298 and defined in /data/project/comprende/public_html/extensions/Wikibase/repo/includes/Store/Sql/SqlIdGenerator.php on line 32 IMHO it's bad that a vanilla installation doesn't work out-of-the-box. Any ideas how to fix this?

2 2

wikidata-query-rdf for other Wikibase installs
by Miguel Paraz 26 Feb '17

26 Feb '17

Hi, Is there documentation on what needs to be done to run wikidata-query-rdf on my custom Wikibase install, so that I could do SPARQL queries on it? When following the instructions at: https://github.com/wikimedia/wikidata-query-rdf/blob/master/docs/getting-st… but using my own RDF file, I get this in the munge: 02:08:14.099 [main] INFO o.wikidata.query.rdf.tool.rdf.Munger - Unrecognized subjects: [ http://www.wikidata.org/entity/statement/Q1174-2A6EDE59-31EA-4585-B211-DCB7… ... Expected only sitelinks and subjects starting with http://www.wikidata.org/wiki/Special:EntityData/ and http://www.wikidata.org/entity/ even if the all the URLs start with http://www.wikidata.org/entity/ They originally did not - the exported RDF was using my own namespace but I did a substitution before running the munge. Thanks! Cheers Miguel

2 1

Removing sitelinks when they aren't being used
by Miguel Paraz 25 Feb '17

25 Feb '17

Hi, On my own install of Wikibase, I don't use sitelinks, but they still appear with what seem to be the defaults; Wikipedia, wikibase-sitelinks-wikinews ... Just like here: http://librarybase.wmflabs.org/wiki/Q264 How can I stop these from being shown? Thanks! Miguel

2 1

Developer Wishlist Survey: Vote for Proposals
by Srishti Sethi 14 Feb '17

14 Feb '17

Hello, Almost two weeks ago, the Technical Collaboration team invited proposals for the first edition of the Developer Wishlist survey! We collected around 77 proposals that were marked as suitable for the developer wishlist and met the defined scope and criteria <https://www.mediawiki.org/wiki/Developer_Wishlist#Scope>. These proposals fall into the following nine categories: Frontend, Backend, Code Contribution (Process, Guidelines), Extensions, Technical Debt, Developer Environment, Documentation, Tools (Phabricator, Gerrit) and Community Engagement. Voting phase starts now and will run until *February 14th, 23:59 UTC*. Click here on a category and show support for the proposals you care for most <https://www.mediawiki.org/wiki/Developer_Wishlist>. Use the 'Vote' and 'Endorse' buttons next to a proposal to do so. *What happens next?*Proposals that will gather most votes will be included in the final results which will be published on *Wednesday, February 15th*. These proposals will also be considered in the Wikimedia Foundation’s annual plan FY 2017-18. Cheers, Srishti -- Srishti Sethi Developer Advocate Technical Collaboration team Wikimedia Foundation https://www.mediawiki.org/wiki/User:SSethi_(WMF)

1 1

Wikidata reconciliation service - possible R&D ideas..
by Rick Labs 03 Feb '17

03 Feb '17

Been following the thread:"[Wikidata] Wikidata reconciliation service and Ope Refine" with interest (on the general list - wikidata(a)lists.wikimedia.org) and wanted to give a reference to some public R&D activity in the financial data area, that may have broader application in tools that assist with Wikidata entity reconciliations. Orienting background from: https://github.com/OpenRefine/OpenRefine/wiki/Reconciliation-Service-API "A reconciliation service is a web service that, given some text which is a name or label for something, and optionally some additional details, returns a ranked list of potential entities matching the criteria. The candidate text does not have to match each entity's official name perfectly, and that's the whole point of reconciliation--to get from ambiguous text name to precisely identified entities. " On to the tip... From: http://sigmod2016.org/dsmmtoc.html Paper: Financial Entity Identification and Information Integration (FEIII) Challenge: The Report of the Organizing Committee Mark Flood John Grant Haiping Luo Louiqa Raschid Ian Soboroff Kyungjin Yoo "The Year One [2016] goal of the Financial Entity Identification and Information Integration (FEIII) Challenge was to develop technologies to automatically align diverse financial entity identification schemes and identifiers. This will be an important first step in developing a reference financial entity identifier knowledge base linking heterogeneous collections of financial entity identifiers. Such a (Linked Data) knowledge base will help to overcome a fundamental road- block to successful information integration, i.e., the resolution of mentions or references to the same financial entity across the financial landscape of financial contract prospectus, regulatory filings, transactional records, news articles, social media, etc. " "In the 2017 program they proceed to trying to identify RELATIONSHIPS between entities" From:https://ir.nist.gov/feiii/ "The challenge: Identify relationships among financial entities. Given sentences from SEC regulatory filings that mention roles/relationships with other entities, rank the sentences in order of importance with respect to the relationships and financial activities." From: https://drive.google.com/open?id=0ByT-60wEacFAQU84QkVEX1NkTEk [data set and instructions for the 2017 challenge] Paper: FEIIY2_README.pdf "In Year One [2016] , we posed an IDENTIFIER ALIGNMENT challenge: Given four databases of financial entities from four different sources, participants needed to find the entities in common across the databases. " "For Year Two [2017], we are continuing with the theme of IDENTIFYING and understanding RELATIONSHIPS among financial entities and the roles that they play in financial CONTRACTS." ... Selected "Role" [relationship] Keywords [Source: above] [What is interesting is Parent company and subsidiary here seem to have potential reuse for parent/child type relationships in many other domains.] SUBSIDIARY COMPANY: A company that satisfies the criteria that more than 50% of the voting shares are owned by another company; the latter company is the PARENT COMPANY. AFFILIATE(D) COMPANY: Company, or other organization related through common ownership, common control of management or owners, or through some other control mechanism, such as a long-term lease. [Other keywords for RELATIONSHIP between entities below.] Thought the above might be of some use to designers of Wkidata reconciliation services. I'm working mostly on Projects concerning Companies in Wikidata/Wikipeda, where reconciliation services is a huge challenge. Rick PS - other Keywords of interest in the 2017 Challenge [Source: above] Note: The term PERSON includes LEGAL PERSON which can be a COMPANY. Affiliate Agent Counterparty Guarantor Insurer Issuer Seller Servicer Trustee Underwriter AGENT: A person that is designated by another person (the principal) to act on behalf of the principal in specified activities. COUNTERPARTY: Given a person or party of interest (in a trade), the party faces a counterparty; there can be more than one counterparty. GUARANTOR: A legal arrangement involving a promise by a person (guarantor) to perform the obligations of a second person (or many persons), in the event that the latter person fails to meet their obligations. INSURER: A person who, through a contractual agreement, undertakes to compensate specified losses, liability, or damages incurred by the person of interest. ISSUER: This term refers to an issuer of securities which are (1) registered under Section 12 of the Securities Exchange Act of 1934, or (2) required to file reports under Section 15(d) of that Act, or (3) has filed a registration statement with the SEC. SELLER: Exchanges a good or service in exchange for a payment. SERVICER: Typically a person that collects payments from one party and makes payments to another party. TRUST: An (ancient) legal practice where one person (GRANTOR) transfers the legal title to an ASSET, also called the principal or corpus or property, to another person (TRUSTEE), with specific instructions about how the ASSET is to be managed and disposed. TRUSTEE: Person who is given legal title to, and management authority over, the property placed in a TRUST. UNDERWRITER: A person that assumed the risk of purchasing securities from the issuing entity and reselling them to the public, either directly or through dealers. The role terms are often modified as follows: administrative agent calculation agent co-documentation agents co-syndication agents life insurance agent placement agent remarketing agent transfer agent bankruptcy trustee debenture trustee guarantee trustee property trustee securitization trustee successor trustee When deciding whether a role is being described, we can ask these following questions: TRUSTEE: * Who is the Person (LEGAL Person) playing the role of TRUSTEE? * What is the associated TRUST? * What are the ASSETs and instructions of the associated TRUST? * What action is being taken by the TRUSTEE or why is the trustee being mentioned in this statement? AFFILIATE COMPANY: * Who is the PARENT COMPANY? * What is the business purpose of the AFFILIATE COMPANY? * Why is the AFFILIATE COMPANY being mentioned in this statement? ISSUER: * What was issued? * Why is the ISSUER being mentioned? GUARANTOR: * What is being guaranteed? * What are the terms of the guarantee? * Who is the GUARANTOR?

1 0

← Newer
1
...
25
26
27
28
29
30
31
...
63
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

Wikidata-tech