Hello colleagues,

During the most recent VIAF harvest we encountered a number of duplicate records in Wikidata. Forwarding on in case this is of interest (there is an attached file – not sure if that will go through on this list or not).

Some discussion from OCLC colleagues is included below.

Merrilee Proffitt, Senior Program Officer
OCLC Research

From: Toves,Jenny
Sent: Tuesday, December 22, 2015 6:02 AM
To: Proffitt,Merrilee
Subject: FW: 201551 vs 201552

Good morning Merrilee,

You probably know that we harvest wikidata monthly for ingest into VIAF. This month we found 315 pairs of records that appear to be duplicates. That was a jump from previous months. I am not sure who would be interested in this but Thom & I thought you might be. The attached report has 630 lines showing what viaf saw as duplicates. So this pair of lines:

WKP|Q21518392   =998    $aCharles du Bois Larbalestier$2WKP|Q21341290$3duplicate

WKP|Q21341290   =998    $aCharles du Bois Larbalestier$2WKP|Q21518392$3duplicate

Shows that those two wikidata numbers are linked to one another by viaf.

I don’t think we expect you to do anything with this unless you find it interesting. I suspect there are bots to clean this stuff up but maybe not.

--Jenny.

From: Hickey,Thom
Sent: Monday, December 21, 2015 9:47 PM
To: Toves,Jenny
Subject: RE: 201551 vs 201552

She probably would be interested.

--Th

From: Toves,Jenny
Sent: Monday, December 21, 2015 9:35 PM
To: Hickey,Thom
Subject: RE: 201551 vs 201552

Exact same name + dates. Do you a list of them? Do you think Merrilee or anyone would be interested?

From: Hickey,Thom
Sent: Monday, December 21, 2015 8:04 PM
To: Toves,Jenny
Subject: FW: 201551 vs 201552

Noticed WKP duplicates went way up

--Th

From: Jenny Toves
Sent: Monday, December 21, 2015 5:12 PM
To: Hickey,Thom; Toves,Jenny
Subject: 201551 vs 201552

REPORT for records

Changed 13.51%:             geographic 3369217.0 -> 3824513.0

Change in % of 8:            NLR at_least_one_match 16% -> 24%

Changed 19.83%:            NLR all_matches 181437.0 -> 217423.0

Change in % of 88:          NLR with_bibs 0% -> 88%

Changed 17.99%:            WKP geographic 2529990.0 -> 2985194.0

Changed -19.95%:          WKP corporate 369224.0 -> 295579.0

REPORT for matches

Changed 12.70%:              exact corporate name 1021239.0 -> 1150899.0

Changed 14.29%:            XR  viafid 7.0 -> 8.0

Changed -10.42%:          XR  expression title to sibling 48.0 -> 43.0

Changed -16.16%:          PTBNP  forced 229.0 -> 192.0

Changed -37.50%:          NSZL  forced 8.0 -> 5.0

Changed 38.46%:            NLP  suggested 13.0 -> 18.0

No longer zero: NLR  standard number 0.0 -> 21479.0

No longer zero: NLR  exact title 0.0 -> 5166.0

No longer zero: NLR  partial date and partial title 0.0 -> 618.0

No longer zero: NLR  name as subject 0.0 -> 62.0

No longer zero: NLR  partial title and publisher 0.0 -> 88.0

No longer zero: NLR  title 0.0 -> 5093.0

Changed -47.66%:          NLR  forced single date 37125.0 -> 19430.0

Changed 14.29%:            NLR  viafid 14.0 -> 16.0

No longer zero: NLR  partial date and publisher 0.0 -> 15894.0

No longer zero: NLR  joint author 0.0 -> 5228.0

Changed -14.49%:          LC  suggested 7594.0 -> 6494.0

Changed 33.33%:            CYT  viafid 12.0 -> 16.0

Changed -21.08%:          NLA  forced 223.0 -> 176.0

Changed 233.33%:         LNL  forced 3.0 -> 10.0

Changed 12.50%:            NLB  viafid 8.0 -> 9.0

Changed 16.67%:            NLB  ngram corporate name 6.0 -> 7.0

Changed 25.71%:            VLACC  forced 35.0 -> 44.0

Changed 19.13%:            DNB  exact corporate name 315872.0 -> 376304.0

Changed 14.29%:            DNB  expression title to sibling 7.0 -> 8.0

Changed 16.67%:            BNF  expression title to sibling 6.0 -> 7.0

Changed 15.91%:            ICCU  forced 44.0 -> 51.0

Changed 25.54%:            NTA  forced 9699.0 -> 12176.0

Changed 28.62%:            WKP  exact corporate name 224787.0 -> 289112.0

Changed 23.73%:            WKP  longer corporate name 76057.0 -> 94106.0

Changed 584.78%:         WKP  duplicate record 92.0 -> 630.0

Changed -18.92%:          EGAXA  forced 37.0 -> 30.0

REPORT for tags

Changed 11.56%:            NSZL  work links (993) 225.0 -> 251.0

No longer zero: NLR  wrote about (955) 0.0 -> 106.0

No longer zero: NLR  bibs (999) 0.0 -> 108202.0

No longer zero: NLR  was a subject (960) 0.0 -> 16423.0

No longer zero: NLR  relator code (941) 0.0 -> 103950.0

No longer zero: NLR  language of work (940) 0.0 -> 108193.0

No longer zero: NLR  issn (902) 0.0 -> 34.0

No longer zero: NLR  bib title (910) 0.0 -> 107895.0

No longer zero: NLR  joint corporate author (951) 0.0 -> 24235.0

Changed 146.67%:         NLR  compared (996) 27448.0 -> 67705.0

No longer zero: NLR  rectype + biblvl (944) 0.0 -> 108194.0

No longer zero: NLR  country of publication (922) 0.0 -> 108169.0

No longer zero: NLR  publisher (921) 0.0 -> 93904.0

No longer zero: NLR  isbn (901) 0.0 -> 78978.0

No longer zero: NLR  publisher id (920) 0.0 -> 78978.0

Changed 50.05%:            NLR  matched (998) 19864.0 -> 29806.0

No longer zero: NLR  name from statement of responsibility (930) 0.0 -> 72478.0

No longer zero: NLR  noise title (912) 0.0 -> 3543.0

No longer zero: NLR  lc class number (942) 0.0 -> 1.0

No longer zero: NLR  joint author (950) 0.0 -> 69048.0

No longer zero: NLR  was a subject (969) 0.0 -> 115.0

Changed -14.29%:          XA  work links (993) 7.0 -> 6.0

No longer zero: SRP  work links (993) 0.0 -> 1.0

Changed 22.50%:            BNL  work links (993) 551.0 -> 675.0

Changed 11.16%:            WKP  auth title (919) 45779.0 -> 50890.0

Changed 12.56%:            WKP  noise title (912) 8249.0 -> 9285.0