... Accepted papers Christoph Hube and Besnik Fetahu Detecting Biased Statements in Wikipedia http://wikiworkshop.org/2018/papers/wikiworkshop2018_paper_1.pdf ...
Hi Christoph and Besnik,
Having worked with several thousand of Amazon Mechanical Turkers over the past year, I am not convinced that their opinions of bias, even in aggregate, are not biased. Did you take any steps to measure the bias against accuracy in your crowdworkers?
Here is an example of what I expect they would get wrong:
"Tax cuts allow consumers to increase their spending, which boosts aggregate demand."
That statement, added by en:User:Bkwillwm in 2012,[1] is still part of the English Wikipedia's Economics article. However, the statement is strictly inaccurate, and heavily biased in favor of trickle-down economics and austerity policy.[2] It and statements like it, pervasive through many if not most of the popular language Wikipedias, directly support increases in income inequality, which in turn is a terrible scourge affecting both health[3] and economic growth.[4]
How can you measure whether your crowdworkers are truly unbiased relative to accuracy, instead of just reflecting the propaganda-influenced whims of the populist center?
Sincerely, James Salsman
[1] https://en.wikipedia.org/w/index.php?title=Economics&diff=prev&oldid...
[2] https://en.wikipedia.org/wiki/Talk:Economics/Archive_7#Tax_cut_claim_in_Fisc...