Hi Andrea,

I can see from yours and others' comments that conference ranking sites are not that helpful (to put it mildly). I'll respond to the matter of the shared bibliography in the separate thread on that topic.

I'm leaning towards exploring citation counts more. How did you get the counts you gave from Google Scholar? Could you give us your exact search keywords? I couldn't reproduce what you gave us; perhaps I don't know how to use Google Scholar that flexibly.

One useful tool for citation analysis with Google Scholar is Harzing's Publish or Perish (freeware, not free software): http://www.harzing.com/pop.htm. By doing a simple search on "Wikipedia" in the General Citations keywords, I got the following as the top ten results:

Cites Authors Title Year Source ArticleURL
913 J Giles Internet encyclopaedias go head to head 2005 Nature http://www.nature.com/nature/journal/v438/n7070/full/438900a.html?&$NMW_TRANS$=ext
385 E Gabrilovich… Computing semantic relatedness using wikipedia-based explicit semantic analysis 2007 Proceedings of the 20th International Joint … http://www.aaai.org/Papers/IJCAI/2007/IJCAI07-259.pdf
358 M Völkel, M Krötzsch, D Vrandecic… Semantic wikipedia 2006 Proceedings of the … http://portal.acm.org/citation.cfm?id=1135863
281 L Denoyer… The wikipedia xml corpus 2006 ACM SIGIR Forum http://portal.acm.org/citation.cfm?id=1147210
260 A Bruns Blogs, Wikipedia, Second Life, and beyond: From production to produsage 2008

228 M Strube… WikiRelate! Computing semantic relatedness using Wikipedia 2006 Proceedings of the National Conference on … http://www.aaai.org/Papers/AAAI/2006/AAAI06-223.pdf
201 A Lih Wikipedia as participatory journalism: Reliable sources? metrics for evaluating collaborative media as a news resource 2003 Nature
197 J Voss Measuring wikipedia 2005 International Conference of the International Society for … http://eprints.rclis.org/handle/10760/6207
161 SP Ponzetto… Deriving a large scale taxonomy from Wikipedia 2007 Proceedings of the national conference on … http://scholar.google.comhttps://www.aaai.org/Papers/AAAI/2007/AAAI07-228.pdf
158 BT Adler… A content-driven reputation system for the Wikipedia 2007 … of the 16th international conference on … http://portal.acm.org/citation.cfm?id=1242608

These are pretty different from your results. Could you tell me how you got yours?

Thanks,
Chitu


-------- Message original --------
Sujet: [Wiki-research-l] Wikipedia literature review - include or exclude conference articles
De : Andrea Forte <andrea.forte@gmail.com>
Pour : Research into Wikimedia content and communities
    <wiki-research-l@lists.wikimedia.org>
Date : 18/03/2011 9:33 AM
Hi all, after following these links:

* Top Tier and 2nd tier conferences from
http://webdocs.cs.ualberta.ca/~zaiane/htmldocs/ConfRanking.html
* A-ranked conferences in Information and Computing Sciences from
http://lamp.infosys.deakin.edu.au/era/?pageÏorsel10
I discovered that CHI is not a top-tier HCI conference. Or even 2nd or
3rd. :) Neither is CSCW, Group, etc.

(For those not in CS/HCI, CHI is *the* top tier conference with
acceptance rates lower than most journals in the area and the others I
listed are nearly as competitive. And venues like WikiSym that have
higher acceptance rates attract top-tier work as well - many papers of
equivalent quality have been published there.)

So... I would suggest that, to review the Wikipedia literature, you
need to choose a field (or set of fields) you know and become deeply
knowledgeable about the literature in that field by reading it and
following citations, etc. Searching for every paper ever written that
mentions "Wikipedia" in the title/abstract will catch you lots of
peripheral work that is not *about* Wikipedia, but that uses Wikipedia
as a context for studying something else. Machines aren't good at
literature reviews. :)

That said, it would be incredibly useful to have a common repository
of citations that can be annotated, discussed etc. Reid Priedhorsky,
Phoebe Ayers, Brent Hecht, Darren Gergle, and Mako Hill and I have
been talking about doing a literature review as well and have come to
the conclusions that A) there's too much to cover in just one paper
and B) a place to collaboratively assemble knowledge about the
literature is a prerequisite for such an endeavor. We were thinking a
MediaWiki with templates to structure citation data for export would
be better than any of the bib software out there. But actually... I
remember reading that Tiki Wiki now explicitly supports citation, I
think?

The bottom line is, B) Is something this community could really do a
great job of developing and it would be mutually beneficial. No one of
us is going to cover all the Wikipedia literature alone, unless we
make it a full time job. :)

FYI, we chose Travis's citation filtering method as a starting point
and came up with the list below as our common starter reading list and
planned to divy things up from there.

Andrea


=Top Citations in Goog Scholar ==

* '''449 cites''' Fernanda B. Viegas, Martin Wattenberg, and Kushal
Dave. 2004. [http://alumni.media.mit.edu/~fviegas/papers/history_flow.pdf
Studying cooperation and conflict between authors with history flow
visualizations]. In Proceedings of the SIGCHI conference on Human
factors in computing systems (CHI '04). ACM, New York, NY, USA,
575-582.

* '''288 cites''' Bryant, Susan, Andrea Forte and Amy Bruckman.
(2005). [http://www.andreaforte.net/BryantForteBruckBecomingWikipedian.pdf
Becoming Wikipedian: transformation of participation in a
collaborative online encyclopedia]. Proceedings of GROUP International
Conference on Supporting Group Work, Sanibel Island, FL, pp. 1-10.
** recent counterpoint: Katherine Panciera, Aaron Halfaker, and Loren
Terveen. 2009. [http://www.grouplens.org/system/files/Group09WikipediansPanciera.pdf
Wikipedians are born, not made: a study of power editors on
Wikipedia]. In Proceedings of the ACM 2009 international conference on
Supporting group work (GROUP '09). ACM, New York, NY, USA, 51-60.

* '''193 cites''' Voß, J.
[http://hapticity.net/pdf/nime2006_180-works_cited/MeasuringWikipedia2005.pdf
Measuring Wikipedia]. Proceedings of 10th International Conference of
the International Society for Scientometrics and Informetrics,
(Stockholm, Sweden), 2005.

* '''187 cites''' Lih, A.
[http://citeseerx.ist.psu.edu/viewdoc/download?doi.1.1.117.9104&rep=rep1&type=pdf
Wikipedia as Participatory journalism: reliable sources? metrics for
evaluating collaborative media as a news resource]. Proceedings of
Fifth International Symposium on Online Journalism, April 16-17, 2004,
(Austin, TX), 2004.

* '''145 cites''' Fernanda B. Viegas, Martin Wattenberg, Jesse Kriss,
Frank van Ham, [http://citeseerx.ist.psu.edu/viewdoc/download?doi.1.1.84.6907&rep=rep1&type=pdf
Talk Before You Type: Coordination in Wikipedia] hicss, pp.78a, 40th
Annual Hawaii International Conference on System Sciences (HICSS'07),
2007

* '''140 cites''' Kittur, A.; Chi, E. H. ; Pendleton, B. A. ; Suh, B.
; Mytkowicz, T. Power of the few vs. wisdom of the crowd: Wikipedia
and the rise of the bourgeoisie. Alt.CHI at CHI 2007; 2007 April 28 -
May 3; San Jose, CA.

* '''138 cites''' Aniket Kittur, Bongwon Suh, Bryan A. Pendleton, and
Ed H. Chi. 2007. He says, she says: conflict and coordination in
Wikipedia. In Proceedings of the SIGCHI conference on Human factors in
computing systems (CHI '07). ACM, New York, NY, USA, 453-462. '

* '''101 cites''' Reid Priedhorsky, Jilin Chen, Shyong (Tony) K. Lam,
Katherine Panciera, Loren Terveen, and John Riedl. 2007.
[http://citeseerx.ist.psu.edu/viewdoc/download?doi.1.1.123.7456&rep=rep1&type=pdf
Creating, destroying, and restoring value in wikipedia]. In
Proceedings of the 2007 international ACM conference on Supporting
group work (GROUP '07). ACM, New York, NY, USA, 259-268.


=Other Significant Papers ==

* '''Best Paper Award''' Ivan Beschastnikh, Travis Kriplean and David
W. McDonald [http://www.aaai.org/Papers/ICWSM/2008/ICWSM08-011.pdf
Wikipedian Self-Governance in Action: Motivating the Policy
Lens]International Conference on Weblogs and Social Media, 2008.

* '''Honorable Mention''' Travis Kriplean, Ivan Beschastnikh and David
W. McDonald [http://dub.washington.edu/djangosite/media/papers/tmpZ77p1r.pdf
Articulations of WikiWork: Uncovering Valued Work in Wikipedia through
Barnstars] Computer Supported Cooperative Work, 2008.

=Relevant Scholarly Books ==

Reagle's book, Lih's book, Sunstein, Benkler