My attention has repeatedly been drawn to serious negative effects created by the ability of Google and other searches to search and display pages outside the mainspace, including pages such as XfD's, DRV's, AN/I discussions, and the like. Some of these discussions have taken place on-wiki and others, I am advised, on discussion of OTRS tickets posted by affected persons.
Given the visibility of Wikipedia results on Google and other searches, and consistent with the overall intent of [[WP:BLP]] on En-Wiki (and what I hope is its equivalent on other projects), we have a serious responsibility to ensure that the overall effect of Wikipedia content is a responsible one. This includes eliminating the likelihood that the first hit on the Google search for a living person is not (for example) a deletion discussion on how insignificant and non-notable that individual is, or a page discussing the ban of that individual (who might be a minor, for example) who chose to edit Wikipedia under his or her real name and made some mistakes in doing so and was criticized or even banned as a result.
There has been discussion from time to time about implementing a technical modification such that only mainspace pages (or such other pages as the community might consciously choose) would be visible to searches. In view of the number of concerns raised about the current situation where everything is searchable, it seems to me that the necessary changes should be developed and implemented quickly.
The main argument in opposition to this change that I have seen is that the internal Wikipedia search capability is not as strong as the external search engines, so that it is desirable that the ability to conduct a complete external search be maintained. I know that I have sometimes found it useful to be able to search all spaces within the site in, for example, looking for precedent cases while drafting EnWiki arbitration decisions. It therefore would probably be desirable to upgrade our internal search capability. However, in view of the number of third parties affected by the current practice, I do not believe that implementation of the non-search capability should await this development.
As a matter of disclosure, although I have raised this concern in passing on prior occasions, my attention has been focused (this is something of an understatement) on it again by an ongoing and extremely unpleasant thread concerning me on the Wikipedia Review site. I understand that my concerns in this matter might be discounted for that reason. Nonetheless, they are sincere, of long standing, and I urge that they receive priority attention.
Newyorkbrad
Newyorkbrad, I've long wondered why any non-encyclopedia pages are available to webcrawlers. XfDs and DRVs, where we will often have long and sometimes unsympathetic discussions about the notability of living people, will often become the top Google hit for individuals. Users who edit under their own names and run ever so slightly afoul of WP rules will have top google hits about behaviour on what is (let's be honest here) *just a website*, with the potential to impact them in real life.
Whether or not we have a better internal search process, these impacts outweigh any benefit of making information browser-searchable.
Risker
2008/4/28 Newyorkbrad (Wikipedia) newyorkbrad@gmail.com:
My attention has repeatedly been drawn to serious negative effects created by the ability of Google and other searches to search and display pages outside the mainspace, including pages such as XfD's, DRV's, AN/I discussions, and the like. Some of these discussions have taken place on-wiki and others, I am advised, on discussion of OTRS tickets posted by affected persons.
Given the visibility of Wikipedia results on Google and other searches, and consistent with the overall intent of [[WP:BLP]] on En-Wiki (and what I hope is its equivalent on other projects), we have a serious responsibility to ensure that the overall effect of Wikipedia content is a responsible one. This includes eliminating the likelihood that the first hit on the Google search for a living person is not (for example) a deletion discussion on how insignificant and non-notable that individual is, or a page discussing the ban of that individual (who might be a minor, for example) who chose to edit Wikipedia under his or her real name and made some mistakes in doing so and was criticized or even banned as a result.
There has been discussion from time to time about implementing a technical modification such that only mainspace pages (or such other pages as the community might consciously choose) would be visible to searches. In view of the number of concerns raised about the current situation where everything is searchable, it seems to me that the necessary changes should be developed and implemented quickly.
The main argument in opposition to this change that I have seen is that the internal Wikipedia search capability is not as strong as the external search engines, so that it is desirable that the ability to conduct a complete external search be maintained. I know that I have sometimes found it useful to be able to search all spaces within the site in, for example, looking for precedent cases while drafting EnWiki arbitration decisions. It therefore would probably be desirable to upgrade our internal search capability. However, in view of the number of third parties affected by the current practice, I do not believe that implementation of the non-search capability should await this development.
As a matter of disclosure, although I have raised this concern in passing on prior occasions, my attention has been focused (this is something of an understatement) on it again by an ongoing and extremely unpleasant thread concerning me on the Wikipedia Review site. I understand that my concerns in this matter might be discounted for that reason. Nonetheless, they are sincere, of long standing, and I urge that they receive priority attention.
Newyorkbrad _______________________________________________ WikiEN-l mailing list WikiEN-l@lists.wikimedia.org To unsubscribe from this mailing list, visit: https://lists.wikimedia.org/mailman/listinfo/wikien-l
2008/4/28 Newyorkbrad (Wikipedia) newyorkbrad@gmail.com:
My attention has repeatedly been drawn to serious negative effects created by the ability of Google and other searches to search and display pages outside the mainspace, including pages such as XfD's, DRV's, AN/I discussions, and the like. Some of these discussions have taken place on-wiki and others, I am advised, on discussion of OTRS tickets posted by affected persons.
Given the visibility of Wikipedia results on Google and other searches, and consistent with the overall intent of [[WP:BLP]] on En-Wiki (and what I hope is its equivalent on other projects), we have a serious responsibility to ensure that the overall effect of Wikipedia content is a responsible one. This includes eliminating the likelihood that the first hit on the Google search for a living person is not (for example) a deletion discussion on how insignificant and non-notable that individual is, or a page discussing the ban of that individual (who might be a minor, for example) who chose to edit Wikipedia under his or her real name and made some mistakes in doing so and was criticized or even banned as a result.
There has been discussion from time to time about implementing a technical modification such that only mainspace pages (or such other pages as the community might consciously choose) would be visible to searches. In view of the number of concerns raised about the current situation where everything is searchable, it seems to me that the necessary changes should be developed and implemented quickly.
The main argument in opposition to this change that I have seen is that the internal Wikipedia search capability is not as strong as the external search engines, so that it is desirable that the ability to conduct a complete external search be maintained. I know that I have sometimes found it useful to be able to search all spaces within the site in, for example, looking for precedent cases while drafting EnWiki arbitration decisions. It therefore would probably be desirable to upgrade our internal search capability. However, in view of the number of third parties affected by the current practice, I do not believe that implementation of the non-search capability should await this development.
As a matter of disclosure, although I have raised this concern in passing on prior occasions, my attention has been focused (this is something of an understatement) on it again by an ongoing and extremely unpleasant thread concerning me on the Wikipedia Review site. I understand that my concerns in this matter might be discounted for that reason. Nonetheless, they are sincere, of long standing, and I urge that they receive priority attention.
Newyorkbrad _______________________________________________ WikiEN-l mailing list WikiEN-l@lists.wikimedia.org To unsubscribe from this mailing list, visit: https://lists.wikimedia.org/mailman/listinfo/wikien-l
I was wondering this myself, especially during the Jon Awbrey (sp) incident - very messy and no real reason to appear on Google.
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Newyorkbrad (Wikipedia) wrote: | My attention has repeatedly been drawn to serious negative effects created | by the ability of Google and other searches to search and display pages | outside the mainspace, including pages such as XfD's, DRV's, AN/I | discussions, and the like. Some of these discussions have taken place | on-wiki and others, I am advised, on discussion of OTRS tickets posted by | affected persons. | | Given the visibility of Wikipedia results on Google and other searches, and | consistent with the overall intent of [[WP:BLP]] on En-Wiki (and what I hope | is its equivalent on other projects), we have a serious responsibility to | ensure that the overall effect of Wikipedia content is a responsible one. | This includes eliminating the likelihood that the first hit on the Google | search for a living person is not (for example) a deletion discussion on how | insignificant and non-notable that individual is, or a page discussing the | ban of that individual (who might be a minor, for example) who chose to edit | Wikipedia under his or her real name and made some mistakes in doing so and | was criticized or even banned as a result. | | There has been discussion from time to time about implementing a technical | modification such that only mainspace pages (or such other pages as the | community might consciously choose) would be visible to searches. In view | of the number of concerns raised about the current situation where | everything is searchable, it seems to me that the necessary changes should | be developed and implemented quickly. | | The main argument in opposition to this change that I have seen is that the | internal Wikipedia search capability is not as strong as the external search | engines, so that it is desirable that the ability to conduct a complete | external search be maintained. I know that I have sometimes found it useful | to be able to search all spaces within the site in, for example, looking for | precedent cases while drafting EnWiki arbitration decisions. It therefore | would probably be desirable to upgrade our internal search capability. | However, in view of the number of third parties affected by the current | practice, I do not believe that implementation of the non-search capability | should await this development. | | As a matter of disclosure, although I have raised this concern in passing on | prior occasions, my attention has been focused (this is something of an | understatement) on it again by an ongoing and extremely unpleasant thread | concerning me on the Wikipedia Review site. I understand that my concerns | in this matter might be discounted for that reason. Nonetheless, they are | sincere, of long standing, and I urge that they receive priority attention. | | Newyorkbrad
http://blog.wikimedia.org/2008/04/29/robotstxt/
I had actually drafted this blog post up before Newyorkbrad's post (I had several people looking at it for me who can probably attest to it) but was delayed in posting it.
I believe it bears relevance to this thread as well.
- -- Cary Bass Volunteer Coordinator
Your continued donations keep Wikipedia running! Support the Wikimedia Foundation today: http://donate.wikimedia.org Wikimedia Foundation, Inc. Phone: 415.839.6885 Fax: 415.882.0495
E-Mail: cary@wikimedia.org