[Mediawiki-l] Google Mini search appliance & MediaWiki

Daniel Barrett danb at VistaPrint.com
Fri Mar 23 02:34:02 UTC 2007


What's the right way to disable "nofollow" in MediaWiki?  Grep for
"setRobotpolicy( 'noindex,nofollow' )" in all the /include files and
change them one by one?

Problem: Our intranet spider, a Google Mini search appliance, randomly
sees "nofollow" directives for pages in MediaWiki 1.9.3 and reports:

  Excluded: On page with robots nofollow meta tag.

In repeated spiderings, the same page might get excluded or not,
seemingly randomly.  Out of 10 spiderings of a particular page, say, 6
of them will fail with this error.  Maybe the same link appears with and
without "nofollow" on different wiki pages (say, articles vs. category
pages), and whichever one the spider hits, it obeys?

Thanks,
DanB




More information about the MediaWiki-l mailing list