Hi,
So 1) How do I generate robot.txt and 2) How do add mediawiki entries in that file.
Thanks,
--- On Mon, 7/14/08, MinuteElectron <minuteelectron(a)googlemail.com> wrote:
From: MinuteElectron <minuteelectron(a)googlemail.com>
Subject: Re: [Wikitech-l] not able to generate robot.txt with $wgDefaultRobotPolicy
To: the_rock3353(a)yahoo.com, "Wikimedia developers"
<wikitech-l(a)lists.wikimedia.org>
Date: Monday, July 14, 2008, 11:50 AM
gbtkjd dgjksbg wrote:
Hi,
I am specifying:
$wgDefaultRobotPolicy = 'index,follow';
$wgNamespaceRobotPolicies = array( NS_MAIN => 'index,follow' );
$wgArticleRobotPolicies = array( 'Main Page' =>
'index,follow'
);
in my LocalSettings.php file but it is not generating any
"robot.txt"
file.
Mediawiki is supposed to generate this file right?
No, this controls the meta tags that inform robots of how to handle
individual pages. It does not generate a robots.txt file.
MinuteElectron.