Hi,
Anybody have experience with the generateSitemap.php maintenance script in MW 1.12 for building sitemap.xml files? How long does it normally take to run? I've tried running it from PHPShell (I host on Network Solutions so no command line) but it times out after a few minutes.
Unfortunately all of the extensions for generating sitemaps seem to be outdated and no longer supported since this maintenance script was added. Any other solutions?
Thanks in advance, Andrew
I am also interested in sitemap functions to build a "more or less" a project management collaboration wiki. I want the sitemap as the first thing loggers see as I want them to become aware of what the most recent work has been. So the site information would want to be as a template.
While wikis are informational, it seems that a highly modularized code can be represented in snippets of editable tables -- very easily.
I am working on a startup that is specifically designed to operate far below the radar and represents itself more as applications than a corporate entity. In fact I seriously doubt we will ever register with the PTB, or powers that be, as a software firm, though we may open a dollar store (that's a joke).
On Wed, Sep 10, 2008 at 11:50 PM, Andrew Miller andrew@richmondwiki.org wrote:
Hi,
Anybody have experience with the generateSitemap.php maintenance script in MW 1.12 for building sitemap.xml files? How long does it normally take to run? I've tried running it from PHPShell (I host on Network Solutions so no command line) but it times out after a few minutes.
Unfortunately all of the extensions for generating sitemaps seem to be outdated and no longer supported since this maintenance script was added. Any other solutions?
Thanks in advance, Andrew _______________________________________________ MediaWiki-l mailing list MediaWiki-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
I use the generateSitemap.php maintenance script in MW 1.11.2, and it takes ~30 seconds for 130,000 pages. However, this is on a dedicated server, running from the command line. /Garth
On Wed, Sep 10, 2008 at 8:50 PM, Andrew Miller andrew@richmondwiki.org wrote:
Hi,
Anybody have experience with the generateSitemap.php maintenance script in MW 1.12 for building sitemap.xml files? How long does it normally take to run? I've tried running it from PHPShell (I host on Network Solutions so no command line) but it times out after a few minutes.
Unfortunately all of the extensions for generating sitemaps seem to be outdated and no longer supported since this maintenance script was added. Any other solutions?
Thanks in advance, Andrew _______________________________________________ MediaWiki-l mailing list MediaWiki-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
That's what I was afraid of. Thanks for the input, that helps me narrow down the list of potential problems.
I will keep investigating sitemap generation tools and report anything worthwhile.
Andrew
On Thu, Sep 11, 2008 at 1:55 PM, Garth Patil garthpatil@gmail.com wrote:
I use the generateSitemap.php maintenance script in MW 1.11.2, and it takes ~30 seconds for 130,000 pages. However, this is on a dedicated server, running from the command line. /Garth
On Wed, Sep 10, 2008 at 8:50 PM, Andrew Miller andrew@richmondwiki.org wrote:
Hi,
Anybody have experience with the generateSitemap.php maintenance script
in
MW 1.12 for building sitemap.xml files? How long does it normally take to run? I've tried running it from PHPShell (I host on Network Solutions so
no
command line) but it times out after a few minutes.
Unfortunately all of the extensions for generating sitemaps seem to be outdated and no longer supported since this maintenance script was added. Any other solutions?
Thanks in advance, Andrew _______________________________________________ MediaWiki-l mailing list MediaWiki-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
MediaWiki-l mailing list MediaWiki-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
I've wanted to write a reply but been short of time.
I'm using generateSitemap.php every night via a cron job but it isn't easy.
First off I never got any of the php maintainance scripts to run reliably on shared hosts via PHPShell (I was on LunarPages) but that might have been just me. I'm now on a VPS so I have shell access and things that I had pulled my hair out on shared hosting are now simple: using SVN to update, runing update.php etc.
You might have some luck running scripts via cron. I did manage this a couple of times on lunarpages but setting this up is a real pain, waiting a minute for them to run and then checking email for feedback. Painful.
As for generateSitemap.php it has some bugs. I've patched mine, submitted my patch to bugzilla but don't really know what more to do. In particular I found it not working properly for giving the full path to sub-sitemaps in the index sitemap. I fixed this with an extra command line option letting me specify a full path. There's probably some server variable and regexp I could have deduced but I only have one life and I'd rather just slap something in a command line.
The bug I've worked around is here: https://bugzilla.wikimedia.org/show_bug.cgi?id=9675
You can also find my version of the file attached to that post.
The current version also gives every link the same priority. It would be nice if it didn't as this makes google upset. I haven't had the energy or spare time to look into this but it would propbably be easy-ish to set the priority based on number of views.
I hope someo of that helps.
GD
On Thu, Sep 11, 2008 at 9:46 PM, Andrew Miller andrew@richmondwiki.orgwrote:
That's what I was afraid of. Thanks for the input, that helps me narrow down the list of potential problems.
I will keep investigating sitemap generation tools and report anything worthwhile.
Andrew
On Thu, Sep 11, 2008 at 1:55 PM, Garth Patil garthpatil@gmail.com wrote:
I use the generateSitemap.php maintenance script in MW 1.11.2, and it takes ~30 seconds for 130,000 pages. However, this is on a dedicated server, running from the command line. /Garth
On Wed, Sep 10, 2008 at 8:50 PM, Andrew Miller andrew@richmondwiki.org wrote:
Hi,
Anybody have experience with the generateSitemap.php maintenance script
in
MW 1.12 for building sitemap.xml files? How long does it normally take
to
run? I've tried running it from PHPShell (I host on Network Solutions
so
no
command line) but it times out after a few minutes.
Unfortunately all of the extensions for generating sitemaps seem to be outdated and no longer supported since this maintenance script was
added.
Any other solutions?
Thanks in advance, Andrew
This is how we got the generateSitemap.php to work at Appropedia - http://forum.appropedia.org/blog/finally-working-mediawiki-sitemap
Hope it helps.
Good luck, Lonny
On Fri, Sep 12, 2008 at 1:24 AM, The Gadget Doctor < mediawiki@thegadgetdoctor.com> wrote:
I've wanted to write a reply but been short of time.
I'm using generateSitemap.php every night via a cron job but it isn't easy.
First off I never got any of the php maintainance scripts to run reliably on shared hosts via PHPShell (I was on LunarPages) but that might have been just me. I'm now on a VPS so I have shell access and things that I had pulled my hair out on shared hosting are now simple: using SVN to update, runing update.php etc.
You might have some luck running scripts via cron. I did manage this a couple of times on lunarpages but setting this up is a real pain, waiting a minute for them to run and then checking email for feedback. Painful.
As for generateSitemap.php it has some bugs. I've patched mine, submitted my patch to bugzilla but don't really know what more to do. In particular I found it not working properly for giving the full path to sub-sitemaps in the index sitemap. I fixed this with an extra command line option letting me specify a full path. There's probably some server variable and regexp I could have deduced but I only have one life and I'd rather just slap something in a command line.
The bug I've worked around is here: https://bugzilla.wikimedia.org/show_bug.cgi?id=9675
You can also find my version of the file attached to that post.
The current version also gives every link the same priority. It would be nice if it didn't as this makes google upset. I haven't had the energy or spare time to look into this but it would propbably be easy-ish to set the priority based on number of views.
I hope someo of that helps.
GD
On Thu, Sep 11, 2008 at 9:46 PM, Andrew Miller <andrew@richmondwiki.org
wrote:
That's what I was afraid of. Thanks for the input, that helps me narrow down the list of potential problems.
I will keep investigating sitemap generation tools and report anything worthwhile.
Andrew
On Thu, Sep 11, 2008 at 1:55 PM, Garth Patil garthpatil@gmail.com
wrote:
I use the generateSitemap.php maintenance script in MW 1.11.2, and it takes ~30 seconds for 130,000 pages. However, this is on a dedicated server, running from the command line. /Garth
On Wed, Sep 10, 2008 at 8:50 PM, Andrew Miller <
andrew@richmondwiki.org>
wrote:
Hi,
Anybody have experience with the generateSitemap.php maintenance
script
in
MW 1.12 for building sitemap.xml files? How long does it normally
take
to
run? I've tried running it from PHPShell (I host on Network Solutions
so
no
command line) but it times out after a few minutes.
Unfortunately all of the extensions for generating sitemaps seem to
be
outdated and no longer supported since this maintenance script was
added.
Any other solutions?
Thanks in advance, Andrew
MediaWiki-l mailing list MediaWiki-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
mediawiki-l@lists.wikimedia.org