Hello,
I've found that running forceSearchIndex.php with --skipLinks --indexOnSkip options is only processing about 1000-1500 pages and then stopping. It's not due to error or anything because I can set --fromId and run it again and it does another batch. I've tried setting --limit and --batchSize and all sorts but nothing allows it to do more than this amount at a time.... anyone have any idea what might be going on here?
(It's happening on both MW 1.27 with Elastic Search 1.75 and MW 1.28 with elastic 2.4.4)
Thanks, Aran
Hi Aran,
without any error messages it's hard to guess what could be the cause of this problem. This script has been used to index million pages but there must be some configuration that trigger this strange behavior you are experiencing. It may require time to investigate so in order not to lose track of your issue could you file an issue to https://phabricator.wikimedia.org/ and add all the details you can extract from your installation.
Thanks!
On Sun, Apr 2, 2017 at 9:40 PM, Aran aran@organicdesign.co.nz wrote:
Hello,
I've found that running forceSearchIndex.php with --skipLinks --indexOnSkip options is only processing about 1000-1500 pages and then stopping. It's not due to error or anything because I can set --fromId and run it again and it does another batch. I've tried setting --limit and --batchSize and all sorts but nothing allows it to do more than this amount at a time.... anyone have any idea what might be going on here?
(It's happening on both MW 1.27 with Elastic Search 1.75 and MW 1.28 with elastic 2.4.4)
Thanks, Aran
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
wikitech-l@lists.wikimedia.org