On Wednesday, 4 April 2012 at 20:16, Andrew Gray wrote:
Catscan has always been quite slow - it's fair enough, I suppose, when you consider it's having to match item-by-item in two very large and dynamically generated lists! I wonder if it's possible to tell it to just return a figure for matching articles, rather than a list, when you expect it to be unusually large?
It's still going to have to calculate the intersection of the two sets (the computationally and IO intensive task) in order to then calculate the size of said intersection.