[...]

Because generating diffs is expensive, it only allows the generation of a limited number of not-already-cached diffs per request. The solution is to request diffs for fewer old revisions per request (e.g. lower your rvlimit).