[Pywikipedia-bugs] [Maniphest] [Created] T87014: Generator returns the same pages multiple times each time data is in the requests

XZise created this task. XZise assigned this task to Mpaa. XZise added subscribers: XZise, Mpaa, jayvdb. XZise added a project: pywikibot-core. Restricted Application added subscribers: Aklapper, pywikipedia-bugs. TASK DESCRIPTION A QueryGenerator might return the same page, because not all data was returned in the first request. When then the second request comes in it contains the same page with additional information. I stumbled across this when I was searching for the files with the same hash: ``` [FilePage(b'File:Star empty.svg'), FilePage(b'File:Star empty.svg')] ``` Both are about the exact same page but the [[https://commons.wikimedia.org/w/api.php?inprop=protection&indexpageids=… request]] says that there is a continuation which results [[https://commons.wikimedia.org/w/api.php?inprop=protection&iistart=2007-… the second request]] which contains the same page. There is a [[https://gerrit.wikimedia.org/r/174827/|patch]] by @Mpaa which promises to fix this and @jayvdb said he has also a patch related to this. TASK DETAIL https://phabricator.wikimedia.org/T87014 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign <username>. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mpaa, XZise Cc: jayvdb, Mpaa, Aklapper, XZise, pywikipedia-bugs