https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
Web browser: --- Bug ID: 55197 Summary: PostData() datas are not gzip compressed Product: Pywikibot Version: unspecified Hardware: All OS: All Status: ASSIGNED Severity: normal Priority: Unprioritized Component: General Assignee: Pywikipedia-bugs@lists.wikimedia.org Reporter: legoktm.wikipedia@gmail.com Classification: Unclassified Mobile Platform: ---
Originally from: http://sourceforge.net/p/pywikipediabot/bugs/1447/ Reported by: Anonymous user Created on: 2012-05-19 16:38:59 Subject: PostData() datas are not gzip compressed Assigned to: xqt Original description: Using the 'pagegenerators', data transfer is not compressed. That data will be several megabytes. That transfer is very time consuming.
Therefore, I think a good idea to remove that line.
Thank you consider.
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #1 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- It is less time consuming than loading e.g. 60 times each page separately. What is the intention of this request?
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #2 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- I also do not consume more time is good.
gzip compression will compress to about one-third of the text data. Therefore, transfer time will be one-third. Is roughly.
However, data transfer has not been compressed in the generator. This proposal is one way to solve this problem.
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #3 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- This has nothing to do with preloading generator. http requests are done by Site.PostData() or Site.getUrl() with gzip compression enabled by default.
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #4 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- - **assigned_to**: nobody --> xqt
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #5 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- I understand. In the request header are described. However, the response data are not compressed.
May be a bug of MediaWiki.
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #6 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- I don't know whether they are compressed or not. How did you see it?
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #7 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- I was confirmed by Wireshark. This is a packet analysis software.
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #8 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- Maybe the header is wrong. I found 'Accept-encoding' as header parameter but at https://www.mediawiki.org/wiki/API:Client%5C_Code header is described as 'Accept-Encoding' (capital Encoding)
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
--- Comment #9 from Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com --- - **summary**: Do not use preloading in featured.py --> PostData() datas are not gzip compressed
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
Kunal Mehta (Legoktm) legoktm.wikipedia@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://sourceforge.net/p/p | |ywikipediabot/bugs/1447
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
xqt info@gno.de changed:
What |Removed |Added ---------------------------------------------------------------------------- Priority|Unprioritized |Lowest Status|ASSIGNED |NEW CC| |info@gno.de Severity|normal |enhancement
https://bugzilla.wikimedia.org/show_bug.cgi?id=55197
John Mark Vandenberg jayvdb@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- Keywords| |testme Priority|Lowest |High CC| |jayvdb@gmail.com, | |ladsgroup@gmail.com Version|unspecified |compat (1.0) Severity|enhancement |major
pywikipedia-bugs@lists.wikimedia.org