Hello all, mainly co-developers,
mitmproxy is a tool that allows you to sniff network traffic -- which is incredibly useful for debugging pywikibot network issues. Of course, there are other tools to do this (e.g. ethereal), but those are not usable anymore now that the WMF switched to HTTPS. In addition, mitmproxy allows you to /manipulate/ the traffic, which can be useful for tricking pywikibot into thinking there are network issues.
This weekend, I finally got mitmproxy to work for pywikibot/core -- the version available in ubuntu did not correctly forge SSL certificates yet. For other interested developers, I put up a guide at https://www.mediawiki.org/wiki/Pywikibot/mitmproxy
Unfortunately, the internet seems to suggest it doesn't work that well for Windows users. http://honeyproxy.org/ is supposed to be better, but I haven't tested it.
Merlijn
----- Original Nachricht ---- Von: Merlijn van Deen valhallasw@arctus.nl An: Pywikipedia discussion list pywikipedia-l@lists.wikimedia.org Datum: 16.01.2014 21:40 Betreff: [Pywikipedia-l] mitmproxy: sniffing pywikibot traffic to debug network issues
Hello all, mainly co-developers,
mitmproxy is a tool that allows you to sniff network traffic -- which is incredibly useful for debugging pywikibot network issues. Of course, there are other tools to do this (e.g. ethereal), but those are not usable anymore now that the WMF switched to HTTPS. In addition, mitmproxy allows you to /manipulate/ the traffic, which can be useful for tricking pywikibot into thinking there are network issues.
This weekend, I finally got mitmproxy to work for pywikibot/core -- the version available in ubuntu did not correctly forge SSL certificates yet. For other interested developers, I put up a guide at https://www.mediawiki.org/wiki/Pywikibot/mitmproxy
Unfortunately, the internet seems to suggest it doesn't work that well for Windows users. http://honeyproxy.org/ is supposed to be better, but I haven't tested it.
Merlijn
Would this help to investigate that bot hanging problem in core?
xqt
On Fri, Jan 17, 2014 at 7:26 PM, info@gno.de wrote:
----- Original Nachricht ---- Von: Merlijn van Deen valhallasw@arctus.nl An: Pywikipedia discussion list pywikipedia-l@lists.wikimedia.org Datum: 16.01.2014 21:40 Betreff: [Pywikipedia-l] mitmproxy: sniffing pywikibot traffic to debug network issues
Hello all, mainly co-developers,
mitmproxy is a tool that allows you to sniff network traffic -- which is incredibly useful for debugging pywikibot network issues. Of course,
there
are other tools to do this (e.g. ethereal), but those are not usable anymore now that the WMF switched to HTTPS. In addition, mitmproxy allows you to /manipulate/ the traffic, which can be useful for tricking
pywikibot
into thinking there are network issues.
This weekend, I finally got mitmproxy to work for pywikibot/core -- the version available in ubuntu did not correctly forge SSL certificates yet. For other interested developers, I put up a guide at https://www.mediawiki.org/wiki/Pywikibot/mitmproxy
Unfortunately, the internet seems to suggest it doesn't work that well
for
Windows users. http://honeyproxy.org/ is supposed to be better, but I haven't tested it.
Merlijn
Would this help to investigate that bot hanging problem in core?
xqt
I think so, I'll start looking at the bug via this tool tomorrow
Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
----- Original Nachricht ---- Von: Amir Ladsgroup ladsgroup@gmail.com An: Pywikipedia discussion list pywikipedia-l@lists.wikimedia.org Datum: 17.01.2014 16:59 Betreff: Re: [Pywikipedia-l] mitmproxy: sniffing pywikibot traffic to debug network issues
Would this help to investigate that bot hanging problem in core?
xqt
I think so, I'll start looking at the bug via this tool tomorrow
-- Amir
That would be great :) xt