Any webrequest is picked up by varnishkafka and goes into the webrequest logs in the cluster. If you want special treatment of your request, say different formatting or different logs, we’ll have to do something else :)
On Mar 19, 2015, at 04:45, Gilles Dubuc gilles@wikimedia.org wrote:
Hi Nuria,
As far as I'm aware, it only goes to the varnish logs at the moment. What happens after that hasn't been configured and is starting to be way beyond the scope of what the Multimedia team should be involved with.
CCing Ori who knows whether the hits to the beacon URI are picked up by varnishkafka or not at the moment, since he set up the endpoint.
On Wed, Mar 18, 2015 at 3:42 PM, Nuria Ruiz <nuria@wikimedia.org mailto:nuria@wikimedia.org> wrote: Gilles:
And we know this data is coming via varnishkafka into the cluster, right? Did we checked that?
Thanks,
Nuria
On Wed, Mar 18, 2015 at 2:02 AM, Gilles Dubuc <gilles@wikimedia.org mailto:gilles@wikimedia.org> wrote: Our solution for this is now live.
Here's an example of a media beacon hit:
http://bits.wikimedia.org/beacon/media?duration=3709&uri=http%3A%2F%2Fup... http://bits.wikimedia.org/beacon/media?duration=3709&uri=http%3A%2F%2Fupload.beta.wmflabs.org%2Fwikipedia%2Fen%2Fthumb%2Fb%2Fb0%2FSunrise_over_fishing_boats_in_Kerala.jpg%2F640px-Sunrise_over_fishing_boats_in_Kerala.jpg
Beta is currently hitting that endpoint and production wikis will start doing the same once they start running 1.25wmf22
All views coming from Media Viewer will be hitting that endpoint. Note that there might be some loss of hits on browsers that don't support sendBeacon, since our fallback is a simple async AJAX request (we haven't tried to go beyond that with local storage and replaying the event, etc.) and this event might be fired in situations of tab/browser close as well as navigating away from the page. Thus keep in mind that a steady small increase of those hits over a long period of time might simply be the natural process of people upgrading their browsers to more modern ones.
On Fri, Feb 6, 2015 at 4:46 PM, Nuria Ruiz <nuria@wikimedia.org mailto:nuria@wikimedia.org> wrote:
A dummy image request seems rather reasonable. (I assume varnish can handle such load of "atypical" requests.)
Right, the filtering for beacons is already in place in vcl and responses are sent right away so as far as I know there is no better place than varnish for this code. See example: https://github.com/wikimedia/operations-puppet/blob/production/templates/var... https://github.com/wikimedia/operations-puppet/blob/production/templates/varnish/bits.inc.vcl.erb#L24
On Thu, Feb 5, 2015 at 10:38 PM, Federico Leva (Nemo) <nemowiki@gmail.com mailto:nemowiki@gmail.com> wrote: Gergo Tisza, 04/02/2015 21:00: Do you see any fundamental problem with this?
A dummy image request seems rather reasonable. (I assume varnish can handle such load of "atypical" requests.) Making additional requests is ugly, but until we get SPDY our articles typically make dozens or hundreds requests, so the effect looks negligible.
Nemo
Analytics mailing list Analytics@lists.wikimedia.org mailto:Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org mailto:Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org mailto:Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org mailto:Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics https://lists.wikimedia.org/mailman/listinfo/analytics
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics