The varnish logs == request logs == also in HDFS.
Ah ha, thanks!
To get access you'll need a phabricator ticket
asking for stat1002 and
analytics cluster access, with Ottomata CCd to make the
patch and Dan CCd
to confirm you need it.
Cool, I'll get on that. In the meantime, where can I learn about the
infrastructure?
On Thu, Jun 25, 2015 at 10:01 AM, Oliver Keyes <okeyes(a)wikimedia.org> wrote:
The varnish logs == request logs == also in HDFS. To
get access you'll
need a phabricator ticket asking for stat1002 and analytics cluster
access, with Ottomata CCd to make the patch and Dan CCd to confirm you
need it.
On 25 June 2015 at 12:53, James Douglas <jdouglas(a)wikimedia.org> wrote:
From IRC, it sounds like this information ought
to be available in the
Varnish logs. What's the story there?
On Thu, Jun 25, 2015 at 9:52 AM, James Douglas <jdouglas(a)wikimedia.org>
wrote:
>
> I misspoke: we're looking for HTTP requests coming from users who are
> leaving the Portal, not retrieving the portal.
>
> e.g. Clicking on enwiki, using one of the search forms, etc.
>
> On Thu, Jun 25, 2015 at 9:50 AM, Oliver Keyes <okeyes(a)wikimedia.org>
> wrote:
>>
>> * Nope :(
>> * It's in HDFS!
>>
>> On 25 June 2015 at 12:05, James Douglas <jdouglas(a)wikimedia.org>
wrote:
> Let's say, hypothetically, that I wanted to
measure information about
> HTTP
> requests coming into the Wikipedia Portal (
www.wikipedia.org).
>
> * Do we record this information?
> * If so, is it accessible via analytical tools?
> * If so, how do I get my mitts on it?
> * If not, is it accessible from a database or similar?
>
> Context:
https://phabricator.wikimedia.org/T100673
>
> _______________________________________________
> Wikimedia-search mailing list
> Wikimedia-search(a)lists.wikimedia.org
>
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
>
--
Oliver Keyes
Research Analyst
Wikimedia Foundation
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
--
Oliver Keyes
Research Analyst
Wikimedia Foundation
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search