Hi,
the `dt` field is the time in UTC (no timezone specified) at which the
request ends being processed by Varnish.
Cheers
Joseph
On Mon, Mar 15, 2021 at 8:36 AM Luca Toscano <ltoscano(a)wikimedia.org> wrote:
+A mailing list for the Analytics Team at WMF and
everybody who has an
interest in Wikipedia and analytics. <analytics(a)lists.wikimedia.org>
Hi!
I added the Analytics mailing list in Cc so other people can chime in,
this is the canonical way to follow up with us and the community, please
avoid direct email if possible :)
Thanks!
Luca
On Sat, Mar 13, 2021 at 10:57 PM Ho Chung <chungho4865(a)gmail.com> wrote:
Hello
I have some problem request , about refine_webrequest.hql
In this file timestamp is use utc ?
This file is it connect wmf_raw.webrequest and wmf.webrequest ?
Because i can't read the code have add Z / +/- zone time
-- Hack to get a correct timestamp because of hive inconsistent
conversion
CAST(unix_timestamp(dt, "yyyy-MM-dd'T'HH:mm:ss") * 1.0 as timestamp)
as
ts,
https://github.com/wikimedia/analytics-refinery/blob/master/oozie/webreques…
I emailed wiki legal request 3 month they not sure , can you clearly ask
me .
If not use utc, is use your server clock or , my computer clock?
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics
--
Joseph Allemandou (joal) (he / him)
Staff Data Engineer
Wikimedia Foundation