Hello everyone,
I have a problem on stat1002.eqiad.wmnet using https://github.com/Wikidata/QueryAnalysis/blob/master/tools/hourlyFieldValue... on two files (1.1 GB and 2.4 GB respectively); the processed ends with Killed. My guess is that my script uses too much memory. However, it was my understanding that csv.DictReader reads line-by-line, so the file sizes should not matter.
If anyone can tell me why my script is taking up so much memory or if there is any other reason for the script getting killed I'd be grateful.
Greetings,
Adrian