-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1
Mashiah Davidson:
I've just looked after a process of text data transmission from a MEMORY table on sql-s3 to my home driven by willow.
1 MB was stored to hdd in 2.5 min. 187 * 2.5.
does it mean that data load takes more than 7 hours for you
Loading the entire pagelinks table from ruwiki took roughly 60 seconds. (I didn't measure that step separately, but the entire run was 1:25, most of which was loading the data.)
or my result is caused by just too slow interface through mysql client called from a bash script?
I'd have to see a more detailed description of how you tested it to answer that, but 1MB in 2.5 minutes seems far too slow.
For raw disk writes to /home:
% time mkfile 100m test mkfile 100m test 0.00s user 0.28s system 12% cpu 2.155 total
i.e. 100MB written in 2.1 seconds, or 47MB/sec.
- river.