On Thu, Oct 17, 2013 at 3:34 PM, Toby Negrin <tnegrin(a)wikimedia.org> wrote:
I would be surprised if sqoop doesn't let you dial
back the load so you
don't crush the source DB. I've used it in production and it's been fine.
There's also some interesting work done on sqoop 2 right now.
I read up a bit, couldn't immediately find any load-reducing strategies.
But you're right, they support incremental imports and lots of interesting
things like integration with oozie. We'll look more closely.