On Thu, Oct 17, 2013 at 3:34 PM, Toby Negrin tnegrin@wikimedia.org wrote:
I would be surprised if sqoop doesn't let you dial back the load so you don't crush the source DB. I've used it in production and it's been fine.
There's also some interesting work done on sqoop 2 right now.
I read up a bit, couldn't immediately find any load-reducing strategies. But you're right, they support incremental imports and lots of interesting things like integration with oozie. We'll look more closely.