Oo, good news! From http://www.cloudera.com/blog/2012/10/cdh4-1-now-released/
Quorum based storage – Quorum-based Storage for HDFS provides the ability for HDFS to store its own NameNode edit logs, allowing you to run a highly available NameNode without external storage or custom fencing.
This one of the reasons we wanted to use DSE in the first place. I haven't looked into the details here, but now we should be able to run HA NameNode without NFS!
On Sep 26, 2012, at 2:44 PM, Andrew Otto otto@wikimedia.org wrote:
Not the proprietary bits, no.
Cool! This is exactly why I wanted to ask this question. This is actually a bit of a relief! While I would love to try out DSE, CDH4 will almost certainly do the job. Having the choice made for me saves me a lot of work in evaluating and researching multiple options.
Thanks all!
On Sep 25, 2012, at 7:34 PM, Erik Moeller erik@wikimedia.org wrote:
On Tue, Sep 25, 2012 at 7:37 AM, Andrew Otto otto@wikimedia.org wrote:
tl;dr: Datastax is cooler than Cloudera, but Datastax is not 100% open source. Can we still use it?
Not the proprietary bits, no.
If it's just about using the open core part, that's less problematic, although I generally advise against buying into open core solutions because the incentive structures aren't aligned (they'll continually try to upsell you on the cool proprietary features).
-- Erik Möller VP of Engineering and Product Development, Wikimedia Foundation
Support Free Knowledge: https://wikimediafoundation.org/wiki/Donate
Ops mailing list Ops@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/ops