Hey guys,

I reached out to this guy yesterday about the bug I ran into in Scribe.  He had posted on the scribe-server google group that he had fixed this bug, and I also wanted to let him know about our potential efforts to standardize Scribe packaging.  

Here's his opinion on Scribe:
I personally gave up on Scribe, I'd recommend that you
consider Flume as a better replacement, that is more supported and
developed.  Scribe has never been really well written or maintained,
it's just one of the many hacks that Facebook released.

In general, it does seem to be pretty given up on.  There have been a couple of pull requests merged in the last year, but beyond that there isn't much activity:  https://github.com/facebook/scribe/commits/master

It would be really interesting to know how (and if?) Facebook still uses Scribe internally.  I'm pretty sure they've done a lot more with Hadoop since 2008-2010 when Scribe was being more actively promoted.  Maybe they're using Flume instead now?  We need a Facebook insider, anyone know one?

-Ao


Begin forwarded message:

From: tsuna <tsunanet@gmail.com>
Subject: Re: Scribe Packaging Effort
Date: July 26, 2012 12:45:30 AM EDT
To: Andrew Otto <otto@wikimedia.org>

On Wed, Jul 25, 2012 at 9:05 AM, Andrew Otto <otto@wikimedia.org> wrote:
Hi Benoît,

Hi Andrew,

In the meantime, I have another question!  I just ran into a problem that
you say you fixed in this thread:
https://groups.google.com/group/scribe-server/tree/browse_frm/month/2010-01?_done=%2Fgroup%2Fscribe-server%2Fbrowse_frm%2Fmonth%2F2010-01%3F&

Are you referring to this?
[Thu Nov 19 18:29:59 2009] "[hdfs] Connecting to HDFS"
*** glibc detected *** ./scribed: munmap_chunk(): invalid pointer: 0x0000000001ea19c3 ***

However, the commit you link to 404s.  I'm willing to rebuild scribe with
whatever fix or release version is necessary.  Can you point me in the right
direction?  What source should I use to build scribe to fix this bug?

If you're referring to the bug above, it's a very old bug, it must be
fixed upstream already.  I can't believe you're running into the same
bug almost 3 years later, it must be a different issue.

Either way, I personally gave up on Scribe, I'd recommend that you
consider Flume as a better replacement, that is more supported and
developed.  Scribe has never been really well written or maintained,
it's just one of the many hacks that Facebook released.

Good luck.

--
Benoit "tsuna" Sigoure
Software Engineer @ www.StumbleUpon.com