Hey guys,
I reached out to this guy yesterday about the bug I ran into in Scribe. He had posted on the scribe-server google group that he had fixed this bug, and I also wanted to let him know about our potential efforts to standardize Scribe packaging.
Here's his opinion on Scribe:
I personally gave up on Scribe, I'd recommend that you consider Flume as a better replacement, that is more supported and developed. Scribe has never been really well written or maintained, it's just one of the many hacks that Facebook released.
In general, it does seem to be pretty given up on. There have been a couple of pull requests merged in the last year, but beyond that there isn't much activity: https://github.com/facebook/scribe/commits/master
It would be really interesting to know how (and if?) Facebook still uses Scribe internally. I'm pretty sure they've done a lot more with Hadoop since 2008-2010 when Scribe was being more actively promoted. Maybe they're using Flume instead now? We need a Facebook insider, anyone know one?
-Ao
Begin forwarded message:
From: tsuna tsunanet@gmail.com Subject: Re: Scribe Packaging Effort Date: July 26, 2012 12:45:30 AM EDT To: Andrew Otto otto@wikimedia.org
On Wed, Jul 25, 2012 at 9:05 AM, Andrew Otto otto@wikimedia.org wrote:
Hi Benoît,
Hi Andrew,
In the meantime, I have another question! I just ran into a problem that you say you fixed in this thread: https://groups.google.com/group/scribe-server/tree/browse_frm/month/2010-01?...
Are you referring to this?
[Thu Nov 19 18:29:59 2009] "[hdfs] Connecting to HDFS" *** glibc detected *** ./scribed: munmap_chunk(): invalid pointer: 0x0000000001ea19c3 ***
However, the commit you link to 404s. I'm willing to rebuild scribe with whatever fix or release version is necessary. Can you point me in the right direction? What source should I use to build scribe to fix this bug?
If you're referring to the bug above, it's a very old bug, it must be fixed upstream already. I can't believe you're running into the same bug almost 3 years later, it must be a different issue.
Either way, I personally gave up on Scribe, I'd recommend that you consider Flume as a better replacement, that is more supported and developed. Scribe has never been really well written or maintained, it's just one of the many hacks that Facebook released.
Good luck.
-- Benoit "tsuna" Sigoure Software Engineer @ www.StumbleUpon.com