Twitter to open source Hadoop-like tool

Submitted by tuxtops2 on Tue, 08/09/2011 - 23:23

Attention webscale aficionados, Twitter says it is planning to open source Storm, its Hadoop-like real-time data processing tool. In a blog post Thursday, the microblogging network said it plans to release the Storm code on Sept. 19 at the Strange Loop event in St. Louis, Mo.

The question is does the world need another real-time data processing tool? After all there are many tools like HStreaming (using Hadoop), the open source S4 and StreamBase, but the overall analytics market (if you can call it a market) is already fragmented. The Storm code comes from Twitter's acquisition of BackType last month and seems to be an effort to get folks comfortable parsing data on Twitter. Read More