[LRUG] Out of curiosity -- BIG DATA with Rails

[Abhishek Parolkar]

I have been using and evangelizing ruby stack (
http://www.slideshare.net/parolkar/ruby-for-soul-of-bigdata-nerds) for a
large scale analytics system.

The question I would ask is What kind of system are you building?
There are two worlds in BigData, The Batch Processing world (Hadoop) and
Stream Processing world (STORM)
Hadoop Streaming allows you to hook any scripting language (use Ruby)  for
writing Map-Reduce on the other hand STORM has jruby wrappers to help you
write topologies.

In most of the use cases, I see people using Hadoop as large scale event
storage and use Hive to aggregate data into an Analytical DB which serves
Dashboards & Data Scientists.

If you are starting afresh, I would instead suggest to use service like
http://www.treasure-data.com to abstract away all the heavy-duty
infrastructure and work with SQL-like interface. You can collect event logs
in scalable manner using Fluend (http://www.youtube.com/watch?v=J9CX8zfH6lU)


Regards,
Abhishek Parolkar
http://github.com/parolkar
http://www.linkedin.com/in/parolkar


On Tue, Oct 30, 2012 at 8:21 PM, Satish Kota <
satishkota at heurionconsulting.com> wrote:

> All,****
>
> ** **
>
> Out of curiosity, I would like to know if anybody is working on Big Data
> using Rails technology!!!.... if yes, what are the best tools and
> techniques being used…. Along with rails….****
>
> ** **
>
> I am of the impression that Ruby, Rails, MongoDB, Elastic Search, Hadoop,
> Redis, any more??? We are building a system on BigData, so would like to
> know the best practices there…. ****
>
> ** **
>
> *Thanks and Regards*
>
> *Satish N Kota*
>
> *@phone: +91 98862 03255*
>
> *@testifor: http://www.testifor.com/satishnkota*
>
> *www.testifor.com – What others say, Matters!!!*
>
> * *
>
> _______________________________________________
> Chat mailing list
> Chat at lists.lrug.org
> http://lists.lrug.org/listinfo.cgi/chat-lrug.org
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lrug.org/pipermail/chat-lrug.org/attachments/20121031/c366e390/attachment-0003.html>