FUDCon Pune 2015

Pune, 26th to 28th June, 2015


26th to 28th June, 2015 09:00 am - 06:00 pm

Website: FUDCon Pune 2015


MIT College of Engineering
See map

Subscribe & Share

June 26, 2015, 3:20 pm

Gluster for Hadoop workloads


shubhendu's picture
Twitter URL:
LinkedIn URL:

I work with RedHat Bangalore and majorly contribute to oVirt upstream project. I also contribute to glusterfs-hadoop plugin. I have got 11+ years of experience in different technologies like Java, Python and bit of C as well. Working with RedHat for close to couple of years.

GlusterFS is an open source, distributed file system capable of scaling to several petabytes (actually, 72 brontobytes!) and handling thousands of clients. GlusterFS clusters together storage building blocks over Infiniband RDMA or TCP/IP interconnect, aggregating disk and memory resources and managing data in a single global namespace. GlusterFS is based on a stackable user space design and can deliver exceptional performance for diverse workloads.

The project glusterfs-hadoop enables Apache hadoop on GlusterFS. It provides a mechanism using which GlusterFS can be used as data store for Hadoop. Its a project done in Java to bypass the data calls to GlusterFS from Hadoop so this component replaces HDFS with GlusterFS

Hall: D406 [4th Floor] Track: Distributed Storage Type: Talk