Gluster
  • Documentation
  • Contact
  • About
  • Developers
  • Download

Gluster 3.2: Configuring GlusterFS to work over InfiniBand

From GlusterDocumentation

You can optionally configure GlusterFS for OpenFabrics verbs RDMA-conformant transports, such as InfiniBand.

Note: Commercial Support for InfiniBand is currently not available, write to info@gluster.com for more information on InfiniBand support.

To configure GlusterFS for InfiniBand on RPM distribution-based systems

  1. Install OFED version 1.5.2 from source using the directions in the download -

    $ wget http://www.openfabrics.org/downloads/OFED/ofed-1.5.2/

  2. Install GlusterFS.

    For more information, see Installing GlusterFS on Red Hat Package Manager (RPM) Distributions.

  3. Using SSH, download the RDMA RPM file to each server in your cluster.

    The RDMA packages contain the OpenFabrics verbs RDMA module for Infiniband and 10GigE networks.

    For CentOS 5.x, download the file using the following command:

    $ wget http://download.gluster.com/pub/gluster/glusterfs/3.2/3.2.0/CentOS/glusterfs-rdma-3.2.0-1.x86_64.rpm

    For Fedora 11, download the file using the following command:

    $ wget http://download.gluster.com/pub/gluster/glusterfs/3.2/3.2.0/Fedora/glusterfs-rdma-3.2.0-1.fc11.x86_64.rpm

  4. Install the RDMA module on the server using the following command:

    $ sudo rpm -Uvh <rdma_RPM_file>

    For example:

    $ sudo rpm -Uvh glusterfs-rdma-3.2.0alpha-1.x86_64.rpm

To configure GlusterFS for InfiniBand on Debian distribution-based systems

  1. Install OFED version 1.5.2 from source using the directions in the download -

    $ wget http://www.openfabrics.org/downloads/OFED/ofed-1.5.2/

  2. Download the latest GlusterFS rdma.deb file and checksum to each server in your cluster.

    You can download the software here.

  3. For each .deb file, get the checksum (using the following command) and compare it against the checksum for that file in the md5sum file.

    $ md5sum GlusterFS_RDMA_DEB_file.deb

  4. Uninstall GlusterFS v3.0 (or an earlier version) from the server using the following command:

    $ sudo dpkg -r glusterfs

  5. Install GlusterFS on all servers using the following command:

    $ sudo dpkg -i GlusterFS_RDMA_DEB_file

    For example:

    $ sudo dpkg -i glusterfs_3.2.0-1_amd64_with_rdma.deb

 

Copyright © Gluster, Inc. All Rights Reserved.