[Gluster-users] System Requirements (and mild rant re: lack-of-documentation)

Craig Carl craig at gluster.com
Sun Sep 26 02:38:58 UTC 2010


Jonathan - 
We are actively working on the documentation, we will release an entirely new set with Gluster 3.1, currently in beta. In the mean time you can find the system requirements here - 
http://www.gluster.com/community/documentation/index.php/Storage_Server_Installation_and_Configuration#Technical_Requirements . 

I'd also suggest the Introduction to Gluster document - 
http://ftp.gluster.com/pub/gluster/documentation/Introduction_to_Gluster.pdf 
We also have a Gluster Architecture document - 
http://ftp.gluster.com/pub/gluster/documentation/Gluster_Architecture.pdf 

Gluster has standardized on some language recently, a 'node' or a 'brick' is a single host with block storage that Gluster will add to a cluster and export via a NAS protocol. We call it a 'storage server'. 

You will need some number of 'storage servers' to meet your performance requirements. The general guidelines for determining the performance of a single storage server are; 

1. For files > 64KB Gluster will run at hardware speeds. 
2. In 90% of Gluster environments the hardware limitation is network I/O. 
3. For files <64KB CPU speeds become more relevant and performance may be reduced to ~60% of hardware performance due to context switching. This is a general NAS issue, not specifically a Gluster problem. 
4. If you use the GlusterFS client and setup a mirror write performance will be reduced by ~50%. 
5. Write performance of a single file is limited to the performance of the storage server on which the file physically exists. 
6. Memory is read cache. 

We generally test the theoretically maximum speeds of a storage server by running iozone locally on the server without using Gluster and then over the network in clustered mode from at least 4 clients. While the iozone tests are running you should monitor resources on the storage server to find your bottleneck. If the performance of the second test matches the performance of the first then you can begin to scale the number of storage servers up to meet your total performance requirements. 

I hope I answered your questions, please let me know if you have more, I'm happy to help. We do offer a 60 day POC that includes support, please let me know if you think it might be helpful for you. - http://www.gluster.com/products/poc.php . 



Thanks, 

Craig 

-- 
Craig Carl 













Sales Engineer; Gluster, Inc. 
Cell - ( 408) 829-9953 (California, USA) 
Office - ( 408) 770-1884 
Gtalk - craig.carl at gmail.com 
Twitter - @gluster 
Installing Gluster Storage Platform, the movie! 
http://rackerhacker.com/2010/08/11/one-month-with-glusterfs-in-production/ 



From: "Jonathan B. Horen" <jbhoren at alaska.edu> 
To: gluster-users at gluster.org 
Sent: Friday, September 24, 2010 2:04:39 PM 
Subject: [Gluster-users] System Requirements (and mild rant re: lack-of-documentation) 

What little documentation that there is for Gluster doesn't include anything 
regarding system requirements -- minimum or recommended. 

We're trying to spec-out a setup using four SAN storage units: two NexSans 
(30T SATAbeast and 10T SATAboy) and two FalconStors (32T NSS650 and 32T 
NSS620), all connected via iSCSI. These supply storage for two RHEL5 compute 
clusters (17-node Penguin and 3-node IBM x3950m2) and 300+ user secure file 
share. 

Without "real" documentation -- conceptual and otherwise -- it's damn 
difficult to decide. Is Gluster cpu-intensive, memory heavy, or a mix of the 
two? And bricks! Is a 10T SAN unit a "brick", or a "block" (or several 
"bricks")? and does it matter? How many bricks can/could/should a Gluster 
server node serve? 

I could spend weeks searching through the mailing-list archives, but that's 
the purpose of documentation. Frankly, we're at a loss. 

Is there information to be found, and, if so, where is it? 

-- 
JONATHAN B. HOREN 
Systems Administrator 
UAF Life Science Informatics 
Center for Research Services 
(907) 474-2742 
jbhoren at alaska.edu 
http://biotech.inbre.alaska.edu 

_______________________________________________ 
Gluster-users mailing list 
Gluster-users at gluster.org 
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users 


More information about the Gluster-users mailing list