AN!Cluster Tutorial 2 - Disk Performance Tuning

From Alteeve Wiki
Revision as of 19:05, 5 December 2015 by Digimer (talk | contribs) (Created page with "{{howto_header}} The goal of this tutorial is to show the process of tuning an Anvil! to maximize storage performance for a given workload. {{warning|1=This is NOT compl...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

 AN!Wiki :: How To :: AN!Cluster Tutorial 2 - Disk Performance Tuning

The goal of this tutorial is to show the process of tuning an Anvil! to maximize storage performance for a given workload.

Warning: This is NOT complete and is largely a dumping ground of raw data. It's probably useless to most people at this time.

The Workload

Our client specified the following 'fio' test as the simulated workload to optimize:

PATH="/data0/test"
fio --name certification --filename $PATH --ioengine libaio --direct 1 --bs 4M --rw randwrite --size 2g  --iodepth 64 --numjobs 4 --runtime 30 --time_based --group_reporting

The '$PATH' will, eventually, be an xfs partition in a server hosted on an Anvil!.

The Setup

Each node is built on two Fujitsu RX2540 M1 nodes. The storage configuration is;

  • 24x 1.8 TB 10krpm self-encrypting SAS drives.

This configuration is designed for maximum availability and security. Performance is critical, but secondary to these priorities. As such, this tutorial will likely fall short of the maximum performance possible.

The Optimization Process

Tuning will be done in stages;

  1. Optimize local storage performance.
  2. Optimize network performance.
  3. Optimize DRBD performance (testing on the raw /dev/drbd0 device).
  4. Optimize clustered LVM performance.
  5. Optimize raw virtio block device performance.
  6. Optimize xfs performance inside the server.

Local Storage

Local storage optimization requires tuning the RAID controller and virtual disk properties. Write-back caching is used and cached data is protected by flash-backed storage on the controller.


 

Any questions, feedback, advice, complaints or meanderings are welcome.
Alteeve's Niche! Enterprise Support:
Alteeve Support
Community Support
© Alteeve's Niche! Inc. 1997-2024   Anvil! "Intelligent Availability®" Platform
legal stuff: All info is provided "As-Is". Do not use anything here unless you are willing and able to take responsibility for your own actions.