NDPF Disk Performance

Disk servers with separate enclosure

Infortrend A16U-G2421, LSI dual U320 SCSI, 500 GB SATA-II disks

Key results

• 150 MByte/s sequential out at 54% CPU
• 118 MByte/s sequential in at 11% CPU.

System setup

• System: SuperMicro 1U
• CPU: dual Xeon 2.8 GHz, HT enabled
• OS: CentOS 4U7, x86_64
• RAM: 4 GByte DDR-2
• System IO: on-board Intel ICH7 SATA-II, native mode, 2x, (sda/sdb) in software RAID-1
• Disk IO: LSI 53c1030 PCI-X Fusion-MPT Dual Ultra320 SCSI (rev 08) on PCI-X riser
• Enclosure: Infortrend (EONStore) A16U-G2421, 16x500GB SATA-II, 160MHz USCSI-W

Disk Configuration

• RAID-6 over 15 disks, 1 HS
• single 6.5TByte LD, with 1 single LV in 1 partition, Write-Through mode
• mapped LV to SCSI CH1, target 0, LUN 0 attached to: LSI on CH-B, at 160 MHz Wide
• configured as 1 PV in one VG, with LV of 60 GB for test
• ext3 filesystem with defaults

Command(s) executed

bonnie++ -d /export/data/test/ -u root -g root -m 'hooikist-LSI' > /root/bonnie.log 2>&1 &

Performance result

Using uid:0, gid:0.
Writing with putc()...done
Writing intelligently...done
Rewriting...done
Reading with getc()...done
Reading intelligently...done
start 'em...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
hooikist-LSI     8G 43811  99 149548  54 50541  13 36172  75 118160  11 622.9   1
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  3096  98 +++++ +++ +++++ +++  3191  99 +++++ +++  9031  99
hooikist-LSI,8G,43811,99,149548,54,50541,13,36172,75,118160,11,622.9,1,16,3096,98,+++++,+++,+++++,+++,3191,99,+++++,+++,9031,99