Looking for System performance tools
Padiyath Sreekumaran
Kumar.Padiyath at psi.ch
Fri Jul 1 07:10:17 UTC 2005
Hi,
I have installed RedHat OS version 3 on a Dell 2500 machine.
The system has 2 CPU's and 2GB memory. This machine is used only as
Archiving (to store information transferred from users via ftp and
nfs - no interactive login). It is connected with san to 2 disk arrays.
One disk array is 1KM away from the machine for which 1Gb connection
used. The other disk array is in the same wrack as the computer.The users
first
transfer data to the disk (via ftp,nfs) and then
after a predefined time interval the files are transferred to tape(LTO).
I see often the load(with top) of the machine very high. Upto 14 to 20.
Is there any tool with which I can findout the bottleneck of the problem:
traffic between disk and tape, memory and disk etc. Is it possible to
measure the network performance of the disk array 1Km away from the
machine?
When I look the top out, I see that the memory is not much used. Both the
CPU
are 60-70% used. What commands can I use to find out the bottleneck?
We are using 1Gb connection from machine.This is the output from dmesg
command:
blk: queue c362de18, I/O limit 4095Mb (mask 0xffffffff)
Vendor: DELL Model: PERC Stripe Rev: V1.0
Type: Direct-Access ANSI SCSI revision: 02
blk: queue c362dc18, I/O limit 4095Mb (mask 0xffffffff)
Vendor: DELL Model: PERC Stripe Rev: V1.0
Type: Direct-Access ANSI SCSI revision: 02
blk: queue c362da18, I/O limit 4095Mb (mask 0xffffffff)
Vendor: DELL Model: PERC Stripe Rev: V1.0
Type: Direct-Access ANSI SCSI revision: 02
blk: queue c362d818, I/O limit 4095Mb (mask 0xffffffff)
Vendor: DELL Model: PERC Stripe Rev: V1.0
Type: Direct-Access ANSI SCSI revision: 02
blk: queue c362d618, I/O limit 4095Mb (mask 0xffffffff)
Vendor: DELL Model: PERC Stripe Rev: V1.0
Type: Direct-Access ANSI SCSI revision: 02
blk: queue c362d418, I/O limit 4095Mb (mask 0xffffffff)
Attached scsi disk sdd at scsi1, channel 0, id 0, lun 0
Attached scsi disk sde at scsi1, channel 0, id 1, lun 0
Attached scsi disk sdf at scsi1, channel 0, id 2, lun 0
Attached scsi disk sdg at scsi1, channel 0, id 3, lun 0
Attached scsi disk sdh at scsi1, channel 0, id 4, lun 0
Attached scsi disk sdi at scsi1, channel 0, id 5, lun 0
SCSI device sdd: 142182912 512-byte hdwr sectors (72798 MB)
sdd: sdd1
SCSI device sde: 142182912 512-byte hdwr sectors (72798 MB)
sde: sde1
SCSI device sdf: 142182912 512-byte hdwr sectors (72798 MB)
sdf: sdf1
SCSI device sdg: 142182912 512-byte hdwr sectors (72798 MB)
sdg: sdg1
SCSI device sdh: 142182912 512-byte hdwr sectors (72798 MB)
sdh: sdh1
SCSI device sdi: 142182912 512-byte hdwr sectors (72798 MB)
sdi: sdi1
qla2x00_set_info starts at address = f884a060
PCI: Found IRQ 9 for device 01:0c.0
IRQ routing conflict for 01:0c.0, have irq 11, want irq 9
qla2x00: Found VID=1077 DID=2200 SSVID=1077 SSDID=2
scsi(3): Found a QLA2200 @ bus 1, device 0xc, irq 11, iobase 0xf8895000
scsi(3): Topology - (F_Port), Host Loop address 0xffff
scsi-qla0-adapter-node=200000e08b04b77e\;
scsi-qla0-adapter-port=210000e08b04b77e\;
scsi-qla0-tgt-0-di-0-port=5005076300442701\;
scsi-qla0-tgt-1-di-0-port=5005076300442702\;
scsi-qla0-tgt-2-di-0-port=5005076300442703\;
scsi-qla0-tgt-3-di-0-port=210000a0b808bfef\;
scsi-qla0-tgt-4-di-0-port=5005076300443001\;
scsi-qla0-tgt-5-di-0-port=5005076300443002\;
scsi-qla0-tgt-6-di-0-port=5005076300443003\;
scsi-qla0-tgt-7-di-0-port=210000a0b808bfee\;
qla2x00_detect num_hosts=0
scsi3 : QLogic QLA2200 PCI to Fibre Channel Host Adapter: bus 1 device 12
irq 11
Firmware version: 2.02.06, Driver version 7.03.00
blk: queue f771c818, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: IBM Model: ULT3580-TD1 Rev: 41K0
Type: Sequential-Access ANSI SCSI revision: 03
blk: queue f771c618, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: IBM Model: 03584L32 Rev: 3484
Type: Medium Changer ANSI SCSI revision: 03
blk: queue f771c418, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: IBM Model: ULT3580-TD2 Rev: 4770
Type: Sequential-Access ANSI SCSI revision: 03
blk: queue f771c218, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: IBM Model: ULT3580-TD2 Rev: 4770
Type: Sequential-Access ANSI SCSI revision: 03
blk: queue f771c018, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: LSI Model: ProFibre 4000R Rev: 5902
Type: Direct-Access ANSI SCSI revision: 02
blk: queue f755de18, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: LSI Model: ProFibre 4000R Rev: 5902
Type: Direct-Access ANSI SCSI revision: 02
blk: queue f755dc18, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: LSI Model: ProFibre 4000R Rev: 5902
Type: Direct-Access ANSI SCSI revision: 02
blk: queue f755da18, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: IBM Model: ULT3580-TD1 Rev: 41K0
Type: Sequential-Access ANSI SCSI revision: 03
blk: queue f755d818, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: IBM Model: 03584L32 Rev: 3484
Type: Medium Changer ANSI SCSI revision: 03
blk: queue f755d618, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: IBM Model: ULT3580-TD2 Rev: 3AP0
Type: Sequential-Access ANSI SCSI revision: 03
blk: queue f755d418, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: IBM Model: ULT3580-TD2 Rev: 3AP0
Type: Sequential-Access ANSI SCSI revision: 03
blk: queue f755d218, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: LSI Model: ProFibre 4000R Rev: 5902
Type: Direct-Access ANSI SCSI revision: 02
blk: queue f755d018, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: LSI Model: ProFibre 4000R Rev: 5902
Type: Direct-Access ANSI SCSI revision: 02
blk: queue f744ae18, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
Vendor: LSI Model: ProFibre 4000R Rev: 5902
Type: Direct-Access ANSI SCSI revision: 02
blk: queue f744ac18, I/O limit 4294967295Mb (mask 0xffffffffffffffff)
scsi(3:0:3:0): Enabled tagged queuing, queue depth 32.
scsi(3:0:3:1): Enabled tagged queuing, queue depth 32.
scsi(3:0:3:2): Enabled tagged queuing, queue depth 32.
scsi(3:0:7:0): Enabled tagged queuing, queue depth 32.
scsi(3:0:7:1): Enabled tagged queuing, queue depth 32.
scsi(3:0:7:2): Enabled tagged queuing, queue depth 32.
Attached scsi disk sdj at scsi3, channel 0, id 3, lun 0
Attached scsi disk sdk at scsi3, channel 0, id 3, lun 1
Attached scsi disk sdl at scsi3, channel 0, id 3, lun 2
Attached scsi disk sdm at scsi3, channel 0, id 7, lun 0
Attached scsi disk sdn at scsi3, channel 0, id 7, lun 1
Attached scsi disk sdo at scsi3, channel 0, id 7, lun 2
PCI: Found IRQ 15 for device 00:08.0
IRQ routing conflict for 00:08.0, have irq 10, want irq 15
PCI: Found IRQ 11 for device 00:0a.0
scsi4 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
<Adaptec 2944 Ultra SCSI adapter>
aic7880: Ultra Wide Channel A, SCSI Id=7, 16/253 SCBs
scsi5 : Adaptec AIC7XXX EISA/VLB/PCI SCSI HBA DRIVER, Rev 6.2.36
<Adaptec 2944 Ultra SCSI adapter>
aic7880: Ultra Wide Channel A, SCSI Id=7, 16/253 SCBs
blk: queue f73bb418, I/O limit 4095Mb (mask 0xffffffff)
scsi(3): Topology - (F_Port), Host Loop address 0xffff
Vendor: ATL Model: ACL2640 206 Rev: 1F5A
Type: Medium Changer ANSI SCSI revision: 02
blk: queue f73bb218, I/O limit 4095Mb (mask 0xffffffff)
(scsi4:A:3): 20.000MB/s transfers (10.000MHz, offset 8, 16bit)
Vendor: QUANTUM Model: DLT7000 Rev: 245F
Type: Sequential-Access ANSI SCSI revision: 02
blk: queue f73c0618, I/O limit 4095Mb (mask 0xffffffff)
(scsi4:A:4): 20.000MB/s transfers (10.000MHz, offset 8, 16bit)
Vendor: QUANTUM Model: DLT7000 Rev: 245F
Type: Sequential-Access ANSI SCSI revision: 02
blk: queue f73b3e18, I/O limit 4095Mb (mask 0xffffffff)
(scsi4:A:5): 20.000MB/s transfers (10.000MHz, offset 8, 16bit)
Vendor: QUANTUM Model: DLT7000 Rev: 2565
Type: Sequential-Access ANSI SCSI revision: 02
blk: queue f73c0818, I/O limit 4095Mb (mask 0xffffffff)
Vendor: ATL Model: ACL2640 206 Rev: 1G5A
Type: Medium Changer ANSI SCSI revision: 02
blk: queue f73bb618, I/O limit 4095Mb (mask 0xffffffff)
(scsi5:A:3): 20.000MB/s transfers (10.000MHz, offset 8, 16bit)
Vendor: QUANTUM Model: DLT7000 Rev: 2565
Type: Sequential-Access ANSI SCSI revision: 02
blk: queue f73b3a18, I/O limit 4095Mb (mask 0xffffffff)
scsi5:A:4): 20.000MB/s transfers (10.000MHz, offset 8, 16bit)
Vendor: QUANTUM Model: DLT7000 Rev: 1E48
Type: Sequential-Access ANSI SCSI revision: 02
blk: queue f73bb818, I/O limit 4095Mb (mask 0xffffffff)
(scsi5:A:5): 20.000MB/s transfers (10.000MHz, offset 8, 16bit)
Vendor: QUANTUM Model: DLT7000 Rev: 1E48
Type: Sequential-Access ANSI SCSI revision: 02
PCI: Found IRQ 11 for device 00:0f.2
IRQ routing conflict for 00:0f.2, have irq 5, want irq 11
usb-ohci.c: USB OHCI at membase 0xf8915000, IRQ 5
usb-ohci.c: usb-00:0f.2, ServerWorks OSB4/CSB5 OHCI USB Controller
usb.c: new USB bus registered, assigned bus number 1
hub.c: USB hub found
hub.c: 2 ports detected
mice: PS/2 mouse device common for all mice
EXT3-fs: mounted filesystem with ordered data mode.
Attached scsi tape st0 at scsi3, channel 0, id 0, lun 0
Attached scsi tape st1 at scsi3, channel 0, id 1, lun 0
Attached scsi tape st2 at scsi3, channel 0, id 2, lun 0
Attached scsi tape st3 at scsi3, channel 0, id 4, lun 0
Attached scsi tape st4 at scsi3, channel 0, id 5, lun 0
Attached scsi tape st5 at scsi3, channel 0, id 6, lun 0
Attached scsi tape st6 at scsi4, channel 0, id 3, lun 0
Attached scsi tape st7 at scsi4, channel 0, id 4, lun 0
Attached scsi tape st8 at scsi4, channel 0, id 5, lun 0
Attached scsi tape st9 at scsi5, channel 0, id 3, lun 0
Attached scsi tape st10 at scsi5, channel 0, id 4, lun 0
Attached scsi tape st11 at scsi5, channel 0, id 5, lun 0
Attached scsi generic sg10 at scsi3, channel 0, id 0, lun 1, type 8
Attached scsi generic sg17 at scsi3, channel 0, id 4, lun 1, type 8
Attached scsi generic sg23 at scsi4, channel 0, id 2, lun 0, type 8
Attached scsi generic sg27 at scsi5, channel 0, id 2, lun 0, type 8
inserting floppy driver for 2.4.21-27.0.2.ELsmp
Floppy drive(s): fd0 is 1.44M
FDC 0 is a National Semiconductor PC87306
Intel(R) PRO/100 Network Driver - version 2.3.43-k1
PCI: Found IRQ 9 for device 00:04.0
IRQ routing conflict for 00:04.0, have irq 11, want irq 9
divert: allocating divert_blk for eth0
e100: selftest OK.
e100: eth0: Intel(R) PRO/100 Network Connection
Hardware receive checksums enabled
cpu cycle saver enabled
Intel(R) PRO/1000 Network Driver - version 5.3.19-k2-NAPI
Copyright (c) 1999-2004 Intel Corporation.
PCI: Found IRQ 5 for device 03:08.0
IRQ routing conflict for 03:08.0, have irq 11, want irq 5
e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
divert: allocating divert_blk for eth1
divert: freeing divert_blk for eth0
divert: freeing divert_blk for eth1
ip_tables: (C) 2000-2002 Netfilter core team
Intel(R) PRO/1000 Network Driver - version 5.3.19-k2-NAPI
Copyright (c) 1999-2004 Intel Corporation.
PCI: Found IRQ 5 for device 03:08.0
IRQ routing conflict for 03:08.0, have irq 11, want irq 5
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
divert: allocating divert_blk for eth0
ip_tables: (C) 2000-2002 Netfilter core team
e1000: eth0: e1000_watchdog: NIC Link is Up 1000 Mbps Full Duplex
s
spurious 8259A interrupt: IRQ7.
spurious 8259A interrupt: IRQ15.
hda: attached ide-cdrom driver.
hda: ATAPI 24X CD-ROM drive, 128kB Cache, (U)DMA
Uniform CD-ROM driver Revision: 3.12
parport0: PC-style at 0x378 (0x778) [PCSPP,TRISTATE]
parport0: irq 7 detected
lp0: using parport0 (polling).
Any suggestions are very much appreciated.
Regards,
Kumar
------------------------------------------------------------------
Padiyath Sreekumar | Tel: +41.56.310.3643
Paul Scherrer Institut | email: kumar.padiyath at psi.ch
AIT | Office: WHGA/U132
WHGA/U132 | Fax: +41.56.310.3649
CH-5232 Villigen PSI |
Switzerland |
-----------------------------------------------------------------
More information about the redhat-list
mailing list