High Load and Low CPU & Memory

Troy Knabe knabe at 4j.lane.edu
Mon Mar 2 23:06:35 UTC 2009


Yes.  143 in the r column

vmstat 1
procs -----------memory---------- ---swap-- -----io---- --system--  
-----cpu------
  r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us  
sy id wa st
  0  0      0 33337076 615864 4990876    0    0     0    29    5    3   
1  1 98  0  0
  0  0      0 33337092 615864 4990888    0    0     0   220 1642 6956   
3  1 97  0  0
  0  0      0 33335844 615864 4990888    0    0     0  1856 1631 7090   
4 10 86  0  0
  0  0      0 33335604 615864 4990916    0    0     0    64 1824 5811   
1  1 98  0  0
  1  0      0 33330652 615864 4990916    0    0     0   420 1745 5547   
4  1 95  0  0
  0  0      0 33332156 615864 4990952    0    0     0     0 1451 7076   
2  1 97  0  0
  0  0      0 33332420 615864 4990952    0    0     0  1468 1411 6049   
2  1 98  0  0
  0  0      0 33341000 615864 4990908    0    0     0   596 1879 6981   
4  4 92  0  0
  0  0      0 33341264 615864 4990908    0    0     0    16 2060 7652   
4  1 95  0  0
  0  0      0 33342908 615864 4990936    0    0     0    16 1256 6413   
3  0 96  0  0
  0  0      0 33342924 615864 4990936    0    0     0   672 2263 6586   
2  1 98  0  0
  0  0      0 33342932 615864 4990960    0    0     0   216 1209 4650   
2  0 98  0  0
  0  0      0 33342328 615864 4990960    0    0     0   692 1445 5685   
3  1 97  0  0
  1  0      0 33341096 615864 4991000    0    0     0     0 1571 5542   
1  0 98  0  0
143  0      0 33371968 615864 4991000    0    0     0    20 1510 5516   
2  5 93  0  0
  0  0      0 33380952 615864 4991028    0    0     0  1068 1655  
10354  3  6 91  0  0
  0  0      0 33382332 615864 4991028    0    0     0   316 1200 6029   
1  0 99  0  0
  0  0      0 33382364 615864 4990988    0    0     0   652 1374 4964   
3  3 95  0  0
  0  0      0 33383736 615864 4990988    0    0     0     0 1171 5549   
1  0 99  0  0
  1  0      0 33382800 615864 4991036    0    0     0     0 1272 6309   
4  5 91  0  0
procs -----------memory---------- ---swap-- -----io---- --system--  
-----cpu------
  r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us  
sy id wa st
  1  0      0 33382816 615864 4991036    0    0     0   956 1379 5441   
2  3 95  0  0
  2  0      0 33380948 615864 4991084    0    0     0   232 2410 8702   
3  1 96  1  0
  0  0      0 33382064 615864 4991084    0    0     0   172 1646 9199   
3  2 94  0  0
  0  0      0 33381204 615864 4991116    0    0     0     0 1458 6948   
3  0 97  0  0
  0  0      0 33381592 615864 4991116    0    0     0     0 1453 6442   
2  1 97  0  0
  0  0      0 33381600 615864 4991140    0    0     0     0 1342 5266   
3  1 96  0  0
  0  0      0 33382104 615864 4991140    0    0     0   752 1185 4534   
1  0 99  0  0
  1  0      0 33383112 615864 4991160    0    0     0    60 1188 4629   
1  0 99  0  0
  0  0      0 33383244 615864 4991160    0    0     0     0 1369 8562   
3  1 97  0  0
  0  0      0 33382764 615864 4991184    0    0     0     0 1289 4830   
1  0 98  0  0
  0  0      0 33394136 615864 4991184    0    0     0     0 1343 5320   
3  3 94  0  0
  0  0      0 33392780 615864 4991228    0    0     0   188 1410 4751   
2  1 97  0  0
  0  0      0 33392796 615864 4991228    0    0     0   124 1254 4594   
0  0 99  0  0
  2  0      0 33393648 615864 4991240    0    0     0     0 1690 6993   
4  2 94  0  0
  1  0      0 33390920 615864 4991240    0    0     0     0 1185 6143   
8 17 74  0  0
  1  0      0 33387340 615864 4991260    0    0     0     0 1713 8093  
12 18 71  0  0
  1  0      0 33388100 615864 4991260    0    0     0   280 1453 8055   
9 18 73  0  0
  1  0      0 33387860 615864 4991280    0    0     0  2092 1541 7539   
8 26 66  0  0
  1  0      0 33387248 615864 4991280    0    0     0     0 2355 6456  
10 17 73  0  0

On Mar 2, 2009, at 2:49 PM, Furnish, Trever G wrote:

>> sysstat is installed, but the spikes seem to be happening so  
>> quickly I
>> can't get a read on it.  For instance, "top" is running and all of  
>> the
>> sudden load average was 20, but cpu is 95% idle.
>
> Hmmm.  The RHEL install of sar defaults to collection every 10  
> minutes,
> which isn't frequent enough for my tastes.  Smoothes out the spikes  
> too
> much.
>
> If you let 'vmstat 1' or 'vmstat 5' run, do you see spikes in the  
> 'r' or
> 'b' columns?
>
>
>> -----Original Message-----
>> From: redhat-list-bounces at redhat.com [mailto:redhat-list-
>> bounces at redhat.com] On Behalf Of Troy Knabe
>> Sent: Monday, March 02, 2009 4:51 PM
>> To: General Red Hat Linux discussion list
>> Subject: Re: High Load and Low CPU & Memory
>>
>>
>> On Mar 2, 2009, at 1:24 PM, Furnish, Trever G wrote:
>>
>>> Do your iowait percentages go up in top?  Perhaps you have an
>>> i/o-related problem.
>>
>> No, %wa is 0%
>>
>>>
>>> Are your network cards running at the same duplex as your connected
>>> switch ports?
>>
>> Yes they are 1000 Full Duplex
>>
>>>
>>> Is kswapd busy (ie your system's thrashing) during the spikes?
>>
>> No.
>>
>>>
>>> You might get useful records by installing the sysstat package and
>>> then
>>> configuring sar to run every minute, then using sar to report on the
>>> collected data.
>>>
>>
>> sysstat is installed, but the spikes seem to be happening so  
>> quickly I
>> can't get a read on it.  For instance, "top" is running and all of  
>> the
>> sudden load average was 20, but cpu is 95% idle.
>>
>>
>>>
>>>
>>>> -----Original Message-----
>>>> From: redhat-list-bounces at redhat.com [mailto:redhat-list-
>>>> bounces at redhat.com] On Behalf Of Troy Knabe
>>>> Sent: Monday, March 02, 2009 4:05 PM
>>>> To: Red Hat
>>>> Subject: High Load and Low CPU & Memory
>>>>
>>>> I have some brand new servers with 2 - Dual Core Xeons 3.33 Ghz and
>>>> 48Gb of RAM.  Intermittently they are spiking to high load averages
>>>> 5+
>>>> or sometimes even 10+ and the application (oracle application
>> server)
>>>> becomes unresponsive.  We are moving them from 2 - Dual Core
>> Opterons
>>>> 2.4 Ghz and 12GB of RAM, and never experienced this type of
>>>> situation.  Can anyone give me some suggestions on where to start
>>>> looking?
>>>>
>>>> I am using Kerberos/LDAP authentication/authorization for the new
>>>> ones, but the ldap servers do not appear to be the issue.  The
>> oracle
>>>> user is local to each server.
>>>>
>>>> Thanks
>>>> -Troy
>>>>
>>>>
>>>> --
>>>> redhat-list mailing list
>>>> unsubscribe mailto:redhat-list-
>> request at redhat.com?subject=unsubscribe
>>>> https://www.redhat.com/mailman/listinfo/redhat-list
>>>
>>> --
>>> redhat-list mailing list
>>> unsubscribe
> mailto:redhat-list-request at redhat.com?subject=unsubscribe
>>> https://www.redhat.com/mailman/listinfo/redhat-list
>>
>> --
>> redhat-list mailing list
>> unsubscribe mailto:redhat-list-request at redhat.com?subject=unsubscribe
>> https://www.redhat.com/mailman/listinfo/redhat-list
>
> -- 
> redhat-list mailing list
> unsubscribe mailto:redhat-list-request at redhat.com?subject=unsubscribe
> https://www.redhat.com/mailman/listinfo/redhat-list




More information about the redhat-list mailing list