From prentice at ias.edu Tue Nov 1 16:38:11 2011 From: prentice at ias.edu (Prentice Bisbal) Date: Tue, 01 Nov 2011 12:38:11 -0400 Subject: [rhelv6-list] You suggestion for 'big' filesystem management Best Practice? In-Reply-To: <4EAAE740.3040702@jila.colorado.edu> References: <4EAA68EA.9020102@filmakademie.de> <4EAAB45B.1010906@jila.colorado.edu> <4EAAE740.3040702@jila.colorado.edu> Message-ID: <4EB02073.9090402@ias.edu> On 10/28/2011 01:32 PM, Peter Ruprecht wrote: > Greg Swift wrote: >> On Fri, Oct 28, 2011 at 11:30, Masopust, Christian >> > > wrote: >> >> >> > G?tz Reinicke wrote: >> > > Hi, >> > > >> > > we plan to set up a big file storage for media files like >> > uncompressed >> > > movies from student film projects, dvd images etc. >> > > >> > > It should be some sort of archive and will not bee accessed >> > by more than >> > > may be 5 people at the same time. >> > > >> > > The iSCSI RAID we have is about 26TB netto and I'm again >> > faced with the >> > > question: How many partitions, which filesystem, which >> > mount options etc. >> > > >> > > For the User it would be the most simpel thing, to have one big >> > > filesystem she/he could fill with all the data and dont has >> > to search >> > > e.g. on multiple volumes. >> > > >> > > On the other hand, if one big filesystem crashes or has do >> > be checked it >> > > will destroy a lot of data or the check will take hours ... >> > > >> > > >> > > Any suggestions pro or cons are welcome! :-) >> > > >> > > My favourite for now is 3 to 4 filesystems with the default >> ext4 >> > > settings. (Redhat EL 5.7, may be soon 6.1) >> > > >> > > Thanks and best regards. G?tz >> > >> > If you decide to go with RHEL6, xfs is a good bet for making >> one big >> > filesystem. We have a setup similar to what you're >> > describing and have >> > had very solid stability and performance using xfs (default >> > filesystem >> > and mount settings.) As far as I can see (and knocking on >> > wood), xfs is >> > now a lot less flaky than it seemed to be in the past. >> > >> > -Peter >> >> I can approve what Peter mentioned. I've been using xfs on my >> CentOS 5 system with 2 16TB arrays (each holding one single >> filesystem) >> for several years with absolutely no issues! >> >> >> So in his intial request he mentioned concern about fsck times. How >> has this been for you guys (Christian and Peter) ? >> >> fwiw, I'm actually mixing both xfs with 30+TB total file system and >> gluster in a different use case... I just haven't had to fsck a >> system yet so I am very curious about how that is performing for others. >> >> -greg > > In testing, I purposely crashed the system while under light-moderate > I/O load, and the xfs fs didn't need any recovery when it was > remounted. I don't have any real-world experience with how long it > would take to xfs_check and xfs_repair a fs of that size that had > gotten corrupted, sorry. Though I will not be disappointed if I > manage to avoid gaining that experience! > > -Peter > I used to manage a handful of SGI's running IRIX on XFS. If I recall correctly, an XFS filesystem should NEVER need an fsck or xfs_repair. Of course, it's the vendor who says that, not the sys admins working in the trenches with XFS. In fact, I don't even think those utilities are installed as part of the OS - I'm pretty sure I had to install them manually myself. That was a few years ago, so my memory might be a bit hazy. Prentice From carlopmart at gmail.com Fri Nov 4 10:58:15 2011 From: carlopmart at gmail.com (carlopmart) Date: Fri, 04 Nov 2011 11:58:15 +0100 Subject: [rhelv6-list] Disable learn on a kvm bridge Message-ID: <4EB3C547.4020600@gmail.com> Hi all, I need to disable learn on a specific kvm bridge on a RHEL6.1 host. Reading brctl's manpage I see this: "The aging time is the number of seconds a MAC address will be kept in the forwarding database after having received a packet from this MAC address."But after this, it says "Setting ageing time to zero makes all entries permanent.". Then for disable learn on a kvm bridge, do I need to configure setaging to zero or not?? Thanks. -- CL Martinez carlopmart {at} gmail {d0t} com From list at fajar.net Sat Nov 5 13:56:48 2011 From: list at fajar.net (Fajar A. Nugraha) Date: Sat, 5 Nov 2011 13:56:48 +0000 (UTC) Subject: [rhelv6-list] Kernel memory leak? References: <4E5C1051.7070207@abdussamad.com> <4E5C2B70.2080406@abdussamad.com> Message-ID: Micky Martin writes: > > John Haxby writes: > > > > > > > On 13 September 2011 15:01, MickyMartin gmail.com> wrote: > > [...] 3 out of 8GB consumed in cache. [...] > > > > > > ?Do you mean consumed by dentry_cache (as shown in slabtop)???? (Which is what > everyone else was talking about.)? Or do you really mean the cache as reported > by free(1)?jch > > > > > > > > Yup, same like others. > > But hold on, cause later I stumbled upon some of the centos unreleased kernels > and using those I cannot replicate the leak. I am still testing them and will > post back the results here. > For anyone that's still having the same problem: http://rackerhacker.com/2008/12/03/reducing-inode-and-dentry-caches-to-keep-oom- killer-at-bay/ My system is a simple web-server with about 300GB static content on ext4 (noatime), 1GB memory. With RHEL6's kernel-2.6.32-131.17.1.el6.x86_64 I still had large memory usage problem. However: - If I don't set anything, after some time (about 1 day) memory usage (as reported by htop) will climb close to all available memory, and http access will be dreadfully slow. - If I use "echo 2 > /proc/sys/vm/drop_caches" every hour or so, memory usage would always stay around 100-130 MB (about same amount just after boot), and http access is fast - If I set /proc/sys/vm/vfs_cache_pressure at 1000 (via sysctl.conf), memory usage would usually hover around 700-900MB, but if anything needs lots of memory (e.g. copying lots amount of data to tmpfs) it's usage would drop back to around 100-130MB mark. http access remains fast. This is the solution I'm using now, as it still allows memory to be used for cache when it's not needed for anything else. -- Fajar From darren.patterson at stanford.edu Wed Nov 9 00:47:16 2011 From: darren.patterson at stanford.edu (Darren Patterson) Date: Tue, 8 Nov 2011 16:47:16 -0800 Subject: [rhelv6-list] 'kvm' or 'qemu-kvm' package? Message-ID: I had a user ask me about installing KVM on RHEL6. The instructions* state to install package 'kvm', but I'm only seeing package 'qemu-kvm' in RHN. Entitlements are set to Virtualization. I don't have a test box for this to verify at the moment (except for VMware VMs), so that makes this different. Am I missing something obvious? Thanks, -darren * http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Virtualization/sect-Virtualization-Installing_the_virtualization_packages-Installing_KVM_packages_on_an_existing_Red_Hat_Enterprise_Linux_system.html -------------- next part -------------- An HTML attachment was scrubbed... URL: From amyagi at gmail.com Wed Nov 9 02:04:36 2011 From: amyagi at gmail.com (Akemi Yagi) Date: Tue, 8 Nov 2011 18:04:36 -0800 Subject: [rhelv6-list] 'kvm' or 'qemu-kvm' package? In-Reply-To: References: Message-ID: On Tue, Nov 8, 2011 at 4:47 PM, Darren Patterson wrote: > I had a user ask me about installing KVM on RHEL6. ?The instructions* state > to install package 'kvm', but I'm only seeing package 'qemu-kvm' in RHN. > ?Entitlements are set to Virtualization. ? I don't have a test box for this > to verify at the moment (except for VMware VMs), so that makes this > different. ?Am I missing something obvious? > Thanks, > > -darren > *?http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/Virtualization/sect-Virtualization-Installing_the_virtualization_packages-Installing_KVM_packages_on_an_existing_Red_Hat_Enterprise_Linux_system.html Actually the instructions are correct (although they may be confusing). 'yum install kvm' will install qemu-kvm and its dependencies. This is because the quem-kvm package Provides: kvm. Akemi From goetz.reinicke at filmakademie.de Fri Nov 18 09:54:59 2011 From: goetz.reinicke at filmakademie.de (=?ISO-8859-15?Q?G=F6tz_Reinicke?=) Date: Fri, 18 Nov 2011 10:54:59 +0100 Subject: [rhelv6-list] yum update fails / problem Message-ID: <4EC62B73.3020802@filmakademie.de> Hi, may be someone has an idea what's broken on one of our RH EL 6.1 server. I tried all suggestions from the centosforum http://www.centos.org/modules/newbb/viewtopic.php?topic_id=20237 but without success. Thanks for any suggestion . best Regards . G?tz Loaded plugins: rhnplugin Traceback (most recent call last): File "/usr/bin/yum", line 29, in yummain.user_main(sys.argv[1:], exit_code=True) File "/usr/share/yum-cli/yummain.py", line 274, in user_main errcode = main(args) File "/usr/share/yum-cli/yummain.py", line 129, in main result, resultmsgs = base.doCommands() File "/usr/share/yum-cli/cli.py", line 432, in doCommands self._getTs(needTsRemove) File "/usr/lib/python2.6/site-packages/yum/depsolve.py", line 99, in _getTs self._getTsInfo(remove_only) File "/usr/lib/python2.6/site-packages/yum/depsolve.py", line 110, in _getTsInfo pkgSack = self.pkgSack File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 882, in pkgSack = property(fget=lambda self: self._getSacks(), File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 668, in _getSacks self.repos.populateSack(which=repos) File "/usr/lib/python2.6/site-packages/yum/repos.py", line 260, in populateSack self.doSetup() File "/usr/lib/python2.6/site-packages/yum/repos.py", line 72, in doSetup self.ayum.plugins.run('prereposetup') File "/usr/lib/python2.6/site-packages/yum/plugins.py", line 184, in run func(conduitcls(self, self.base, conf, **kwargs)) File "/usr/share/yum-plugins/rhnplugin.py", line 121, in prereposetup_hook str(e)) File "/usr/share/rhn/up2date_client/up2dateErrors.py", line 177, in __repr__ "The message was:\n") + self.errmsg UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 6: ordinal not in range(128) -- G?tz Reinicke IT-Koordinator Tel. +49 7141 969 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke at filmakademie.de Filmakademie Baden-W?rttemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: J?rgen Walter MdL Staatssekret?r im Ministerium f?r Wissenschaft, Forschung und Kunst Baden-W?rttemberg Gesch?ftsf?hrer: Prof. Thomas Schadt -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5161 bytes Desc: S/MIME Kryptografische Unterschrift URL: From gcraciun at transfond.ro Fri Nov 18 10:28:00 2011 From: gcraciun at transfond.ro (Gabriel S. Craciun) Date: Fri, 18 Nov 2011 10:28:00 +0000 Subject: [rhelv6-list] yum update fails / problem In-Reply-To: <4EC62B73.3020802@filmakademie.de> References: <4EC62B73.3020802@filmakademie.de> Message-ID: <18ACE6C30FF1454D93B4C039FB62EA762510B89B@SPO-MAIL.stfd.ro> Quote users at lists.fedoraproject.org: http://comments.gmane.org/gmane.linux.redhat.fedora.general/384432 "It seems that there are characters on your system that are not in the ASCII range. In particular, character 0xc3. For some reason, your version of python is not using UTF-8, which I thought was now the norm. You can try running yum clean metadata or yum clean all to clear out possibly erroneous information, and run yum update or whatever you want." Hope that helpS! -----Original Message----- From: rhelv6-list-bounces at redhat.com [mailto:rhelv6-list-bounces at redhat.com] On Behalf Of G?tz Reinicke Sent: Friday, November 18, 2011 11:55 AM To: rhelv6-list at redhat.com >> "'rhelv6-list at redhat.com'" Subject: [rhelv6-list] yum update fails / problem Hi, may be someone has an idea what's broken on one of our RH EL 6.1 server. I tried all suggestions from the centosforum http://www.centos.org/modules/newbb/viewtopic.php?topic_id=20237 but without success. Thanks for any suggestion . best Regards . G?tz Loaded plugins: rhnplugin Traceback (most recent call last): File "/usr/bin/yum", line 29, in yummain.user_main(sys.argv[1:], exit_code=True) File "/usr/share/yum-cli/yummain.py", line 274, in user_main errcode = main(args) File "/usr/share/yum-cli/yummain.py", line 129, in main result, resultmsgs = base.doCommands() File "/usr/share/yum-cli/cli.py", line 432, in doCommands self._getTs(needTsRemove) File "/usr/lib/python2.6/site-packages/yum/depsolve.py", line 99, in _getTs self._getTsInfo(remove_only) File "/usr/lib/python2.6/site-packages/yum/depsolve.py", line 110, in _getTsInfo pkgSack = self.pkgSack File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 882, in pkgSack = property(fget=lambda self: self._getSacks(), File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 668, in _getSacks self.repos.populateSack(which=repos) File "/usr/lib/python2.6/site-packages/yum/repos.py", line 260, in populateSack self.doSetup() File "/usr/lib/python2.6/site-packages/yum/repos.py", line 72, in doSetup self.ayum.plugins.run('prereposetup') File "/usr/lib/python2.6/site-packages/yum/plugins.py", line 184, in run func(conduitcls(self, self.base, conf, **kwargs)) File "/usr/share/yum-plugins/rhnplugin.py", line 121, in prereposetup_hook str(e)) File "/usr/share/rhn/up2date_client/up2dateErrors.py", line 177, in __repr__ "The message was:\n") + self.errmsg UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 6: ordinal not in range(128) -- G?tz Reinicke IT-Koordinator Tel. +49 7141 969 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke at filmakademie.de Filmakademie Baden-W?rttemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: J?rgen Walter MdL Staatssekret?r im Ministerium f?r Wissenschaft, Forschung und Kunst Baden-W?rttemberg Gesch?ftsf?hrer: Prof. Thomas Schadt -------------------------------- NOTICE OF CONFIDENTIALITY This E-mail message and its attachments (if any) are intended solely for the use of the addressees hereof. In addition, this message and the attachments (if any) may contain information that is confidential, privileged and exempt from disclosure under applicable law. If you are not the intended recipient of this message, you are prohibited from reading, disclosing, reproducing, distributing, disseminating or otherwise using this transmission. Delivery of this message to any person other than the intended recipient is not intended to waive any right or privilege. If you have received this message in error, please promptly notify the sender by reply E-mail and immediately delete this message from your system. From goetz.reinicke at filmakademie.de Mon Nov 21 08:11:37 2011 From: goetz.reinicke at filmakademie.de (=?ISO-8859-1?Q?G=F6tz_Reinicke?=) Date: Mon, 21 Nov 2011 09:11:37 +0100 Subject: [rhelv6-list] yum update fails / problem In-Reply-To: <18ACE6C30FF1454D93B4C039FB62EA762510B89B@SPO-MAIL.stfd.ro> References: <4EC62B73.3020802@filmakademie.de> <18ACE6C30FF1454D93B4C039FB62EA762510B89B@SPO-MAIL.stfd.ro> Message-ID: <4ECA07B9.8000300@filmakademie.de> Hi, thanks for your suggestion, but that posting did not help me :-/ I tried a lot of suggested remove, update, rebuild rpm things without success. How might i 'force' python to use UTF-8? Regards Am 18.11.11 11:28, schrieb Gabriel S. Craciun: > Quote users at lists.fedoraproject.org: > > > http://comments.gmane.org/gmane.linux.redhat.fedora.general/384432 > > > > "It seems that there are characters on your system that are not in the > ASCII range. In particular, character 0xc3. For some reason, your > version of python is not using UTF-8, which I thought was now the norm. > > You can try running yum clean metadata or yum clean all to clear > out possibly erroneous information, and run yum update or whatever you > want." > > > Hope that helpS! > > > > > -----Original Message----- > From: rhelv6-list-bounces at redhat.com [mailto:rhelv6-list-bounces at redhat.com] On Behalf Of G?tz Reinicke > Sent: Friday, November 18, 2011 11:55 AM > To: rhelv6-list at redhat.com >> "'rhelv6-list at redhat.com'" > Subject: [rhelv6-list] yum update fails / problem > > Hi, > > may be someone has an idea what's broken on one of our RH EL 6.1 server. > I tried all suggestions from the centosforum > http://www.centos.org/modules/newbb/viewtopic.php?topic_id=20237 but without success. > > Thanks for any suggestion . best Regards . G?tz > > > Loaded plugins: rhnplugin > Traceback (most recent call last): > File "/usr/bin/yum", line 29, in > yummain.user_main(sys.argv[1:], exit_code=True) > File "/usr/share/yum-cli/yummain.py", line 274, in user_main > errcode = main(args) > File "/usr/share/yum-cli/yummain.py", line 129, in main > result, resultmsgs = base.doCommands() > File "/usr/share/yum-cli/cli.py", line 432, in doCommands > self._getTs(needTsRemove) > File "/usr/lib/python2.6/site-packages/yum/depsolve.py", line 99, in _getTs > self._getTsInfo(remove_only) > File "/usr/lib/python2.6/site-packages/yum/depsolve.py", line 110, in _getTsInfo > pkgSack = self.pkgSack > File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 882, in > pkgSack = property(fget=lambda self: self._getSacks(), > File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 668, in _getSacks > self.repos.populateSack(which=repos) > File "/usr/lib/python2.6/site-packages/yum/repos.py", line 260, in populateSack > self.doSetup() > File "/usr/lib/python2.6/site-packages/yum/repos.py", line 72, in doSetup > self.ayum.plugins.run('prereposetup') > File "/usr/lib/python2.6/site-packages/yum/plugins.py", line 184, in run > func(conduitcls(self, self.base, conf, **kwargs)) > File "/usr/share/yum-plugins/rhnplugin.py", line 121, in prereposetup_hook > str(e)) > File "/usr/share/rhn/up2date_client/up2dateErrors.py", line 177, in __repr__ > "The message was:\n") + self.errmsg > UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 6: > ordinal not in range(128) -- G?tz Reinicke IT-Koordinator Tel. +49 7141 969 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke at filmakademie.de Filmakademie Baden-W?rttemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: J?rgen Walter MdL Staatssekret?r im Ministerium f?r Wissenschaft, Forschung und Kunst Baden-W?rttemberg Gesch?ftsf?hrer: Prof. Thomas Schadt -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5161 bytes Desc: S/MIME Kryptografische Unterschrift URL: From goetz.reinicke at filmakademie.de Mon Nov 21 14:54:45 2011 From: goetz.reinicke at filmakademie.de (=?ISO-8859-1?Q?G=F6tz_Reinicke?=) Date: Mon, 21 Nov 2011 15:54:45 +0100 Subject: [rhelv6-list] yum update fails / problem - SOLVED .... strange :-/ In-Reply-To: <4ECA07B9.8000300@filmakademie.de> References: <4EC62B73.3020802@filmakademie.de> <18ACE6C30FF1454D93B4C039FB62EA762510B89B@SPO-MAIL.stfd.ro> <4ECA07B9.8000300@filmakademie.de> Message-ID: <4ECA6635.8050804@filmakademie.de> Hi, searching further more, I got the hint, that it might be a DNS resolving issue. [1] The server with the update problem was resolving at localhost as it is our DNS server. Changing from localhost to the serves IP worked. Strange :-/ Regards . G?tz [1] https://bugzilla.redhat.com/show_bug.cgi?id=504951 Am 21.11.11 09:11, schrieb G?tz Reinicke: > Hi, > > thanks for your suggestion, but that posting did not help me :-/ > > I tried a lot of suggested remove, update, rebuild rpm things without > success. How might i 'force' python to use UTF-8? > > Regards > > Am 18.11.11 11:28, schrieb Gabriel S. Craciun: >> Quote users at lists.fedoraproject.org: >> >> >> http://comments.gmane.org/gmane.linux.redhat.fedora.general/384432 >> >> >> >> "It seems that there are characters on your system that are not in the >> ASCII range. In particular, character 0xc3. For some reason, your >> version of python is not using UTF-8, which I thought was now the norm. >> >> You can try running yum clean metadata or yum clean all to clear >> out possibly erroneous information, and run yum update or whatever you >> want." >> >> >> Hope that helpS! >> >> >> >> >> -----Original Message----- >> From: rhelv6-list-bounces at redhat.com [mailto:rhelv6-list-bounces at redhat.com] On Behalf Of G?tz Reinicke >> Sent: Friday, November 18, 2011 11:55 AM >> To: rhelv6-list at redhat.com >> "'rhelv6-list at redhat.com'" >> Subject: [rhelv6-list] yum update fails / problem >> >> Hi, >> >> may be someone has an idea what's broken on one of our RH EL 6.1 server. >> I tried all suggestions from the centosforum >> http://www.centos.org/modules/newbb/viewtopic.php?topic_id=20237 but without success. >> >> Thanks for any suggestion . best Regards . G?tz >> >> >> Loaded plugins: rhnplugin >> Traceback (most recent call last): >> File "/usr/bin/yum", line 29, in >> yummain.user_main(sys.argv[1:], exit_code=True) >> File "/usr/share/yum-cli/yummain.py", line 274, in user_main >> errcode = main(args) >> File "/usr/share/yum-cli/yummain.py", line 129, in main >> result, resultmsgs = base.doCommands() >> File "/usr/share/yum-cli/cli.py", line 432, in doCommands >> self._getTs(needTsRemove) >> File "/usr/lib/python2.6/site-packages/yum/depsolve.py", line 99, in _getTs >> self._getTsInfo(remove_only) >> File "/usr/lib/python2.6/site-packages/yum/depsolve.py", line 110, in _getTsInfo >> pkgSack = self.pkgSack >> File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 882, in >> pkgSack = property(fget=lambda self: self._getSacks(), >> File "/usr/lib/python2.6/site-packages/yum/__init__.py", line 668, in _getSacks >> self.repos.populateSack(which=repos) >> File "/usr/lib/python2.6/site-packages/yum/repos.py", line 260, in populateSack >> self.doSetup() >> File "/usr/lib/python2.6/site-packages/yum/repos.py", line 72, in doSetup >> self.ayum.plugins.run('prereposetup') >> File "/usr/lib/python2.6/site-packages/yum/plugins.py", line 184, in run >> func(conduitcls(self, self.base, conf, **kwargs)) >> File "/usr/share/yum-plugins/rhnplugin.py", line 121, in prereposetup_hook >> str(e)) >> File "/usr/share/rhn/up2date_client/up2dateErrors.py", line 177, in __repr__ >> "The message was:\n") + self.errmsg >> UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 6: >> ordinal not in range(128) > > > > > _______________________________________________ > rhelv6-list mailing list > rhelv6-list at redhat.com > https://www.redhat.com/mailman/listinfo/rhelv6-list -- G?tz Reinicke IT-Koordinator Tel. +49 7141 969 420 Fax +49 7141 969 55 420 E-Mail goetz.reinicke at filmakademie.de Filmakademie Baden-W?rttemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: J?rgen Walter MdL Staatssekret?r im Ministerium f?r Wissenschaft, Forschung und Kunst Baden-W?rttemberg Gesch?ftsf?hrer: Prof. Thomas Schadt -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5161 bytes Desc: S/MIME Kryptografische Unterschrift URL: From Eirikur.Hjartarson at decode.is Thu Nov 24 12:44:47 2011 From: Eirikur.Hjartarson at decode.is (=?iso-8859-1?Q?Eir=EDkur_Hjartarson?=) Date: Thu, 24 Nov 2011 12:44:47 +0000 Subject: [rhelv6-list] Uninterruptable sleep when accessing nfs Message-ID: <4C3D9F9382FE07458AF8E79B234B4BD8B320C7@smbx.decode.is> Hi all, We are having a bunch of processes going into uninterruptable sleep when accessing nfs-mounted files. Sometimes the processes recover, but sometimes they don't and we must reboot the machine. This is probably associated with quite high load on the NFS server. Below is an example of what we see in the kernel logs. We are running RHEL 6.1, kernel version 2.6.32-131.17.1.el6.x86_64. My question is; is anyone else running RHEL 6.1 seeing these problems and are there any solutions? (There are several reports on the net about similar problems with kernels released within the last year, but I have found no solutions.) --------------------------------------------------------------------------------------------------------------------------------------------- Nov 24 02:05:04 lclcx487 kernel: INFO: task java:12278 blocked for more than 120 seconds. Nov 24 02:05:04 lclcx487 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Nov 24 02:05:04 lclcx487 kernel: java D 0000000000000008 0 12278 12269 0x00000080 Nov 24 02:05:04 lclcx487 kernel: ffff88078bf05c78 0000000000000082 ffff88078bf05bf8 ffffffffa0257ca9 Nov 24 02:05:04 lclcx487 kernel: ffff8805d7c75c00 ffff880969800340 ffff8806872feb60 ffff8805d7c75c08 Nov 24 02:05:04 lclcx487 kernel: ffff88096931ba78 ffff88078bf05fd8 000000000000f598 ffff88096931ba78 Nov 24 02:05:04 lclcx487 kernel: Call Trace: Nov 24 02:05:04 lclcx487 kernel: [] ? rpc_run_task+0xd9/0x130 [sunrpc] Nov 24 02:05:04 lclcx487 kernel: [] ? ktime_get_ts+0xa9/0xe0 Nov 24 02:05:04 lclcx487 kernel: [] ? sync_page+0x0/0x50 Nov 24 02:05:04 lclcx487 kernel: [] io_schedule+0x73/0xc0 Nov 24 02:05:04 lclcx487 kernel: [] sync_page+0x3d/0x50 Nov 24 02:05:04 lclcx487 kernel: [] __wait_on_bit+0x5f/0x90 Nov 24 02:05:04 lclcx487 kernel: [] wait_on_page_bit+0x73/0x80 Nov 24 02:05:04 lclcx487 kernel: [] ? wake_bit_function+0x0/0x50 Nov 24 02:05:04 lclcx487 kernel: [] ? pagevec_lookup_tag+0x25/0x40 Nov 24 02:05:04 lclcx487 kernel: [] wait_on_page_writeback_range+0xfb/0x190 Nov 24 02:05:04 lclcx487 kernel: [] filemap_write_and_wait_range+0x78/0x90 Nov 24 02:05:04 lclcx487 kernel: [] vfs_fsync_range+0x7e/0xe0 Nov 24 02:05:04 lclcx487 kernel: [] vfs_fsync+0x1d/0x20 Nov 24 02:05:04 lclcx487 kernel: [] nfs_file_flush+0x70/0xa0 [nfs] Nov 24 02:05:04 lclcx487 kernel: [] filp_close+0x3c/0x90 Nov 24 02:05:04 lclcx487 kernel: [] sys_close+0xa5/0x100 Nov 24 02:05:04 lclcx487 kernel: [] system_call_fastpath+0x16/0x1b --------------------------------------------------------------------------------------------------------------------------------------------- Regards, -- Eir?kur Hjartarson E-mail: Eirikur.Hjartarson at decode.is deCODE genetics Mobile: +3546641898 Sturlug?tu 7 IS-101 Reykjav?k From alois at astro.ch Sat Nov 26 14:46:04 2011 From: alois at astro.ch (Alois Treindl) Date: Sat, 26 Nov 2011 15:46:04 +0100 Subject: [rhelv6-list] extremely slow (10kb/s) LVS NAT on new RHEL 6 load balancer Message-ID: <4ED0FBAC.70608@astro.ch> I am setting up a new LVS NAT load balancer, running on Redhat Enterprise Linux 6. I have been runnign LVS NAT on RHEL for many years, our current load balancer is on RHEL3, which isno longer supported by Redhat. I have a very strnge problem: performance of http through the LVS is extremely slow at something like 10 kbyte/sec, ridiculous. I have made two approaches for the setup, but arrive at the same problem. kernel: 2.6.32-131.17.1.el6.x86_64 ipvsadm-1.25-9.el6.x86_64 from Centos 6 (becaus my subscription for RHEL6 does not include the load balancing) Approach a) I used my own old scripts based on ldirectord, ipvsadm and iptables to configure and administer my setup as I did on my old LVS. It worked, but as I said, extremely slow. 10 kByte/second !!!! For the moment, I only set up http Approach b) I installed piranha-gui (piranha-0.8.5-7.el6.x86_64, also from centos6) and configured the NAT lvs with it. The simple setup looks like this: TCP (my virtual ip):http wlc persistent 60 -> w2:http Masq 1000 0 0 -> w3:http Masq 1000 0 0 -> w4:http Masq 1000 0 0 Routing in the NAT LVS is: Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface 192.53.104.0 0.0.0.0 255.255.255.128 U 0 0 0 eth1 10.1.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0 0.0.0.0 192.53.104.62 0.0.0.0 UG 0 0 0 eth1 routing in a real server is: Destination Gateway Genmask Flags Metric Ref Use Iface 10.1.1.0 0.0.0.0 255.255.255.0 U 0 0 0 em1 0.0.0.0 10.1.1.254 0.0.0.0 UG 0 0 0 em1 currently empty iptables: iptables -L Chain INPUT (policy ACCEPT) target prot opt source destination Chain FORWARD (policy ACCEPT) target prot opt source destination Chain OUTPUT (policy ACCEPT) target prot opt source destination ip6tables dito Is something broken in RHEL6 regarding LVS NAT use? Or am I doing something stupid without noticing? I need to get this thing running over the weekend, but am running against a wall! From alois at astro.ch Sat Nov 26 18:43:32 2011 From: alois at astro.ch (Alois Treindl) Date: Sat, 26 Nov 2011 19:43:32 +0100 Subject: [rhelv6-list] extremely slow (10kb/s) LVS NAT on new RHEL 6 load balancer In-Reply-To: <4ED0FBAC.70608@astro.ch> References: <4ED0FBAC.70608@astro.ch> Message-ID: <4ED13354.9090600@astro.ch> I used tcpdump to look at the network traffic, looking at both interfaces of the LVS by running two tcdump processes. The httpd real server introduces 200 millisecond delays between packets when sending. When I reconfigure the network so that I can connect directly without LVS to the real server, there are no such delays in the traffic. I (believe to) see the ACK packages from the http client in both cases, they do not seem to get lost. Who/what introduces the delay into this tcp socket, should it not be turned off (via TCP_NODELAY)? How can I look at the properties of he tcp sockets involved in the connection? Any help welcome, I need to get this fixed over the weekend! On 26.11.11 15:46, Alois Treindl wrote: > I am setting up a new LVS NAT load balancer, running on Redhat > Enterprise Linux 6. > > I have been runnign LVS NAT on RHEL for many years, our current load > balancer is on RHEL3, which isno longer supported by Redhat. > > I have a very strnge problem: performance of http through the LVS is > extremely slow at something like 10 kbyte/sec, ridiculous. > > I have made two approaches for the setup, but arrive at the same problem. > > kernel: 2.6.32-131.17.1.el6.x86_64 > ipvsadm-1.25-9.el6.x86_64 from Centos 6 (becaus my subscription for > RHEL6 does not include the load balancing) > > Approach a) > I used my own old scripts based on ldirectord, ipvsadm and iptables > to configure and administer my setup as I did on my old LVS. > It worked, but as I said, extremely slow. 10 kByte/second !!!! > > For the moment, I only set up http > > Approach b) > I installed piranha-gui (piranha-0.8.5-7.el6.x86_64, also from centos6) > and configured the NAT lvs with it. > > The simple setup looks like this: > TCP (my virtual ip):http wlc persistent 60 > -> w2:http Masq 1000 0 0 > -> w3:http Masq 1000 0 0 > -> w4:http Masq 1000 0 0 > > Routing in the NAT LVS is: > Kernel IP routing table > Destination Gateway Genmask Flags Metric Ref Use Iface > 192.53.104.0 0.0.0.0 255.255.255.128 U 0 0 0 eth1 > 10.1.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0 > 0.0.0.0 192.53.104.62 0.0.0.0 UG 0 0 0 eth1 > > routing in a real server is: > Destination Gateway Genmask Flags Metric Ref Use Iface > 10.1.1.0 0.0.0.0 255.255.255.0 U 0 0 0 em1 > 0.0.0.0 10.1.1.254 0.0.0.0 UG 0 0 0 em1 > > currently empty iptables: > iptables -L > Chain INPUT (policy ACCEPT) > target prot opt source destination > Chain FORWARD (policy ACCEPT) > target prot opt source destination > Chain OUTPUT (policy ACCEPT) > target prot opt source destination > > ip6tables dito > > Is something broken in RHEL6 regarding LVS NAT use? > Or am I doing something stupid without noticing? > > I need to get this thing running over the weekend, but am running > against a wall! > > > _______________________________________________ > Please read the documentation before posting - it's available at: > http://www.linuxvirtualserver.org/ > > LinuxVirtualServer.org mailing list - lvs-users at LinuxVirtualServer.org > Send requests to lvs-users-request at LinuxVirtualServer.org > or go to http://lists.graemef.net/mailman/listinfo/lvs-users From solarflow99 at gmail.com Sat Nov 26 18:54:08 2011 From: solarflow99 at gmail.com (solarflow99) Date: Sat, 26 Nov 2011 13:54:08 -0500 Subject: [rhelv6-list] extremely slow (10kb/s) LVS NAT on new RHEL 6 load balancer In-Reply-To: <4ED13354.9090600@astro.ch> References: <4ED0FBAC.70608@astro.ch> <4ED13354.9090600@astro.ch> Message-ID: Why can't you just use direct routing? On Sat, Nov 26, 2011 at 1:43 PM, Alois Treindl wrote: > I used tcpdump to look at the network traffic, looking at both interfaces > of the LVS by running two tcdump processes. > > The httpd real server introduces 200 millisecond delays between packets > when sending. > > When I reconfigure the network so that I can connect directly without LVS > to the real server, there are no such delays in the traffic. > > I (believe to) see the ACK packages from the http client in both cases, > they do not seem to get lost. > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From alois at astro.ch Sat Nov 26 19:09:58 2011 From: alois at astro.ch (Alois Treindl) Date: Sat, 26 Nov 2011 20:09:58 +0100 Subject: [rhelv6-list] extremely slow (10kb/s) LVS NAT on new RHEL 6 load balancer In-Reply-To: References: <4ED0FBAC.70608@astro.ch> <4ED13354.9090600@astro.ch> Message-ID: <4ED13986.8010404@astro.ch> Two reasons: - I have done it for ten years with NAT and am happy with it. - I use the LVS also as firewall (turned off now during testing) and do not want a direct connection from outside to the real servers (i.e. no cable). All traffic must go through the LVS and its firewall. I am sure that you have arguments against NAT, but I am really content with it and do not want to change. I just want the new router to get to work like the old one does since years, with the same configuration, just a new kernel. On 26.11.11 19:54, solarflow99 wrote: > Why can't you just use direct routing? > > > On Sat, Nov 26, 2011 at 1:43 PM, Alois Treindl > wrote: > > I used tcpdump to look at the network traffic, looking at both > interfaces of the LVS by running two tcdump processes. > > The httpd real server introduces 200 millisecond delays between > packets when sending. > > When I reconfigure the network so that I can connect directly > without LVS to the real server, there are no such delays in the traffic. > > I (believe to) see the ACK packages from the http client in both > cases, they do not seem to get lost. > > > > _______________________________________________ > rhelv6-list mailing list > rhelv6-list at redhat.com > https://www.redhat.com/mailman/listinfo/rhelv6-list From alois at astro.ch Sat Nov 26 21:50:12 2011 From: alois at astro.ch (Alois Treindl) Date: Sat, 26 Nov 2011 22:50:12 +0100 Subject: [rhelv6-list] Fwd: Re: [lvs-users] extremely slow (10kb/s) LVS NAT on new RHEL 6 ... solved In-Reply-To: <4ED15EE8.9040108@astro.ch> References: <4ED15EE8.9040108@astro.ch> Message-ID: <4ED15F14.3080904@astro.ch> -------- Original Message -------- Subject: Re: [lvs-users] extremely slow (10kb/s) LVS NAT on new RHEL 6 ... solved Date: Sat, 26 Nov 2011 22:49:28 +0100 From: Alois Treindl To: LinuxVirtualServer.org users mailing list. I read the documentation again, and took this sentence to heart: 7.4. ipvsadm gives wierd erroneous output Symptom: you get inpropriate characters, numbers for IPs, ports, services in the output of ipvsadm Problem: your ipvsadm doesn't match the version of ip_vs. (You may have forgotten to compile the new version of ipvsadm after rebooting the computer following loading the LVS-patched kernel and you're using an old ipvsadm). Solution: get the ipvsadm that matches your ip_vs. I had: kernel: 2.6.32-131.17.1.el6.x86_64 (from Redhat) ipvsadm-1.25-9.el6.x86_64 from Centos 6 But the CentOS kernel in the same repository as ipvsadm is kernel-2.6.32-71.el6.x86_64.rpm on RHEL I have this older kernel of the same generation: 2.6.32-71.29.1.el6.x86_64 When I rebooted with it, the LVS worked!!!!! Thanks for the help, Joseph. It encouraged me that you responded, and made me read the manual again.