[rhos-list] Unable to access Swift using Keystone on reboot

Mon Nov 5 21:05:30 UTC 2012

OK.  I believe my problem with the "swift list" command was due to a 
problem I had with my storage devices.  The original loopback devices that 
I used weren't working properly after I rebooted.  I used the loopback 
device option outlined in the Swift Folsom preview documentation for my 
storage device.  I reconfigured my storage devices using HPSS VFS mount 
points and then tried the "swift list" command and it worked properly with 
no errors.  I then tried to upload some files to Swift using the following 
commands:

head -c 1024 /dev/urandom > data.file ; swift upload c1 data.file
head -c 1024 /dev/urandom > data2.file ; swift upload c1 data2.file
head -c 1024 /dev/urandom > data3.file ; swift upload c2 data2.file

I encountered errors while trying to run these commands.  It was able to 
create the containers but no the objects within the containers.

Message from syslogd at addicks at Nov  5 14:45:35 ...
 �<131>proxy-server ERROR 500 Traceback (most recent call last):#012 File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 810, in 
__call__#012    res = getattr(self, req.method)(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib64/python2.6/contextlib.py", line 34, in __exit__#012 
self.gen.throw(type, value, traceback)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 251, in 
mkstemp#012    yield fd, tmppath#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 275, in 
put#012    write_metadata(fd, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 89, in 
write_metadata#012    setxattr(fd, '%s%s' % (METADATA_KEY, key or ''), 
metastr[:254])#012IOError: [Errno 22] Invalid argument#012 From Object 
Server re: /v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file 
127.0.0.1:6000 (txn: tx2c8deadbd8914ca08c93af9e35c75b53)

Message from syslogd at addicks at Nov  5 14:45:35 ...
 �<131>proxy-server Object PUT returning 503 for [500, 500, 500] (txn: 
tx2c8deadbd8914ca08c93af9e35c75b53) (client_ip: 127.0.0.1)

Message from syslogd at addicks at Nov  5 14:45:36 ...
 �<131>proxy-server ERROR 500 Traceback (most recent call last):#012 File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 810, in 
__call__#012    res = getattr(self, req.method)(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib64/python2.6/contextlib.py", line 34, in __exit__#012 
self.gen.throw(type, value, traceback)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 251, in 
mkstemp#012    yield fd, tmppath#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 275, in 
put#012    write_metadata(fd, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 89, in 
write_metadata#012    setxattr(fd, '%s%s' % (METADATA_KEY, key or ''), 
metastr[:254])#012IOError: [Errno 22] Invalid argument#012 From Object 
Server re: /v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file 
127.0.0.1:6000 (txn: tx0c4164df59a74a1db901378abceb0e89)

Message from syslogd at addicks at Nov  5 14:45:36 ...
 �<131>proxy-server Object PUT returning 503 for [500, 500, 500] (txn: 
tx0c4164df59a74a1db901378abceb0e89) (client_ip: 127.0.0.1)

Message from syslogd at addicks at Nov  5 14:45:38 ...
 �<131>proxy-server ERROR 500 Traceback (most recent call last):#012 File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 810, in 
__call__#012    res = getattr(self, req.method)(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib64/python2.6/contextlib.py", line 34, in __exit__#012 
self.gen.throw(type, value, traceback)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 251, in 
mkstemp#012    yield fd, tmppath#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 275, in 
put#012    write_metadata(fd, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 89, in 
write_metadata#012    setxattr(fd, '%s%s' % (METADATA_KEY, key or ''), 
metastr[:254])#012IOError: [Errno 22] Invalid argument#012 From Object 
Server re: /v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file 
127.0.0.1:6000 (txn: txc8258b68758e4b47b890607aa3b30c17)

Message from syslogd at addicks at Nov  5 14:45:38 ...
 �<131>proxy-server Object PUT returning 503 for [500, 500, 500] (txn: 
txc8258b68758e4b47b890607aa3b30c17) (client_ip: 127.0.0.1)

Message from syslogd at addicks at Nov  5 14:45:42 ...
 �<131>proxy-server ERROR 500 Traceback (most recent call last):#012 File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 810, in 
__call__#012    res = getattr(self, req.method)(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib64/python2.6/contextlib.py", line 34, in __exit__#012 
self.gen.throw(type, value, traceback)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 251, in 
mkstemp#012    yield fd, tmppath#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 275, in 
put#012    write_metadata(fd, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 89, in 
write_metadata#012    setxattr(fd, '%s%s' % (METADATA_KEY, key or ''), 
metastr[:254])#012IOError: [Errno 22] Invalid argument#012 From Object 
Server re: /v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file 
127.0.0.1:6000 (txn: tx59fec9f1365f4d13bfac5c82f89081a1)

Message from syslogd at addicks at Nov  5 14:45:42 ...
 �<131>proxy-server Object PUT returning 503 for [500, 500, 500] (txn: 
tx59fec9f1365f4d13bfac5c82f89081a1) (client_ip: 127.0.0.1)

Message from syslogd at addicks at Nov  5 14:45:51 ...
 �<131>proxy-server ERROR 500 Traceback (most recent call last):#012 File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 810, in 
__call__#012    res = getattr(self, req.method)(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib64/python2.6/contextlib.py", line 34, in __exit__#012 
self.gen.throw(type, value, traceback)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 251, in 
mkstemp#012    yield fd, tmppath#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 275, in 
put#012    write_metadata(fd, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 89, in 
write_metadata#012    setxattr(fd, '%s%s' % (METADATA_KEY, key or ''), 
metastr[:254])#012IOError: [Errno 22] Invalid argument#012 From Object 
Server re: /v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file 
127.0.0.1:6000 (txn: tx828dd3e96e624096bc0320c27c58de6c)

Message from syslogd at addicks at Nov  5 14:45:52 ...
 �<131>proxy-server ERROR 500 Traceback (most recent call last):#012 File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 810, in 
__call__#012    res = getattr(self, req.method)(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib64/python2.6/contextlib.py", line 34, in __exit__#012 
self.gen.throw(type, value, traceback)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 251, in 
mkstemp#012    yield fd, tmppath#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 275, in 
put#012    write_metadata(fd, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 89, in 
write_metadata#012    setxattr(fd, '%s%s' % (METADATA_KEY, key or ''), 
metastr[:254])#012IOError: [Errno 22] Invalid argument#012 From Object 
Server re: /v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file 
127.0.0.1:6000 (txn: tx828dd3e96e624096bc0320c27c58de6c)

Message from syslogd at addicks at Nov  5 14:45:52 ...
 �<131>proxy-server Object PUT returning 503 for [500, 500, 500] (txn: 
tx828dd3e96e624096bc0320c27c58de6c) (client_ip: 127.0.0.1)

Message from syslogd at addicks at Nov  5 14:46:09 ...
 �<131>proxy-server ERROR 500 Traceback (most recent call last):#012 File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 810, in 
__call__#012    res = getattr(self, req.method)(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib64/python2.6/contextlib.py", line 34, in __exit__#012 
self.gen.throw(type, value, traceback)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 251, in 
mkstemp#012    yield fd, tmppath#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in 
PUT#012    file.put(fd, tmppath, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 275, in 
put#012    write_metadata(fd, metadata)#012  File 
"/usr/lib/python2.6/site-packages/swift/obj/server.py", line 89, in 
write_metadata#012    setxattr(fd, '%s%s' % (METADATA_KEY, key or ''), 
metastr[:254])#012IOError: [Errno 22] Invalid argument#012 From Object 
Server re: /v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file 
127.0.0.1:6000 (txn: txb5d4c689af214fd9b451b88d591b0b79)

Message from syslogd at addicks at Nov  5 14:46:09 ...
 �<131>proxy-server Object PUT returning 503 for [500, 500, 500] (txn: 
txb5d4c689af214fd9b451b88d591b0b79) (client_ip: 127.0.0.1)
Object PUT failed: 
http://127.0.0.1:8080/v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file 
503 Internal Server Error
[root at addickslog(keystone_admin)]$ swift list
c1
c2
[root at addickslog(keystone_admin)]$ swift list c1
[root at addickslog(keystone_admin)]$ swift list c2
[root at addickslog(keystone_admin)]$

Please advise.

David Hernandez

Contractor / HPSS
IBM Global Business Services - US Federal
12301 Kurland Dr Suite 300
Houston, TX 77034-4812 
Mobile 713-444-5755

From:   David Hernandez/Houston/Contr/IBM at IBMUS
To:     rhos-list at redhat.com
Date:   11/05/2012 12:17 PM
Subject:        [rhos-list] Unable to access Swift using Keystone on 
reboot
Sent by:        rhos-list-bounces at redhat.com

I reboot my Swift server after days after intitial configuration and tried 
using the "swift list" command and got the following: 

[root at addicks~(keystone_admin)]$ swift list 

Message from syslogd at addicks at Nov  5 12:07:49 ... 
 �<131>proxy-server Account GET returning 503 for (503, 503, 503) (txn: 
tx1dadc7db7836493f85f73057325faf6c) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:07:49 ... 
 �<131>proxy-server ERROR Unhandled exception in request: #012Traceback 
(most recent call last):#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1888, in 
handle_request#012    return handler(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 93, in 
wrapped#012    return func(*a, **kw)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 645, in 
GET#012    return self.GETorHEAD(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1629, in 
GETorHEAD#012    self.account_name)#012Exception: Could not autocreate 
account 'AUTH_91186334603648d78602bf5481e9393f' (txn: 
tx1dadc7db7836493f85f73057325faf6c) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:07:50 ... 
 �<131>proxy-server Account GET returning 503 for (503, 503, 503) (txn: 
tx138f8595d2634c0ca9d82e2f83799b60) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:07:50 ... 
 �<131>proxy-server ERROR Unhandled exception in request: #012Traceback 
(most recent call last):#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1888, in 
handle_request#012    return handler(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 93, in 
wrapped#012    return func(*a, **kw)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 645, in 
GET#012    return self.GETorHEAD(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1629, in 
GETorHEAD#012    self.account_name)#012Exception: Could not autocreate 
account 'AUTH_91186334603648d78602bf5481e9393f' (txn: 
tx138f8595d2634c0ca9d82e2f83799b60) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:07:52 ... 
 �<131>proxy-server Account GET returning 503 for (503, 503, 503) (txn: 
tx63fab3200eed4a17a311cb2fef663906) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:07:52 ... 
 �<131>proxy-server ERROR Unhandled exception in request: #012Traceback 
(most recent call last):#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1888, in 
handle_request#012    return handler(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 93, in 
wrapped#012    return func(*a, **kw)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 645, in 
GET#012    return self.GETorHEAD(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1629, in 
GETorHEAD#012    self.account_name)#012Exception: Could not autocreate 
account 'AUTH_91186334603648d78602bf5481e9393f' (txn: 
tx63fab3200eed4a17a311cb2fef663906) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:07:56 ... 
 �<131>proxy-server Account GET returning 503 for (503, 503, 503) (txn: 
tx1085d568897643b183d4d528fbbc9f24) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:07:56 ... 
 �<131>proxy-server ERROR Unhandled exception in request: #012Traceback 
(most recent call last):#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1888, in 
handle_request#012    return handler(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 93, in 
wrapped#012    return func(*a, **kw)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 645, in 
GET#012    return self.GETorHEAD(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1629, in 
GETorHEAD#012    self.account_name)#012Exception: Could not autocreate 
account 'AUTH_91186334603648d78602bf5481e9393f' (txn: 
tx1085d568897643b183d4d528fbbc9f24) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:08:04 ... 
 �<131>proxy-server Account GET returning 503 for (503, 503, 503) (txn: 
tx435e6a0906104f9f935b09dd9dada55e) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:08:04 ... 
 �<131>proxy-server ERROR Unhandled exception in request: #012Traceback 
(most recent call last):#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1888, in 
handle_request#012    return handler(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 93, in 
wrapped#012    return func(*a, **kw)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 645, in 
GET#012    return self.GETorHEAD(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1629, in 
GETorHEAD#012    self.account_name)#012Exception: Could not autocreate 
account 'AUTH_91186334603648d78602bf5481e9393f' (txn: 
tx435e6a0906104f9f935b09dd9dada55e) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:08:20 ... 
 �<131>proxy-server Account GET returning 503 for (503, 503, 503) (txn: 
tx9d4e10fefe394b349221bb4db5ba85d5) (client_ip: 127.0.0.1) 

Message from syslogd at addicks at Nov  5 12:08:20 ... 
 �<131>proxy-server ERROR Unhandled exception in request: #012Traceback 
(most recent call last):#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1888, in 
handle_request#012    return handler(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 93, in 
wrapped#012    return func(*a, **kw)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 645, in 
GET#012    return self.GETorHEAD(req)#012  File 
"/usr/lib/python2.6/site-packages/swift/proxy/server.py", line 1629, in 
GETorHEAD#012    self.account_name)#012Exception: Could not autocreate 
account 'AUTH_91186334603648d78602bf5481e9393f' (txn: 
tx9d4e10fefe394b349221bb4db5ba85d5) (client_ip: 127.0.0.1) 
Account GET failed: 
http://127.0.0.1:8080/v1/AUTH_91186334603648d78602bf5481e9393f?format=json 
500 Internal Server Error  [first 60 chars of response] 500 Internal 
Server Error 

The server has either erred or is 

Please help. 
Thanks. 

David Hernandez 

Contractor / HPSS 
IBM Global Business Services - US Federal 
12301 Kurland Dr Suite 300 
Houston, TX 77034-4812 
Mobile 713-444-5755 _______________________________________________
rhos-list mailing list
rhos-list at redhat.com
https://www.redhat.com/mailman/listinfo/rhos-list

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/rhos-list/attachments/20121105/bab1793b/attachment.htm>