<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=us-ascii"> <meta name="Generator" content="Microsoft Word 14 (filtered medium)"> <style></style> </head> <body bgcolor="white" lang="EN-US" link="blue" vlink="purple"> <div class="WordSection1"> I don’t know if this is your issue, but I noticed this: <o:p></o:p> <o:p> </o:p> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: WARNING: Failed to create krb5 context for user with uid 0 for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: WARNING: Failed to create machine krb5 context with credentials cache</code><o:p></o:p> <o:p> </o:p> Who are you “kinit”ed as? Is your idmapper working on both client and server? <o:p></o:p> <o:p> </o:p> Bryce<o:p></o:p> <o:p> </o:p> <div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt"> <div> <div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in"> From: freeipa-users-bounces@redhat.com [mailto:freeipa-users-bounces@redhat.com] On Behalf Of regpm@mccleary.me.uk Sent: Sunday, February 16, 2014 4:49 AM To: freeipa-users@redhat.com Cc: regpm@mccleary.me.uk Subject: [Freeipa-users] Kerberized NFS Mount Issues<o:p></o:p> </div> </div> <o:p> </o:p> Hi, I'm really stuck trying to get kerberized NFS configured via IPA and would be very grateful for any comments or advice based on the info I've provided below. I'm sure this is a very popular kerberized service configured under IPA and I must be missing something obvious. Thanks, Paul ### Background ### I've configured IPA (3.0.0-37.el6) on CentOS 6.5 (2.6.32-431.3.1.el6.x86_64) and have an NFS server and an NFS client (both also CentOS 6.5) configured and working as IPA clients, e.g. can login as an IPA LDAP user. I have tested plain NFSv4 and that works fine:<o:p></o:p> <div style="margin-left:15.0pt;margin-top:3.75pt;margin-right:15.0pt;margin-bottom:15.0pt"> <div style="margin-bottom:1.5pt"> Code:<o:p></o:p> </div> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="2" width="100%" align="center"> </div> <code>Testing Non-Kerberized NFS v4:</code> <code>#####</code> <code>#####</code> <code>Client:</code> <code>[root@nfs-client ~]# mount -v -t nfs4 -o rw,sec=sys nfs-server.example.local:/ /mnt</code> <code>mount.nfs4: timeout set for Sat Feb 15 23:58:23 2014</code> <code>mount.nfs4: trying text-based options 'sec=sys,addr=10.50.0.18,clientaddr=10.50.0.11'</code> <code>nfs-server.example.local:/ on /mnt type nfs4 (rw,sec=sys)</code> <code>[root@nfs-client ~]# df -h /mnt</code> <code>Filesystem Size Used Avail Use% Mounted on</code> <code>nfs-server.example.local:/ 50G 14G 33G 30% /mnt</code> <code>[root@nfs-client ~]# mount|grep nfs</code> <code>sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)</code> <code>nfsd on /proc/fs/nfsd type nfsd (rw)</code> <code>nfs-server.example.local:/ on /mnt type nfs4 (rw,sec=sys,addr=10.50.0.18,clientaddr=10.50.0.11)</code> <code>#####</code> <code>#####</code> <code>Server:</code> <code>[root@nfs-server ~]# cat /etc/exports</code> <code>/pmtest 10.50.0.0/24(rw,sec=sys,fsid=0)</code> <code>[root@nfs-server ~]# exportfs -v</code> <code>/pmtest 10.50.0.0/24(rw,wdelay,root_squash,no_subtree_check,fsid=0,sec=sys,rw,root_squash,no_all_squash)</code> <o:p></o:p> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="2" width="100%" align="center"> </div> </div> When I try to mount using kerberos it fails. I've searched for a number of days and tried many things, but am still stuck. The key error I think is in the NFS server syslog:<o:p></o:p> <div style="margin-left:15.0pt;margin-top:3.75pt;margin-right:15.0pt;margin-bottom:15.0pt"> <div style="margin-bottom:1.5pt"> Code:<o:p></o:p> </div> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="2" width="100%" align="center"> </div> <code>Feb 15 23:43:24 nfs-server rpc.svcgssd[6446]: ERROR: GSS-API: error in handle_nullreq: gss_accept_sec_context(): GSS_S_FAILURE (Unspecified GSS failure. Minor code may provide more information) - Wrong principal in request</code> <code>Feb 15 23:43:24 nfs-server rpc.svcgssd[6446]: ERROR: GSS-API: error in handle_nullreq: gss_accept_sec_context(): GSS_S_FAILURE (Unspecified GSS failure. Minor code may provide more information) - Wrong principal in request</code> <o:p></o:p> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="2" width="100%" align="center"> </div> </div> I don't understand how I have the wrong principal in the krb5.keytab. The various guides I've seen all have a similar keytab config as me, but I really hoped my first attempt using kerberos was going to be very easy as IPA would do all the hard stuff :-) ########################################################### Output and Config Info From Failed Kerberized NFS mount: Both client and server have secure NFS set to yes and name resolution is fine:<o:p></o:p> <div style="margin-left:15.0pt;margin-top:3.75pt;margin-right:15.0pt;margin-bottom:15.0pt"> <div style="margin-bottom:1.5pt"> Code:<o:p></o:p> </div> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="2" width="100%" align="center"> </div> <code>[root@nfs-client ~]# nslookup nfs-server</code> <code>Server: 10.50.0.20</code> <code>Address: 10.50.0.20#53</code> <code>Name: nfs-server.example.local</code> <code>Address: 10.50.0.18</code> <code>[root@nfs-client ~]# nslookup nfs-client</code> <code>Server: 10.50.0.20</code> <code>Address: 10.50.0.20#53</code> <code>Name: nfs-client.example.local</code> <code>Address: 10.50.0.11</code> <code>[root@nfs-server ~]# nslookup nfs-server</code> <code>Server: 10.50.0.20</code> <code>Address: 10.50.0.20#53</code> <code>Name: nfs-server.example.local</code> <code>Address: 10.50.0.18</code> <code>[root@nfs-server ~]# nslookup nfs-client</code> <code>Server: 10.50.0.20</code> <code>Address: 10.50.0.20#53</code> <code>Name: nfs-client.example.local</code> <code>Address: 10.50.0.11</code> <o:p></o:p> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="2" width="100%" align="center"> </div> </div> <div style="margin-bottom:1.5pt"> Code:<o:p></o:p> </div> <div class="MsoNormal" align="center" style="text-align:center"> <hr size="2" width="100%" align="center"> </div> <code>#####</code> <code>#####</code> <code>Client:</code> <code>[root@nfs-client ~]# service iptables status;getenforce</code> <code>iptables: Firewall is not running.</code> <code>Disabled</code> <code>Attempted mount:</code> <code>[root@nfs-client ~]# mount -v -t nfs4 -o rw,sec=krb5 nfs-server.example.local:/ /mnt</code> <code>mount.nfs4: timeout set for Sat Feb 15 23:45:23 2014</code> <code>mount.nfs4: trying text-based options 'sec=krb5,addr=10.50.0.18,clientaddr=10.50.0.11'</code> <code>mount.nfs4: mount(2): Permission denied</code> <code>mount.nfs4: access denied by server while mounting nfs-server.example.local:/</code> <code>/var/log/messages:</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fac70 data 0x7fffaf4fab40</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fac70 data 0x7fffaf4fab40</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fac70 data 0x7fffaf4fab40</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fac70 data 0x7fffaf4fab40</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fac70 data 0x7fffaf4fab40</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: handling gssd upcall (/var/lib/nfs/rpc_pipefs/nfs/clnt0)</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: handle_gssd_upcall: 'mech=krb5 uid=0 enctypes=18,17,16,23,3,1,2 '</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: handling krb5 upcall (/var/lib/nfs/rpc_pipefs/nfs/clnt0)</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: process_krb5_upcall: service is '<null>'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: Full hostname for 'nfs-server.example.local' is 'nfs-server.example.local'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: Full hostname for 'nfs-client.example.local' is 'nfs-client.example.local'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: No key table entry found for <a href="mailto:NFS-CLIENT.EXAMPLE.LOCAL$@EXAMPLE.LOCAL"> NFS-CLIENT.EXAMPLE.LOCAL$@EXAMPLE.LOCAL</a> while getting keytab entry for '<a href="mailto:NFS-CLIENT.EXAMPLE.LOCAL$@EXAMPLE.LOCAL">NFS-CLIENT.EXAMPLE.LOCAL$@EXAMPLE.LOCAL</a>'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: No key table entry found for <a href="mailto:root/nfs-client.example.local@EXAMPLE.LOCAL"> root/nfs-client.example.local@EXAMPLE.LOCAL</a> while getting keytab entry for '<a href="mailto:root/nfs-client.example.local@EXAMPLE.LOCAL">root/nfs-client.example.local@EXAMPLE.LOCAL</a>'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: Success getting keytab entry for '<a href="mailto:nfs/nfs-client.example.local@EXAMPLE.LOCAL">nfs/nfs-client.example.local@EXAMPLE.LOCAL</a>'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: Successfully obtained machine credentials for principal '<a href="mailto:nfs/nfs-client.example.local@EXAMPLE.LOCAL">nfs/nfs-client.example.local@EXAMPLE.LOCAL</a>' stored in ccache '<a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL">FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a>'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: INFO: Credentials in CC '<a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL">FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a>' are good until 1392594203</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: using <a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL"> FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a> as credentials cache for machine creds</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: using environment variable to select krb5 ccache <a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL">FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a></code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: creating context using fsuid 0 (save_uid 0)</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: creating tcp client for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: DEBUG: port already set to 2049</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: creating context with server <a href="mailto:nfs@nfs-server.example.local"> nfs@nfs-server.example.local</a></code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: WARNING: Failed to create krb5 context for user with uid 0 for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: WARNING: Failed to create machine krb5 context with credentials cache <a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL">FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a> for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: WARNING: Machine cache is prematurely expired or corrupted trying to recreate cache for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: Full hostname for 'nfs-server.example.local' is 'nfs-server.example.local'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: Full hostname for 'nfs-client.example.local' is 'nfs-client.example.local'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: No key table entry found for <a href="mailto:NFS-CLIENT.EXAMPLE.LOCAL$@EXAMPLE.LOCAL"> NFS-CLIENT.EXAMPLE.LOCAL$@EXAMPLE.LOCAL</a> while getting keytab entry for '<a href="mailto:NFS-CLIENT.EXAMPLE.LOCAL$@EXAMPLE.LOCAL">NFS-CLIENT.EXAMPLE.LOCAL$@EXAMPLE.LOCAL</a>'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: No key table entry found for <a href="mailto:root/nfs-client.example.local@EXAMPLE.LOCAL"> root/nfs-client.example.local@EXAMPLE.LOCAL</a> while getting keytab entry for '<a href="mailto:root/nfs-client.example.local@EXAMPLE.LOCAL">root/nfs-client.example.local@EXAMPLE.LOCAL</a>'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: Success getting keytab entry for '<a href="mailto:nfs/nfs-client.example.local@EXAMPLE.LOCAL">nfs/nfs-client.example.local@EXAMPLE.LOCAL</a>'</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: INFO: Credentials in CC '<a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL">FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a>' are good until 1392594203</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: INFO: Credentials in CC '<a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL">FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a>' are good until 1392594203</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: using <a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL"> FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a> as credentials cache for machine creds</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: using environment variable to select krb5 ccache <a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL">FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a></code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: creating context using fsuid 0 (save_uid 0)</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: creating tcp client for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: DEBUG: port already set to 2049</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: creating context with server <a href="mailto:nfs@nfs-server.example.local"> nfs@nfs-server.example.local</a></code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: WARNING: Failed to create krb5 context for user with uid 0 for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: WARNING: Failed to create machine krb5 context with credentials cache <a href="FILE:///\\tmp\krb5cc_machine_EXAMPLE.LOCAL">FILE:/tmp/krb5cc_machine_EXAMPLE.LOCAL</a> for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: WARNING: Failed to create machine krb5 context with any credentials cache for server nfs-server.example.local</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: doing error downcall</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fa770 data 0x7fffaf4fa640</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fa770 data 0x7fffaf4fa640</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fa770 data 0x7fffaf4fa640</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fa770 data 0x7fffaf4fa640</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fa770 data 0x7fffaf4fa640</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: dir_notify_handler: sig 37 si 0x7fffaf4fa770 data 0x7fffaf4fa640</code> <code>Feb 15 23:43:23 nfs-client rpc.gssd[1123]: destroying client /var/lib/nfs/rpc_pipefs/nfs/clnt0</code> <code>/etc/krb5.conf</code> <code>includedir /var/lib/sss/pubconf/krb5.include.d/</code> <code>[libdefaults]</code> <code> default_realm = EXAMPLE.LOCAL</code> <code> dns_lookup_realm = false</code> <code> dns_lookup_kdc = true</code> <code> rdns = false</code> <code> ticket_lifetime = 24h</code> <code> forwardable = yes</code> <code> allow_weak_crypto = true</code> <code> permitted_enctypes = des3-cbc-sha1</code> <code>[realms]</code> <code> EXAMPLE.LOCAL = {</code> <code> kdc = ipa-server.example.local:88</code> <code> master_kdc = ipa-server.example.local:88</code> <code> admin_server = ipa-server.example.local:749</code> <code> default_domain = example.local</code> <code> pkinit_anchors = <a href="FILE:///\\etc\ipa\ca.crt">FILE:/etc/ipa/ca.crt</a></code> <code> }</code> <code>[domain_realm]</code> <code> .example.local = EXAMPLE.LOCAL</code> <code> example.local = EXAMPLE.LOCAL</code> <code>/etc/krb5.keytab entries:</code> <code>[root@nfs-client ~]# klist -kte</code> <code>Keytab name: <a href="FILE:///\\etc\krb5.keytab">FILE:/etc/krb5.keytab</a></code> <code>KVNO Timestamp Principal</code> <code>---- ----------------- --------------------------------------------------------</code> <code> 4 02/15/14 23:27:51 <a href="mailto:host/nfs-client.example.local@EXAMPLE.LOCAL"> host/nfs-client.example.local@EXAMPLE.LOCAL</a> (des3-cbc-sha1)</code> <code> 3 02/15/14 23:27:58 <a href="mailto:nfs/nfs-client.example.local@EXAMPLE.LOCAL"> nfs/nfs-client.example.local@EXAMPLE.LOCAL</a> (des3-cbc-sha1)</code> <code>#####</code> <code>#####</code> <code>Server:</code> <code>[root@nfs-server ~]# cat /etc/exports</code> <code>/pmtest 10.50.0.0/24(rw,sec=krb5,fsid=0)</code> <code>[root@nfs-server ~]# exportfs -v</code> <code>/pmtest 10.50.0.0/24(rw,wdelay,root_squash,no_subtree_check,fsid=0,sec=krb5,rw,root_squash,no_all_squash)</code> <code>[root@nfs-server ~]# service iptables status;getenforce</code> <code>iptables: Firewall is not running.</code> <code>Disabled</code> <code>/var/log/messages:</code> <code>Feb 15 23:43:24 nfs-server rpc.svcgssd[6446]: ERROR: GSS-API: error in handle_nullreq: gss_accept_sec_context(): GSS_S_FAILURE (Unspecified GSS failure. Minor code may provide more information) - Wrong principal in request</code> <code>Feb 15 23:43:24 nfs-server rpc.svcgssd[6446]: ERROR: GSS-API: error in handle_nullreq: gss_accept_sec_context(): GSS_S_FAILURE (Unspecified GSS failure. Minor code may provide more information) - Wrong principal in request</code> <code>/etc/krb5.conf</code> <code>includedir /var/lib/sss/pubconf/krb5.include.d/</code> <code>[libdefaults]</code> <code> default_realm = EXAMPLE.LOCAL</code> <code> dns_lookup_realm = true</code> <code> dns_lookup_kdc = true</code> <code> rdns = false</code> <code> ticket_lifetime = 24h</code> <code> forwardable = yes</code> <code> allow_weak_crypto = true</code> <code> permitted_enctypes = des3-cbc-sha1</code> <code>[realms]</code> <code> EXAMPLE.LOCAL = {</code> <code> kdc = ipa-server.example.local:88</code> <code> master_kdc = ipa-server.example.local:88</code> <code> admin_server = ipa-server.example.local:749</code> <code> default_domain = example.local</code> <code> pkinit_anchors = <a href="FILE:///\\etc\ipa\ca.crt">FILE:/etc/ipa/ca.crt</a></code> <code> }</code> <code>[domain_realm]</code> <code> .example.local = EXAMPLE.LOCAL</code> <code> example.local = EXAMPLE.LOCAL</code> <code>/etc/krb5.keytab entries:</code> <code>[root@nfs-server ~]# klist -kte</code> <code>Keytab name: <a href="FILE:///\\etc\krb5.keytab">FILE:/etc/krb5.keytab</a></code> <code>KVNO Timestamp Principal</code> <code>---- ----------------- --------------------------------------------------------</code> <code> 2 02/15/14 23:09:43 <a href="mailto:host/nfs-server.example.local@EXAMPLE.LOCAL"> host/nfs-server.example.local@EXAMPLE.LOCAL</a> (des3-cbc-sha1)</code> <code> 3 02/15/14 23:09:51 <a href="mailto:nfs/nfs-server.example.local@EXAMPLE.LOCAL"> nfs/nfs-server.example.local@EXAMPLE.LOCAL</a> (des3-cbc-sha1)</code> <o:p> </o:p> </div> </div> This electronic message contains information generated by the USDA solely for the intended recipients. Any unauthorized interception of this message or the use or disclosure of the information it contains may violate the law and subject the violator to civil or criminal penalties. If you believe you have received this message in error, please notify the sender and delete the email immediately. </body> </html>