[Freeipa-devel] [PATCH] Patch to allow IPA to work with dogtag 10 on f18

[Martin Kosek]

On 08/08/2012 10:05 PM, Ade Lee wrote:
> Hi, 
> 
> Dogtag 10 is being released on f18, and has a number of changes that
> will affect IPA.  In particular, the following changes will affect
> current IPA code. 
> 
> * The directory layout of the dogtag instance has changed.  Instead of
> using separate tomcat instances to host different subsystems, the
> standard dogtag installation will allow one to install a CA. KRA, OCSP
> and TKS within the same instance.  There have been corresponding changes
> in the directory layout, as well as the default instance name
> (pki-tomcat instead of pki-ca), and startup daemon (pki-tomcatd, instead
> of pki-cad, pki-krad etc.) 
> 
> * The default instance will use only four ports (HTTPS, HTTP, AJP and
> tomcat shutdown port) rather than the 6 previously used.  The default
> ports will be changed to the standard tomcat ports.  As these ports are
> local to the ipa server machine, this should not cause too much
> disruption. 
> 
> * There is a new single step installer written in python.
> (pkispawn/destroy) vs. pkicreate/pkisilent/pkiremove.
> 
> * Dogtag 10 runs on tomcat7 - with a new corresponding version of
> tomcatjss.
> 
> The attached patch integrates all the above changes in IPA installation
> and maintenance code.  Once the patch is applied, users will be able to:
> 
> 1. run ipa-server-install to completion on f18 with dogtag 10.
> 2. install a new replica on f18 on dogtag 10.
> 3. upgrade an f17 machine with an existing IPA instance to f18/ dogtag
> 10 - and have that old-style dogtag instance continue to run correctly.
> This will require the installation of the latest version of tomcatjss as
> well as the installation of tomcat6.  The old-style instance will
> continue to use tomcat6.
> 4. in addition, the new cert renewal code has been patched and should
> continue to work.
> 
> What is not yet completed / supported:
> 
> 1. Installation with an external CA is not yet completed in the new
> installer.  We plan to complete this soon.
> 
> 2. There is some IPA upgrade code that has not yet been touched
> (install/tools/ipa-upgradeconfig).
> 
> 3. A script needs to be written to allow admins to convert their
> old-style dogtag instances to new style instances, as well as code to
> periodically prompt admins to do this.
> 
> 4. Installation of old-style instances using pkicreate/pkisilent on
> dogtag 10 will no longer be supported, and will be disabled soon.
> 
> 5.  The pki-selinux policy has been updated to reflect these changes,
> but is still in flux.  In fact, it is our intention to place the dogtag
> selinux policy in the base selinux policy for f18.  In the meantime, it
> may be necessary to run installs in permissive mode.
> 
> The dogtag 10 code will be released shortly into f18.  Prior to that
> though, we have placed the new dogtag 10 and tomcatjss code in a
> developer repo that is located at 
> http://nkinder.fedorapeople.org/dogtag-devel/
> 
> Testing can be done on both f18 and f17 - although the target platform -
> and the only platform for which official builds will be created is f18.
> 
> Thanks, 
> Ade
> 

Hi Ade,

Thanks for the patch, I started with review and integration tests (currently
running on Fedora 17 with Nathan's repo).

Installation on single master was smooth, it worked just fine, even with
enforced SELinux, without any error - kudos to you and the whole dogtag team.
The resulting logs and the structure of your log directory seems improved. I
believe that the brand new Python installers will make it easier to debug
issues with dogtag installation when they come.  When I tried our unit tests or
some simple cert operation, it worked fine as well.

Now the bad news, or rather few issues and suggestions I found:

1) As we already discussed on IRC, tomcat 7 was not pulled automatically on
Fedora 17 when I updated pki-ca, you somewhere miss a Requires.

2) I had installed IPA with dogtag10 on master. However, CA installation on a
replica (ipa-ca-install) with dogtag9 failed - is this expectable?

3) I had installed IPA with dogtag10 on master. Replica had dogtag10 as well
and I got the following error:

# ipa-ca-install /home/mkosek/replica-info-vm-114.idm.lab.bos.redhat.com.gpg
...
Configuring certificate server: Estimated time 3 minutes 30 seconds
  [1/14]: creating certificate server user
  [2/14]: configuring certificate server instance

Your system may be partly configured.
Run /usr/sbin/ipa-server-install --uninstall to clean up.

Unexpected error - see /var/log/ipareplica-ca-install.log for details:
IOError: [Errno 2] No such file or directory:
'/var/lib/pki/pki-tomcat/alias/ca_backup_keys.p12'

Root cause:
...
  File "/usr/lib/python2.7/site-packages/ipaserver/install/cainstance.py", line
625, in __spawn_instance
    "/root/cacert.p12")
...

4) What ports does replica need to be open on the master when installing a CA?
Currently, ipa-replica-conncheck does a port check and checks only for 7389,
i.e. a port of backend LDAP instance for CA.


Now to the patch itself.

5) The patch needs a rebase

6) The patch itself looks and works fine (with the issues I wrote above), but
there is currently a lot of hard-coded file paths, instance names or ports. I
think it would be really great to move most of this to the platform code
(ipapython/platform/). I think that ideal solution would allow us to choose if
we want to build FreeIPA with dogtag9 or dogtag10 environment in a build time.

I am not saying that it is something you would need to do, its just a proposal
also for other developers. This step would enable us to:
a) Consolidate CA ports, file paths, instance names etc. to one place
b) Easily build IPA to non-Fedora platforms where we still need to use dogtag9

Comments welcome.

Martin