[Pulp-dev] Pulp 3 Release Process Questions
pthomas at redhat.com
Mon Apr 23 18:27:20 UTC 2018
On Mon, Apr 23, 2018 at 2:01 PM, Robin Chan <rchan at redhat.com> wrote:
> I feel like the Travis change is recent enough that I'm not exactly sure
> how they differ from the Jenkins jobs. Are we all clear on these
> terminology? Aren't there multiple jobs running at different times? I am
> not comfortable enough without the assurance that we are all talking about
> the same things to say we don't need "the Jenkins jobs". I would like for
> some of these discussions around release process and where (and what and
> when) different tests are run be a little bit more collaborative from the
> beginning rather than reactive post-change happening.
> I'm all for making quick incremental changes. I'm happy that there are
> test results that are accessible to everyone. I don't want us to over
> thinking these, but are we sure we don't have any tests that need to stay
> private (do we test for any security type things that might need to be
> embargoed before reported)? I want to make sure we think thing through
> before we start tearing stuff down.
> On Mon, Apr 23, 2018 at 1:37 PM, Brian Bouterse <bbouters at redhat.com>
>> On Mon, Apr 23, 2018 at 1:25 PM, David Davis <daviddavis at redhat.com>
>>> > Are those Travis jobs testing combinations of web servers, AMQP
>>> brokers, databases, etc? If not, is testing across those combinations a
>>> This is definitely the goal. Right now, our build matrix tests against
>>> different databases, different Django versions, and different python
>>> versions. We could look at testing against different webservers but right
>>> now we just use django’s built-in webserver. AMQP is going away though.
>>> > Let's say pulp_file is being tested. Is both it and pulpcore
>>> installed from source? Or is pulpcore installed from egg/wheel?
>>> Yes, we’re testing against source which also allows us to test against
>>> different PRs. Often, a pulpcore change will require a pulp_file change or
>>> vice versa and we just added some functionality recently that actually lets
>>> us test against PRs too. pulp-smash is also running against source or
>>> PRs. IMO, testing against source lets us move faster than testing against
>>> releases. Maybe we can look at switching though once things have stabilized
>>> after the MVP.
>>> > Who is looking at Jenkins jobs? If only QE, why have Jenkins jobs?
>>> I don’t think we need them. We can trigger builds on an as-needed basis
>>> with Travis without making git commits. We’re also running builds nightly
>>> right now with Travis’ cron.
>> I agree we don't need the Jenkins jobs for Pulp3 and they can be deleted.
>> We still need to keep them for Pulp2 because Pulp2 can't run on Travis.
>> Moving to Travis is a big step forward for the community since Travis is
>> readable by the whole Internet while to read Jenkins jobs, you have to be a
>> Red Hat employee.
I admit that I know very little about Travis. So I did some reading up here
Does Travis-ci run only on Ubuntu?
If that is is true, how are we planning to test fedora/centos/rhel ? With
our history of SeLinux issues in pulp2 I would think we need to be running
tests in these as well.
>>> > What does this mean for goals like multi-host testing?
>>> It looks like Travis supports running docker containers so maybe we
>>> could leverage containers to test this sort of setup. There are definitely
>>> limitations of Travis that might require us to move to something more
>>> robust in the future but short-term I think/hope Travis will fit our needs.
>>>  https://github.com/pulp/pulp/pull/3454
>>>  https://github.com/pulp/pulp/pull/3435
>>>  https://docs.travis-ci.com/user/docker/
>>> On Mon, Apr 23, 2018 at 12:10 PM, Jeremy Audet <jaudet at redhat.com>
>>>> Using Travis jobs instead of Jenkins jobs for testing Pulp 3 releases
>>>> begs several questions:
>>>> - Are those Travis jobs testing combinations of web servers, AMQP
>>>> brokers, databases, etc? If not, is testing across those combinations a
>>>> - Let's say pulp_file is being tested. Is both it and pulpcore
>>>> installed from source? Or is pulpcore installed from egg/wheel?
>>>> - Who is looking at Jenkins jobs? If only QE, why have Jenkins
>>>> jobs? (Possible answer: So that we can trigger test runs on an as-needed
>>>> basis, without making new git commits.)
>>>> - What does this mean for goals like multi-host testing? That is,
>>>> what does this mean for the case where a single Pulp 3 application is
>>>> deployed across multiple hosts? Can that be tested with Travis? Pulp Smash
>>>> is architected with this in mind, and it's been a long standing goal. The
>>>> biggest impediment has been the use of legacy Jenkins (1.x) and nodepool,
>>>> and recent upgrades make this a more realistic testing target.
>>>> If these questions have already been considered and answered somewhere,
>>>> please point me to the correct resource.
>> Pulp-dev mailing list
>> Pulp-dev at redhat.com
> Pulp-dev mailing list
> Pulp-dev at redhat.com
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Pulp-dev