[Avocado-devel] Wrong behaviour with exclusion paths in variants

[Sergey Bronnikov]

Hello,

I am stuck with strange behavior with using option --mux-filter-only.
I use following YAML config:

nightly: !mux
    shutdown:
        test_reference: io-github-autotest-qemu.shutdown

    boot:
        test_reference: io-github-autotest-qemu.boot

versions: !mux
    test_reference_resolver_class: avocado_vt.loader.VirtTestLoader
    timeout: 720
    fedora-27-x86_64:
        mux_suite_test_name_prefix: 'fedora-27-x86_64 '
        test_reference_resolver_args: !!python/dict
            vt_guest_os: Fedora.27.x86_64
            vt_machine_type: q35
    jeos-27-x86_64:
        mux_suite_test_name_prefix: 'jeos-27-x86_64 '
        test_reference_resolver_args: !!python/dict
            vt_guest_os: JeOS.27.x86_64
            vt_machine_type: q35

Avocado successfully generate variants with it:

$ avocado variants -m os.yaml
Multiplex variants (4):
Variant shutdown-fedora-27-x86_64-f4a5:    /run/nightly/shutdown,
/run/versions/fedora-27-x86_64
Variant shutdown-jeos-27-x86_64-5c42:    /run/nightly/shutdown,
/run/versions/jeos-27-x86_64
Variant boot-fedora-27-x86_64-b296:    /run/nightly/boot,
/run/versions/fedora-27-x86_64
Variant boot-jeos-27-x86_64-cad3:    /run/nightly/boot,
/run/versions/jeos-27-x86_64
$

Let's imagine we want to exclude jeos-27-x86_64 and run tests with Fedora
27 only. Avocado shows variants with Fedora 27 guest OS only:

$ avocado variants -m os.yaml --mux-filter-only /run/versions/jeos-27-x86_64
Multiplex variants (2):
Variant shutdown-jeos-27-x86_64-5c42:    /run/nightly/shutdown,
/run/versions/jeos-27-x86_64
Variant boot-jeos-27-x86_64-cad3:    /run/nightly/boot,
/run/versions/jeos-27-x86_64
$

But avocado run _all_ tests when I'm trying to use same option with run
command:

$ avocado run os.yaml --mux-filter-only /run/versions/jeos-27-x86_64
JOB ID     : 20890fa3194cf83a7b40b42a12cb16255ddb9550
JOB LOG    :
/home/sergeyb/avocado/job-results/job-2018-08-28T17.17-20890fa/job.log
 (1/4) fedora-27-x86_64 io-github-autotest-qemu.shutdown;-e630: PASS (45.06
s)
 (2/4) jeos-27-x86_64 io-github-autotest-qemu.shutdown;-e630: PASS (37.65 s)
 (3/4) fedora-27-x86_64 io-github-autotest-qemu.boot;-e630: PASS (46.93 s)
 (4/4) jeos-27-x86_64 io-github-autotest-qemu.boot;-e630: PASS (39.78 s)
No handlers could be found for logger "avocado.test.stdout"
RESULTS    : PASS 4 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 |
CANCEL 0
JOB TIME   : 177.34 s
$

Is it a bug?

Sergey
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/avocado-devel/attachments/20180828/d454d7ab/attachment.htm>