[Avocado-devel] Test assumptions question.

[Dmitry Monakhov]

Hi,
I try to automate my kernel testing via avocado.
I've faced some general design questions. And want to ask an advice.

Testing procedure is quite general, and suites for any project.
1) Download source
2) configure kernel
3) Build kernel
4) Run several semantic checkers
5-N) Run tests for that kernel (inside qemu, so reboot is not necessary)
     in my case this is xfstests-bld (filesystem test)

* Questions about test iterations
It is obvious that it is not good idea to place all functionality in
single class. Actually it is reasonable to create following hierarchy
linuxbuild.py: Does: 1,2,3
sparse_check.py: 4
xfstests-blk.py: 5
....

But this means tests should be aware about there to find common data.
sparse_check.py needs source of linux-kernel
xfstests-bld.py needs to now where to find bzImage
But each tests has it's own set of directories {workdir,srcdir, etc} and
there is no convenient path where tests can share data.
The only candidate I found is get_tmp_dir from core.data_dir module
In fact avocado-misc-tests/memory/dma_memtest.py already use that
interface. Is this correct way to do?
BTW: If this is the case let's make some default install-prefix for
tests, where tests can install their binaries
Example:
job_init()
export  AVOCADO_PKG_PREFIX="job.get_tmp_dir() + 'pkg-prefix'
export  PATH=$PATH:$AVOCADO_PKG_PREFIX/bin/:$AVOCADO_PKG_PREFIX/sbin

Test1: ./configure --prefix=$AVOCADO_PKG_PREFIX && make && make install
Test2: Not it can use binaries installed by Test1

* Performance numbers:
Some tests may produce performance values. Autotest has cool feature
aka 'key/val' for that. AFAIU avocado suppose to use whiteboard for that.
But AFAIS now one use it at the moment. Btw  dbench, iozone and ebizzy save
data in datadir/perf.json instead.
What is the best way to store perf values?

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 472 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/avocado-devel/attachments/20160913/adb365a1/attachment.sig>