aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting/ci/run_tests.py
AgeCommit message (Collapse)AuthorFilesLines
2022-03-04Search config files in treeCédric Ollivier1-10/+12
It allows putting configurations in classical dirs. It fallbacks to the python package for backward compatibility. Change-Id: Ie33b9482fb197926c7d7d66ace815fa4ae01d02d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-27Reset argv to prevent wrong usageCédric Ollivier1-0/+4
It bypasses a clear pyats issue Change-Id: Ib5e8d51b5bea1015c7e1b371b5ba4679c0921555 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6e7f515947c54d3ed9bb3df9cc2014fc1baaea51)
2020-09-05Remove order in testcases.yamlCédric Ollivier1-3/+2
It's not used and asked for useless configuration data. Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Suppress admin password in default logsajay331-1/+1
Currently, OS_PASSWORD is getting printed in the console of Functest. This password is secret and must not be printed in default log file. This patch suppresses the logging of OS_PASSWORD unless users ask for debug logs. Signed-off-by: mahajanajay33@gmail.com Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4
2019-11-09Add links in testcase detailsCédric Ollivier1-2/+2
It allows finding easily reports thanks to DB. Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-02Publish artifacts to S3 repositoryCédric Ollivier1-1/+9
It simplifies Jenkins or Gitlab jobs by automatically publishing all artifacts via the framework. It leverages on Amazon Web Services (AWS) SDK [1] which supports the current cases (OPNFV, Xtesting Ansible role [2], etc.). [1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway [2] https://github.com/collivier/ansible-role-xtesting Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-26Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-3/+2
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: I8568eeafa44c5dba72e206c532c1f50e3ad547f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-24Enable debug messages via env varCédric Ollivier1-2/+6
It stops printing in xtesting.debug.log by default. It decreases testing duration via Raspberry PI without additional tasks [1]. [1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Initialize testcase results to EX_TESTCASE_FAILEDCédric Ollivier1-1/+1
Else the testcase returns EX_OK if exceptions in __init__() Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier1-4/+6
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Skip the selected testcase too0.56Cédric Ollivier1-1/+1
It completes "Allow calling a skip test" [1] [1] https://gerrit.opnfv.org/gerrit/60655 Change-Id: I02499aed56e6b23563165ea1f17b476e12408823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Allow calling a skip testCédric Ollivier1-7/+7
run_tests shouldn't return an incorrect value if the test is skipped. Else it simply forbids running tests in parallel (one test per thread). Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Stop skipping testcases if one raises exceptionsCédric Ollivier1-0/+6
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Fix results when only one skipped testCédric Ollivier1-1/+3
Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Allow dynamically skipping testcases0.52Cédric Ollivier1-6/+11
Change-Id: I7cf47f0625bdb8345fef43b24c51bd84ef4486ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Skip testcases by any env var0.51Cédric Ollivier1-5/+2
It also removes CI_LOOP which is releng centric. It can be passed as dependency if required. Change-Id: I146bb97950cb88062451158b7cc6a16c7f9d47a2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Improve dependency managementCédric Ollivier1-3/+1
It avoids declaring dependencies if needed. Negative regex are correcty managed as well. Change-Id: I0e978823526246bc4a5192e63a8a893a4add0e2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-04Return all status when running tiers0.22Cédric Ollivier1-2/+1
Change-Id: I31a062304d47c055c14e5afe8f560c3048b071f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-03Stop filtering the project when calculating results0.21Cédric Ollivier1-4/+1
Change-Id: Ia0917426775831176206f4bb300d513cc3190e08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Switch from /home/opnfv/functest to /var/lib/xtestingCédric Ollivier1-0/+8
Functest containers will have to create symlinks to allow publishing artifacts. All classes create the mandatory dirs. Change-Id: Ia1f215005d553dd6d64685e4d8a3f5c843c5db7a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Rename all Functest refs to XtestingCédric Ollivier1-0/+302
It mainly renames python modules and then the related documentation config files. Change-Id: I186010bb88d3d39afe7b8fd1ebcef9c690cc1282 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>