aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting/ci/run_tests.py
AgeCommit message (Collapse)AuthorFilesLines
2024-01-18Don't override env values via testcases.yaml if they existCédric Ollivier1-3/+4
Change-Id: I0d7a52f8bae37ea09f15a5344ee1f7d19d0ecd77 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2023-09-29Upgrade pylint and fix latest warningsCédric Ollivier1-1/+1
Change-Id: I8b9e4b663a12ac9be18fded2d7b4e4b38428fa9f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2023-04-13Allow setting env vars via testcases.yamlCédric Ollivier1-0/+6
It helps defining env vars per test cases. /home/opnfv/functest/conf/env_file is rather designed for comme env vars ro all test cases (see OpenStack Creds). Change-Id: Ic5d34701475440e1f768bbb22be7a4cfa3e1625b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-03-03Rewrite last direct call to ci/testcases.yamlCédric Ollivier1-14/+8
Change-Id: Ic4a857b6cdee7e3f9e2330414b0e6a6df98eea25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-03-03Search config files in treeCédric Ollivier1-6/+15
It allows putting configurations in classical dirs. It fallbacks to the python package for backward compatibility. Change-Id: Ie33b9482fb197926c7d7d66ace815fa4ae01d02d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-27Reset argv to prevent wrong usageCédric Ollivier1-0/+4
It bypasses a clear pyats issue Change-Id: Ib5e8d51b5bea1015c7e1b371b5ba4679c0921555 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-09Leverage latest pylint featuresCédric Ollivier1-5/+5
It adds encoding in all open call and leverage f-strings. Change-Id: I70ccd2bfcadae44929d5874f98fa3bf4ff644488 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-12Update pylint to 2.9.6Cédric Ollivier1-1/+1
It stops filtering upper constraints by versions as python 2 (and 3.5) dropped. Change-Id: Ieb96d068ebda813e020a093f3291b4a9526402e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-01Drop sixVincent Danno1-2/+1
python 2 was dropped [1] so we don't need six anymore [1]: https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68262 Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I840211990b76f77a46e9e737fc4a4c857b57c0b2
2021-05-10Use constants instead of hard-coding pathsVincent Danno1-4/+4
Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I9bef7db7584d6b615ef102d13797914095512733
2020-09-05Remove order in testcases.yamlCédric Ollivier1-3/+2
It's not used and asked for useless configuration data. Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Suppress admin password in default logsajay331-1/+1
Currently, OS_PASSWORD is getting printed in the console of Functest. This password is secret and must not be printed in default log file. This patch suppresses the logging of OS_PASSWORD unless users ask for debug logs. Signed-off-by: mahajanajay33@gmail.com Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4
2019-11-09Add links in testcase detailsCédric Ollivier1-2/+2
It allows finding easily reports thanks to DB. Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-02Publish artifacts to S3 repositoryCédric Ollivier1-1/+9
It simplifies Jenkins or Gitlab jobs by automatically publishing all artifacts via the framework. It leverages on Amazon Web Services (AWS) SDK [1] which supports the current cases (OPNFV, Xtesting Ansible role [2], etc.). [1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway [2] https://github.com/collivier/ansible-role-xtesting Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-26Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-3/+2
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: I8568eeafa44c5dba72e206c532c1f50e3ad547f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-24Enable debug messages via env varCédric Ollivier1-2/+6
It stops printing in xtesting.debug.log by default. It decreases testing duration via Raspberry PI without additional tasks [1]. [1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Initialize testcase results to EX_TESTCASE_FAILEDCédric Ollivier1-1/+1
Else the testcase returns EX_OK if exceptions in __init__() Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier1-4/+6
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Skip the selected testcase too0.56Cédric Ollivier1-1/+1
It completes "Allow calling a skip test" [1] [1] https://gerrit.opnfv.org/gerrit/60655 Change-Id: I02499aed56e6b23563165ea1f17b476e12408823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Allow calling a skip testCédric Ollivier1-7/+7
run_tests shouldn't return an incorrect value if the test is skipped. Else it simply forbids running tests in parallel (one test per thread). Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Stop skipping testcases if one raises exceptionsCédric Ollivier1-0/+6
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Fix results when only one skipped testCédric Ollivier1-1/+3
Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Allow dynamically skipping testcases0.52Cédric Ollivier1-6/+11
Change-Id: I7cf47f0625bdb8345fef43b24c51bd84ef4486ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Skip testcases by any env var0.51Cédric Ollivier1-5/+2
It also removes CI_LOOP which is releng centric. It can be passed as dependency if required. Change-Id: I146bb97950cb88062451158b7cc6a16c7f9d47a2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Improve dependency managementCédric Ollivier1-3/+1
It avoids declaring dependencies if needed. Negative regex are correcty managed as well. Change-Id: I0e978823526246bc4a5192e63a8a893a4add0e2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-04Return all status when running tiers0.22Cédric Ollivier1-2/+1
Change-Id: I31a062304d47c055c14e5afe8f560c3048b071f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-03Stop filtering the project when calculating results0.21Cédric Ollivier1-4/+1
Change-Id: Ia0917426775831176206f4bb300d513cc3190e08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Switch from /home/opnfv/functest to /var/lib/xtestingCédric Ollivier1-0/+8
Functest containers will have to create symlinks to allow publishing artifacts. All classes create the mandatory dirs. Change-Id: Ia1f215005d553dd6d64685e4d8a3f5c843c5db7a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Rename all Functest refs to XtestingCédric Ollivier1-0/+302
It mainly renames python modules and then the related documentation config files. Change-Id: I186010bb88d3d39afe7b8fd1ebcef9c690cc1282 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>