aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting/ci
AgeCommit message (Collapse)AuthorFilesLines
2023-09-29Upgrade pylint and fix latest warningsCédric Ollivier1-1/+1
Change-Id: I8b9e4b663a12ac9be18fded2d7b4e4b38428fa9f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f430ee4d9ef63f104dde63710fce7f8fa3c61591)
2023-04-14Remove MTS from XtestingCédric Ollivier1-18/+0
The MTS drivers is unmaintained and they are lots of security issues in its dependencies. Change-Id: I397e22c8868204b8d52a8ac35906278b5e530961 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 781fc313c1c59018edb892ff0423963191781592)
2023-04-14Add pytest driver in XtestingCédric Ollivier1-0/+11
Co-authored-by: Edouard Hinard <edouard.hinard@orange.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ice364f7f4287aacc7f375ed4a23503fd38c8e543 (cherry picked from commit 12732b13c55eb91f32ed65f1d8a1f72b4aa2c534)
2023-04-13Allow setting env vars via testcases.yamlCédric Ollivier1-0/+6
It helps defining env vars per test cases. /home/opnfv/functest/conf/env_file is rather designed for comme env vars ro all test cases (see OpenStack Creds). Change-Id: Ic5d34701475440e1f768bbb22be7a4cfa3e1625b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fd8498598096cabb991cf3494220a9715d3360f7)
2023-04-13Add missing api docsCédric Ollivier1-3/+3
Change-Id: I29a470f74d2429862d0e26426a375d0a76550082 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8aac8f8eb357c595fc2e8272d6302bfd068cd4ab)
2022-03-03Rewrite last direct call to ci/testcases.yamlCédric Ollivier1-14/+8
Change-Id: Ic4a857b6cdee7e3f9e2330414b0e6a6df98eea25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-03-03Search config files in treeCédric Ollivier2-9/+18
It allows putting configurations in classical dirs. It fallbacks to the python package for backward compatibility. Change-Id: Ie33b9482fb197926c7d7d66ace815fa4ae01d02d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-27Reset argv to prevent wrong usageCédric Ollivier1-0/+4
It bypasses a clear pyats issue Change-Id: Ib5e8d51b5bea1015c7e1b371b5ba4679c0921555 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-09Leverage latest pylint featuresCédric Ollivier2-6/+6
It adds encoding in all open call and leverage f-strings. Change-Id: I70ccd2bfcadae44929d5874f98fa3bf4ff644488 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-12Update pylint to 2.9.6Cédric Ollivier2-6/+6
It stops filtering upper constraints by versions as python 2 (and 3.5) dropped. Change-Id: Ieb96d068ebda813e020a093f3291b4a9526402e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-01Drop sixVincent Danno1-2/+1
python 2 was dropped [1] so we don't need six anymore [1]: https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68262 Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I840211990b76f77a46e9e737fc4a4c857b57c0b2
2021-05-20Delete dead codeVincent Danno1-18/+0
The piece of code became unused following change https://gerrit.opnfv.org/gerrit/c/functest/+/39443 Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I0bf80790c05cef217be574ad196d8c4e8dfb4c2d
2021-05-10Use constants instead of hard-coding pathsVincent Danno1-4/+4
Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I9bef7db7584d6b615ef102d13797914095512733
2021-04-27Add an Ansible driverAjay Kumar1-99/+98
It calls ansible_runner.interface.run() by converting the testcase description data to kwargs. It only overrides quiet and artifact_dir to implement the Xtesting behavior. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ifd09810400babc0f2b81f2c33edf55a3ed88807b Signed-off-by: Ajay kumar <ajay4.kumar@orange.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Remove order in testcases.yamlCédric Ollivier4-13/+6
It's not used and asked for useless configuration data. Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Make testcases descriptions optionalCédric Ollivier1-4/+4
Change-Id: If0e45f10816edd2199c589bb5fbfc03fbc0a4b77 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Suppress admin password in default logsajay333-3/+3
Currently, OS_PASSWORD is getting printed in the console of Functest. This password is secret and must not be printed in default log file. This patch suppresses the logging of OS_PASSWORD unless users ask for debug logs. Signed-off-by: mahajanajay33@gmail.com Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4
2020-08-05Add MTS driverVincent Mahe1-0/+20
It creates a new container xtesting-mts to avoid increase core container size. Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I59544023e1235747e140a442815778a133bf6acf
2019-11-09Add links in testcase detailsCédric Ollivier1-2/+2
It allows finding easily reports thanks to DB. Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-02Publish artifacts to S3 repositoryCédric Ollivier1-1/+9
It simplifies Jenkins or Gitlab jobs by automatically publishing all artifacts via the framework. It leverages on Amazon Web Services (AWS) SDK [1] which supports the current cases (OPNFV, Xtesting Ansible role [2], etc.). [1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway [2] https://github.com/collivier/ansible-role-xtesting Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-26Switch to Python 3.7 and Alpine 3.10Cédric Ollivier3-6/+5
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: I8568eeafa44c5dba72e206c532c1f50e3ad547f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Adding first patch for behave featureDeepak Chandella1-0/+16
Change-Id: Ic975c301103b49cdec2bd26746b708388f21e892 Signed-off-by: Deepak Chandella <deepak.chandella@orange.com>
2019-05-11Rename HelloWorld.txt to HelloWorld.robotCédric Ollivier1-1/+1
It takes the following warning into account [1] "Automatically parsing other than '*.robot' files is deprecated" [1] https://build.opnfv.org/ci/job/xtesting-opnfv-xtesting-latest-fifth-run/150/console Change-Id: Ibe01eea7eb83c8724d6b4afe3a487ad813fed30d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-07Update to Python3Cédric Ollivier1-1/+1
Now Xtesting containers use Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework to latest release. Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-24Enable debug messages via env varCédric Ollivier3-10/+74
It stops printing in xtesting.debug.log by default. It decreases testing duration via Raspberry PI without additional tasks [1]. [1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Apply operations via sixerCédric Ollivier1-1/+1
Change-Id: I7609f83da73d0ac03fc0d270d42f44708335995c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19Fix a wierd pylint errorCédric Ollivier1-1/+2
Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Update RobotFramework configCédric Ollivier1-2/+1
It completes "Leverage on abc and stevedore". Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Initialize testcase results to EX_TESTCASE_FAILEDCédric Ollivier1-1/+1
Else the testcase returns EX_OK if exceptions in __init__() Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Merge "Protect vs None when calling regex"Cedric Ollivier1-1/+2
2018-08-14Protect vs None when calling regexCédric Ollivier1-1/+2
Change-Id: I93d22442c28e674433234d7729838944962bdbe2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier2-12/+10
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Skip the selected testcase too0.56Cédric Ollivier3-3/+10
It completes "Allow calling a skip test" [1] [1] https://gerrit.opnfv.org/gerrit/60655 Change-Id: I02499aed56e6b23563165ea1f17b476e12408823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Allow calling a skip testCédric Ollivier2-9/+9
run_tests shouldn't return an incorrect value if the test is skipped. Else it simply forbids running tests in parallel (one test per thread). Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Stop skipping testcases if one raises exceptionsCédric Ollivier1-0/+6
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Stop printing exceptions twice0.53Cédric Ollivier1-3/+14
Change-Id: Ife772d33741e7023ed72afeb0f74ed8b461e0033 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Fix results when only one skipped testCédric Ollivier1-1/+3
Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Allow dynamically skipping testcases0.52Cédric Ollivier1-6/+11
Change-Id: I7cf47f0625bdb8345fef43b24c51bd84ef4486ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Skip testcases by any env var0.51Cédric Ollivier4-65/+25
It also removes CI_LOOP which is releng centric. It can be passed as dependency if required. Change-Id: I146bb97950cb88062451158b7cc6a16c7f9d47a2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Improve dependency managementCédric Ollivier4-36/+21
It avoids declaring dependencies if needed. Negative regex are correcty managed as well. Change-Id: I0e978823526246bc4a5192e63a8a893a4add0e2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-29Remove Feature logger0.42Panagiotis Karalis1-19/+3
This class atttribute is removed as it's quite useless (it forces one module per project). All messages are now printed to xtesting.log whatever the namespace and all warnings are printed in console. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I6860eaf427093ea21b3bd78650bec7939e947b2d Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Fix regex when INSTALLER_TYPE is unsetCédric Ollivier1-10/+8
Change-Id: I0ec012185f3c90b2a2c82b6f204ce332f3fa9c7f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-04Return all status when running tiers0.22Cédric Ollivier1-2/+1
Change-Id: I31a062304d47c055c14e5afe8f560c3048b071f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-03Stop filtering the project when calculating results0.21Cédric Ollivier1-4/+1
Change-Id: Ia0917426775831176206f4bb300d513cc3190e08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Switch from /home/opnfv/functest to /var/lib/xtestingCédric Ollivier3-1/+10
Functest containers will have to create symlinks to allow publishing artifacts. All classes create the mandatory dirs. Change-Id: Ia1f215005d553dd6d64685e4d8a3f5c843c5db7a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Publish Dockerfile and samplesCédric Ollivier2-377/+39
Change-Id: Ie776fea631f04bb42d8ae80bc658318d8644d0e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Rename all Functest refs to XtestingCédric Ollivier6-0/+1071
It mainly renames python modules and then the related documentation config files. Change-Id: I186010bb88d3d39afe7b8fd1ebcef9c690cc1282 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>