aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting/core
AgeCommit message (Collapse)AuthorFilesLines
2023-04-14Remove MTS from XtestingCédric Ollivier1-241/+0
The MTS drivers is unmaintained and they are lots of security issues in its dependencies. Change-Id: I397e22c8868204b8d52a8ac35906278b5e530961 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2023-04-14Add pytest driver in XtestingCédric Ollivier1-0/+101
Co-authored-by: Edouard Hinard <edouard.hinard@orange.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ice364f7f4287aacc7f375ed4a23503fd38c8e543
2022-09-23Make robot driver even more genericCédric Ollivier1-7/+6
It allows setting any option via testcases.yaml Change-Id: I8cb5ead037a65f962c3ba1a14729b52195e95483 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-07-07Add deny_skipping parameterBellengé Maxime1-3/+10
It takes into account or not skip tests in the global result It also adds unit tests to cover it. It should be noted that if follows the deny skipping model proposed by Functest (tempest). Change-Id: I15fa7a3946c6e3b2ae190e4f8abf3b9361a391a4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-04-15Change working dirCédric Ollivier1-0/+1
/ is no longer good as we allow non root user. Change-Id: If2483f7d177db8f2b99e05456d1ea803e3153466 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-03-04Protect vs Bucket containing html charsCédric Ollivier1-11/+14
It allows dumping MTS output files. Change-Id: I2b35ee81a764573a9d17cb3a225cb5febed5fa46 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-03-03Rewrite last direct call to ci/testcases.yamlCédric Ollivier1-9/+9
Change-Id: Ic4a857b6cdee7e3f9e2330414b0e6a6df98eea25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-03-03Allow overriding project_name via envCédric Ollivier1-1/+2
It now offers a new env var, PROJECT_NAME, to override the default value in testcases.yaml. Change-Id: I911f1af56afe88edb37de40176733b65bc8e490a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-21Protect if detail is returned as NoneCédric Ollivier2-1/+3
It occured when running ansible. Change-Id: I908270fdb76fbc3bdf60787b189cdbc29c41b52b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-04Fix incorrect f-stringCédric Ollivier1-1/+1
Change-Id: I463dc155d03b0d5c86b72f4fb7868c1aa7c29a0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-09Leverage latest pylint featuresCédric Ollivier8-48/+45
It adds encoding in all open call and leverage f-strings. Change-Id: I70ccd2bfcadae44929d5874f98fa3bf4ff644488 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-08Update robotframework to latest releaseCédric Ollivier1-3/+2
Change-Id: I298320f666e048d42047fd00de74df83142a5186 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-19Correct documented return valuesVincent Danno1-2/+2
In particular, for mts, error cases can yield values other than -1. Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I50ba896b835075fd3f3dd01f848fcc45076245ac
2021-08-12Update pylint to 2.9.6Cédric Ollivier2-23/+25
It stops filtering upper constraints by versions as python 2 (and 3.5) dropped. Change-Id: Ieb96d068ebda813e020a093f3291b4a9526402e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-12Use python 3 super() styleVincent Danno7-8/+8
See https://www.python.org/dev/peps/pep-3135/ Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I4f74db4a019b70d0289f8969d57fa9ad629c586f
2021-06-11Fix tag logics in behaveCédric Ollivier1-3/+3
The unit tests will be fully rewritten in a second change (out of this bugfix). Co-Authored-By: Ugur Caglar Kilic <ugur.caglar.kilic@oracle.com> Change-Id: I6413fbcecdf44dbfe9c978045f4b1d43ca0de2ec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-08MTS inherits BashFeatureVincent Danno2-63/+17
Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: Ifa3a5d5946c29863905490de5f875e17026744a5
2021-06-03Merge "Drop six"Cedric Ollivier7-42/+28
2021-06-02Delete wrong docstringVincent Danno1-5/+1
This seems an unfortunate copy-paste from the file feature.py Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: If4c8eec10616f0dce3f1ac90abb0c2e78aeae11d
2021-06-01Drop sixVincent Danno7-42/+28
python 2 was dropped [1] so we don't need six anymore [1]: https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68262 Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I840211990b76f77a46e9e737fc4a4c857b57c0b2
2021-05-18Use constants instead of hard-coding pathsVincent Danno1-4/+5
This complements https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/72495 which missed one occurence due to trailing slash difference. Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: Iabfa89161cc099c924a7609aeb4ef6ed1b027cd3
2021-05-12Remove superfluous property declarationVincent Danno2-2/+0
It is inherited. Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: Ic68172dfb93f03cc62cf4944b82de8bc1e37b097
2021-05-10Use constants instead of hard-coding pathsVincent Danno1-2/+3
Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I9bef7db7584d6b615ef102d13797914095512733
2021-04-29Merge "Allow printing playbook output to console"Cedric Ollivier1-1/+2
2021-04-29Allow printing playbook output to consoleAjay Kumar1-1/+2
User can specify quiet: False in "testcases.yaml" if he wants to print the output on console. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Signed-off-by: Ajay kumar <ajay4.kumar@orange.com> Change-Id: I30fa21bdcc2ed97757cd3c0b4720f9413466833f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-28Add console parameter to behaveframeworkFrancois Regis Menguy1-0/+2
Change-Id: I289de43bdea8c52181ec0622c83c5c56dd6890e3 Signed-off-by: Francois Regis Menguy <francoisregis.menguy@orange.com>
2021-04-27Add an Ansible driverAjay Kumar1-0/+70
It calls ansible_runner.interface.run() by converting the testcase description data to kwargs. It only overrides quiet and artifact_dir to implement the Xtesting behavior. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ifd09810400babc0f2b81f2c33edf55a3ed88807b Signed-off-by: Ajay kumar <ajay4.kumar@orange.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-11Create dummy xtesting-mts:armCédric Ollivier1-0/+8
Change-Id: Ib6cc1236aa46b7fb1fd9dfa96750894d87c3563e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-09Take pylint's len-as-condition into accountCédric Ollivier1-2/+2
Change-Id: Ib19de453857a2732d9c70a24539a96cd7129613d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-16Cleanup previous run output filesVincent Mahe1-4/+13
Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I9ec39012457ae1a5f7017d41d79237d7a1e300d4
2020-09-05Protect mts vs py2Cédric Ollivier1-8/+12
Change-Id: I7a9aa9267a81161b10b1d625efbaa924187f8690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Fix duration calculationCédric Ollivier1-2/+3
It falsy printed 00:60 Change-Id: Ib2852268a6833b353232c80e9013b6926058479c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-05Add MTS driverVincent Mahe1-0/+287
It creates a new container xtesting-mts to avoid increase core container size. Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I59544023e1235747e140a442815778a133bf6acf
2020-03-17Post-processed data from DBCédric Ollivier1-2/+10
It removes base_url to match the location in archive. It forces a relative path by removing first "/". It makes sense but it may raise side effects in dovetail webportal. Change-Id: Idca69a99fed54ddf69334a865bae15b0a08220fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Fix behave driver and its related unit testsCédric Ollivier1-21/+8
Change-Id: I466d655162c1ddd5f4e3ef0e356a27007bfaea0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Compress Campaign data (zip)Cédric Ollivier1-1/+2
Change-Id: I7b46a88a181293297cc764026f2804d36a59955a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-21Dump DB and artifacts for third-party certificationCédric Ollivier2-2/+217
It conforms with Kubernetes Conformance [1] model and could be reused by OVP or any third-party CNTT-based certification. It publishes the final archive in the S3 repository. XtestingCI will generate the final job calling this feature. [1] https://github.com/cncf/k8s-conformance Change-Id: I7394c9d52d2cc9370eae125ca5398ff734e5b8d6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-30Postprocess the TestAPI href returnedCédric Ollivier1-5/+6
[1] returned http://localhost:8082 [1] https://build.opnfv.org/ci/job/airship-opnfv-functest-healthcheck-latest-connection_check-run/58/console Change-Id: Ifc0e37a97442193a77762ecc2928b100e27028cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-18Forbid multipart upload if google storageCédric Ollivier1-2/+6
Google Storage doesn't support S3 multipart uploads https://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html https://cloud.google.com/storage/docs/composite-objects 5 * 1024 ** 5 is the multipart upload limit. https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html Change-Id: Iec3a5cd70ea6e912272ea231eecde6ee4f51ce4f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-16Add ContentType when publishing artifactsCédric Ollivier1-4/+17
The default value 'application/octet-stream' is mostly incorrect and forces downloading all links. https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-hunter-connection_check-run/436/console Change-Id: Ia680654f5e9f67154504264bc380f0a8d6a74d85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Improve file scanning when publishing artifactsCédric Ollivier1-2/+13
Else it copies files from other testcases if the full suite is executed sequentially. Change-Id: Ic61472e47b655c34823a6fcb3ed3615e8f84a4c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Add links in testcase detailsCédric Ollivier1-4/+6
It allows finding easily reports thanks to DB. Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Print Test API links in consoleCédric Ollivier1-2/+8
It adds TEST_DB_EXT_URL to print the right links in case of NAT or SSH port forwardings. Change-Id: If85b00de7325909facc903fba13a3fd59a1e705f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Generate Html and Xunit Behave reportsCédric Ollivier1-2/+8
Change-Id: I7d5f31502ba61b61a0b1c885fe8828211bc0bc0a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-07Create Bucket if it doesn't existCédric Ollivier1-4/+18
Xtesting Ansible Role no longer creates bucket after starting Minio [1]. [1] https://github.com/collivier/ansible-role-xtesting/commit/8c62525bb0d0b5f8dcc2c4436711d5d075de8811 Change-Id: I1ad473ce55f9c00df8e558fdc67f571ee0a1875c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-02Publish artifacts to S3 repositoryCédric Ollivier5-4/+66
It simplifies Jenkins or Gitlab jobs by automatically publishing all artifacts via the framework. It leverages on Amazon Web Services (AWS) SDK [1] which supports the current cases (OPNFV, Xtesting Ansible role [2], etc.). [1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway [2] https://github.com/collivier/ansible-role-xtesting Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-26Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-1/+1
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: I8568eeafa44c5dba72e206c532c1f50e3ad547f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Adding first patch for behave featureDeepak Chandella2-8/+124
Change-Id: Ic975c301103b49cdec2bd26746b708388f21e892 Signed-off-by: Deepak Chandella <deepak.chandella@orange.com>
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier2-4/+4
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-12Stop setting utf-8 in decode/encode callsCédric Ollivier2-4/+4
It's the default value. Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>