aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting/core
AgeCommit message (Collapse)AuthorFilesLines
2022-01-21Protect if detail is returned as NoneCédric Ollivier2-1/+3
It occured when running ansible. Change-Id: I908270fdb76fbc3bdf60787b189cdbc29c41b52b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-04Fix incorrect f-stringCédric Ollivier1-1/+1
Change-Id: I463dc155d03b0d5c86b72f4fb7868c1aa7c29a0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-09Leverage latest pylint featuresCédric Ollivier8-48/+45
It adds encoding in all open call and leverage f-strings. Change-Id: I70ccd2bfcadae44929d5874f98fa3bf4ff644488 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-08Update robotframework to latest releaseCédric Ollivier1-3/+2
Change-Id: I298320f666e048d42047fd00de74df83142a5186 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-19Correct documented return valuesVincent Danno1-2/+2
In particular, for mts, error cases can yield values other than -1. Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I50ba896b835075fd3f3dd01f848fcc45076245ac
2021-08-12Update pylint to 2.9.6Cédric Ollivier2-23/+25
It stops filtering upper constraints by versions as python 2 (and 3.5) dropped. Change-Id: Ieb96d068ebda813e020a093f3291b4a9526402e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-12Use python 3 super() styleVincent Danno7-8/+8
See https://www.python.org/dev/peps/pep-3135/ Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I4f74db4a019b70d0289f8969d57fa9ad629c586f
2021-06-11Fix tag logics in behaveCédric Ollivier1-3/+3
The unit tests will be fully rewritten in a second change (out of this bugfix). Co-Authored-By: Ugur Caglar Kilic <ugur.caglar.kilic@oracle.com> Change-Id: I6413fbcecdf44dbfe9c978045f4b1d43ca0de2ec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-08MTS inherits BashFeatureVincent Danno2-63/+17
Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: Ifa3a5d5946c29863905490de5f875e17026744a5
2021-06-03Merge "Drop six"Cedric Ollivier7-42/+28
2021-06-02Delete wrong docstringVincent Danno1-5/+1
This seems an unfortunate copy-paste from the file feature.py Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: If4c8eec10616f0dce3f1ac90abb0c2e78aeae11d
2021-06-01Drop sixVincent Danno7-42/+28
python 2 was dropped [1] so we don't need six anymore [1]: https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68262 Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I840211990b76f77a46e9e737fc4a4c857b57c0b2
2021-05-18Use constants instead of hard-coding pathsVincent Danno1-4/+5
This complements https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/72495 which missed one occurence due to trailing slash difference. Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: Iabfa89161cc099c924a7609aeb4ef6ed1b027cd3
2021-05-12Remove superfluous property declarationVincent Danno2-2/+0
It is inherited. Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: Ic68172dfb93f03cc62cf4944b82de8bc1e37b097
2021-05-10Use constants instead of hard-coding pathsVincent Danno1-2/+3
Signed-off-by: Vincent Danno <vincent.danno@orange.com> Change-Id: I9bef7db7584d6b615ef102d13797914095512733
2021-04-29Merge "Allow printing playbook output to console"Cedric Ollivier1-1/+2
2021-04-29Allow printing playbook output to consoleAjay Kumar1-1/+2
User can specify quiet: False in "testcases.yaml" if he wants to print the output on console. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Signed-off-by: Ajay kumar <ajay4.kumar@orange.com> Change-Id: I30fa21bdcc2ed97757cd3c0b4720f9413466833f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-28Add console parameter to behaveframeworkFrancois Regis Menguy1-0/+2
Change-Id: I289de43bdea8c52181ec0622c83c5c56dd6890e3 Signed-off-by: Francois Regis Menguy <francoisregis.menguy@orange.com>
2021-04-27Add an Ansible driverAjay Kumar1-0/+70
It calls ansible_runner.interface.run() by converting the testcase description data to kwargs. It only overrides quiet and artifact_dir to implement the Xtesting behavior. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ifd09810400babc0f2b81f2c33edf55a3ed88807b Signed-off-by: Ajay kumar <ajay4.kumar@orange.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-11Create dummy xtesting-mts:armCédric Ollivier1-0/+8
Change-Id: Ib6cc1236aa46b7fb1fd9dfa96750894d87c3563e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-09Take pylint's len-as-condition into accountCédric Ollivier1-2/+2
Change-Id: Ib19de453857a2732d9c70a24539a96cd7129613d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-16Cleanup previous run output filesVincent Mahe1-4/+13
Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I9ec39012457ae1a5f7017d41d79237d7a1e300d4
2020-09-05Protect mts vs py2Cédric Ollivier1-8/+12
Change-Id: I7a9aa9267a81161b10b1d625efbaa924187f8690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Fix duration calculationCédric Ollivier1-2/+3
It falsy printed 00:60 Change-Id: Ib2852268a6833b353232c80e9013b6926058479c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-05Add MTS driverVincent Mahe1-0/+287
It creates a new container xtesting-mts to avoid increase core container size. Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I59544023e1235747e140a442815778a133bf6acf
2020-03-17Post-processed data from DBCédric Ollivier1-2/+10
It removes base_url to match the location in archive. It forces a relative path by removing first "/". It makes sense but it may raise side effects in dovetail webportal. Change-Id: Idca69a99fed54ddf69334a865bae15b0a08220fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Fix behave driver and its related unit testsCédric Ollivier1-21/+8
Change-Id: I466d655162c1ddd5f4e3ef0e356a27007bfaea0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Compress Campaign data (zip)Cédric Ollivier1-1/+2
Change-Id: I7b46a88a181293297cc764026f2804d36a59955a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-21Dump DB and artifacts for third-party certificationCédric Ollivier2-2/+217
It conforms with Kubernetes Conformance [1] model and could be reused by OVP or any third-party CNTT-based certification. It publishes the final archive in the S3 repository. XtestingCI will generate the final job calling this feature. [1] https://github.com/cncf/k8s-conformance Change-Id: I7394c9d52d2cc9370eae125ca5398ff734e5b8d6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-30Postprocess the TestAPI href returnedCédric Ollivier1-5/+6
[1] returned http://localhost:8082 [1] https://build.opnfv.org/ci/job/airship-opnfv-functest-healthcheck-latest-connection_check-run/58/console Change-Id: Ifc0e37a97442193a77762ecc2928b100e27028cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-18Forbid multipart upload if google storageCédric Ollivier1-2/+6
Google Storage doesn't support S3 multipart uploads https://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html https://cloud.google.com/storage/docs/composite-objects 5 * 1024 ** 5 is the multipart upload limit. https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html Change-Id: Iec3a5cd70ea6e912272ea231eecde6ee4f51ce4f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-16Add ContentType when publishing artifactsCédric Ollivier1-4/+17
The default value 'application/octet-stream' is mostly incorrect and forces downloading all links. https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-hunter-connection_check-run/436/console Change-Id: Ia680654f5e9f67154504264bc380f0a8d6a74d85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Improve file scanning when publishing artifactsCédric Ollivier1-2/+13
Else it copies files from other testcases if the full suite is executed sequentially. Change-Id: Ic61472e47b655c34823a6fcb3ed3615e8f84a4c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Add links in testcase detailsCédric Ollivier1-4/+6
It allows finding easily reports thanks to DB. Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Print Test API links in consoleCédric Ollivier1-2/+8
It adds TEST_DB_EXT_URL to print the right links in case of NAT or SSH port forwardings. Change-Id: If85b00de7325909facc903fba13a3fd59a1e705f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Generate Html and Xunit Behave reportsCédric Ollivier1-2/+8
Change-Id: I7d5f31502ba61b61a0b1c885fe8828211bc0bc0a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-07Create Bucket if it doesn't existCédric Ollivier1-4/+18
Xtesting Ansible Role no longer creates bucket after starting Minio [1]. [1] https://github.com/collivier/ansible-role-xtesting/commit/8c62525bb0d0b5f8dcc2c4436711d5d075de8811 Change-Id: I1ad473ce55f9c00df8e558fdc67f571ee0a1875c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-02Publish artifacts to S3 repositoryCédric Ollivier5-4/+66
It simplifies Jenkins or Gitlab jobs by automatically publishing all artifacts via the framework. It leverages on Amazon Web Services (AWS) SDK [1] which supports the current cases (OPNFV, Xtesting Ansible role [2], etc.). [1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway [2] https://github.com/collivier/ansible-role-xtesting Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-26Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-1/+1
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: I8568eeafa44c5dba72e206c532c1f50e3ad547f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Adding first patch for behave featureDeepak Chandella2-8/+124
Change-Id: Ic975c301103b49cdec2bd26746b708388f21e892 Signed-off-by: Deepak Chandella <deepak.chandella@orange.com>
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier2-4/+4
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-12Stop setting utf-8 in decode/encode callsCédric Ollivier2-4/+4
It's the default value. Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-07Update to Python3Cédric Ollivier2-7/+7
Now Xtesting containers use Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework to latest release. Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-04Remove url from logsCédric Ollivier1-1/+1
It can be false in case of NAT. Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Allow printing bash cmd output in consoleCédric Ollivier1-8/+20
It switches to Popen to print real-time console. Console has to be enabled per testcase (testcases.yaml). Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Generate reports for unit testsCédric Ollivier1-7/+58
It now leverages on subunit to generate html and xml reports. Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-01Set shell=True in subprocess.check_callCédric Ollivier1-9/+6
It allows running multiple shell instructions (see third). Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f99cef18b6dd3eff6703c4d748fae415fea78ae2)
2018-08-29Stop verifying ResultWriter.write_results exit codesCédric Ollivier1-1/+1
ResultWriter.write_results() returns false if one test fails. It's skipped by run() because the report is correctly generated. [1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html Change-Id: If29059b272679ed89a1189e0bb52997c83401b94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Change output dirCédric Ollivier1-2/+2
It now reads case_name instead of selecting an hardcoded value (robot). Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier2-12/+10
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>