aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting
AgeCommit message (Collapse)AuthorFilesLines
2020-09-05Remove order in testcases.yamlCédric Ollivier6-24/+8
It's not used and asked for useless configuration data. Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Make testcases descriptions optionalCédric Ollivier1-4/+4
Change-Id: If0e45f10816edd2199c589bb5fbfc03fbc0a4b77 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Suppress admin password in default logsajay333-3/+3
Currently, OS_PASSWORD is getting printed in the console of Functest. This password is secret and must not be printed in default log file. This patch suppresses the logging of OS_PASSWORD unless users ask for debug logs. Signed-off-by: mahajanajay33@gmail.com Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4
2020-08-05Add MTS driverVincent Mahe4-0/+323
It creates a new container xtesting-mts to avoid increase core container size. Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I59544023e1235747e140a442815778a133bf6acf
2020-03-17Post-processed data from DBCédric Ollivier1-2/+10
It removes base_url to match the location in archive. It forces a relative path by removing first "/". It makes sense but it may raise side effects in dovetail webportal. Change-Id: Idca69a99fed54ddf69334a865bae15b0a08220fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Fix behave driver and its related unit testsCédric Ollivier3-39/+27
Change-Id: I466d655162c1ddd5f4e3ef0e356a27007bfaea0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Compress Campaign data (zip)Cédric Ollivier1-1/+2
Change-Id: I7b46a88a181293297cc764026f2804d36a59955a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-21Dump DB and artifacts for third-party certificationCédric Ollivier2-2/+217
It conforms with Kubernetes Conformance [1] model and could be reused by OVP or any third-party CNTT-based certification. It publishes the final archive in the S3 repository. XtestingCI will generate the final job calling this feature. [1] https://github.com/cncf/k8s-conformance Change-Id: I7394c9d52d2cc9370eae125ca5398ff734e5b8d6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-30Mock os.path.join in push_to_dbCédric Ollivier2-1/+3
Change-Id: I8d0c8f9ef4688454a6d2992ab1a20d871814e23f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-30Postprocess the TestAPI href returnedCédric Ollivier3-7/+10
[1] returned http://localhost:8082 [1] https://build.opnfv.org/ci/job/airship-opnfv-functest-healthcheck-latest-connection_check-run/58/console Change-Id: Ifc0e37a97442193a77762ecc2928b100e27028cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-18Forbid multipart upload if google storageCédric Ollivier2-2/+12
Google Storage doesn't support S3 multipart uploads https://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html https://cloud.google.com/storage/docs/composite-objects 5 * 1024 ** 5 is the multipart upload limit. https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html Change-Id: Iec3a5cd70ea6e912272ea231eecde6ee4f51ce4f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-16Add ContentType when publishing artifactsCédric Ollivier2-7/+54
The default value 'application/octet-stream' is mostly incorrect and forces downloading all links. https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-hunter-connection_check-run/436/console Change-Id: Ia680654f5e9f67154504264bc380f0a8d6a74d85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Improve file scanning when publishing artifactsCédric Ollivier2-5/+25
Else it copies files from other testcases if the full suite is executed sequentially. Change-Id: Ic61472e47b655c34823a6fcb3ed3615e8f84a4c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Add links in testcase detailsCédric Ollivier2-6/+8
It allows finding easily reports thanks to DB. Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Print Test API links in consoleCédric Ollivier3-2/+10
It adds TEST_DB_EXT_URL to print the right links in case of NAT or SSH port forwardings. Change-Id: If85b00de7325909facc903fba13a3fd59a1e705f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Add S3 env vars in env.pyCédric Ollivier1-1/+4
It completes the previous commits adding S3 support: https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68760 https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68796 Change-Id: Iaaeb02ef2d9c6cdb7ff6c2c52e7086c751119871 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-09Generate Html and Xunit Behave reportsCédric Ollivier2-12/+33
Change-Id: I7d5f31502ba61b61a0b1c885fe8828211bc0bc0a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-07Create Bucket if it doesn't existCédric Ollivier2-5/+52
Xtesting Ansible Role no longer creates bucket after starting Minio [1]. [1] https://github.com/collivier/ansible-role-xtesting/commit/8c62525bb0d0b5f8dcc2c4436711d5d075de8811 Change-Id: I1ad473ce55f9c00df8e558fdc67f571ee0a1875c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-02Publish artifacts to S3 repositoryCédric Ollivier7-5/+127
It simplifies Jenkins or Gitlab jobs by automatically publishing all artifacts via the framework. It leverages on Amazon Web Services (AWS) SDK [1] which supports the current cases (OPNFV, Xtesting Ansible role [2], etc.). [1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway [2] https://github.com/collivier/ansible-role-xtesting Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-26Switch to Python 3.7 and Alpine 3.10Cédric Ollivier7-11/+11
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: I8568eeafa44c5dba72e206c532c1f50e3ad547f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Adding first patch for behave featureDeepak Chandella7-15/+332
Change-Id: Ic975c301103b49cdec2bd26746b708388f21e892 Signed-off-by: Deepak Chandella <deepak.chandella@orange.com>
2019-06-14Remove energy modulesCédric Ollivier5-709/+1
The public recorder api has been down for a while. Change-Id: Ib879ef3b9ef56338c10cfcdeb733451c6f7573a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier2-4/+4
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-12Fix unit tests (py36)Cédric Ollivier2-12/+12
It completes the patch "Update to Python3" [1] which was not fully verified in Functest Gates [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67782/ [2] https://travis-ci.org/collivier/functest-xtesting/jobs/531380395 Change-Id: Icd0d743e14ca1430828907cefba10b50489020a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-12Stop setting utf-8 in decode/encode callsCédric Ollivier2-4/+4
It's the default value. Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-11Rename HelloWorld.txt to HelloWorld.robotCédric Ollivier2-1/+1
It takes the following warning into account [1] "Automatically parsing other than '*.robot' files is deprecated" [1] https://build.opnfv.org/ci/job/xtesting-opnfv-xtesting-latest-fifth-run/150/console Change-Id: Ibe01eea7eb83c8724d6b4afe3a487ad813fed30d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-07Update to Python3Cédric Ollivier4-11/+11
Now Xtesting containers use Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework to latest release. Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-24Enable debug messages via env varCédric Ollivier4-10/+75
It stops printing in xtesting.debug.log by default. It decreases testing duration via Raspberry PI without additional tasks [1]. [1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-04Remove url from logsCédric Ollivier1-1/+1
It can be false in case of NAT. Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Apply operations via sixerCédric Ollivier1-1/+1
Change-Id: I7609f83da73d0ac03fc0d270d42f44708335995c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Allow printing bash cmd output in consoleCédric Ollivier2-22/+117
It switches to Popen to print real-time console. Console has to be enabled per testcase (testcases.yaml). Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Generate reports for unit testsCédric Ollivier2-57/+262
It now leverages on subunit to generate html and xml reports. Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-01Set shell=True in subprocess.check_callCédric Ollivier2-24/+20
It allows running multiple shell instructions (see third). Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f99cef18b6dd3eff6703c4d748fae415fea78ae2)
2018-11-28Stop returning values in run()Cédric Ollivier1-1/+0
Runner only checks status via is_successful(). Change-Id: I12647449b037223ac4e3c6ee577610d4430d0bf5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19Fix a wierd pylint errorCédric Ollivier1-1/+2
Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-30Remove former samples/testcases.yamlCédric Ollivier1-66/+0
Change-Id: I1487c73ae4c6e2801c7952689c8d9fe49613db95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Stop verifying ResultWriter.write_results exit codesCédric Ollivier2-2/+2
ResultWriter.write_results() returns false if one test fails. It's skipped by run() because the report is correctly generated. [1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html Change-Id: If29059b272679ed89a1189e0bb52997c83401b94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Change output dirCédric Ollivier1-2/+2
It now reads case_name instead of selecting an hardcoded value (robot). Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Update RobotFramework configCédric Ollivier1-2/+1
It completes "Leverage on abc and stevedore". Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Initialize testcase results to EX_TESTCASE_FAILEDCédric Ollivier1-1/+1
Else the testcase returns EX_OK if exceptions in __init__() Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Merge "Protect vs None when calling regex"Cedric Ollivier1-1/+2
2018-08-14Protect vs None when calling regexCédric Ollivier1-1/+2
Change-Id: I93d22442c28e674433234d7729838944962bdbe2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier8-47/+81
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Skip the selected testcase too0.56Cédric Ollivier5-5/+51
It completes "Allow calling a skip test" [1] [1] https://gerrit.opnfv.org/gerrit/60655 Change-Id: I02499aed56e6b23563165ea1f17b476e12408823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Generate robot reportsCédric Ollivier2-6/+113
Change-Id: Ib9efe14bce6227f9609200c12ded4470bd0be969 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Allow calling a skip testCédric Ollivier3-11/+12
run_tests shouldn't return an incorrect value if the test is skipped. Else it simply forbids running tests in parallel (one test per thread). Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Stop skipping testcases if one raises exceptionsCédric Ollivier1-0/+6
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Stop printing exceptions twice0.53Cédric Ollivier1-3/+14
Change-Id: Ife772d33741e7023ed72afeb0f74ed8b461e0033 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Fix results when only one skipped testCédric Ollivier1-1/+3
Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Allow dynamically skipping testcases0.52Cédric Ollivier3-15/+67
Change-Id: I7cf47f0625bdb8345fef43b24c51bd84ef4486ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>