aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting
AgeCommit message (Collapse)AuthorFilesLines
2021-02-11Create dummy xtesting-mts:armCédric Ollivier1-0/+8
Change-Id: Ib6cc1236aa46b7fb1fd9dfa96750894d87c3563e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 239dc4006e01b78b5a3bda9faec604f19bcf87e7)
2021-02-09Take pylint's len-as-condition into accountCédric Ollivier1-2/+2
Change-Id: Ib19de453857a2732d9c70a24539a96cd7129613d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8fc7c92cd3a8704aff806c2b9c500369b7360759) (cherry picked from commit 5029cf1adddb5b3f25754bcc8c6b265e29678948)
2021-02-09Cleanup previous run output filesVincent Mahe1-4/+13
Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I9ec39012457ae1a5f7017d41d79237d7a1e300d4 (cherry picked from commit 43d5772accb16742f09ddbc3d89ff5c315a2c0a4)
2021-02-09Protect mts vs py2Cédric Ollivier1-8/+12
Change-Id: I7a9aa9267a81161b10b1d625efbaa924187f8690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cd0f0900cb9290f2e84ad184842d8d8ce543a2e7)
2021-02-09Add MTS driverVincent Mahe4-0/+323
It creates a new container xtesting-mts to avoid increase core container size. Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I59544023e1235747e140a442815778a133bf6acf (cherry picked from commit 32eb7687bf7b8440aa87805480789ef61ae65ec9)
2021-02-09Generate Html and Xunit Behave reportsCédric Ollivier2-55/+61
Change-Id: I7d5f31502ba61b61a0b1c885fe8828211bc0bc0a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 728f5c95df4d3edbe6b3f814a270cdf3b532aef9)
2021-02-09Adding first patch for behave featureDeepak Chandella7-15/+332
Change-Id: Ic975c301103b49cdec2bd26746b708388f21e892 Signed-off-by: Deepak Chandella <deepak.chandella@orange.com> (cherry picked from commit 5dd0d0ffd46e7665fddde8fd2f4da1a9b58506bb)
2020-09-05Wrap long env valuesCédric Ollivier1-1/+3
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-kali-k8s_smoke-run/162/console Change-Id: If6837a85f54309ad7c221144570c10eb1615993d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 16742834bbca1a7074f19a57d004a1b41068744d)
2020-09-05Fix duration calculationCédric Ollivier1-2/+3
It falsy printed 00:60 Change-Id: Ib2852268a6833b353232c80e9013b6926058479c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 242696fe51c7dc3530587350550ab07164706e56)
2020-09-05Remove order in testcases.yamlCédric Ollivier6-24/+8
It's not used and asked for useless configuration data. Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2480a8ed48d232b6395f992fc46d388ba2820872)
2020-09-05Make testcases descriptions optionalCédric Ollivier1-4/+4
Change-Id: If0e45f10816edd2199c589bb5fbfc03fbc0a4b77 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 150405525d6e9924858cd40c872600ddb2bfb57c)
2020-09-05Suppress admin password in default logsajay333-3/+3
Currently, OS_PASSWORD is getting printed in the console of Functest. This password is secret and must not be printed in default log file. This patch suppresses the logging of OS_PASSWORD unless users ask for debug logs. Signed-off-by: mahajanajay33@gmail.com Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4 (cherry picked from commit bbdc01c30dcf5a1365ad5a61ec0f7fee49b7fb59)
2020-03-17Post-processed data from DBCédric Ollivier1-2/+10
It removes base_url to match the location in archive. It forces a relative path by removing first "/". It makes sense but it may raise side effects in dovetail webportal. Change-Id: Idca69a99fed54ddf69334a865bae15b0a08220fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0ef9c196b42b8c9182710b0f937f775199b0feea)
2020-01-04Add a missing blank lineCédric Ollivier1-0/+1
Change-Id: I466d655162c1ddd5f4e3ef0e356a27007bfaea0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Compress Campaign data (zip)Cédric Ollivier1-1/+2
Change-Id: I7b46a88a181293297cc764026f2804d36a59955a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f187187c3afa730e94ffcdffd84e54494def306a)
2019-12-22Enable debug messages via env varCédric Ollivier4-10/+75
It stops printing in xtesting.debug.log by default. It decreases testing duration via Raspberry PI without additional tasks [1]. [1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump DB and artifacts for third-party certificationCédric Ollivier2-2/+217
It conforms with Kubernetes Conformance [1] model and could be reused by OVP or any third-party CNTT-based certification. It publishes the final archive in the S3 repository. XtestingCI will generate the final job calling this feature. [1] https://github.com/cncf/k8s-conformance Change-Id: I7394c9d52d2cc9370eae125ca5398ff734e5b8d6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 65b489bbc42c7b24c7f9a435de6e5094d5208cf3)
2019-11-30Postprocess the TestAPI href returnedCédric Ollivier3-7/+12
[1] returned http://localhost:8082 [1] https://build.opnfv.org/ci/job/airship-opnfv-functest-healthcheck-latest-connection_check-run/58/console Change-Id: Ifc0e37a97442193a77762ecc2928b100e27028cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 740afc884b2af2f068945e7a9963d5e4b66a1a0e)
2019-11-18Forbid multipart upload if google storageCédric Ollivier2-2/+12
Google Storage doesn't support S3 multipart uploads https://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html https://cloud.google.com/storage/docs/composite-objects 5 * 1024 ** 5 is the multipart upload limit. https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html Change-Id: Iec3a5cd70ea6e912272ea231eecde6ee4f51ce4f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f5aceb5447deed25234c5354b9dd9601115d9378)
2019-11-16Add ContentType when publishing artifactsCédric Ollivier2-7/+54
The default value 'application/octet-stream' is mostly incorrect and forces downloading all links. https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-hunter-connection_check-run/436/console Change-Id: Ia680654f5e9f67154504264bc380f0a8d6a74d85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e2e7dbe185a552b21315063dbbed8ac4f40f309d)
2019-11-09Improve file scanning when publishing artifactsCédric Ollivier2-5/+25
Else it copies files from other testcases if the full suite is executed sequentially. Change-Id: Ic61472e47b655c34823a6fcb3ed3615e8f84a4c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a48c62165923be6a37aaff5d54918dbe9cb6ff58)
2019-11-09Add links in testcase detailsCédric Ollivier2-6/+8
It allows finding easily reports thanks to DB. Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 256e6b0a10d43e930ecd81078d9cbcd89ebb5a06)
2019-11-09Print Test API links in consoleCédric Ollivier3-2/+10
It adds TEST_DB_EXT_URL to print the right links in case of NAT or SSH port forwardings. Change-Id: If85b00de7325909facc903fba13a3fd59a1e705f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 384308c4a5af0a66ff9e78de17ace94ab7d1d51f)
2019-11-09Add S3 env vars in env.pyCédric Ollivier1-1/+4
It completes the previous commits adding S3 support: https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68760 https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68796 Change-Id: Iaaeb02ef2d9c6cdb7ff6c2c52e7086c751119871 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 66809ebba91d1f068c0a930dba695c3b02fc85bd)
2019-11-07Create Bucket if it doesn't existCédric Ollivier2-5/+52
Xtesting Ansible Role no longer creates bucket after starting Minio [1]. [1] https://github.com/collivier/ansible-role-xtesting/commit/8c62525bb0d0b5f8dcc2c4436711d5d075de8811 Change-Id: I1ad473ce55f9c00df8e558fdc67f571ee0a1875c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7ddcfae7ff8a20fac21f5ba2b923e8e5cbce19e5)
2019-11-02Publish artifacts to S3 repositoryCédric Ollivier6-4/+127
It simplifies Jenkins or Gitlab jobs by automatically publishing all artifacts via the framework. It leverages on Amazon Web Services (AWS) SDK [1] which supports the current cases (OPNFV, Xtesting Ansible role [2], etc.). [1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway [2] https://github.com/collivier/ansible-role-xtesting Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d012f3ac3ec4aa2730532be095956867d797aefb)
2019-09-20Switch to py3.6 in containersCédric Ollivier10-717/+8
Xtesting has supported both py2 and py3. py3 is now selected due to the OPNFV Iruya planning closed to python2 EOL. It also removes energy as in master which should have been updated (pylint). Change-Id: Ic1113b95f85f5882676e10acea1159a808a98f32 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-21Add **kwargs in Energy wrapper()Cédric Ollivier1-1/+1
It's asked by few Functest testcases (rally_full). Change-Id: Ia1c91c9284f703d239542a1ed929f67eae15ca6c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Enable py36 unit testsCédric Ollivier3-7/+9
It benefits from the swith to lf-virtual1. Change-Id: I9f99f24a5e3c8ef6374e049d7117aa7d5aa4d442 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier2-4/+4
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 12aa6e34ec1f388a40cb5a00826729f7c0d6f201)
2019-05-23Fix unit tests (py36)Cédric Ollivier2-12/+12
It completes the patch "Update to Python3" [1] which was not fully verified in Functest Gates [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67782/ [2] https://travis-ci.org/collivier/functest-xtesting/jobs/531380395 Change-Id: Icd0d743e14ca1430828907cefba10b50489020a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 934e90a269ea6b65e38578ac3f9a8bf7fc5212b1)
2019-05-23Stop setting utf-8 in decode/encode callsCédric Ollivier2-4/+4
It's the default value. Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0d308f4db3434ae6f8147f0f452e5c542429e636)
2019-05-23Update to Python3Cédric Ollivier3-10/+10
Now Xtesting containers use Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework to latest release. Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6f8aa2785e0239dbed22fcb4d093a5bc110bcc3c)
2019-05-11Rename HelloWorld.txt to HelloWorld.robotCédric Ollivier2-1/+1
It takes the following warning into account [1] "Automatically parsing other than '*.robot' files is deprecated" [1] https://build.opnfv.org/ci/job/xtesting-opnfv-xtesting-latest-fifth-run/150/console Change-Id: Ibe01eea7eb83c8724d6b4afe3a487ad813fed30d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 74d0cd9b2c43a730c76ea3f03d0db8510a3be831)
2019-01-04Remove url from logsCédric Ollivier1-1/+1
It can be false in case of NAT. Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Apply operations via sixerCédric Ollivier1-1/+1
Change-Id: I7609f83da73d0ac03fc0d270d42f44708335995c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Allow printing bash cmd output in consoleCédric Ollivier2-22/+117
It switches to Popen to print real-time console. Console has to be enabled per testcase (testcases.yaml). Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Generate reports for unit testsCédric Ollivier2-57/+262
It now leverages on subunit to generate html and xml reports. Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-01Set shell=True in subprocess.check_callCédric Ollivier2-24/+20
It allows running multiple shell instructions (see third). Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f99cef18b6dd3eff6703c4d748fae415fea78ae2)
2018-11-28Stop returning values in run()Cédric Ollivier1-1/+0
Runner only checks status via is_successful(). Change-Id: I12647449b037223ac4e3c6ee577610d4430d0bf5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19Fix a wierd pylint errorCédric Ollivier1-1/+2
Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-30Remove former samples/testcases.yamlCédric Ollivier1-66/+0
Change-Id: I1487c73ae4c6e2801c7952689c8d9fe49613db95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Stop verifying ResultWriter.write_results exit codesCédric Ollivier2-2/+2
ResultWriter.write_results() returns false if one test fails. It's skipped by run() because the report is correctly generated. [1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html Change-Id: If29059b272679ed89a1189e0bb52997c83401b94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Change output dirCédric Ollivier1-2/+2
It now reads case_name instead of selecting an hardcoded value (robot). Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Update RobotFramework configCédric Ollivier1-2/+1
It completes "Leverage on abc and stevedore". Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Initialize testcase results to EX_TESTCASE_FAILEDCédric Ollivier1-1/+1
Else the testcase returns EX_OK if exceptions in __init__() Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Merge "Protect vs None when calling regex"Cedric Ollivier1-1/+2
2018-08-14Protect vs None when calling regexCédric Ollivier1-1/+2
Change-Id: I93d22442c28e674433234d7729838944962bdbe2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier8-47/+81
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Skip the selected testcase too0.56Cédric Ollivier5-5/+51
It completes "Allow calling a skip test" [1] [1] https://gerrit.opnfv.org/gerrit/60655 Change-Id: I02499aed56e6b23563165ea1f17b476e12408823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>