aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting
AgeCommit message (Collapse)AuthorFilesLines
2021-02-12Create dummy xtesting-mts:armCédric Ollivier1-0/+8
Change-Id: Ib6cc1236aa46b7fb1fd9dfa96750894d87c3563e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 239dc4006e01b78b5a3bda9faec604f19bcf87e7)
2021-02-09Fix pylint issuesCédric Ollivier1-0/+2
Change-Id: Id6f0ce4c594d1f377fd2added3010de681855561 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-09Take pylint's len-as-condition into accountCédric Ollivier1-2/+2
Change-Id: Ib19de453857a2732d9c70a24539a96cd7129613d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8fc7c92cd3a8704aff806c2b9c500369b7360759) (cherry picked from commit 5029cf1adddb5b3f25754bcc8c6b265e29678948)
2021-02-09Cleanup previous run output filesVincent Mahe2-5/+14
Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I9ec39012457ae1a5f7017d41d79237d7a1e300d4 (cherry picked from commit 43d5772accb16742f09ddbc3d89ff5c315a2c0a4)
2021-02-09Protect mts vs py2Cédric Ollivier1-8/+12
Change-Id: I7a9aa9267a81161b10b1d625efbaa924187f8690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cd0f0900cb9290f2e84ad184842d8d8ce543a2e7)
2021-02-09Add MTS driverVincent Mahe4-0/+323
It creates a new container xtesting-mts to avoid increase core container size. Signed-off-by: Vincent Mahe <v.mahe@orange.com> Change-Id: I59544023e1235747e140a442815778a133bf6acf (cherry picked from commit 32eb7687bf7b8440aa87805480789ef61ae65ec9)
2021-02-09Generate Html and Xunit Behave reportsCédric Ollivier2-55/+61
Change-Id: I7d5f31502ba61b61a0b1c885fe8828211bc0bc0a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 728f5c95df4d3edbe6b3f814a270cdf3b532aef9)
2021-02-09Adding first patch for behave featureDeepak Chandella7-15/+332
Change-Id: Ic975c301103b49cdec2bd26746b708388f21e892 Signed-off-by: Deepak Chandella <deepak.chandella@orange.com> (cherry picked from commit 5dd0d0ffd46e7665fddde8fd2f4da1a9b58506bb) (cherry picked from commit b7d72be6458dbe73e3893ba242fb2dd7a6c745fc)
2020-09-05Wrap long env valuesCédric Ollivier1-1/+3
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-kali-k8s_smoke-run/162/console Change-Id: If6837a85f54309ad7c221144570c10eb1615993d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 16742834bbca1a7074f19a57d004a1b41068744d)
2020-09-05Fix duration calculationCédric Ollivier1-2/+3
It falsy printed 00:60 Change-Id: Ib2852268a6833b353232c80e9013b6926058479c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 242696fe51c7dc3530587350550ab07164706e56)
2020-09-05Remove order in testcases.yamlCédric Ollivier6-24/+8
It's not used and asked for useless configuration data. Change-Id: Ie1713873aa880bed74bc3c9c4c08da5b30ea3bbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2480a8ed48d232b6395f992fc46d388ba2820872)
2020-09-05Make testcases descriptions optionalCédric Ollivier1-4/+4
Change-Id: If0e45f10816edd2199c589bb5fbfc03fbc0a4b77 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 150405525d6e9924858cd40c872600ddb2bfb57c)
2020-09-05Suppress admin password in default logsajay333-3/+3
Currently, OS_PASSWORD is getting printed in the console of Functest. This password is secret and must not be printed in default log file. This patch suppresses the logging of OS_PASSWORD unless users ask for debug logs. Signed-off-by: mahajanajay33@gmail.com Change-Id: Ib83a12eb09a8551b30b352858649932a5ca842e4 (cherry picked from commit bbdc01c30dcf5a1365ad5a61ec0f7fee49b7fb59)
2020-03-17Post-processed data from DBCédric Ollivier1-2/+10
It removes base_url to match the location in archive. It forces a relative path by removing first "/". It makes sense but it may raise side effects in dovetail webportal. Change-Id: Idca69a99fed54ddf69334a865bae15b0a08220fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0ef9c196b42b8c9182710b0f937f775199b0feea)
2020-01-04Add a missing blank lineCédric Ollivier1-0/+1
Change-Id: I466d655162c1ddd5f4e3ef0e356a27007bfaea0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1578582efb2dd748fce2e44174c54fd2613bf492)
2019-12-22Compress Campaign data (zip)Cédric Ollivier1-1/+2
Change-Id: I7b46a88a181293297cc764026f2804d36a59955a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f187187c3afa730e94ffcdffd84e54494def306a)
2019-12-22Enable debug messages via env varCédric Ollivier4-10/+75
It stops printing in xtesting.debug.log by default. It decreases testing duration via Raspberry PI without additional tasks [1]. [1] https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI Change-Id: I2eded47a7a150a45330a69f3262fc7ca6fdb7463 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump DB and artifacts for third-party certificationCédric Ollivier2-2/+217
It conforms with Kubernetes Conformance [1] model and could be reused by OVP or any third-party CNTT-based certification. It publishes the final archive in the S3 repository. XtestingCI will generate the final job calling this feature. [1] https://github.com/cncf/k8s-conformance Change-Id: I7394c9d52d2cc9370eae125ca5398ff734e5b8d6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 65b489bbc42c7b24c7f9a435de6e5094d5208cf3)
2019-11-30Postprocess the TestAPI href returnedCédric Ollivier3-7/+12
[1] returned http://localhost:8082 [1] https://build.opnfv.org/ci/job/airship-opnfv-functest-healthcheck-latest-connection_check-run/58/console Change-Id: Ifc0e37a97442193a77762ecc2928b100e27028cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 740afc884b2af2f068945e7a9963d5e4b66a1a0e)
2019-11-18Forbid multipart upload if google storageCédric Ollivier2-2/+12
Google Storage doesn't support S3 multipart uploads https://docs.aws.amazon.com/AmazonS3/latest/dev/mpuoverview.html https://cloud.google.com/storage/docs/composite-objects 5 * 1024 ** 5 is the multipart upload limit. https://docs.aws.amazon.com/AmazonS3/latest/dev/qfacts.html Change-Id: Iec3a5cd70ea6e912272ea231eecde6ee4f51ce4f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f5aceb5447deed25234c5354b9dd9601115d9378)
2019-11-16Add ContentType when publishing artifactsCédric Ollivier2-7/+54
The default value 'application/octet-stream' is mostly incorrect and forces downloading all links. https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-hunter-connection_check-run/436/console Change-Id: Ia680654f5e9f67154504264bc380f0a8d6a74d85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e2e7dbe185a552b21315063dbbed8ac4f40f309d)
2019-11-09Improve file scanning when publishing artifactsCédric Ollivier2-5/+25
Else it copies files from other testcases if the full suite is executed sequentially. Change-Id: Ic61472e47b655c34823a6fcb3ed3615e8f84a4c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a48c62165923be6a37aaff5d54918dbe9cb6ff58)
2019-11-09Add links in testcase detailsCédric Ollivier2-6/+8
It allows finding easily reports thanks to DB. Change-Id: Ib5c4400c186fd320ae87e7fd3d4404b65e996a82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 256e6b0a10d43e930ecd81078d9cbcd89ebb5a06)
2019-11-09Print Test API links in consoleCédric Ollivier3-2/+10
It adds TEST_DB_EXT_URL to print the right links in case of NAT or SSH port forwardings. Change-Id: If85b00de7325909facc903fba13a3fd59a1e705f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 384308c4a5af0a66ff9e78de17ace94ab7d1d51f)
2019-11-09Add S3 env vars in env.pyCédric Ollivier1-1/+4
It completes the previous commits adding S3 support: https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68760 https://gerrit.opnfv.org/gerrit/c/functest-xtesting/+/68796 Change-Id: Iaaeb02ef2d9c6cdb7ff6c2c52e7086c751119871 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 66809ebba91d1f068c0a930dba695c3b02fc85bd)
2019-11-07Create Bucket if it doesn't existCédric Ollivier2-5/+52
Xtesting Ansible Role no longer creates bucket after starting Minio [1]. [1] https://github.com/collivier/ansible-role-xtesting/commit/8c62525bb0d0b5f8dcc2c4436711d5d075de8811 Change-Id: I1ad473ce55f9c00df8e558fdc67f571ee0a1875c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7ddcfae7ff8a20fac21f5ba2b923e8e5cbce19e5)
2019-11-02Publish artifacts to S3 repositoryCédric Ollivier6-4/+127
It simplifies Jenkins or Gitlab jobs by automatically publishing all artifacts via the framework. It leverages on Amazon Web Services (AWS) SDK [1] which supports the current cases (OPNFV, Xtesting Ansible role [2], etc.). [1] https://boto3.amazonaws.com/v1/documentation/api/latest/index.html?id=docs_gateway [2] https://github.com/collivier/ansible-role-xtesting Change-Id: I66e380c4da29fb0f973472a2c59ae0ea3c44fcfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d012f3ac3ec4aa2730532be095956867d797aefb)
2019-08-21Add **kwargs in Energy wrapper()Cédric Ollivier1-1/+1
It's asked by few Functest testcases (rally_full). Change-Id: Ia1c91c9284f703d239542a1ed929f67eae15ca6c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6bacb465e3075a3288db140abeab8daca4d256d0)
2019-07-27Enable py36 unit testsCédric Ollivier3-7/+9
It benefits from the swith to lf-virtual1. Change-Id: I9f99f24a5e3c8ef6374e049d7117aa7d5aa4d442 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a8287fbdee4a75f1a8bd54f0c9072bc637242e03)
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier2-4/+4
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I09c793469bdf4a679e6ed5a268e705efa5f2a20f Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 12aa6e34ec1f388a40cb5a00826729f7c0d6f201)
2019-05-23Fix unit tests (py36)Cédric Ollivier2-12/+12
It completes the patch "Update to Python3" [1] which was not fully verified in Functest Gates [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67782/ [2] https://travis-ci.org/collivier/functest-xtesting/jobs/531380395 Change-Id: Icd0d743e14ca1430828907cefba10b50489020a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 934e90a269ea6b65e38578ac3f9a8bf7fc5212b1)
2019-05-23Stop setting utf-8 in decode/encode callsCédric Ollivier2-4/+4
It's the default value. Change-Id: I301f750cabc41a1564a700ae8d7328f195a4ae9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0d308f4db3434ae6f8147f0f452e5c542429e636)
2019-05-23Update to Python3Cédric Ollivier3-10/+10
Now Xtesting containers use Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework to latest release. Change-Id: I57e0d8b1af9aeaae0c445941a9bdf0b8bd346834 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6f8aa2785e0239dbed22fcb4d093a5bc110bcc3c)
2019-05-11Rename HelloWorld.txt to HelloWorld.robotCédric Ollivier2-1/+1
It takes the following warning into account [1] "Automatically parsing other than '*.robot' files is deprecated" [1] https://build.opnfv.org/ci/job/xtesting-opnfv-xtesting-latest-fifth-run/150/console Change-Id: Ibe01eea7eb83c8724d6b4afe3a487ad813fed30d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 74d0cd9b2c43a730c76ea3f03d0db8510a3be831)
2019-01-04Remove url from logsCédric Ollivier1-1/+1
It can be false in case of NAT. Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 20e96ac57df21108cd23feea709e734907866fb6)
2018-12-27Apply operations via sixerCédric Ollivier1-1/+1
Change-Id: I7609f83da73d0ac03fc0d270d42f44708335995c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d66b6c6d89059055e67ac939c258b0dc6fac9825)
2018-12-27Allow printing bash cmd output in consoleCédric Ollivier2-22/+117
It switches to Popen to print real-time console. Console has to be enabled per testcase (testcases.yaml). Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ebe4291c4457d84cb8425999cfa12371c1c7ce40)
2018-12-27Generate reports for unit testsCédric Ollivier2-57/+262
It now leverages on subunit to generate html and xml reports. Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 07d8b10d394d1632742c16e4f1f45a29879cf7c1)
2018-12-01Set shell=True in subprocess.check_callCédric Ollivier2-24/+20
It allows running multiple shell instructions (see third). Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit eae8283aaadeb77884406ded028f2e414659c3b3)
2018-12-01Stop returning values in run()Cédric Ollivier1-1/+0
Runner only checks status via is_successful(). Change-Id: I12647449b037223ac4e3c6ee577610d4430d0bf5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0afe15823d98871a09ae88840a2d3538137299a8)
2018-10-19Fix a wierd pylint errorCédric Ollivier1-1/+2
Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9b3774344894b076dc0824630523f93f0943ee67)
2018-08-30Remove former samples/testcases.yamlCédric Ollivier1-66/+0
Change-Id: I1487c73ae4c6e2801c7952689c8d9fe49613db95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Stop verifying ResultWriter.write_results exit codesCédric Ollivier2-2/+2
ResultWriter.write_results() returns false if one test fails. It's skipped by run() because the report is correctly generated. [1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html Change-Id: If29059b272679ed89a1189e0bb52997c83401b94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Change output dirCédric Ollivier1-2/+2
It now reads case_name instead of selecting an hardcoded value (robot). Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Update RobotFramework configCédric Ollivier1-2/+1
It completes "Leverage on abc and stevedore". Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Initialize testcase results to EX_TESTCASE_FAILEDCédric Ollivier1-1/+1
Else the testcase returns EX_OK if exceptions in __init__() Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Merge "Protect vs None when calling regex"Cedric Ollivier1-1/+2
2018-08-14Protect vs None when calling regexCédric Ollivier1-1/+2
Change-Id: I93d22442c28e674433234d7729838944962bdbe2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier8-47/+81
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Skip the selected testcase too0.56Cédric Ollivier5-5/+51
It completes "Allow calling a skip test" [1] [1] https://gerrit.opnfv.org/gerrit/60655 Change-Id: I02499aed56e6b23563165ea1f17b476e12408823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>