aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-12-27Allow printing bash cmd output in consoleCédric Ollivier2-22/+117
It switches to Popen to print real-time console. Console has to be enabled per testcase (testcases.yaml). Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Generate reports for unit testsCédric Ollivier4-58/+269
It now leverages on subunit to generate html and xml reports. Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-26Fix OpenStack version (master) in tox.iniCédric Ollivier1-1/+1
Change-Id: I4a5c3a85870ce515d64be5efb25b016908b56164 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-15Verify the Ansible playbook via ansible-lintCédric Ollivier2-1/+7
Change-Id: I9e6778b935a0a8d6e76cb4f1f16ef08c811eee73 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-15Verify missing yaml files via yamllintCédric Ollivier3-2/+4
Change-Id: I0cd412cd49cac62b393658bf55e0e32def908c85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-11Deploy CI/CD toolchains for any Xtesting-based projectCédric Ollivier1-0/+4
It allows deploying the CI/CD toolchain via ansible for all projects based on Xtesting (e.g. OPNFV Functest, ONAP robot tests, etc.). It deploys Jenkins, Minio and S3www and loads all jobs in Jenkins. Last components (MongoDB, TestAPI and dashboard) will be deployed in the next update of the ansible role. To deploy the testing toolchain: $ ansible-galaxy install collivier.xtesting $ ansible-playbook ansible/site.yml Change-Id: I5a8ddb45fc354c9a22c52f0d42ce2e0181f345b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-09Enable robot sample in the containerCédric Ollivier2-0/+67
The testcase is disabled by default in package as the location depends on OS. But it can be safely enabled in the Alpine container. Change-Id: I8d1befd09b8d823010dfce7fbb18eddb864fd6e6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-01Set shell=True in subprocess.check_callCédric Ollivier2-24/+20
It allows running multiple shell instructions (see third). Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f99cef18b6dd3eff6703c4d748fae415fea78ae2)
2018-11-28Stop returning values in run()Cédric Ollivier1-1/+0
Runner only checks status via is_successful(). Change-Id: I12647449b037223ac4e3c6ee577610d4430d0bf5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19Temporarily disable py36Cédric Ollivier1-1/+1
Verify servers haven't been updated yet to support py36. Change-Id: Id2999a94f9c2c03432412a4b40a4b3c593aaffb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19Fix a wierd pylint errorCédric Ollivier1-1/+2
Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-17Update python3 to python3.6Cédric Ollivier1-2/+2
Change-Id: I845f8eb0544dc32febec7a17ac7c05412eb31198 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-12Merge "Updated from global requirements"Cedric Ollivier2-14/+14
2018-09-12Updated from global requirementsCédric Ollivier2-14/+14
Change-Id: I8eb758bb28904ed9504cba4eef5a94026a0e34bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-12Follow OpenStack masterCédric Ollivier1-1/+1
Change-Id: I9b3ead197d54061adddbf47b6b94bbeb79c81793 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Rewrite git cloneCédric Ollivier1-2/+4
Change-Id: I0e17233faaf8eddb263e90cb82b65335f1c9cf40 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Publish daily and gating jjbsCédric Ollivier4-0/+124
Change-Id: I1050741ce34e151be30404275670e83fc2a40d1a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-01Update to Alpine 3.8Cédric Ollivier2-2/+2
https://alpinelinux.org/posts/Alpine-3.8.0-released.html Change-Id: I73fba49c3d1bbf018e94e67c835c4049c34209b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-30Remove former samples/testcases.yamlCédric Ollivier1-66/+0
Change-Id: I1487c73ae4c6e2801c7952689c8d9fe49613db95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Stop verifying ResultWriter.write_results exit codesCédric Ollivier2-2/+2
ResultWriter.write_results() returns false if one test fails. It's skipped by run() because the report is correctly generated. [1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html Change-Id: If29059b272679ed89a1189e0bb52997c83401b94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Change output dirCédric Ollivier1-2/+2
It now reads case_name instead of selecting an hardcoded value (robot). Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Update RobotFramework configCédric Ollivier1-2/+1
It completes "Leverage on abc and stevedore". Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Initialize testcase results to EX_TESTCASE_FAILEDCédric Ollivier1-1/+1
Else the testcase returns EX_OK if exceptions in __init__() Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Merge "Protect vs None when calling regex"Cedric Ollivier1-1/+2
2018-08-14Protect vs None when calling regexCédric Ollivier1-1/+2
Change-Id: I93d22442c28e674433234d7729838944962bdbe2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier11-47/+89
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Skip the selected testcase too0.56Cédric Ollivier6-6/+51
It completes "Allow calling a skip test" [1] [1] https://gerrit.opnfv.org/gerrit/60655 Change-Id: I02499aed56e6b23563165ea1f17b476e12408823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Generate robot reportsCédric Ollivier2-6/+113
Change-Id: Ib9efe14bce6227f9609200c12ded4470bd0be969 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Allow calling a skip testCédric Ollivier3-11/+12
run_tests shouldn't return an incorrect value if the test is skipped. Else it simply forbids running tests in parallel (one test per thread). Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Stop skipping testcases if one raises exceptionsCédric Ollivier1-0/+6
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Stop printing exceptions twice0.53Cédric Ollivier1-3/+14
Change-Id: Ife772d33741e7023ed72afeb0f74ed8b461e0033 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Fix results when only one skipped testCédric Ollivier1-1/+3
Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Allow dynamically skipping testcases0.52Cédric Ollivier3-15/+67
Change-Id: I7cf47f0625bdb8345fef43b24c51bd84ef4486ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Skip testcases by any env var0.51Cédric Ollivier8-131/+31
It also removes CI_LOOP which is releng centric. It can be passed as dependency if required. Change-Id: I146bb97950cb88062451158b7cc6a16c7f9d47a2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Improve dependency managementCédric Ollivier6-39/+26
It avoids declaring dependencies if needed. Negative regex are correcty managed as well. Change-Id: I0e978823526246bc4a5192e63a8a893a4add0e2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-29Remove Feature logger0.42Panagiotis Karalis3-61/+10
This class atttribute is removed as it's quite useless (it forces one module per project). All messages are now printed to xtesting.log whatever the namespace and all warnings are printed in console. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I6860eaf427093ea21b3bd78650bec7939e947b2d Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-24Check shell scripts via bashateCédric Ollivier3-4/+14
Change-Id: I33df0017945a32946c46bff0768624901e13f6f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Create a static method to configure logger0.41Cédric Ollivier1-4/+9
It helps OPNFV Features to configure their multiple loggers as self.logger is not suitable in case of multiple modules. Change-Id: I5794a3e323d70abfdd85db89a9890488828efd88 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Update to stable/queens0.40Cédric Ollivier2-2/+2
Change-Id: I2a8d624df52c0c705d5fbc662f11948bdc51d765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Updated from global requirementsCédric Ollivier2-8/+8
Change-Id: If9959fb71b9970a27f607ec1c491bf790adfe499 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-11Exclude doc/reveal.js from permCédric Ollivier1-1/+1
Change-Id: I6c81163d55217a374269ee7d2aae63a854c9fdeb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-10Updated from global requirementsCédric Ollivier1-1/+1
Change-Id: I8fae672c01c3fa9d99842827436e2e94cfac2be8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-07Check README.rst by doc8Cédric Ollivier1-1/+1
Change-Id: I9ac9fa26d49fd9cd01844e5579255cfadbd8b276 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-04Check API doc via doc8Cédric Ollivier7-235/+23
It also cleans unseless dirs. Change-Id: I52ddc9e2adcd13c95e4a8939397686f50b9e6c4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-31Ignore output dirs and filesCédric Ollivier1-0/+4
Change-Id: I5d8bbee73489e723dec4a1962c3b95943a038efc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-31Fix software names (uppercase letters)Cédric Ollivier1-13/+12
Change-Id: I1eba2a3594b050e4c50ac081a653011fa1e98426 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-24Update Xtesting presentationCédric Ollivier1-8/+23
Change-Id: Ida18f3fd0138eb70bb2dd6b512cec5bef470b685 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-23Publish xtesting presentationCédric Ollivier5-0/+190
Change-Id: Ia33a17ed5868bf61f088feea1a608603fdeb28dc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Fix regex when INSTALLER_TYPE is unsetCédric Ollivier2-16/+18
Change-Id: I0ec012185f3c90b2a2c82b6f204ce332f3fa9c7f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-18Update api/index.rstCédric Ollivier1-2/+60
It mainly copies the wiki main page [1]. [1] https://wiki.opnfv.org/display/functest/Xtesting Change-Id: Iaedfa2bbf83976654a626640b38d8cc27131d3d4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>