aboutsummaryrefslogtreecommitdiffstats
path: root/xtesting
AgeCommit message (Collapse)AuthorFilesLines
2019-01-04Remove url from logsCédric Ollivier1-1/+1
It can be false in case of NAT. Change-Id: Id1f4b59eeaf466545cc906bd86c2917b8df2b7a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Apply operations via sixerCédric Ollivier1-1/+1
Change-Id: I7609f83da73d0ac03fc0d270d42f44708335995c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Allow printing bash cmd output in consoleCédric Ollivier2-22/+117
It switches to Popen to print real-time console. Console has to be enabled per testcase (testcases.yaml). Change-Id: Id36b42c8409262f7c443e98ae2bcc465984b287f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-27Generate reports for unit testsCédric Ollivier2-57/+262
It now leverages on subunit to generate html and xml reports. Change-Id: I3f5a4fe5547e743b122b63e0b8530c9d9677cdbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-01Set shell=True in subprocess.check_callCédric Ollivier2-24/+20
It allows running multiple shell instructions (see third). Change-Id: I132813c51d42f0fb4bc729d315c468d426f2fb3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f99cef18b6dd3eff6703c4d748fae415fea78ae2)
2018-11-28Stop returning values in run()Cédric Ollivier1-1/+0
Runner only checks status via is_successful(). Change-Id: I12647449b037223ac4e3c6ee577610d4430d0bf5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19Fix a wierd pylint errorCédric Ollivier1-1/+2
Change-Id: Ia213e3e1beb80e62f6691c79544b1a0e0e3bb81e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-30Remove former samples/testcases.yamlCédric Ollivier1-66/+0
Change-Id: I1487c73ae4c6e2801c7952689c8d9fe49613db95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Stop verifying ResultWriter.write_results exit codesCédric Ollivier2-2/+2
ResultWriter.write_results() returns false if one test fails. It's skipped by run() because the report is correctly generated. [1] https://robot-framework.readthedocs.io/en/2.9.2/_modules/robot/reporting/resultwriter.html Change-Id: If29059b272679ed89a1189e0bb52997c83401b94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Change output dirCédric Ollivier1-2/+2
It now reads case_name instead of selecting an hardcoded value (robot). Change-Id: I1dfb0daa2eb52f526abdf1664bf5ac36549509a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Update RobotFramework configCédric Ollivier1-2/+1
It completes "Leverage on abc and stevedore". Change-Id: Ieb8e7dee79cd4a8a1e93e2db9945577754e35aa8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Initialize testcase results to EX_TESTCASE_FAILEDCédric Ollivier1-1/+1
Else the testcase returns EX_OK if exceptions in __init__() Change-Id: I5f23e91a3ecda22a429a006af56592ee86084038 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Merge "Protect vs None when calling regex"Cedric Ollivier1-1/+2
2018-08-14Protect vs None when calling regexCédric Ollivier1-1/+2
Change-Id: I93d22442c28e674433234d7729838944962bdbe2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Leverage on abc and stevedoreCédric Ollivier8-47/+81
Change-Id: I7b3c4c0c5dd0c9e6fb3e52c3fff5221d4b831b02 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Skip the selected testcase too0.56Cédric Ollivier5-5/+51
It completes "Allow calling a skip test" [1] [1] https://gerrit.opnfv.org/gerrit/60655 Change-Id: I02499aed56e6b23563165ea1f17b476e12408823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Generate robot reportsCédric Ollivier2-6/+113
Change-Id: Ib9efe14bce6227f9609200c12ded4470bd0be969 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Allow calling a skip testCédric Ollivier3-11/+12
run_tests shouldn't return an incorrect value if the test is skipped. Else it simply forbids running tests in parallel (one test per thread). Change-Id: I07efca28dbf6cf1c29ec8e5c999e38cfe3ad0aad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Stop skipping testcases if one raises exceptionsCédric Ollivier1-0/+6
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ic412c5b55169f599bd9cdb623f349dd2220940db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Stop printing exceptions twice0.53Cédric Ollivier1-3/+14
Change-Id: Ife772d33741e7023ed72afeb0f74ed8b461e0033 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Fix results when only one skipped testCédric Ollivier1-1/+3
Change-Id: Id6c8029b8be1e3a01979feb45daebad08710fe20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Allow dynamically skipping testcases0.52Cédric Ollivier3-15/+67
Change-Id: I7cf47f0625bdb8345fef43b24c51bd84ef4486ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Skip testcases by any env var0.51Cédric Ollivier7-130/+31
It also removes CI_LOOP which is releng centric. It can be passed as dependency if required. Change-Id: I146bb97950cb88062451158b7cc6a16c7f9d47a2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Improve dependency managementCédric Ollivier6-39/+26
It avoids declaring dependencies if needed. Negative regex are correcty managed as well. Change-Id: I0e978823526246bc4a5192e63a8a893a4add0e2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-29Remove Feature logger0.42Panagiotis Karalis3-61/+10
This class atttribute is removed as it's quite useless (it forces one module per project). All messages are now printed to xtesting.log whatever the namespace and all warnings are printed in console. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I6860eaf427093ea21b3bd78650bec7939e947b2d Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Create a static method to configure logger0.41Cédric Ollivier1-4/+9
It helps OPNFV Features to configure their multiple loggers as self.logger is not suitable in case of multiple modules. Change-Id: I5794a3e323d70abfdd85db89a9890488828efd88 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Fix regex when INSTALLER_TYPE is unsetCédric Ollivier2-16/+18
Change-Id: I0ec012185f3c90b2a2c82b6f204ce332f3fa9c7f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-08Add tags support using include optionsmrichomme2-5/+7
Change-Id: Ibfd8645e2ec7da7d05ae806b5bc1f5a90bfc39a2 Signed-off-by: mrichomme <morgan.richomme@orange.com>
2018-03-06Add py3 support in samplesCédric Ollivier2-2/+6
Change-Id: I402be2f5921577985218306161a6efe1b9d62a48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-04Return all status when running tiers0.22Cédric Ollivier1-2/+1
Change-Id: I31a062304d47c055c14e5afe8f560c3048b071f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-03Stop filtering the project when calculating results0.21Cédric Ollivier1-4/+1
Change-Id: Ia0917426775831176206f4bb300d513cc3190e08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01Remove Functest-related env varsCédric Ollivier1-3/+0
Change-Id: If1b44ad61db58fd3d02817373255c6467f515e85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Switch from /home/opnfv/functest to /var/lib/xtestingCédric Ollivier8-5/+16
Functest containers will have to create symlinks to allow publishing artifacts. All classes create the mandatory dirs. Change-Id: Ia1f215005d553dd6d64685e4d8a3f5c843c5db7a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Publish Dockerfile and samplesCédric Ollivier8-377/+170
Change-Id: Ie776fea631f04bb42d8ae80bc658318d8644d0e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Fully cover tier_builder.pyCédric Ollivier1-2/+13
Change-Id: I48ad1d430bb56b5be75b003800990a251f6a4065 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Remove all OpenStack operations in vnf.pyCédric Ollivier2-91/+4
Change-Id: I356305f3c59b51f97f5fb1335369834a77fda9b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Rename all Functest refs to XtestingCédric Ollivier36-0/+4224
It mainly renames python modules and then the related documentation config files. Change-Id: I186010bb88d3d39afe7b8fd1ebcef9c690cc1282 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>