aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-06-03Add presentation for test APIMorgan Richomme3-0/+236
Change-Id: I23a474247680751bb4f9ac0cc17b00229edd8886 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-03Presentation Test community Design SummitMorgan Richomme1-0/+204
Change-Id: I34393b0398f1c7a4f7aef9fea79f265ec5c915b5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-02Stop the job and quit with error if a test case failsjose.lausuch1-0/+4
JIRA: FUNCTEST-282 Change-Id: I9fd638c19333772040481140f9e2324b7d80772f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-02Replace subnet by portCédric Ollivier6-61/+61
It also fixes several upper case letters and formats *delete*.robot Change-Id: I071be39860dd33296a067e4f3d0188d36e9b9660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Rename Robot Framework sources to *.robotCédric Ollivier3-0/+0
It avoids mixing robot and txt suffixes in the same directory. Change-Id: Ia2288cc9ad7dc86fc9a4cea2c6ca7a08a7dd3e3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Merge "Add criteria in testcases.yaml and Test class"Morgan Richomme5-6/+47
2016-06-01Fix duplicated output when using the functest loggerjose.lausuch1-0/+1
JIRA: FUNCTEST-275 Change-Id: I49c66521652b31d5bb398ea4013ac061f320d725 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01Merge "Add framework for presentations"Morgan Richomme119-0/+20622
2016-06-01Merge "Check correctly arguments"Morgan Richomme1-3/+7
2016-06-01Check correctly argumentsCédric Ollivier1-3/+7
It fixes argument parsing and verifies all mandatory arguments are provided. It also prevents UnboundLocalError exceptions. Change-Id: Iec3403533b312c95dd453236ccadb1fe495d61cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-01Add criteria in testcases.yaml and Test classjose.lausuch5-6/+47
JIRA: FUNCTEST-257 Added example of usage in vping_ssh Change-Id: Iac143b811db163f0f86682b0688948c20843ede5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01bug fix: pb when pushing bgpvpn results when no failedMorgan Richomme1-5/+11
failed field is empty (not equal to 0) JIRA: FUNCTEST-234 Change-Id: Ic243e1e23615d585a735266d9012fc4c52d67ba3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-01Merge "Add Apex based security scan code"Morgan Richomme9-330/+466
2016-05-31Avoid tuples when printing multiple stringsCédric Ollivier2-29/+29
It fixes bugs induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/12623 Change-Id: I0232b14bed767b3ff857192146551a7963699bb9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Write login correctlyCédric Ollivier1-1/+1
Change-Id: I1806fb7ac3d276065badd8537f84339c18a1856e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Add Apex based security scan codelukehinds9-330/+466
JIRA: FUNCTEST-169 Performs a SCAP based security scan of all overcloud nodes, followed by report download to functest dashboard Change-Id: I9058227e19c0877e5f8913931febdd667a908cdd Signed-off-by: lukehinds <lukehinds@gmail.com>
2016-05-31Remove unused CI_DEBUGCédric Ollivier1-1/+0
Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-30Bugfix: can not find tempest.logSerenaFeng1-24/+21
JIRA: FUNCTEST-269 Remove dependency on CI_DEBUG and use subprocess.call to redirect stdout to tempest.log in any case. Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-05-27Merge "bug fix: if all tests passed failed could be empty"Morgan Richomme1-4/+6
2016-05-27bug fix: if all tests passed failed could be emptyMorgan Richomme1-4/+6
consider failed only if regex match JIRA: FUNCTEST-234 Change-Id: Ie9d29c7bc1eb2f051600d689133b47bf276bc856 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-27Merge "Use flavor name instead of flavor id"Morgan Richomme2-5/+5
2016-05-27Merge "Add simple error logs in result DB"Morgan Richomme1-16/+28
2016-05-26Take report arg into accountCédric Ollivier1-1/+2
$report is now tested before calling odlreport2db.py Change-Id: I92be1488f710065dbc0a0c00e8023c6201028c2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-26Use flavor name instead of flavor idCédric Ollivier2-5/+5
Default flavor id changes if its attributes have been modified. Flavor name is used instead of flavor id. Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Add security_scan in Functest CI pipelineMorgan Richomme2-1/+15
JIRA: FUNCTEST-258 Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-25Merge "Added 60 sec delay before launching instances in healthcheck"Jose Lausuch1-0/+5
2016-05-25Push results if INSTALLER_TYPE and NODE_NAME are definedCédric Ollivier1-1/+3
INSTALLER_TYPE and NODE_NAME are also checked before pushing ODL results in DB Change-Id: If92c8b50d3ae7618475aeb25ab732c6dddb08019 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Allow unknown ci_installer or ci_scenario in is_compatibleCédric Ollivier1-4/+9
ci_installer and ci_scenario are only tested if they are set. At least one of theses variables must be set to get dependencies It modifies the previous logic introduced by the first implementation of tier_handler.py [1] [1] https://gerrit.opnfv.org/gerrit/#/c/12579/ Change-Id: Icc9663a620f0b18f502b3eff7c0ce0d71e4e5910 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Added 60 sec delay before launching instances in healthcheckvitikkan1-0/+5
This delay should be removed after resolving Jira case APEX-149. The purpose is to give some time to populate openflow rules by SDN controller in case of odl_l2 scenario. Change-Id: I05c0b82a7544e934d82f1fa37e2f146aab03f7b9 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-24Join Rally_full and Tempest_full in the same Tierjose.lausuch1-20/+3
JIRA: FUNCTEST-190 Change-Id: Ib82c59e0a68ed73caba79a0d5b2000861ee31552 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-23Add framework for presentationsMorgan Richomme119-0/+20622
Change-Id: I8ba24fb4b2a3a6c8d8c69f15a1fd9259aea4ab6c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-20Push bgpvpn_api results into Test DBMorgan Richomme1-5/+60
JIRA: FUNCTEST-234 Change-Id: I0494043bff6a37dc94724dfee1a718a1ab9fbcf3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Preserving Nova instances from os_defaults.yamlvitikkan1-12/+18
Previously clean_openstack deleted all the existing instances even if they were included into os_defaults.yaml. Change-Id: Id7c17ec86a5616c44bd2965844a4a8545054358b Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-19Fix path for vping.sh and exit if SCP failsjose.lausuch1-1/+3
Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-19fix vPing paths post refactoring effectMorgan Richomme1-2/+2
Change-Id: I24e961965db5103af1625418e7f5ae977bcabf54 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-17Change 'testcases' directory structurejose.lausuch60-37/+32
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-17Merge "BGPVPN test case refactored"Morgan Richomme4-32/+86
2016-05-17Merge "Catch TypeError exceptions in ci/tier_handler.py"Jose Lausuch1-6/+6
2016-05-16BGPVPN test case refactoredvitikkan4-32/+86
BGPVPN test case is refactored and moved into bgpvpn.py module. JIRA: FUNCTEST-234 Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-13Refactor ODL vars in ci/exec_test.shCédric Ollivier1-10/+5
neutron_ip is set equal to neutron public endpoint and odl_ip to neutron_ip or SDN_CONTROLLER according to INSTALLER_TYPE. It also doesn't exit if INSTALLER_TYPE is unset. Change-Id: I9ffa9f2837216ba88645d9bdfeeedd7a86a50b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Replace error in ci/exec_test.shCédric Ollivier1-2/+2
error undefined in ci/exec_test.sh is now replaced by echo $msg >&2 Change-Id: I90fc44d94680206a2b0e85f9dfa5c48dadf6ac04 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Catch TypeError exceptions in ci/tier_handler.pyCédric Ollivier1-6/+6
If INSTALLER_TYPE is unset, is_compatible returns False instead of raising an ErrorType exception. Change-Id: I55c219808851907a19e2aa0124eb13d53a5e685d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Merge "Added handling of blacklist for tempest"Jose Lausuch1-39/+72
2016-05-13Added handling of blacklist for tempestvitikkan1-39/+72
It is now possible to exclude some specific test cases ("black list") from the test case suites. JIRA: FUNCTEST-197 Change-Id: I2946a010793da0a3d3ef1d96aa0ca0840e8a761d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-12Add protections if INSTALLER_TYPE is unsetCédric Ollivier1-5/+5
It avoids unary operator expected errors. Change-Id: Ie717631b651b258d9bf62706f09c6f6b7c534620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-12Merge "Fix typos in testcases.yaml"Jose Lausuch1-2/+2
2016-05-11Fix typos in testcases.yamlCédric Ollivier1-2/+2
Change-Id: I7b014c55b626a06c0b4aaba006691f726f88acac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Respect multiline syntax in DockerfileCédric Ollivier1-3/+7
It fixes errors in /home/opnfv/.bashrc induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/13699/ Change-Id: I07ff6504ee8fee7428b700553419d1208e639379 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Fix a few nits in prepare_env and dockerfilejose.lausuch2-2/+2
Change-Id: Idb407ab80a41be0838c35d79819f8953885ba668 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>