aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-05-27Merge "bug fix: if all tests passed failed could be empty"Morgan Richomme1-4/+6
2016-05-27bug fix: if all tests passed failed could be emptyMorgan Richomme1-4/+6
consider failed only if regex match JIRA: FUNCTEST-234 Change-Id: Ie9d29c7bc1eb2f051600d689133b47bf276bc856 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-27Merge "Use flavor name instead of flavor id"Morgan Richomme2-5/+5
2016-05-27Merge "Add simple error logs in result DB"Morgan Richomme1-16/+28
2016-05-26Take report arg into accountCédric Ollivier1-1/+2
$report is now tested before calling odlreport2db.py Change-Id: I92be1488f710065dbc0a0c00e8023c6201028c2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-26Use flavor name instead of flavor idCédric Ollivier2-5/+5
Default flavor id changes if its attributes have been modified. Flavor name is used instead of flavor id. Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Add security_scan in Functest CI pipelineMorgan Richomme2-1/+15
JIRA: FUNCTEST-258 Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-25Merge "Added 60 sec delay before launching instances in healthcheck"Jose Lausuch1-0/+5
2016-05-25Push results if INSTALLER_TYPE and NODE_NAME are definedCédric Ollivier1-1/+3
INSTALLER_TYPE and NODE_NAME are also checked before pushing ODL results in DB Change-Id: If92c8b50d3ae7618475aeb25ab732c6dddb08019 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Allow unknown ci_installer or ci_scenario in is_compatibleCédric Ollivier1-4/+9
ci_installer and ci_scenario are only tested if they are set. At least one of theses variables must be set to get dependencies It modifies the previous logic introduced by the first implementation of tier_handler.py [1] [1] https://gerrit.opnfv.org/gerrit/#/c/12579/ Change-Id: Icc9663a620f0b18f502b3eff7c0ce0d71e4e5910 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Added 60 sec delay before launching instances in healthcheckvitikkan1-0/+5
This delay should be removed after resolving Jira case APEX-149. The purpose is to give some time to populate openflow rules by SDN controller in case of odl_l2 scenario. Change-Id: I05c0b82a7544e934d82f1fa37e2f146aab03f7b9 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-24Join Rally_full and Tempest_full in the same Tierjose.lausuch1-20/+3
JIRA: FUNCTEST-190 Change-Id: Ib82c59e0a68ed73caba79a0d5b2000861ee31552 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-20Push bgpvpn_api results into Test DBMorgan Richomme1-5/+60
JIRA: FUNCTEST-234 Change-Id: I0494043bff6a37dc94724dfee1a718a1ab9fbcf3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Preserving Nova instances from os_defaults.yamlvitikkan1-12/+18
Previously clean_openstack deleted all the existing instances even if they were included into os_defaults.yaml. Change-Id: Id7c17ec86a5616c44bd2965844a4a8545054358b Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-19Fix path for vping.sh and exit if SCP failsjose.lausuch1-1/+3
Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-19fix vPing paths post refactoring effectMorgan Richomme1-2/+2
Change-Id: I24e961965db5103af1625418e7f5ae977bcabf54 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-17Change 'testcases' directory structurejose.lausuch60-37/+32
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-17Merge "BGPVPN test case refactored"Morgan Richomme4-32/+86
2016-05-17Merge "Catch TypeError exceptions in ci/tier_handler.py"Jose Lausuch1-6/+6
2016-05-16BGPVPN test case refactoredvitikkan4-32/+86
BGPVPN test case is refactored and moved into bgpvpn.py module. JIRA: FUNCTEST-234 Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-13Refactor ODL vars in ci/exec_test.shCédric Ollivier1-10/+5
neutron_ip is set equal to neutron public endpoint and odl_ip to neutron_ip or SDN_CONTROLLER according to INSTALLER_TYPE. It also doesn't exit if INSTALLER_TYPE is unset. Change-Id: I9ffa9f2837216ba88645d9bdfeeedd7a86a50b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Replace error in ci/exec_test.shCédric Ollivier1-2/+2
error undefined in ci/exec_test.sh is now replaced by echo $msg >&2 Change-Id: I90fc44d94680206a2b0e85f9dfa5c48dadf6ac04 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Catch TypeError exceptions in ci/tier_handler.pyCédric Ollivier1-6/+6
If INSTALLER_TYPE is unset, is_compatible returns False instead of raising an ErrorType exception. Change-Id: I55c219808851907a19e2aa0124eb13d53a5e685d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Merge "Added handling of blacklist for tempest"Jose Lausuch1-39/+72
2016-05-13Added handling of blacklist for tempestvitikkan1-39/+72
It is now possible to exclude some specific test cases ("black list") from the test case suites. JIRA: FUNCTEST-197 Change-Id: I2946a010793da0a3d3ef1d96aa0ca0840e8a761d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-12Add protections if INSTALLER_TYPE is unsetCédric Ollivier1-5/+5
It avoids unary operator expected errors. Change-Id: Ie717631b651b258d9bf62706f09c6f6b7c534620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-12Merge "Fix typos in testcases.yaml"Jose Lausuch1-2/+2
2016-05-11Fix typos in testcases.yamlCédric Ollivier1-2/+2
Change-Id: I7b014c55b626a06c0b4aaba006691f726f88acac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Respect multiline syntax in DockerfileCédric Ollivier1-3/+7
It fixes errors in /home/opnfv/.bashrc induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/13699/ Change-Id: I07ff6504ee8fee7428b700553419d1208e639379 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Fix a few nits in prepare_env and dockerfilejose.lausuch2-2/+2
Change-Id: Idb407ab80a41be0838c35d79819f8953885ba668 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-11Specify the field id in neutron argumentsCédric Ollivier1-1/+1
It fixes the parsing error when 2 subnets are created on a specific network. Change-Id: I46154a65d0e916387faea5b506ae6a93240c6726 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Removed obsolete modulesvitikkan2-122/+0
testcases/VIM/OpenStack/CI/libraries/check_os.sh testcases/VIM/OpenStack/CI/libraries/os_defaults.yaml Change-Id: I835bfbdc9aa43903ca2ad6041a38216fd68263a5 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Split tempest into smoke and full modesvitikkan3-20/+20
"tempest_smoke_serial" and "tempest_full_parallel" test cases replace the original "tempest" case. Corrected fetching tempest results from "rally verify list" output (last result is taken instead of the first one). This correction is needed when "rally verify start" is run multiple times. JIRA: FUNCTEST-242 Change-Id: I544a22081655af819dbaaaafc0ba0fa6eae1e4ea Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-10Enable sanity mode of Rally test for the CI runsJuha Kosonen2-12/+15
JIRA: FUNCTEST-241 Change-Id: Ie37657bf9e8c01ae4126c1c45146d8aadb2c5775 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-10Adapt tiers to run depending on WEEKLY/DAILYjose.lausuch5-19/+35
JIRA: FUNCTEST-244 Change-Id: I11bf28baff52b75b0f6c58845edc22f266dfcbe8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-10Merge "CLI implementation"jose.lausuch13-151/+461
2016-05-10Create a private shared network for RallyJuha Kosonen2-4/+31
Since functest-net will be obsolete, own private network, subnet and router is created for Rally tests. JIRA: FUNCTEST-240 Change-Id: I8a30e2b4fe12238dba526c21188c85f75bacc0b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-10Creating private network for Tempestvitikkan2-36/+29
Since functest-net will be obsolete, own private network, subnet and router is taken into use for Tempest test. JIRA: FUNCTEST-239 Change-Id: I2b9f6aae74dc36decf305a4531fe0a071031aca3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-09CLI implementationjose.lausuch13-151/+461
JIRA: FUNCTEST-243 Change-Id: Ibf0ef9bcc5f3aeda96b050827b954ce060317613 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-09Generic Function to create a private networkjose.lausuch5-131/+99
This is to be used by all the tests which need a private network to work, for example Tempest, Rally, vPing, ssh.. Added example for vPing and promise scripts. Change-Id: I5d79e7b60b81b0f34230ea3ef2f3076697a1958c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-09Fix shebang of python scriptsJuha Kosonen2-2/+2
Change-Id: I8a05fd6fbb0d392a27f354a6b8cacf33073bf17f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-05Add results dir to Dockerfilejose.lausuch1-1/+2
This will allow to create the functest.log used by logger in /home/opnfv/functest/results/functest.log Change-Id: Iebc1130942c4e4a5f592cfa247e7ba7403559a59 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-05Don't exit on error when destroying rally deploymentjose.lausuch2-30/+45
Also, some improvements in execute_command function Change-Id: I8271d55202b8859701275d5f7322a7bd4894e475 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-05Fix bug config_functest.yaml locationjose.lausuch3-3/+4
Change-Id: I3b28eb7015f6f1418ef04ca91103e313f71f74e3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor, add logger handler to collect all the logs to a file as welljose.lausuch5-250/+55
JIRA: FUNCTEST-190 Also: - remove old code that are not used any more - improve execute_command function - fix logger output for run_tempest Change-Id: Ib268738ada1b9de2a418ef01e684a90e6f4e02ed Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor improvementsjose.lausuch24-894/+131
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-03Merge "Create CLI template for Functest"Morgan Richomme8-0/+204
2016-05-02Add command to execute the actual testsjose.lausuch3-20/+23
JIRA: FUNCTEST-190 Run_tests was generating the tests cases to be executed, but not actually running them. This patch also includes a small enhancement to avoid too much output when showing which tiers to be tested. Change-Id: Id70cfe44a8263ce7f598386668a33c67a8961b42 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-02Enhance output when showing tiers and testcases infojose.lausuch2-9/+66
JIRA: FUNCTEST-190 Change-Id: I43e26700ee3c92be64d79243c6762a3ccd5d42d3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>