aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-25Allow unknown ci_installer or ci_scenario in is_compatibleCédric Ollivier1-4/+9
ci_installer and ci_scenario are only tested if they are set. At least one of theses variables must be set to get dependencies It modifies the previous logic introduced by the first implementation of tier_handler.py [1] [1] https://gerrit.opnfv.org/gerrit/#/c/12579/ Change-Id: Icc9663a620f0b18f502b3eff7c0ce0d71e4e5910 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-24Join Rally_full and Tempest_full in the same Tierjose.lausuch1-20/+3
JIRA: FUNCTEST-190 Change-Id: Ib82c59e0a68ed73caba79a0d5b2000861ee31552 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-20Push bgpvpn_api results into Test DBMorgan Richomme1-5/+60
JIRA: FUNCTEST-234 Change-Id: I0494043bff6a37dc94724dfee1a718a1ab9fbcf3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Preserving Nova instances from os_defaults.yamlvitikkan1-12/+18
Previously clean_openstack deleted all the existing instances even if they were included into os_defaults.yaml. Change-Id: Id7c17ec86a5616c44bd2965844a4a8545054358b Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-19Fix path for vping.sh and exit if SCP failsjose.lausuch1-1/+3
Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-19fix vPing paths post refactoring effectMorgan Richomme1-2/+2
Change-Id: I24e961965db5103af1625418e7f5ae977bcabf54 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-17Change 'testcases' directory structurejose.lausuch60-37/+32
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-17Merge "BGPVPN test case refactored"Morgan Richomme4-32/+86
2016-05-17Merge "Catch TypeError exceptions in ci/tier_handler.py"Jose Lausuch1-6/+6
2016-05-16BGPVPN test case refactoredvitikkan4-32/+86
BGPVPN test case is refactored and moved into bgpvpn.py module. JIRA: FUNCTEST-234 Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-13Refactor ODL vars in ci/exec_test.shCédric Ollivier1-10/+5
neutron_ip is set equal to neutron public endpoint and odl_ip to neutron_ip or SDN_CONTROLLER according to INSTALLER_TYPE. It also doesn't exit if INSTALLER_TYPE is unset. Change-Id: I9ffa9f2837216ba88645d9bdfeeedd7a86a50b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Replace error in ci/exec_test.shCédric Ollivier1-2/+2
error undefined in ci/exec_test.sh is now replaced by echo $msg >&2 Change-Id: I90fc44d94680206a2b0e85f9dfa5c48dadf6ac04 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Catch TypeError exceptions in ci/tier_handler.pyCédric Ollivier1-6/+6
If INSTALLER_TYPE is unset, is_compatible returns False instead of raising an ErrorType exception. Change-Id: I55c219808851907a19e2aa0124eb13d53a5e685d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-13Merge "Added handling of blacklist for tempest"Jose Lausuch1-39/+72
2016-05-13Added handling of blacklist for tempestvitikkan1-39/+72
It is now possible to exclude some specific test cases ("black list") from the test case suites. JIRA: FUNCTEST-197 Change-Id: I2946a010793da0a3d3ef1d96aa0ca0840e8a761d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-12Add protections if INSTALLER_TYPE is unsetCédric Ollivier1-5/+5
It avoids unary operator expected errors. Change-Id: Ie717631b651b258d9bf62706f09c6f6b7c534620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-12Merge "Fix typos in testcases.yaml"Jose Lausuch1-2/+2
2016-05-11Fix typos in testcases.yamlCédric Ollivier1-2/+2
Change-Id: I7b014c55b626a06c0b4aaba006691f726f88acac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Respect multiline syntax in DockerfileCédric Ollivier1-3/+7
It fixes errors in /home/opnfv/.bashrc induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/13699/ Change-Id: I07ff6504ee8fee7428b700553419d1208e639379 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Fix a few nits in prepare_env and dockerfilejose.lausuch2-2/+2
Change-Id: Idb407ab80a41be0838c35d79819f8953885ba668 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-11Specify the field id in neutron argumentsCédric Ollivier1-1/+1
It fixes the parsing error when 2 subnets are created on a specific network. Change-Id: I46154a65d0e916387faea5b506ae6a93240c6726 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Removed obsolete modulesvitikkan2-122/+0
testcases/VIM/OpenStack/CI/libraries/check_os.sh testcases/VIM/OpenStack/CI/libraries/os_defaults.yaml Change-Id: I835bfbdc9aa43903ca2ad6041a38216fd68263a5 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Split tempest into smoke and full modesvitikkan3-20/+20
"tempest_smoke_serial" and "tempest_full_parallel" test cases replace the original "tempest" case. Corrected fetching tempest results from "rally verify list" output (last result is taken instead of the first one). This correction is needed when "rally verify start" is run multiple times. JIRA: FUNCTEST-242 Change-Id: I544a22081655af819dbaaaafc0ba0fa6eae1e4ea Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-10Enable sanity mode of Rally test for the CI runsJuha Kosonen2-12/+15
JIRA: FUNCTEST-241 Change-Id: Ie37657bf9e8c01ae4126c1c45146d8aadb2c5775 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-10Adapt tiers to run depending on WEEKLY/DAILYjose.lausuch5-19/+35
JIRA: FUNCTEST-244 Change-Id: I11bf28baff52b75b0f6c58845edc22f266dfcbe8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-10Merge "CLI implementation"jose.lausuch13-151/+461
2016-05-10Create a private shared network for RallyJuha Kosonen2-4/+31
Since functest-net will be obsolete, own private network, subnet and router is created for Rally tests. JIRA: FUNCTEST-240 Change-Id: I8a30e2b4fe12238dba526c21188c85f75bacc0b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-10Creating private network for Tempestvitikkan2-36/+29
Since functest-net will be obsolete, own private network, subnet and router is taken into use for Tempest test. JIRA: FUNCTEST-239 Change-Id: I2b9f6aae74dc36decf305a4531fe0a071031aca3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-09CLI implementationjose.lausuch13-151/+461
JIRA: FUNCTEST-243 Change-Id: Ibf0ef9bcc5f3aeda96b050827b954ce060317613 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-09Generic Function to create a private networkjose.lausuch5-131/+99
This is to be used by all the tests which need a private network to work, for example Tempest, Rally, vPing, ssh.. Added example for vPing and promise scripts. Change-Id: I5d79e7b60b81b0f34230ea3ef2f3076697a1958c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-09Fix shebang of python scriptsJuha Kosonen2-2/+2
Change-Id: I8a05fd6fbb0d392a27f354a6b8cacf33073bf17f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-05Add results dir to Dockerfilejose.lausuch1-1/+2
This will allow to create the functest.log used by logger in /home/opnfv/functest/results/functest.log Change-Id: Iebc1130942c4e4a5f592cfa247e7ba7403559a59 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-05Don't exit on error when destroying rally deploymentjose.lausuch2-30/+45
Also, some improvements in execute_command function Change-Id: I8271d55202b8859701275d5f7322a7bd4894e475 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-05Fix bug config_functest.yaml locationjose.lausuch3-3/+4
Change-Id: I3b28eb7015f6f1418ef04ca91103e313f71f74e3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor, add logger handler to collect all the logs to a file as welljose.lausuch5-250/+55
JIRA: FUNCTEST-190 Also: - remove old code that are not used any more - improve execute_command function - fix logger output for run_tempest Change-Id: Ib268738ada1b9de2a418ef01e684a90e6f4e02ed Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor improvementsjose.lausuch24-894/+131
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-03Merge "Create CLI template for Functest"Morgan Richomme8-0/+204
2016-05-02Add command to execute the actual testsjose.lausuch3-20/+23
JIRA: FUNCTEST-190 Run_tests was generating the tests cases to be executed, but not actually running them. This patch also includes a small enhancement to avoid too much output when showing which tiers to be tested. Change-Id: Id70cfe44a8263ce7f598386668a33c67a8961b42 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-02Enhance output when showing tiers and testcases infojose.lausuch2-9/+66
JIRA: FUNCTEST-190 Change-Id: I43e26700ee3c92be64d79243c6762a3ccd5d42d3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-02Create CLI template for Functestjose.lausuch8-0/+204
JIRA: FUNCTEST-235 Change-Id: I235a53781fbcde91ccf15d15ea52c96ee2ee9433 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-02Source the credentials in run_tests.pyjose.lausuch2-1/+12
JIRA: FUNCTEST-227 JIRA: FUNCTEST-190 OpenStack clean was failing due to this. Change-Id: Ia4dcf084becb532f157c0924baf44bb2441f6379 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-29Functest - documentation small correctionsDavid Blaisonneau2-2/+4
Signed-off-by: David Blaisonneau <david.blaisonneau@orange.com>
2016-04-29Merge "Add a step to enable docker run without sudo"Morgan Richomme1-0/+1
2016-04-29Execute successive scenarios after task failureJuha Kosonen1-2/+20
Log the result of task validation and proceed executing next rally scenario when the current task start-up fails. JIRA: FUNCTEST-230 Change-Id: I5544a9559636f671035578f9cc5cf6f934bcbcd8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-29Merge "Create run_test.py using the tier mechanism to run the tests"jose.lausuch8-110/+462
2016-04-29Add a step to enable docker run without sudoDavid Blaisonneau1-0/+1
Signed-off-by: David Blaisonneau <david.blaisonneau@orange.com>
2016-04-28Create run_test.py using the tier mechanism to run the testsjose.lausuch8-110/+462
JIRA: FUNCTEST-227 JIRA: FUNCTEST-190 Change-Id: I5445ad36ec65e62d48c8f5b16352caea2e51e3c9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-27Merge "Replace all the loggers by the functest logger module"Morgan Richomme8-147/+47
2016-04-27Merge "Prepare Brahmaputra 3.0 release"Morgan Richomme9-64/+5036