summaryrefslogtreecommitdiffstats
path: root/testcases
AgeCommit message (Collapse)AuthorFilesLines
2016-06-13Remove unnecessary defaults from rally task fileJuha Kosonen2-12/+1
Parameters used in test scenarios are defined and correctly set by run script. No need to hardcode defaults in task file. JIRA: FUNCTEST-311 Change-Id: Ic7decfc5144c40a50cd32862eb4aed263930a78e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Remove external server references on Rally scenariosJuha Kosonen2-19/+8
Use url derived from OS_AUTH_URL on a scenario making http request and checking the response. This way successful test execution does not require internet connection nor rely on external servers functionality. JIRA: FUNCTEST-201 Change-Id: Ic11f8f5c32d015624bdec1db07d8bb49f7b77bc8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Creating Glance image for Tempest suitevitikkan1-0/+30
If not yet existing, Cirros-0.3.4 image is created before running Tempest test suite. Source file for the image is included into opnfv/functest Docker container. JIRA: FUNCTEST-195 Change-Id: I980193c4207c1301ca4e3b6e850b4056e6aa0130 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-06-13Fix flake8 violationsMorgan Richomme3-8/+3
Change-Id: I911eab6d4c0cdcfcf4d75f03e91c528d3388876c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-13bug fix: end_time var does not exist to calculate durationMorgan Richomme1-1/+1
Change-Id: If73b6fbf022a837e4cb0190ab8074d18017ca57b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-09Fixes and Docker Specific Attributes on security_scanLuke Hinds5-66/+95
JIRA: FUNCTEST-306 Fixed Incorrect logging format Added Key Download Added Docker Specifics discovered during tests Change-Id: I0c275c77a1eeb5911afb472bd0cb9c8020ae5879 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-09Fix vPing success criteria evaluation bugfixjose.lausuch1-8/+5
Switching back to the odl approach. Need more discussions to see how to evaluate the result from testcases.yaml Change-Id: Iaa866db3010d35bd2cc427190dfe64db6b732a93 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-08Merge "Fixes incorrect parenthesis format & adds ft_logger import"Morgan Richomme2-23/+27
2016-06-08Fixes incorrect parenthesis format & adds ft_logger importLuke Hinds2-27/+28
JIRA: FUNCTEST-302 Change-Id: Id83077a1b1376f726ea8abd4a97e5b705c22f9cc Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-08Adapt functest testcase to APi refactoringMorgan Richomme10-208/+176
JIRA: FUNCTEST-303 Change-Id: Ia276d9ca6e8d62b496c3b5f81561b14b02c43fd7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-08Added paramiko.util.log_to_fileLuke Hinds1-4/+3
JIRA: FUNCTEST-301 Change-Id: I489653d4e47232c5bf51bbae54d2a89c7ac780b6 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-07Use current ODL Integration/Test repoDaniel Farrell2-5/+5
ODL Integration used to contain system testing, Karaf distribution building and packaging/delivery logic. It was split into three projects in August 2015: Int/Test, Int/Distribution and Int/Packaging. https://wiki.opendaylight.org/view/Archive_Proposals/Integration The integration.git repo Functest was cloning is the old one, containing all three projects. It hasn't been updated since the split. The new integration-test.git repo is the current version of ODL's system test code. This change also clones ODL from its official Gerrit, instead of its GitHub mirror. Change-Id: I6b38b1fedada504411ca0e0639355339f373084c Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-06-02Replace subnet by portCédric Ollivier6-61/+61
It also fixes several upper case letters and formats *delete*.robot Change-Id: I071be39860dd33296a067e4f3d0188d36e9b9660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Rename Robot Framework sources to *.robotCédric Ollivier3-0/+0
It avoids mixing robot and txt suffixes in the same directory. Change-Id: Ia2288cc9ad7dc86fc9a4cea2c6ca7a08a7dd3e3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Merge "Add criteria in testcases.yaml and Test class"Morgan Richomme1-5/+6
2016-06-01Merge "Check correctly arguments"Morgan Richomme1-3/+7
2016-06-01Check correctly argumentsCédric Ollivier1-3/+7
It fixes argument parsing and verifies all mandatory arguments are provided. It also prevents UnboundLocalError exceptions. Change-Id: Iec3403533b312c95dd453236ccadb1fe495d61cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-01Add criteria in testcases.yaml and Test classjose.lausuch1-5/+6
JIRA: FUNCTEST-257 Added example of usage in vping_ssh Change-Id: Iac143b811db163f0f86682b0688948c20843ede5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01bug fix: pb when pushing bgpvpn results when no failedMorgan Richomme1-5/+11
failed field is empty (not equal to 0) JIRA: FUNCTEST-234 Change-Id: Ic243e1e23615d585a735266d9012fc4c52d67ba3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-01Merge "Add Apex based security scan code"Morgan Richomme8-328/+464
2016-05-31Write login correctlyCédric Ollivier1-1/+1
Change-Id: I1806fb7ac3d276065badd8537f84339c18a1856e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Add Apex based security scan codelukehinds8-328/+464
JIRA: FUNCTEST-169 Performs a SCAP based security scan of all overcloud nodes, followed by report download to functest dashboard Change-Id: I9058227e19c0877e5f8913931febdd667a908cdd Signed-off-by: lukehinds <lukehinds@gmail.com>
2016-05-31Remove unused CI_DEBUGCédric Ollivier1-1/+0
Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-30Bugfix: can not find tempest.logSerenaFeng1-24/+21
JIRA: FUNCTEST-269 Remove dependency on CI_DEBUG and use subprocess.call to redirect stdout to tempest.log in any case. Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-05-27Merge "bug fix: if all tests passed failed could be empty"Morgan Richomme1-4/+6
2016-05-27bug fix: if all tests passed failed could be emptyMorgan Richomme1-4/+6
consider failed only if regex match JIRA: FUNCTEST-234 Change-Id: Ie9d29c7bc1eb2f051600d689133b47bf276bc856 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-27Merge "Use flavor name instead of flavor id"Morgan Richomme1-4/+4
2016-05-27Merge "Add simple error logs in result DB"Morgan Richomme1-16/+28
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-26Use flavor name instead of flavor idCédric Ollivier1-4/+4
Default flavor id changes if its attributes have been modified. Flavor name is used instead of flavor id. Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Added 60 sec delay before launching instances in healthcheckvitikkan1-0/+5
This delay should be removed after resolving Jira case APEX-149. The purpose is to give some time to populate openflow rules by SDN controller in case of odl_l2 scenario. Change-Id: I05c0b82a7544e934d82f1fa37e2f146aab03f7b9 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-20Push bgpvpn_api results into Test DBMorgan Richomme1-5/+60
JIRA: FUNCTEST-234 Change-Id: I0494043bff6a37dc94724dfee1a718a1ab9fbcf3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Fix path for vping.sh and exit if SCP failsjose.lausuch1-1/+3
Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-17Change 'testcases' directory structurejose.lausuch57-8/+8
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-16BGPVPN test case refactoredvitikkan2-16/+59
BGPVPN test case is refactored and moved into bgpvpn.py module. JIRA: FUNCTEST-234 Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-13Added handling of blacklist for tempestvitikkan1-39/+72
It is now possible to exclude some specific test cases ("black list") from the test case suites. JIRA: FUNCTEST-197 Change-Id: I2946a010793da0a3d3ef1d96aa0ca0840e8a761d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Removed obsolete modulesvitikkan2-122/+0
testcases/VIM/OpenStack/CI/libraries/check_os.sh testcases/VIM/OpenStack/CI/libraries/os_defaults.yaml Change-Id: I835bfbdc9aa43903ca2ad6041a38216fd68263a5 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Split tempest into smoke and full modesvitikkan1-1/+1
"tempest_smoke_serial" and "tempest_full_parallel" test cases replace the original "tempest" case. Corrected fetching tempest results from "rally verify list" output (last result is taken instead of the first one). This correction is needed when "rally verify start" is run multiple times. JIRA: FUNCTEST-242 Change-Id: I544a22081655af819dbaaaafc0ba0fa6eae1e4ea Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-10Create a private shared network for RallyJuha Kosonen1-4/+27
Since functest-net will be obsolete, own private network, subnet and router is created for Rally tests. JIRA: FUNCTEST-240 Change-Id: I8a30e2b4fe12238dba526c21188c85f75bacc0b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-10Creating private network for Tempestvitikkan1-34/+25
Since functest-net will be obsolete, own private network, subnet and router is taken into use for Tempest test. JIRA: FUNCTEST-239 Change-Id: I2b9f6aae74dc36decf305a4531fe0a071031aca3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-09Generic Function to create a private networkjose.lausuch3-131/+39
This is to be used by all the tests which need a private network to work, for example Tempest, Rally, vPing, ssh.. Added example for vPing and promise scripts. Change-Id: I5d79e7b60b81b0f34230ea3ef2f3076697a1958c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-05Fix bug config_functest.yaml locationjose.lausuch2-2/+3
Change-Id: I3b28eb7015f6f1418ef04ca91103e313f71f74e3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor, add logger handler to collect all the logs to a file as welljose.lausuch2-121/+25
JIRA: FUNCTEST-190 Also: - remove old code that are not used any more - improve execute_command function - fix logger output for run_tempest Change-Id: Ib268738ada1b9de2a418ef01e684a90e6f4e02ed Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor improvementsjose.lausuch12-612/+77
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-29Execute successive scenarios after task failureJuha Kosonen1-2/+20
Log the result of task validation and proceed executing next rally scenario when the current task start-up fails. JIRA: FUNCTEST-230 Change-Id: I5544a9559636f671035578f9cc5cf6f934bcbcd8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-27Replace all the loggers by the functest logger modulejose.lausuch8-147/+47
JIRA: FUNCTEST-228 Change-Id: If7a3c8cb08e9fbdf155fc5eff5330f79e5f8d234 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-27Create prepare_env.py from prepare_env.sh and config_functest.pyjose.lausuch3-672/+2
JIRA: FUNCTEST-227 Change-Id: I1aa890b9f91ec524c766ba3c460666ed227f2126 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-26Move functest_utils and openstack_utils to directory /utilsjose.lausuch12-1102/+22
JIRA: FUNCTEST-226 Change-Id: I74d09f6322844b25ab45a02156317ae76ab40d8a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-26Corrected logging.Formatter parametersvitikkan1-2/+2
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-25Remove backslashs for line continuationCédric Ollivier17-334/+313
JIRA: FUNCTEST-213 Change-Id: Ia50521cf8fcf60a847aa44fe0ea59b6e64830e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>