summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-06-14Reduce rally run script log outputJuha Kosonen1-1/+1
Log scenario specific tables only in debug mode. JIRA: FUNCTEST-312 Change-Id: Iacfdfb8156b1d5e9bc0a85abc1d6a10d6cac032e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13SSH key key type select improvements and jump host renameLuke Hinds5-32/+46
JIRA: FUNCTEST-310 Change-Id: I7adca57febfe8e6861d22de18858c6afd97b5199 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-13Remove unnecessary defaults from rally task fileJuha Kosonen2-12/+1
Parameters used in test scenarios are defined and correctly set by run script. No need to hardcode defaults in task file. JIRA: FUNCTEST-311 Change-Id: Ic7decfc5144c40a50cd32862eb4aed263930a78e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Fix bug: use right format for date when pushing to DBMorgan Richomme1-2/+5
JIRA: FUNCTEST-303 Change-Id: I53e7c8f963ef0fa248d76e0d1c5f04326a750dcc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-13Remove external server references on Rally scenariosJuha Kosonen2-19/+8
Use url derived from OS_AUTH_URL on a scenario making http request and checking the response. This way successful test execution does not require internet connection nor rely on external servers functionality. JIRA: FUNCTEST-201 Change-Id: Ic11f8f5c32d015624bdec1db07d8bb49f7b77bc8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Creating Glance image for Tempest suitevitikkan2-1/+31
If not yet existing, Cirros-0.3.4 image is created before running Tempest test suite. Source file for the image is included into opnfv/functest Docker container. JIRA: FUNCTEST-195 Change-Id: I980193c4207c1301ca4e3b6e850b4056e6aa0130 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-06-13Fix flake8 violationsMorgan Richomme3-8/+3
Change-Id: I911eab6d4c0cdcfcf4d75f03e91c528d3388876c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-13bug fix: end_time var does not exist to calculate durationMorgan Richomme1-1/+1
Change-Id: If73b6fbf022a837e4cb0190ab8074d18017ca57b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-13Merge "little changes in testapi presentation"Morgan Richomme2-2/+2
2016-06-13Merge "Update testapi presentation"Morgan Richomme1-12/+45
2016-06-12little changes in testapi presentationSerenaFeng2-2/+2
change testapi0.png file rename test_criteria to criteria change criteria description from passed/failed to PASS/FAILED JIRA: FUNCTEST-308 Change-Id: I29c05c4068c50cfe47ab6b5e8acc3d797f2ff43a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-06-10Update testapi presentationMorgan Richomme1-12/+45
Change-Id: Ic1fd53a7a1e7cc35259bc2af78dab791617b6185 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-09Fixes and Docker Specific Attributes on security_scanLuke Hinds5-66/+95
JIRA: FUNCTEST-306 Fixed Incorrect logging format Added Key Download Added Docker Specifics discovered during tests Change-Id: I0c275c77a1eeb5911afb472bd0cb9c8020ae5879 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-09Fix vPing success criteria evaluation bugfixjose.lausuch1-8/+5
Switching back to the odl approach. Need more discussions to see how to evaluate the result from testcases.yaml Change-Id: Iaa866db3010d35bd2cc427190dfe64db6b732a93 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-08Add CPerf slide to OPNFV Summit Berlin deckDaniel Farrell1-1/+4
Change-Id: Ia1d3ce3c220a405821d8fae80cb5f4ddd22c72ec Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-06-08Merge "Fixes incorrect parenthesis format & adds ft_logger import"Morgan Richomme2-23/+27
2016-06-08Fixes incorrect parenthesis format & adds ft_logger importLuke Hinds2-27/+28
JIRA: FUNCTEST-302 Change-Id: Id83077a1b1376f726ea8abd4a97e5b705c22f9cc Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-08Adapt functest testcase to APi refactoringMorgan Richomme12-215/+201
JIRA: FUNCTEST-303 Change-Id: Ia276d9ca6e8d62b496c3b5f81561b14b02c43fd7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-08Merge changes I23a47424,I34393b03Morgan Richomme4-0/+440
* changes: Add presentation for test API Presentation Test community Design Summit
2016-06-08Added paramiko.util.log_to_fileLuke Hinds1-4/+3
JIRA: FUNCTEST-301 Change-Id: I489653d4e47232c5bf51bbae54d2a89c7ac780b6 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-07Use current ODL Integration/Test repoDaniel Farrell3-6/+6
ODL Integration used to contain system testing, Karaf distribution building and packaging/delivery logic. It was split into three projects in August 2015: Int/Test, Int/Distribution and Int/Packaging. https://wiki.opendaylight.org/view/Archive_Proposals/Integration The integration.git repo Functest was cloning is the old one, containing all three projects. It hasn't been updated since the split. The new integration-test.git repo is the current version of ODL's system test code. This change also clones ODL from its official Gerrit, instead of its GitHub mirror. Change-Id: I6b38b1fedada504411ca0e0639355339f373084c Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-06-03Add presentation for test APIMorgan Richomme3-0/+236
Change-Id: I23a474247680751bb4f9ac0cc17b00229edd8886 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-03Presentation Test community Design SummitMorgan Richomme1-0/+204
Change-Id: I34393b0398f1c7a4f7aef9fea79f265ec5c915b5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-02Stop the job and quit with error if a test case failsjose.lausuch1-0/+4
JIRA: FUNCTEST-282 Change-Id: I9fd638c19333772040481140f9e2324b7d80772f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-02Replace subnet by portCédric Ollivier6-61/+61
It also fixes several upper case letters and formats *delete*.robot Change-Id: I071be39860dd33296a067e4f3d0188d36e9b9660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Rename Robot Framework sources to *.robotCédric Ollivier3-0/+0
It avoids mixing robot and txt suffixes in the same directory. Change-Id: Ia2288cc9ad7dc86fc9a4cea2c6ca7a08a7dd3e3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Merge "Add criteria in testcases.yaml and Test class"Morgan Richomme5-6/+47
2016-06-01Fix duplicated output when using the functest loggerjose.lausuch1-0/+1
JIRA: FUNCTEST-275 Change-Id: I49c66521652b31d5bb398ea4013ac061f320d725 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01Merge "Add framework for presentations"Morgan Richomme119-0/+20622
2016-06-01Merge "Check correctly arguments"Morgan Richomme1-3/+7
2016-06-01Check correctly argumentsCédric Ollivier1-3/+7
It fixes argument parsing and verifies all mandatory arguments are provided. It also prevents UnboundLocalError exceptions. Change-Id: Iec3403533b312c95dd453236ccadb1fe495d61cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-01Add criteria in testcases.yaml and Test classjose.lausuch5-6/+47
JIRA: FUNCTEST-257 Added example of usage in vping_ssh Change-Id: Iac143b811db163f0f86682b0688948c20843ede5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01bug fix: pb when pushing bgpvpn results when no failedMorgan Richomme1-5/+11
failed field is empty (not equal to 0) JIRA: FUNCTEST-234 Change-Id: Ic243e1e23615d585a735266d9012fc4c52d67ba3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-01Merge "Add Apex based security scan code"Morgan Richomme9-330/+466
2016-05-31Avoid tuples when printing multiple stringsCédric Ollivier2-29/+29
It fixes bugs induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/12623 Change-Id: I0232b14bed767b3ff857192146551a7963699bb9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Write login correctlyCédric Ollivier1-1/+1
Change-Id: I1806fb7ac3d276065badd8537f84339c18a1856e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Add Apex based security scan codelukehinds9-330/+466
JIRA: FUNCTEST-169 Performs a SCAP based security scan of all overcloud nodes, followed by report download to functest dashboard Change-Id: I9058227e19c0877e5f8913931febdd667a908cdd Signed-off-by: lukehinds <lukehinds@gmail.com>
2016-05-31Remove unused CI_DEBUGCédric Ollivier1-1/+0
Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-30Bugfix: can not find tempest.logSerenaFeng1-24/+21
JIRA: FUNCTEST-269 Remove dependency on CI_DEBUG and use subprocess.call to redirect stdout to tempest.log in any case. Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-05-27Merge "bug fix: if all tests passed failed could be empty"Morgan Richomme1-4/+6
2016-05-27bug fix: if all tests passed failed could be emptyMorgan Richomme1-4/+6
consider failed only if regex match JIRA: FUNCTEST-234 Change-Id: Ie9d29c7bc1eb2f051600d689133b47bf276bc856 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-27Merge "Use flavor name instead of flavor id"Morgan Richomme2-5/+5
2016-05-27Merge "Add simple error logs in result DB"Morgan Richomme1-16/+28
2016-05-26Take report arg into accountCédric Ollivier1-1/+2
$report is now tested before calling odlreport2db.py Change-Id: I92be1488f710065dbc0a0c00e8023c6201028c2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-26Use flavor name instead of flavor idCédric Ollivier2-5/+5
Default flavor id changes if its attributes have been modified. Flavor name is used instead of flavor id. Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Add security_scan in Functest CI pipelineMorgan Richomme2-1/+15
JIRA: FUNCTEST-258 Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-25Merge "Added 60 sec delay before launching instances in healthcheck"Jose Lausuch1-0/+5
2016-05-25Push results if INSTALLER_TYPE and NODE_NAME are definedCédric Ollivier1-1/+3
INSTALLER_TYPE and NODE_NAME are also checked before pushing ODL results in DB Change-Id: If92c8b50d3ae7618475aeb25ab732c6dddb08019 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Allow unknown ci_installer or ci_scenario in is_compatibleCédric Ollivier1-4/+9
ci_installer and ci_scenario are only tested if they are set. At least one of theses variables must be set to get dependencies It modifies the previous logic introduced by the first implementation of tier_handler.py [1] [1] https://gerrit.opnfv.org/gerrit/#/c/12579/ Change-Id: Icc9663a620f0b18f502b3eff7c0ce0d71e4e5910 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>