aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-06-14Enable security scanningLuke Hinds2-4/+3
Change-Id: Ib179ee6b2fcc7cf6c9ac522fdb83755ecbb99f52 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-14Reduce rally run script log outputJuha Kosonen1-1/+1
Log scenario specific tables only in debug mode. JIRA: FUNCTEST-312 Change-Id: Iacfdfb8156b1d5e9bc0a85abc1d6a10d6cac032e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13SSH key key type select improvements and jump host renameLuke Hinds5-32/+46
JIRA: FUNCTEST-310 Change-Id: I7adca57febfe8e6861d22de18858c6afd97b5199 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-13Remove unnecessary defaults from rally task fileJuha Kosonen2-12/+1
Parameters used in test scenarios are defined and correctly set by run script. No need to hardcode defaults in task file. JIRA: FUNCTEST-311 Change-Id: Ic7decfc5144c40a50cd32862eb4aed263930a78e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Fix bug: use right format for date when pushing to DBMorgan Richomme1-2/+5
JIRA: FUNCTEST-303 Change-Id: I53e7c8f963ef0fa248d76e0d1c5f04326a750dcc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-13Remove external server references on Rally scenariosJuha Kosonen2-19/+8
Use url derived from OS_AUTH_URL on a scenario making http request and checking the response. This way successful test execution does not require internet connection nor rely on external servers functionality. JIRA: FUNCTEST-201 Change-Id: Ic11f8f5c32d015624bdec1db07d8bb49f7b77bc8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Creating Glance image for Tempest suitevitikkan2-1/+31
If not yet existing, Cirros-0.3.4 image is created before running Tempest test suite. Source file for the image is included into opnfv/functest Docker container. JIRA: FUNCTEST-195 Change-Id: I980193c4207c1301ca4e3b6e850b4056e6aa0130 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-06-13Fix flake8 violationsMorgan Richomme3-8/+3
Change-Id: I911eab6d4c0cdcfcf4d75f03e91c528d3388876c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-13bug fix: end_time var does not exist to calculate durationMorgan Richomme1-1/+1
Change-Id: If73b6fbf022a837e4cb0190ab8074d18017ca57b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-13Merge "little changes in testapi presentation"Morgan Richomme2-2/+2
2016-06-13Merge "Update testapi presentation"Morgan Richomme1-12/+45
2016-06-12little changes in testapi presentationSerenaFeng2-2/+2
change testapi0.png file rename test_criteria to criteria change criteria description from passed/failed to PASS/FAILED JIRA: FUNCTEST-308 Change-Id: I29c05c4068c50cfe47ab6b5e8acc3d797f2ff43a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-06-10Update testapi presentationMorgan Richomme1-12/+45
Change-Id: Ic1fd53a7a1e7cc35259bc2af78dab791617b6185 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-09Fixes and Docker Specific Attributes on security_scanLuke Hinds5-66/+95
JIRA: FUNCTEST-306 Fixed Incorrect logging format Added Key Download Added Docker Specifics discovered during tests Change-Id: I0c275c77a1eeb5911afb472bd0cb9c8020ae5879 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-09Fix vPing success criteria evaluation bugfixjose.lausuch1-8/+5
Switching back to the odl approach. Need more discussions to see how to evaluate the result from testcases.yaml Change-Id: Iaa866db3010d35bd2cc427190dfe64db6b732a93 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-08Add CPerf slide to OPNFV Summit Berlin deckDaniel Farrell1-1/+4
Change-Id: Ia1d3ce3c220a405821d8fae80cb5f4ddd22c72ec Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-06-08Merge "Fixes incorrect parenthesis format & adds ft_logger import"Morgan Richomme2-23/+27
2016-06-08Fixes incorrect parenthesis format & adds ft_logger importLuke Hinds2-27/+28
JIRA: FUNCTEST-302 Change-Id: Id83077a1b1376f726ea8abd4a97e5b705c22f9cc Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-08Adapt functest testcase to APi refactoringMorgan Richomme12-215/+201
JIRA: FUNCTEST-303 Change-Id: Ia276d9ca6e8d62b496c3b5f81561b14b02c43fd7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-08Merge changes I23a47424,I34393b03Morgan Richomme4-0/+440
* changes: Add presentation for test API Presentation Test community Design Summit
2016-06-08Added paramiko.util.log_to_fileLuke Hinds1-4/+3
JIRA: FUNCTEST-301 Change-Id: I489653d4e47232c5bf51bbae54d2a89c7ac780b6 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-07Use current ODL Integration/Test repoDaniel Farrell3-6/+6
ODL Integration used to contain system testing, Karaf distribution building and packaging/delivery logic. It was split into three projects in August 2015: Int/Test, Int/Distribution and Int/Packaging. https://wiki.opendaylight.org/view/Archive_Proposals/Integration The integration.git repo Functest was cloning is the old one, containing all three projects. It hasn't been updated since the split. The new integration-test.git repo is the current version of ODL's system test code. This change also clones ODL from its official Gerrit, instead of its GitHub mirror. Change-Id: I6b38b1fedada504411ca0e0639355339f373084c Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-06-03Add presentation for test APIMorgan Richomme3-0/+236
Change-Id: I23a474247680751bb4f9ac0cc17b00229edd8886 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-03Presentation Test community Design SummitMorgan Richomme1-0/+204
Change-Id: I34393b0398f1c7a4f7aef9fea79f265ec5c915b5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-02Stop the job and quit with error if a test case failsjose.lausuch1-0/+4
JIRA: FUNCTEST-282 Change-Id: I9fd638c19333772040481140f9e2324b7d80772f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-02Replace subnet by portCédric Ollivier6-61/+61
It also fixes several upper case letters and formats *delete*.robot Change-Id: I071be39860dd33296a067e4f3d0188d36e9b9660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Rename Robot Framework sources to *.robotCédric Ollivier3-0/+0
It avoids mixing robot and txt suffixes in the same directory. Change-Id: Ia2288cc9ad7dc86fc9a4cea2c6ca7a08a7dd3e3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Merge "Add criteria in testcases.yaml and Test class"Morgan Richomme5-6/+47
2016-06-01Fix duplicated output when using the functest loggerjose.lausuch1-0/+1
JIRA: FUNCTEST-275 Change-Id: I49c66521652b31d5bb398ea4013ac061f320d725 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01Merge "Add framework for presentations"Morgan Richomme119-0/+20622
2016-06-01Merge "Check correctly arguments"Morgan Richomme1-3/+7
2016-06-01Check correctly argumentsCédric Ollivier1-3/+7
It fixes argument parsing and verifies all mandatory arguments are provided. It also prevents UnboundLocalError exceptions. Change-Id: Iec3403533b312c95dd453236ccadb1fe495d61cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-01Add criteria in testcases.yaml and Test classjose.lausuch5-6/+47
JIRA: FUNCTEST-257 Added example of usage in vping_ssh Change-Id: Iac143b811db163f0f86682b0688948c20843ede5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01bug fix: pb when pushing bgpvpn results when no failedMorgan Richomme1-5/+11
failed field is empty (not equal to 0) JIRA: FUNCTEST-234 Change-Id: Ic243e1e23615d585a735266d9012fc4c52d67ba3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-01Merge "Add Apex based security scan code"Morgan Richomme9-330/+466
2016-05-31Avoid tuples when printing multiple stringsCédric Ollivier2-29/+29
It fixes bugs induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/12623 Change-Id: I0232b14bed767b3ff857192146551a7963699bb9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Write login correctlyCédric Ollivier1-1/+1
Change-Id: I1806fb7ac3d276065badd8537f84339c18a1856e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Add Apex based security scan codelukehinds9-330/+466
JIRA: FUNCTEST-169 Performs a SCAP based security scan of all overcloud nodes, followed by report download to functest dashboard Change-Id: I9058227e19c0877e5f8913931febdd667a908cdd Signed-off-by: lukehinds <lukehinds@gmail.com>
2016-05-31Remove unused CI_DEBUGCédric Ollivier1-1/+0
Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-30Bugfix: can not find tempest.logSerenaFeng1-24/+21
JIRA: FUNCTEST-269 Remove dependency on CI_DEBUG and use subprocess.call to redirect stdout to tempest.log in any case. Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-05-27Merge "bug fix: if all tests passed failed could be empty"Morgan Richomme1-4/+6
2016-05-27bug fix: if all tests passed failed could be emptyMorgan Richomme1-4/+6
consider failed only if regex match JIRA: FUNCTEST-234 Change-Id: Ie9d29c7bc1eb2f051600d689133b47bf276bc856 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-27Merge "Use flavor name instead of flavor id"Morgan Richomme2-5/+5
2016-05-27Merge "Add simple error logs in result DB"Morgan Richomme1-16/+28
2016-05-26Take report arg into accountCédric Ollivier1-1/+2
$report is now tested before calling odlreport2db.py Change-Id: I92be1488f710065dbc0a0c00e8023c6201028c2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-26Use flavor name instead of flavor idCédric Ollivier2-5/+5
Default flavor id changes if its attributes have been modified. Flavor name is used instead of flavor id. Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Add security_scan in Functest CI pipelineMorgan Richomme2-1/+15
JIRA: FUNCTEST-258 Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-25Merge "Added 60 sec delay before launching instances in healthcheck"Jose Lausuch1-0/+5
2016-05-25Push results if INSTALLER_TYPE and NODE_NAME are definedCédric Ollivier1-1/+3
INSTALLER_TYPE and NODE_NAME are also checked before pushing ODL results in DB Change-Id: If92c8b50d3ae7618475aeb25ab732c6dddb08019 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>