summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-06-12little changes in testapi presentationSerenaFeng2-2/+2
change testapi0.png file rename test_criteria to criteria change criteria description from passed/failed to PASS/FAILED JIRA: FUNCTEST-308 Change-Id: I29c05c4068c50cfe47ab6b5e8acc3d797f2ff43a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-06-09Fixes and Docker Specific Attributes on security_scanLuke Hinds5-66/+95
JIRA: FUNCTEST-306 Fixed Incorrect logging format Added Key Download Added Docker Specifics discovered during tests Change-Id: I0c275c77a1eeb5911afb472bd0cb9c8020ae5879 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-09Fix vPing success criteria evaluation bugfixjose.lausuch1-8/+5
Switching back to the odl approach. Need more discussions to see how to evaluate the result from testcases.yaml Change-Id: Iaa866db3010d35bd2cc427190dfe64db6b732a93 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-08Add CPerf slide to OPNFV Summit Berlin deckDaniel Farrell1-1/+4
Change-Id: Ia1d3ce3c220a405821d8fae80cb5f4ddd22c72ec Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-06-08Merge "Fixes incorrect parenthesis format & adds ft_logger import"Morgan Richomme2-23/+27
2016-06-08Fixes incorrect parenthesis format & adds ft_logger importLuke Hinds2-27/+28
JIRA: FUNCTEST-302 Change-Id: Id83077a1b1376f726ea8abd4a97e5b705c22f9cc Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-08Adapt functest testcase to APi refactoringMorgan Richomme12-215/+201
JIRA: FUNCTEST-303 Change-Id: Ia276d9ca6e8d62b496c3b5f81561b14b02c43fd7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-08Merge changes I23a47424,I34393b03Morgan Richomme4-0/+440
* changes: Add presentation for test API Presentation Test community Design Summit
2016-06-08Added paramiko.util.log_to_fileLuke Hinds1-4/+3
JIRA: FUNCTEST-301 Change-Id: I489653d4e47232c5bf51bbae54d2a89c7ac780b6 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-07Use current ODL Integration/Test repoDaniel Farrell3-6/+6
ODL Integration used to contain system testing, Karaf distribution building and packaging/delivery logic. It was split into three projects in August 2015: Int/Test, Int/Distribution and Int/Packaging. https://wiki.opendaylight.org/view/Archive_Proposals/Integration The integration.git repo Functest was cloning is the old one, containing all three projects. It hasn't been updated since the split. The new integration-test.git repo is the current version of ODL's system test code. This change also clones ODL from its official Gerrit, instead of its GitHub mirror. Change-Id: I6b38b1fedada504411ca0e0639355339f373084c Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-06-03Add presentation for test APIMorgan Richomme3-0/+236
Change-Id: I23a474247680751bb4f9ac0cc17b00229edd8886 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-03Presentation Test community Design SummitMorgan Richomme1-0/+204
Change-Id: I34393b0398f1c7a4f7aef9fea79f265ec5c915b5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-02Stop the job and quit with error if a test case failsjose.lausuch1-0/+4
JIRA: FUNCTEST-282 Change-Id: I9fd638c19333772040481140f9e2324b7d80772f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-02Replace subnet by portCédric Ollivier6-61/+61
It also fixes several upper case letters and formats *delete*.robot Change-Id: I071be39860dd33296a067e4f3d0188d36e9b9660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Rename Robot Framework sources to *.robotCédric Ollivier3-0/+0
It avoids mixing robot and txt suffixes in the same directory. Change-Id: Ia2288cc9ad7dc86fc9a4cea2c6ca7a08a7dd3e3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-02Merge "Add criteria in testcases.yaml and Test class"Morgan Richomme5-6/+47
2016-06-01Fix duplicated output when using the functest loggerjose.lausuch1-0/+1
JIRA: FUNCTEST-275 Change-Id: I49c66521652b31d5bb398ea4013ac061f320d725 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01Merge "Add framework for presentations"Morgan Richomme119-0/+20622
2016-06-01Merge "Check correctly arguments"Morgan Richomme1-3/+7
2016-06-01Check correctly argumentsCédric Ollivier1-3/+7
It fixes argument parsing and verifies all mandatory arguments are provided. It also prevents UnboundLocalError exceptions. Change-Id: Iec3403533b312c95dd453236ccadb1fe495d61cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-01Add criteria in testcases.yaml and Test classjose.lausuch5-6/+47
JIRA: FUNCTEST-257 Added example of usage in vping_ssh Change-Id: Iac143b811db163f0f86682b0688948c20843ede5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-01bug fix: pb when pushing bgpvpn results when no failedMorgan Richomme1-5/+11
failed field is empty (not equal to 0) JIRA: FUNCTEST-234 Change-Id: Ic243e1e23615d585a735266d9012fc4c52d67ba3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-01Merge "Add Apex based security scan code"Morgan Richomme9-330/+466
2016-05-31Avoid tuples when printing multiple stringsCédric Ollivier2-29/+29
It fixes bugs induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/12623 Change-Id: I0232b14bed767b3ff857192146551a7963699bb9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Write login correctlyCédric Ollivier1-1/+1
Change-Id: I1806fb7ac3d276065badd8537f84339c18a1856e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-31Add Apex based security scan codelukehinds9-330/+466
JIRA: FUNCTEST-169 Performs a SCAP based security scan of all overcloud nodes, followed by report download to functest dashboard Change-Id: I9058227e19c0877e5f8913931febdd667a908cdd Signed-off-by: lukehinds <lukehinds@gmail.com>
2016-05-31Remove unused CI_DEBUGCédric Ollivier1-1/+0
Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-30Bugfix: can not find tempest.logSerenaFeng1-24/+21
JIRA: FUNCTEST-269 Remove dependency on CI_DEBUG and use subprocess.call to redirect stdout to tempest.log in any case. Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-05-27Merge "bug fix: if all tests passed failed could be empty"Morgan Richomme1-4/+6
2016-05-27bug fix: if all tests passed failed could be emptyMorgan Richomme1-4/+6
consider failed only if regex match JIRA: FUNCTEST-234 Change-Id: Ie9d29c7bc1eb2f051600d689133b47bf276bc856 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-27Merge "Use flavor name instead of flavor id"Morgan Richomme2-5/+5
2016-05-27Merge "Add simple error logs in result DB"Morgan Richomme1-16/+28
2016-05-26Take report arg into accountCédric Ollivier1-1/+2
$report is now tested before calling odlreport2db.py Change-Id: I92be1488f710065dbc0a0c00e8023c6201028c2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-26Use flavor name instead of flavor idCédric Ollivier2-5/+5
Default flavor id changes if its attributes have been modified. Flavor name is used instead of flavor id. Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Add security_scan in Functest CI pipelineMorgan Richomme2-1/+15
JIRA: FUNCTEST-258 Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-25Merge "Added 60 sec delay before launching instances in healthcheck"Jose Lausuch1-0/+5
2016-05-25Push results if INSTALLER_TYPE and NODE_NAME are definedCédric Ollivier1-1/+3
INSTALLER_TYPE and NODE_NAME are also checked before pushing ODL results in DB Change-Id: If92c8b50d3ae7618475aeb25ab732c6dddb08019 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Allow unknown ci_installer or ci_scenario in is_compatibleCédric Ollivier1-4/+9
ci_installer and ci_scenario are only tested if they are set. At least one of theses variables must be set to get dependencies It modifies the previous logic introduced by the first implementation of tier_handler.py [1] [1] https://gerrit.opnfv.org/gerrit/#/c/12579/ Change-Id: Icc9663a620f0b18f502b3eff7c0ce0d71e4e5910 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Added 60 sec delay before launching instances in healthcheckvitikkan1-0/+5
This delay should be removed after resolving Jira case APEX-149. The purpose is to give some time to populate openflow rules by SDN controller in case of odl_l2 scenario. Change-Id: I05c0b82a7544e934d82f1fa37e2f146aab03f7b9 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-24Join Rally_full and Tempest_full in the same Tierjose.lausuch1-20/+3
JIRA: FUNCTEST-190 Change-Id: Ib82c59e0a68ed73caba79a0d5b2000861ee31552 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-23Add framework for presentationsMorgan Richomme119-0/+20622
Change-Id: I8ba24fb4b2a3a6c8d8c69f15a1fd9259aea4ab6c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-20Push bgpvpn_api results into Test DBMorgan Richomme1-5/+60
JIRA: FUNCTEST-234 Change-Id: I0494043bff6a37dc94724dfee1a718a1ab9fbcf3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Preserving Nova instances from os_defaults.yamlvitikkan1-12/+18
Previously clean_openstack deleted all the existing instances even if they were included into os_defaults.yaml. Change-Id: Id7c17ec86a5616c44bd2965844a4a8545054358b Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-19Fix path for vping.sh and exit if SCP failsjose.lausuch1-1/+3
Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-19fix vPing paths post refactoring effectMorgan Richomme1-2/+2
Change-Id: I24e961965db5103af1625418e7f5ae977bcabf54 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-17Change 'testcases' directory structurejose.lausuch60-37/+32
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-17Merge "BGPVPN test case refactored"Morgan Richomme4-32/+86
2016-05-17Merge "Catch TypeError exceptions in ci/tier_handler.py"Jose Lausuch1-6/+6
2016-05-16BGPVPN test case refactoredvitikkan4-32/+86
BGPVPN test case is refactored and moved into bgpvpn.py module. JIRA: FUNCTEST-234 Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>