aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2018-07-11Clean all possible resourcesCédric Ollivier6-18/+28
It checks all openstack resources before cleaning. It allows removing images even if the test fail quickly. Change-Id: I1763b8a70fa7ffeb03c435e8e775c7afd1a7adac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Check the status of inherited stepsCédric Ollivier3-3/+6
Change-Id: If63c228f2844194279b560515f4ab24a4ee88be0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Force result = 0 if exceptionCédric Ollivier2-0/+2
self.result can be positive due to intermediary steps (scenarios). Else it can return false positives [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console Change-Id: Iecadee7f7380fda5273a0668aff1b441647c45aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Merge "Update rally image name regex"Cedric Ollivier1-0/+11
2018-07-11Update rally image name regexCédric Ollivier1-0/+11
The default value doesn't conform with our image names. Else it downloads the image from internet which may be not possible (offline testing, proxy or deployment l3 issues [1]) [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console Change-Id: I7d951967784d591e7155fe8582299aaa9b680b10 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Run script only if volume device is foundDelia Popescu2-2/+2
Add back volume device name search on instance. If vol is not attached script should not run. In the current state, if volume is not found, write_data returns positive result and read_data cannot find any new file Change-Id: Ifaa8af1e6d5c66f5ac776c83bebde526e77a9fd8 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-07-10Force region to RegionOne if OS_REGION_NAME is unsetCédric Ollivier1-2/+2
tempest still selects the first one if unset [1]. JIRA: FUNCTEST-990 [1] https://docs.openstack.org/tempest/latest/sampleconf.html Change-Id: I238d47173c2c4aa1db694028e4d44b80b0e280f1 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2018-07-09Force public identity endpoint in ShakerCédric Ollivier1-1/+1
It conforms with our VNFs by calling public endpoints (from VM). It fixes by design the issues when testing Compass [1] due to export OS_INTERFACE=publicURL [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/180/consoleFull Change-Id: Iea15506ba5910879d05e61cfd20da2c0878e569b Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2018-07-09Merge "Refactor tempest common"Cedric Ollivier6-379/+45
2018-07-09Add Vmtp as a new testcaseCédric Ollivier2-0/+153
VMTP is a small python application that will automatically perform ping connectivity, round trip time measurement (latency) and TCP/UDP throughput. JIRA: FUNCTEST-980 Change-Id: I8e94fc52a429f505ac14e14bbb9d0a3b20996ba4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-08Refactor tempest commonCédric Ollivier6-379/+45
It also renames two testcases and updates all docs because tests run in parallel in case of tempest smoke. To force one thread as before: run: module: 'functest.opnfv_tests.openstack.tempest.tempest' class: 'TempestCommon' args: mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' option: - '--concurrency=1' JIRA: FUNCTEST-989 Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-08Merge "Cover vping_ssh"Cedric Ollivier1-2/+0
2018-07-08Temporarily disable Snaps CreateRouterSuccessTestsCédric Ollivier1-7/+10
The test could be falsy regarding the possible external network configs [1]. This patch will be reverted as soon as the bug is closed [2]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/246/console [2] https://jira.opnfv.org/browse/SNAPS-320 Change-Id: I680656b300f0d669e8d96bec6c94a4a804ebbecb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-07Cover vping_sshCédric Ollivier1-2/+0
Change-Id: I37c52057a45d76e081a1a0145baee96041ca25a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-06Fix delete_keypair argCédric Ollivier1-0/+1
It uses keypair name instead of id as expected by Shade. It also increases timers as it boots an ubuntu VM. Change-Id: I8cd131e7c7a94c8f6b0fcc54a4d75ef8af31b807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-05Set timeout for create, attach and detach volumeDelia Popescu1-4/+9
Without timeout for volume opperations the testcase will fail only after functest timeout Change-Id: I669c7933846574c09fc7db06a2a2ce7d101a44f5 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-07-02Merge "Inherit rally from VmReady1"Cedric Ollivier2-129/+16
2018-06-30Inherit rally from VmReady1Cédric Ollivier2-129/+16
It also fixes clean(). Change-Id: I42d1305d5cdb5a717cfa7fce26798ac7102310f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-29Remove floating ip of second instance in cinder testcaseDelia Popescu1-1/+1
Change-Id: I30e30f1d35bb83984b63d7308331fc7bfee53955 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-06-25Remove list_zones() which requires dnsCédric Ollivier1-1/+1
Change-Id: I271545a654a1a508c8b47a3fa4dcf72ad314a154 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Implement connection_check via shade tooCédric Ollivier4-44/+59
SNAPS connection_check tests are merged into api_check. It would ease debugging deployment as well [1] [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/127/console Change-Id: I30254a46c3dc6874881d687e36903c6b7878d63d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-24Force the use of public endpoints in shaker.pyCédric Ollivier1-7/+31
It now leverages on the new user created and gets the public endpoint. Change-Id: Iead106e614a73708cb13e33b49a2f438766a3056 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-24Fix hardcoded values in cinder_testCédric Ollivier4-331/+55
Only Fuel attaches a kdrive in all cases and then increase the device numbers. cinder_test now leverages on VOLUME_DEVICE_NAME as tempest. It also updates the testcase to leverage on the right scenario. Change-Id: Ib5cd17f69411f608f1b79e704604dc481581ebe0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-24Improve scenarios to reduce duplicate codesCédric Ollivier5-323/+42
Change-Id: I71f79b9ac8314ac979d4b1009f662baa7c93a4fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-23Fix user/project create operationsCédric Ollivier1-3/+8
os_client_config creates a singleton which forbids the previous processing. It also cleans remaining resources and allows publishing public images (needed by Tempest) Change-Id: I3a0ad8664b263d3ee8599efe2973465006d5750b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-22Update tempest to inherit from VmReady1Cédric Ollivier3-146/+47
It also copies tempest.conf due to side effects raised by Barbican plugins. Change-Id: Ie87680f5d2e68527a5a61aac302838afc339dde8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Add the Barbican test suiteCédric Ollivier1-0/+18
It eases verifying the functionality of a barbican installation. Change-Id: Iac2144ae6ba4d61b2b37bb5c7a0359edb3f222a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Integrate Shaker as a new testcaseCédric Ollivier2-0/+78
Shaker wraps around popular system network testing tools like iperf, iperf3 and netperf (with help of flent). Change-Id: Idd82ffd9642c90335ad156e899c0330473260f15 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-20Publish tenantnetwork scenariosCédric Ollivier1-3/+5
They ease creating all tenant network ressources. These scenarios should be reused by other more complex ones. Change-Id: I4ce1872065bde92408d34f2ca8823ce98275d8d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-19Fix pylint errorsCédric Ollivier3-11/+12
They are highlighted by the last pylint version. Change-Id: I473212a413013492716993fb536903b13bff66ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-14Add py3 support in tempest and rallyCédric Ollivier3-7/+11
Change-Id: I009d38a0db409ab4ec641cba9173ab2386d0ce2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-13Merge "Abort vping_userdata test if IP address is missing"Cedric Ollivier1-0/+4
2018-06-13Abort vping_userdata test if IP address is missingJuha Kosonen1-0/+4
Do not start checking the result of ping test if the first instance has no IP address. JIRA: FUNCTEST-976 Change-Id: I2da3154e63a6a97f86efe8274be84abc437aa133 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-06-12SNAPS via functest with flavor metadata configurablePanagiotis Karalis1-1/+2
The required data for the SNAPS flavors are sent through the config_functest yaml file in order for the SNAPS scenarios to be configured accordingly. If the config_functest yaml file includes empty flavor_extra_specs or there is not included this parameter, the SNAPS scenarios will be executed using the hardcoded value. Change-Id: I4ef46d1fe93497d658414170a72c4520d8f37808 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-06-05Switch from OS_ENDPOINT_TYPE to OS_INTERFACECédric Ollivier1-14/+13
It also set endpoint_type to public in tempest.conf if unset. JIRA: FUNCTEST-975 Change-Id: I91bd1d7171b4bcf58dbe818696d5b864d5036619 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-01Merge "Update read and write data path in cinder test"Cedric Ollivier2-13/+20
2018-05-31Update read and write data path in cinder testDelia Popescu2-13/+20
Update the path for read/write data Fix a false possitive result on read_data Fix read device name Unmount volume after writing data JIRA: FUNCTEST-908 Change-Id: I555b5a3daaeff3aa58891e65c0b70094372c04c9 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-30Fix tempest result parsingJuha Kosonen1-1/+1
Detailed results of verifier are in tempest-error.log. Change-Id: Id5dbdfd3389d1b79dba2bebc5f5ffa7811ef06c8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-05-30Fix _do_execute() return code in vping_sshCédric Ollivier1-1/+1
Change-Id: I781e51bb56f6cdac8b347e7fd85e70c07eb69e23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-28Print vping output instead of Paramiko objectCédric Ollivier1-1/+1
Change-Id: Iddc1abdf443e482e8748434a4ba7d85709d8cd0e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-26Merge "Add cinder_test testcase"Cedric Ollivier5-0/+439
2018-05-25Add cinder_test testcaseDelia Popescu5-0/+439
Create 2 instances with Floating IPs Attach data volume to instance 1 Write data on the volume Detach volume from instance 1 Attach volume to instance 2 Read data from volume JIRA: FUNCTEST-908 Change-Id: I10efdfb3b7f9d7e6ab5c6a538052437585d52fb0 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-24Set image metadata in tempestCédric Ollivier2-2/+3
It applied the same operations as [1]. Only one config is used between rally, tempest and vping. [1] https://gerrit.opnfv.org/gerrit/#/c/57613/ Change-Id: I4d5fd2117d404b7eaa79326e21a35272232d0b92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-18Refactor task results manipulation in rallyJuha Kosonen1-58/+82
Use data provided by report generation since the output of task results is not available as valid JSON if task didn't finish gracefully. JIRA: FUNCTEST-966 Change-Id: Ieb906bc209cc26055babd5f4e6b2bb556724f9a8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-05-10Add image extra properties back in vping_baseDelia Popescu1-1/+4
Image extra properties are missing for ARM Set image_url for ARM JIRA: ARMBAND-383 Change-Id: I0e2730c3f22214ad61d72424ea76173f1783d0ca Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-07Switch to project domain nameCédric Ollivier1-3/+5
At least Fuel, Apex and Joid don't export OS_PROJECT_DOMAIN_ID. https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/353/console Change-Id: I8441d2de1841d5a9ce78c6929fd78da01c45548c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-07Improve ssh timeout in vping_sshCédric Ollivier1-6/+18
It seems that 10s is not enough for Fuel. Change-Id: I46d3d2c9091946befb0e056a8c8cc56c59087471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-07Simplify vping_sshCédric Ollivier4-91/+26
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-05Merge "Functest fail to parse refstack results"Cedric Ollivier1-3/+6
2018-05-05Switch to Shade in rallyJuha Kosonen1-76/+79
Use Shade for managing OpenStack resources in rally. Change-Id: Ic8b7aaef6886f6ca4930b2ea463317b75ed8d3c9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>