summaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-10-26Temporarily disable VNC testsstable/fraserCédric Ollivier1-0/+3
At least Compass and Fuel configure Spice as console [1][2]. It disables vnc testing as it could fail for endusers as well. [1] https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Conflicts: functest/opnfv_tests/openstack/tempest/conf_utils.py Change-Id: I2a1ecf345cb81170c1b1a3e49f8f3a58602fc3f0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit df9d5c5d3b80b613130de59a1810f7fce9cbbc0d)
2018-09-25Update juju agentsCédric Ollivier1-1/+1
It conforms with last juju update. Change-Id: I4941aac66e5ac96045090f10f197f6ee2712caac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1ab7a53dab08a6f67ff2cf54f33b70dea0e82bfb)
2018-09-24Protect if default secgroup not createdCédric Ollivier1-3/+5
https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/lastFailedBuild/console Change-Id: I2b5f1dc577f98773ad40ed3bcfff609d8d6c4b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5bb60b33a8fad4859b7391576fdfed7cec4c14a8)
2018-09-23Protect vs former OS env varsCédric Ollivier2-0/+10
rally_jobs is failing vs APEX which still sets OS_TENANT [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console Change-Id: I672bfa93b37b1b773ea7d20fdd91bea0ff14b79f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 83e0e6836d7f5e18eb4eb8c9d28b4e6980b790c2)
2018-09-23List default secgroup via orig userCédric Ollivier1-1/+1
Else the generated account can be already removed [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console Change-Id: I93d88763cdc67cd38286c24ad830244e0c12e019 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f6748c8f3737bf7fbae519319b93e88db9e65834)
2018-09-23Conform with OpenStack Pike gatesCédric Ollivier1-1/+1
It excludes slow tests conforming with OpenStack Gates. All tests run in parallel here. It should be noted that only one skipped test was in failure here. tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_mtu_sized_frames Change-Id: I110a8cf5dd8603f29f40fcf01fc277d468582bf6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-23Fix typos in tempest.confCédric Ollivier1-4/+5
It completes the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/62793/2 Change-Id: Ie4c4c5cb374f2bfac6397841f8ddc2cd3b2f524b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 98a4a863935be38f63e78550ddbcf4c1299bfdf1)
2018-09-23Set default_domain_id in tempest.confCédric Ollivier2-3/+6
It allows verifying via non-default domain. Change-Id: I95ae26fd3bfd1c10421c02d2b4f6e8a9b6aa49e6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 11d28aaf2e726859b59b7511d64dc4dd4b422e1e)
2018-09-22Set admin_domain_scope to True (tempest)Cédric Ollivier2-15/+15
It completes the previous commit [1]. It also sets cidr and fully forces Keystone v3. [1] https://gerrit.opnfv.org/gerrit/#/c/62777/ Change-Id: Ida948a4ff051dc1d1325d29a815c201366a1e33e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f4b545efe2339bdb5f6117d484e127adda5c8021)
2018-09-22List all sheduler filters instead of allCédric Ollivier1-1/+5
It doesn't work as expected as highlighted in [1]. [1] https://review.openstack.org/#/c/570207/ Change-Id: Iaf64345c40e8d62349cd50a6861c1191d25c40b9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ecc7bc215cdf47104d61ba7e23e5f8ec65ca03c4)
2018-09-22Clean the default security groupCédric Ollivier1-0/+4
It's not removed when deleting the users and the projects. Change-Id: Ib5de0885dcbfb558a48cdd20ae3ccc47b7f23748 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d4e60af2b8f544d774223b16c193dc40bd5dce38)
2018-09-22Grant new tempest user as admin in domain tooCédric Ollivier1-0/+3
It seems mandatory for test_list_projects_returns_only_authorized_projects Change-Id: Id994e66b088d751c4f6d7f260f8e482c2ee83307 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 17e87d5af713bb07759c4b2af0c2b40077343a32)
2018-09-22Stop creating network resources in tempestCédric Ollivier2-4/+5
fixed_network_name is not used in neutron or nova gates [1]. It may bypass juju bug (subnet discovery). [1] http://logs.openstack.org/46/603046/1/check/tempest-full/a8468a1/controller/logs/tempest_conf.txt Change-Id: I820e8c723918ed683ed1f8016363eb70bad0d14a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ac31a32320122ea1683fe9884e5bf1f969678b03)
2018-09-20Allow overriding default storage protocolCédric Ollivier2-2/+5
It adds a new env var STORAGE_PROTOCOL to override storage_protocol in tempest. The default value is unchanged [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I19e4e25212b6f6176e3b967e01eb634c15e4d474 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a561c6ca316feb1a203327aa729ac0317f70df48)
2018-09-20Set scheduler_available_filters to allCédric Ollivier1-0/+2
It indicates all filters that are included with nova are enabled [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I0d1943941d62d2eee418200c69e8198cd858383e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ff2ba1fd18b05bf1b031e78d2589028968bbe906)
2018-09-20Temporarily disable shelveCédric Ollivier1-0/+1
They are blocking in Orange Openlab as the support is missing. A dynamic check has to be implemented before activating it. Change-Id: I8d87251fa4589f96d3515e411aeec5e79b7e7960 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1da4b519f8e73d3be9e37f9d72367654bf662e63)
2018-09-19Modify creation of SecGroup Rule for SSHThierry ALLENO1-1/+11
There is multiple "default" security groups, when user is created with admin role. Change-Id: I7555dc9461816dfdaaee36d82d712e25b4b65da7 Signed-off-by: Thierry ALLENO <thierry.alleno@orange.com> (cherry picked from commit 7488f119f9d9c61c61ef55d53f87de0e671fed23)
2018-09-19Correct proxy configuration for VNF VMThierry ALLENO1-0/+12
The configuration of proxy for apt is missing in ubuntu images. Line Feed is missing in cloudify conf files. Change-Id: I3237b914e993c57f4fe3ed568690d2d9a41c0bdf Signed-off-by: Thierry ALLENO <thierry.alleno@orange.com> (cherry picked from commit be864b0de9f0f990984ad9e3c2d20b694e1b2c26)
2018-09-12Ease adding proxies in vmsCédric Ollivier1-0/+41
It eases running VNFs behind proxies as they download packages. Change-Id: I187078dab744c51188b9835417d1a29fad1b4bd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d5fce8c12bc73c1b1547df2750563c271a3ab3f6)
2018-09-12Support VIO (VMware in OpenStack)Cédric Ollivier2-0/+68
It allows converting all images to vmdk and then patching all testcases. DEPLOY_SCENARIO should match vio to do so. convert_images.sh has to be called as prerequisite. JIRA: FUNCTEST-992 JIRA: FUNCTEST-993 Change-Id: Ie35bf80af1cd9610a8c416ec01b81b61c6148cfe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d176e20067368d834e8b77d4f685f48cb54d03f5)
2018-09-08Stop cloning when running vyos_vrouterCédric Ollivier5-39/+7
It moves the clone operation into docker build instead. Change-Id: I296005d8638510a999665d383a26c4fcd48897a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2e7f66734394dc5e749ef9ac95e46a8ded9fb2c9)
2018-09-08Fix dict conversion in tempest.confCédric Ollivier2-3/+3
https://github.com/openstack/oslo.config/blob/master/oslo_config/types.py#L600 https://build.opnfv.org/ci/view/fuel/job/functest-fuel-virtual-daily-master/817/consoleFull Change-Id: Icde9938bb9f6c0c37d2504317f31b0af4ef9ee8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 59cf95974b2b9c0271c1ff9c9604b960c4bcfa26)
2018-09-08Update scenario section in tempest.confCédric Ollivier3-1/+61
It's required at least by Barbican tempest plugin. Change-Id: I46a65ee5fee044917c5375adaa8ebb529efe86ec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9ec639526ed32d4b05168627c5c016fb66b7d008)
2018-09-07Remove one useless security groupCédric Ollivier1-5/+0
This rule breaks lookup when the user created is admin. Change-Id: I2fe3dba687bd5d151cd7e53217586a0bcb21815d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 65b9318ffcb4b12e0aa4aa08027a35ff1e2d285d)
2018-09-07Add role to users created by rally if requiredCédric Ollivier1-0/+27
It sets [openstack] keystone_default_role if NEW_USER_ROLE differs from member. Change-Id: Ib6be5cf22654e882ea110298cba421c1e87c78fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 98f3bf16722e5e718130f960910d64bc76951e3b)
2018-09-03Create network via admin userCédric Ollivier2-5/+10
It creates the network via admin user as segmentation id may be set. Change-Id: I853f40e09aee9a658fc2373cd7e8bf00e3c0c3ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 92ba2d7f3bbbecebcd4214bc9b8682d2b6ce87e9)
2018-08-31Add concurrency parameter to refstack_defcore testsDimitrios Markou1-0/+3
In fraser release we observed that refstack tests are executed in parallel and that might causes problems in CI because without concurrency parameter it will try to use as many cpus as possible and that might lead to race condition issues. This patch is created for backporting purposes to fraser branch where the problem occurs. JIRA: DOVETAIL-662 Change-Id: I6cf0ad3a32e88f04abd00d69523aa8ac47c39470 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit d5c3692d211cb3e82708eaf2595ba3f26fafc6a6)
2018-08-30Ensure len(project_name) < 64Cédric Ollivier1-1/+1
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/259/console https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/428/console Change-Id: Ib64878962a71b6b45ef039fce8bfaa43172b2498 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3eec6556fa20e51d5e6596253393199469c83556)
2018-08-29Create new project/user for tempest testsJuha Kosonen4-30/+37
JIRA: FUNCTEST-1009 Change-Id: I6b9bca3827ba6cc804c25689a896ca63eec6a78b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 9d03fcdd488c385842b43fd914915cbe4ae5390a)
2018-08-29Support pre-Provisioned credentialsCédric Ollivier3-3/+16
If USE_DYNAMIC_CREDENTIALS = False, Functest is expected for /home/opnfv/functest/data/accounts.yaml which contains the set of pre-existing credentials to use for testing [1]. It also sets admin_domain_scope and default_credentials_domain_name. [1] https://docs.openstack.org/tempest/latest/configuration.html Change-Id: Ie7b81f0c56049260ca99b8e3a6d58cb8a2660659 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7e0f65a25f1c83c90051e13e4aa5333aaaa8c6d5)
2018-08-29Allow adding a specific role to users created by tempestCédric Ollivier1-0/+2
It may allow bypassing RBAC policies if required. Change-Id: I3b7ad44d7b80f8ea757846afdcd787b686c52856 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ea596bbf094c8e45961b1b1379e58631942e4864)
2018-08-25Create new project/user for snaps testsJuha Kosonen3-20/+97
JIRA: FUNCTEST-1003 Change-Id: Ic55998977386f95f619a355d22bd285782fe81f0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 5d9acb84f492dca4da863c60e30a5463fe165cb5)
2018-08-23Redirect stderr to stdout when running tempestCédric Ollivier1-8/+4
JIRA: FUNCTEST-999 Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c4b3f91c6bb79c50adc1c5a4397666ebcd1f7375)
2018-08-23Create output directoryGeorg Kunz1-0/+2
The rally.conf gets copied before the target directory has been created. JIRA: FUNCTEST-1007 JIRA: DOVETAIL-730 Change-Id: Ie774fce994ada644c1163600e6c62e1231fde443 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> (cherry picked from commit b55aa749c379ce7af918f43558f2195e2259d872)
2018-08-22Fix fixed_network_name in tempest.confCédric Ollivier1-1/+7
It also copies rally.conf and tempest.log in res_dir. Change-Id: Ib907a29ba3f47ca861d3af8afc0ee74446222e89 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0fd76322f95b755d347826f707c092105506311b)
2018-08-19Typos (ressources)Cédric Ollivier2-14/+14
Change-Id: Ifcf1d4bd48b64bc9175c3b0d594f897f4f3f5e7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 873e5f5c868027d34f36d494719b4dad2bdb1e7d)
2018-08-18Generate API doc rst filesCédric Ollivier1-0/+1
It also fixes few docstrings Change-Id: I09b3456e82953f64ec49628e2979115cc7bbec55 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Allocate OperatorCloud instead of OpenStackCloudCédric Ollivier1-1/+1
Else it fails for Rally which lists computes [1]. Former Shade releases split Openstack operations into 2 classes. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/269/console Change-Id: Icdf01c540ff62d7e7ef609929e806334823d2969 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-16Create new project/user for rally testJuha Kosonen4-11/+30
FUNCTEST-1002 Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 4b7d89de42fe9a3867b12ea39721ad92aff96340)
2018-08-13Fix typo (ressources)Cédric Ollivier1-2/+2
Change-Id: Ibe131e0cf02493f0f3a82c1e179848605bd0a292 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8cfa994563a238bbd34d01e97de1fcfd40535e6e)
2018-08-13Allow setting two image extra properties per testcaseCédric Ollivier1-13/+17
It conforms with the flavor extra specs model [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/60713/ Change-Id: I1555a313aaf56ae47f9ad2a4529eb8b94e636c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8d3eb364d84f90b19f9e7234d01add8764843081)
2018-08-13Update all patch configsCédric Ollivier3-6/+99
It takes all new testcases into account. It allows running vnfs vs dpdk scenarios too. Change-Id: I789f6bb1c3df891b1a94f2a674c15085f81f2f23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 484acb3716b6f6261793b8a6a0220cce62ccb0c3)
2018-08-07Fix swift operator roleCédric Ollivier1-1/+1
[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/35/console Change-Id: I7236bf5a74f36941f499da32c5c77dcd0b98b6f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3d1986d1a8035e93b7ad7e4331cb1cbe126a857f)
2018-08-07Update Xtesting to 0.34.0Cédric Ollivier2-6/+31
It mainly fixes negative regex operations and allows calling one skipped test via run_tests (parallel testing). Change-Id: Ibf34ecf2dae46c4c3af15d05af2946c9eb33f6cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-06Change juju_epc cidrCédric Ollivier1-0/+2
juju cannot bootstrap if cidr already exists which now happens only if a shared network with the same cidr is defined (it should be considered as a bug about juju). By allocation its own cidr, it protects vs remaining rally or tempest remaining shared networks or vs parallel testing. juju_epc can already run twice in parallel as it creates a new project and a private network. Change-Id: I76c4971d631f763307315478e6cf5a383c91ed36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 27bc4acea711b5e6e09102bdc4209c9ef13283f3)
2018-08-04Make synchronous Shade callsCédric Ollivier1-10/+14
It makes difficult to find the issues (floating ip, boot, ssh connection, etc...) for a small benefit regarding the current testcase implementations. It increases the default floating ip timeout because it has been reached when running Functest multiple times in parallel. It may be the root cause when running singlevm vs XCI (in that case, neutron api and agents are hosted in a nested vm). Change-Id: Ia97e04902321644c207c59987283754318aee5e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8faf2e3365fc5acc0167a05a919eef564f11491a)
2018-08-03Fix timeout (switch to synchronous calls)Cédric Ollivier2-3/+1
It completes "Switch create_server timeout to default value" [1] which forbids waiting more that 180s (create_server was asynchronous). [1] https://gerrit.opnfv.org/gerrit/#/c/60423/2 Change-Id: Icbf9ee48024fe9e10571c2bb7ca895d5828fb561 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f31841906a7cddcecc4c8fba9b641265811e9b7f)
2018-08-03Increase Cloudify create_server_timeoutCédric Ollivier1-1/+1
The timeout has been reached when running multiple vnfs in parallel. Only few additional seconds seemed required here. Change-Id: I0d6e38e827c581edb617bb0cc13249645468a2aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9c19bb9bb41e36d4ca70563649ced92ce7ab9b82)
2018-08-01Add fallback mechanism if vlanCédric Ollivier2-5/+12
private_v4 and public_v4 are incorrectly set when vlan is used as overlay. JIRA: FUNCTEST-996 Change-Id: I120a247e92e0fd295769b2a0eeb15ce82a0eabc8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5522ecd302ee54b494714cb2e1af0fe2381e5c37)
2018-08-01Print stderr in logs when calling cmd over sshCédric Ollivier3-4/+6
Change-Id: I152ac898661a0e99a6232df86689c70c468ceaa5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b66827d753e09c29cd6f541119dc0ec4c6344511)