aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack/tempest
AgeCommit message (Collapse)AuthorFilesLines
2018-10-23Disable Glance API v1Cédric Ollivier1-0/+4
It has been deprecated since Newton [1]. Even if the related tests are skipped in latest tempest [2], API v1 has to be disabled in Gambia's tempest.conf [3]. [1] https://docs.openstack.org/glance/latest/user/glanceapi.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-22_02-34-24/tempest_full/tempest-report.html [3] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I3b6bb632412c0fecaa659da262760af64d79fa71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Harden Rally generate reportCédric Ollivier1-3/+2
It converts html_file to str and raises all possible exceptions. It sometimes fails when locally generating reports. Change-Id: Idf6a12aaac4561800cd5e364f8bcc495aabbee1d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-14Fix image properties parsingCédric Ollivier2-20/+7
It removes useless spaces and now conforms with oslo.conf dict. New helpers and unit tests are available. Change-Id: I20335c5e5c3840cc872e158c6072d97a3f2cb98c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-06Merge "Rename IMG_PROP to IMAGE_PROPERTIES"Cedric Ollivier1-4/+5
2018-10-06Rename IMG_PROP to IMAGE_PROPERTIESCédric Ollivier1-4/+5
Any other env vars are reduced. Change-Id: Ic2c37d6efd543603a2495f9d2621b66d61710a54 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-06Merge "Use environment variable for image properties"Cedric Ollivier1-0/+4
2018-10-05Use environment variable for image propertiesDelia Popescu1-0/+4
Use IMG_PROP environment variable to read extra image properties. Set image_extra_properties for scsi volume types without file patch, but using IMG_PROP env variable IMG_PROP is defined through releng. Image extra_properties will continue to get updates from functest config file With this change, remove unnecessary parameters from arm patch Related to:https://gerrit.opnfv.org/gerrit/#/c/63203/ JIRA:ARMBAND-402 Change-Id: I64139240751b1e109bbe24ba32f487ccd98b9a92 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-09-23Protect vs former OS env varsCédric Ollivier1-0/+5
rally_jobs is failing vs APEX which still sets OS_TENANT [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console Change-Id: I672bfa93b37b1b773ea7d20fdd91bea0ff14b79f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-23Fix typos in tempest.confCédric Ollivier1-4/+5
It completes the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/62793/2 Change-Id: Ie4c4c5cb374f2bfac6397841f8ddc2cd3b2f524b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-23Set default_domain_id in tempest.confCédric Ollivier2-3/+6
It allows verifying via non-default domain. Change-Id: I95ae26fd3bfd1c10421c02d2b4f6e8a9b6aa49e6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22Set admin_domain_scope to True (tempest)Cédric Ollivier2-15/+15
It completes the previous commit [1]. It also sets cidr and fully forces Keystone v3. [1] https://gerrit.opnfv.org/gerrit/#/c/62777/ Change-Id: Ida948a4ff051dc1d1325d29a815c201366a1e33e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22List all sheduler filters instead of allCédric Ollivier1-1/+5
It doesn't work as expected as highlighted in [1]. [1] https://review.openstack.org/#/c/570207/ Change-Id: Iaf64345c40e8d62349cd50a6861c1191d25c40b9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22Grant new tempest user as admin in domain tooCédric Ollivier1-0/+3
It seems mandatory for test_list_projects_returns_only_authorized_projects Change-Id: Id994e66b088d751c4f6d7f260f8e482c2ee83307 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22Stop creating network resources in tempestCédric Ollivier2-4/+5
fixed_network_name is not used in neutron or nova gates [1]. It may bypass juju bug (subnet discovery). [1] http://logs.openstack.org/46/603046/1/check/tempest-full/a8468a1/controller/logs/tempest_conf.txt Change-Id: I820e8c723918ed683ed1f8016363eb70bad0d14a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-20Allow overriding default storage protocolCédric Ollivier1-1/+3
It adds a new env var STORAGE_PROTOCOL to override storage_protocol in tempest. The default value is unchanged [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I19e4e25212b6f6176e3b967e01eb634c15e4d474 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-20Set scheduler_available_filters to allCédric Ollivier1-0/+2
It indicates all filters that are included with nova are enabled [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I0d1943941d62d2eee418200c69e8198cd858383e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-09Clean user/project after skipping testcasesCédric Ollivier1-0/+2
It avoids remaining resources after skipping a tempest-based testcase. Change-Id: I0a993486c6e9265d15166d5eed5a612875d29b08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-08Merge "Fix dict conversion in tempest.conf"Cedric Ollivier1-1/+1
2018-09-08Fix dict conversion in tempest.confCédric Ollivier1-1/+1
https://github.com/openstack/oslo.config/blob/master/oslo_config/types.py#L600 https://build.opnfv.org/ci/view/fuel/job/functest-fuel-virtual-daily-master/817/consoleFull Change-Id: Icde9938bb9f6c0c37d2504317f31b0af4ef9ee8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-07Do not raise exceptions in conf_utilsJuha Kosonen2-14/+13
Return a reasonable value for caller to process. Change-Id: I5a83544aaebb4e53db37ddaa13033d77848722b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-05Update scenario section in tempest.confCédric Ollivier2-1/+41
It's required at least by Barbican tempest plugin. Change-Id: I46a65ee5fee044917c5375adaa8ebb529efe86ec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Switch from tempest section to openstackCédric Ollivier1-10/+10
Rally warns from these deprecated conf sections. Change-Id: I15933c4f2cda14384e53202ec22f438a586d7b05 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Merge "Create new project/user for tempest tests"Cedric Ollivier2-15/+25
2018-08-29Create new project/user for tempest testsJuha Kosonen2-15/+25
JIRA: FUNCTEST-1009 Change-Id: I6b9bca3827ba6cc804c25689a896ca63eec6a78b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-29Merge "Support pre-Provisioned credentials"Cedric Ollivier2-2/+14
2018-08-28Support pre-Provisioned credentialsCédric Ollivier2-2/+14
If USE_DYNAMIC_CREDENTIALS = False, Functest is expected for /home/opnfv/functest/data/accounts.yaml which contains the set of pre-existing credentials to use for testing [1]. It also sets admin_domain_scope and default_credentials_domain_name. [1] https://docs.openstack.org/tempest/latest/configuration.html Change-Id: Ie7b81f0c56049260ca99b8e3a6d58cb8a2660659 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Merge "Remove installer type from tempest blacklist"Cedric Ollivier1-7/+3
2018-08-28Allow adding a specific role to users created by tempestCédric Ollivier1-0/+2
It may allow bypassing RBAC policies if required. Change-Id: I3b7ad44d7b80f8ea757846afdcd787b686c52856 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Remove installer type from tempest blacklistJuha Kosonen1-7/+3
Enables utilization of blacklist also on non-OPNFV environments since there is no link to installer type. JIRA: FUNCTEST-1008 Change-Id: I3a012b8b7e7dbd049f8794dff3c9d56dcc1cadad Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-23Create output directoryGeorg Kunz1-0/+2
The rally.conf gets copied before the target directory has been created. JIRA: FUNCTEST-1007 JIRA: DOVETAIL-730 Change-Id: Ie774fce994ada644c1163600e6c62e1231fde443 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-22Temporarily disable shelveCédric Ollivier1-0/+1
They are blocking in Orange Openlab as the support is missing. A dynamic check has to be implemented before activating it. Change-Id: I8d87251fa4589f96d3515e411aeec5e79b7e7960 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-21Fix fixed_network_name in tempest.confCédric Ollivier1-1/+7
It also copies rally.conf and tempest.log in res_dir. Change-Id: Ib907a29ba3f47ca861d3af8afc0ee74446222e89 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Clean /etc/rally.confCédric Ollivier1-0/+17
Else rally_sanity may print logs in tempest_smoke res dir. Change-Id: Iae97d533e9b99dcf8da70229b0675228472bfe52 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Create new project/user for rally testJuha Kosonen1-2/+2
FUNCTEST-1002 Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-10Publish rally logs to ease debugging.Cédric Ollivier1-10/+17
It also redirect stderr to stdout as tempest mainly prints in stderr. JIRA: FUNCTEST-999 Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Fix swift operator roleCédric Ollivier1-1/+1
[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/35/console Change-Id: I7236bf5a74f36941f499da32c5c77dcd0b98b6f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-02Fix parse error in tempest_smokeDelia Popescu1-1/+1
Test failes to parse /etc/rally/rally.conf (RALLY_CONF_FILE) whith inplace=1 keyword argument for fileinput One new space is added in second line JIRA: ARMBAND-395 Change-Id: I8adb333047f9962f4105a6a74e2f8ef83d5745e0 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-07-30Delete alt images before removing the accountCédric Ollivier1-1/+1
Else it could raise unauthorized exceptions [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ia9b857069f775e2c8ecc5e07cf39b3a1fb7e3540 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-17Set filename_alt in tempestCédric Ollivier1-0/+1
Change-Id: I9137ee30bd2107ec23ef6cfea92ccfc5f010410d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-17Leverage cloudify_ims on CloudifyCédric Ollivier1-2/+1
It also defines 2 new methods to avoid duplicating code: - TenantNetwork1.get_public_auth_url() - VmReady1.publish_image_alt() Shaker and Tempest are updated as well. Change-Id: Ie9095c57c580b95f067d5a8275ad71818b4df335 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Dynamically skip neutron_trunk and barbicanCédric Ollivier1-0/+34
It avoids fasly testcases in failure for end users. It also removes the neutron_trunk class which is now useless (Queens). Change-Id: I3f5a1ac84a50e061da6eadcc5c9bafb2e99050db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-14Set swift_operator_role if requiredCédric Ollivier1-0/+14
Apex creates member as default role which conflicts with the default swift_operator_role [1]. It detects the default role in lowercase as well and write it in rally.conf if required. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/116/console Change-Id: Ic4dc98c793207fc32ff35852472742c92db6699c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Avoid duplicating tempest section in rally.confCédric Ollivier1-1/+2
Change-Id: I79598cce2c7dfe0a2e969ddd32735c3eb189fa7a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Add tempest section in rally.confCédric Ollivier1-0/+1
It completes the previous patch [1][2]. [1] https://gerrit.opnfv.org/gerrit/#/c/59681/ [2] https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/555/console Change-Id: I93ad9db2c7a8a0691fed8bf58f5e21d8f3dc9c57 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Clean all possible resourcesCédric Ollivier1-2/+4
It checks all openstack resources before cleaning. It allows removing images even if the test fail quickly. Change-Id: I1763b8a70fa7ffeb03c435e8e775c7afd1a7adac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Check the status of inherited stepsCédric Ollivier1-1/+2
Change-Id: If63c228f2844194279b560515f4ab24a4ee88be0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Force result = 0 if exceptionCédric Ollivier1-0/+1
self.result can be positive due to intermediary steps (scenarios). Else it can return false positives [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console Change-Id: Iecadee7f7380fda5273a0668aff1b441647c45aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-11Update rally image name regexCédric Ollivier1-0/+11
The default value doesn't conform with our image names. Else it downloads the image from internet which may be not possible (offline testing, proxy or deployment l3 issues [1]) [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console Change-Id: I7d951967784d591e7155fe8582299aaa9b680b10 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-10Force region to RegionOne if OS_REGION_NAME is unsetCédric Ollivier1-2/+2
tempest still selects the first one if unset [1]. JIRA: FUNCTEST-990 [1] https://docs.openstack.org/tempest/latest/sampleconf.html Change-Id: I238d47173c2c4aa1db694028e4d44b80b0e280f1 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2018-07-08Refactor tempest commonCédric Ollivier2-351/+13
It also renames two testcases and updates all docs because tests run in parallel in case of tempest smoke. To force one thread as before: run: module: 'functest.opnfv_tests.openstack.tempest.tempest' class: 'TempestCommon' args: mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' option: - '--concurrency=1' JIRA: FUNCTEST-989 Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>