aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2018-04-23Switch from deploy utils to the right objectsCédric Ollivier3-18/+28
It also prints the full exceptions and removes useless casts. Change-Id: I19ff1ae90670833f998c0d17592da82207235229 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-22Bypass NoneType errors when creating router in rallyCédric Ollivier1-1/+1
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: Ia728415207f8ecb5b5ac55982f82337c45671c4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-21Bypass NoneType errors when creating routerCédric Ollivier1-2/+2
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: I849944fa9d4d2be21fe1a37b76c4cfd231b6d56f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-19Introduce Rally scenarios for GnocchiJuha Kosonen4-1/+278
Added scenarios for testing: - capabilities - status - archive policy - archive policy rule - resource - resource type - metric Change-Id: I79f4f0b2bd4d206588ea3edbce8037d1cb993646 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-13Install new neutron-tempest-pluginCédric Ollivier1-1/+1
Change-Id: Id43e7cd5efa4a78397238bf27ef7e6b476704557 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Merge "Fix role processing in Patrole"Cedric Ollivier3-16/+19
2018-04-13Merge "Pass kwargs in TempestCommon:configure()"Cedric Ollivier1-1/+1
2018-04-13Update regex to get verification_idCédric Ollivier1-6/+4
Rally changes the sentence which our testcase was unable to parse. Change-Id: I9bab3109adc37d349c6fbec73cea9052d09cedb1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Switch to stestrCédric Ollivier1-1/+1
It also updates rally and installs rally-openstack. It completes the update to OpenStack Queens. Change-Id: Iabf436ac6e7facfa21a3d7c8a3dfaffa9142da98 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Fix role processing in PatroleCédric Ollivier3-16/+19
Role has to be listed in tempest.conf before calling testr. It also saves the right config file. Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Pass kwargs in TempestCommon:configure()Cédric Ollivier1-1/+1
It's required by Patrole. Change-Id: I07eb6f05b4776c3f9929b6f08c5cbfa131e09d8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-09Remove Ceilometer test scenariosJuha Kosonen5-763/+1
The API utilized by Rally in Ceilometer scenarios was deprecated in OpenStack Pike and scenarios were blacklisted. Remove these scenarios from respository. JIRA: FUNCTEST-949 Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-02Control vping cleanup step via --nocleanLinda Wang3-46/+40
Change-Id: Ic43b100348e77fd96aab9abc5a9ec4a0b47a2f87 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-20Update the details of tempest resultsLinda Wang1-4/+6
Change-Id: Idb18c7784e44030a48208ea64c21cde2536a3387 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-18Allow exceptions when deleting a missing verifierCédric Ollivier1-2/+5
Change-Id: I2e48bdcf9bce872a4a7855f9f6cd05d2b4897244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Refactor refstack to limit instructionsCédric Ollivier1-24/+8
Change-Id: I3cd490d18898d0ee6f48e4c19d7ed65c0cf0c275 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute all rally messagesCédric Ollivier2-39/+36
The are now printed in functest.log only. JIRA: FUNCTEST-950 Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Precise tempest regexCédric Ollivier1-1/+1
It stops running neutron tests which matched the former regex. Change-Id: Ica5a0d1f4858d01533156c98da87f9ed4662489f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Refactor Patrole to limit instructionsCédric Ollivier1-26/+12
Change-Id: Ie0ab079b1f674587ff3d68bf170df2296303780e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Set api_extensions = all for NeutronTrunk onlyCédric Ollivier2-3/+9
Change-Id: I6c019094a9cea86f5990752463a3690d4f00df0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Create 2 images and flavors for tempest testsLinda Wang5-66/+18
Also 1. remove the obsolete function: generate_test_accounts_file 2. Use patch mechanism to get config Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-14Refactor TempestCommon to simplify subclassesCédric Ollivier4-64/+34
Change-Id: I8d265b6939861fd9d02a3d0f31aef53b9bfcb035 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-14Merge "Implement trunk ports testcase"Linda Wang2-0/+15
2018-03-13Leverage on VOLUME_DEVICE_NAME if FuelCédric Ollivier1-6/+1
As Fuel sets VOLUME_DEVICE_NAME [1], the specific conditional instruction can be removed. [1] https://build.opnfv.org/ci/job/functest-fuel-baremetal-daily-master/18/console Change-Id: Iee3fd7c969cf31c8017b73c6ffd646f0e33a9e73 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-13Implement trunk ports testcasePanagiotis Karalis2-0/+15
The tempest testcases have been integrated from Neutron trunk testcases. It also enables every Neutron extension which may raise side effects [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html JIRA: FUNCTEST-926 Change-Id: I05015acf119f504ce0a5539d677719de874594ad Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-13Fix tempest_customLinda Wang1-1/+1
Change-Id: I684c06eae899d9bc468e0be6a1537f9c942e86ce Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-12Stopping setting identity-feature-enabled if PatroleCédric Ollivier1-1/+0
It avoids differing from all other tempest-based testcases for a useless config option. Change-Id: I02e1786f0ba3c1f7da11f258e80f57ca624247f9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Rewrite refstack testcaseCédric Ollivier3-261/+73
It now leverages on rally to factorize code between all tempest-based testcases. refstack-client is also added as requirement. JIRA: FUNCTEST-942 Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-11Fix many pylint warningsCédric Ollivier1-1/+1
Only pylint warnings in vnf modules has to be fixed now. Change-Id: Ie71230072a51bb72ec0b1d4fef2652494d29948e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-11Refactor configure_tempest_patrole()Cédric Ollivier1-19/+9
Change-Id: I1c34b3bce68a7d57d63fb2e5e4b6aa003dda8f61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Improve tempest files managementCédric Ollivier2-4/+5
Calling apply_tempest_blacklist() is no longer mandatory. Change-Id: Id9a4e970c8acca066a36be89920745127867cd63 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Enhance patrole configurationsCédric Ollivier1-2/+4
It allows listing the OpenStack services tested or setting test exlusions (e.g. tests requiring GRE as overlay). It should be noted that Keystone and Nova can't currently be tested without their default policy.json. Change-Id: I8909694b4ffc315959504441f5ea0b1f3023fe7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-09Add one missing res dir in refstackCédric Ollivier1-9/+9
It completes "Allow overriding tempest output dir" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/53241/ Change-Id: I236a1eb708de324dd42440897e317ce2d0787ffc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Add neutron and glance policy.json for patroleCédric Ollivier1-1/+2
It only runs tests about neutron and glance because their policy.json can be still downloaded. Installers could override them via docker volumes if needed. Several tests about provider networks are currently excluded because GRE is selected. Change-Id: Ic4e2274e3f53e66be0174e117993e8c307b96bf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Allow overriding tempest output dirCédric Ollivier3-43/+53
Change-Id: I31a5d2772bab168b3cb4e6b0713d6e95aa5b6fd7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Add a new env var for nameserverLinda Wang3-3/+6
We should still consider that the nameserver must be handled by all installers instead [1]: - by configuring one or more DNS resolvers in dhcp_agent.ini - by asking a local resolv It eases setting the nameserver in testcases and then allows gating them. 8.8.8.8 is still defined by default. [1] https://docs.openstack.org/neutron/pike/admin/config-dns-res.html Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Id58dd5ebee612a0fce2ebc40f089769e60899416 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Define a new env var for volume device nameCédric Ollivier1-4/+5
It eases modifying the volume device name written in tempest config. Fuel jobs should be adapted to set the right value (vdc) which differs from default (vdb). Change-Id: I09212018f94daa800ede815bd3586cceed0d54e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-05Fix Rally scenario parameters representationJuha Kosonen1-7/+7
Use printable format of string in scenario input parameters. JIRA: FUNCTEST-946 Change-Id: Ic4826506a6f030e749fecdc7f880e9f911f9c987 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-03-05Config volume_device_name as vdc for fuelLinda Wang1-0/+3
JIRA: FUNCTEST-947 Change-Id: I69a83dc69eaa4379c630e201e837f29311c716b9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-04Support domains when creating project/userLinda Wang1-2/+4
JIRA: FUNCTEST-945 Change-Id: Ibfce5a7d2ebb59a83ad5b2b6344c2fc87d7f3e84 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-02Leverage on XtestingCédric Ollivier8-46/+42
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Integrate Patrole as a new testcaseCédric Ollivier2-0/+79
It's published in a new container because the current results don't allow gating. 0.2 is selected to meet OpenStack Pike's requirements. Co-Authored-By: Rémi Le Trocquer <remi.letrocquer@orange.com> Change-Id: Iafcf8f66ee3531fc43136886095774885bfc3150 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-25Fix default identity version in conf_utilsCédric Ollivier1-2/+1
Change-Id: I2e78958b3c96b36a5fac636a1817424fb102afea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-24Automatically download defcore.txtCédric Ollivier5-510/+89
It stops writing files in Functest package dirs and cleans instance variables in refstack modules too. Change-Id: Iaddbe4fbaf12d1af207b86d4e44258efdc6d6f3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Switch from CONST to CONFCédric Ollivier7-142/+159
It also removes constants.CONST and env.Environment which are now useless. Depends-On: I764a0a2a24447c941d1e726f3116593b29dd1c1e Depends-On: I6cfa832466dcefd737314633d807512e46267a69 Change-Id: Ife41c59d9f2e6ec4e49df38af962039f99554bc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Use constants for Functest config fileCédric Ollivier1-6/+5
env_file can't be defined in a config file simply because it's an entry point (Jenkins jobs, end users) Change-Id: Ie23c0ef90efc839d60f0f3a9754c58746b1f3a00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-20Merge "Remove last CONST.__getattribute__()"Cedric Ollivier3-13/+11
2018-02-19Remove last CONST.__getattribute__()Cédric Ollivier3-13/+11
Change-Id: I82f6aa1e723c88eebd4c7410da4b9741a482e9bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Generate tempest verification report (HTML)Juha Kosonen1-2/+12
JIRA: FUNCTEST-934 Change-Id: I2befbd3f2b2311f69b24321c7e9544fb43df3a9d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-19Precise Tempest tests listCédric Ollivier1-3/+3
Else full mode could run tests defined in tempest plugins too [1]. [1] https://docs.openstack.org/tempest/latest/plugin-registry.html Change-Id: I4355b03ba1b9ba47938f748c4f1a8822fd412142 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>