aboutsummaryrefslogtreecommitdiffstats
path: root/functest/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-04-29Rewrite vping_ssh and vping_userdataCédric Ollivier1-179/+0
They now leverage on shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (openstacksdk) requires to change only one line. It deletes the related unit tests as they have to be fully rewritten. They will be added in another change. Change-Id: I0c60681d6e1c0944960770429ef972947dd85321 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Switch from deploy utils to the right objectsCédric Ollivier1-17/+21
It also prints the full exceptions and removes useless casts. Change-Id: I19ff1ae90670833f998c0d17592da82207235229 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Merge "Fix role processing in Patrole"Cedric Ollivier2-25/+17
2018-04-13Switch to stestrCédric Ollivier1-1/+1
It also updates rally and installs rally-openstack. It completes the update to OpenStack Queens. Change-Id: Iabf436ac6e7facfa21a3d7c8a3dfaffa9142da98 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Fix role processing in PatroleCédric Ollivier2-25/+17
Role has to be listed in tempest.conf before calling testr. It also saves the right config file. Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-11Leverage on SDN_CONTROLLER_IP if fuelCédric Ollivier1-1/+6
It conforms with [1]. [1] https://jira.opnfv.org/browse/FUEL-352 Change-Id: Idae142de8de09203509c73c35c2e7fea5a5d880b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-09[fuel] Unite OpenDaylight portsMichael Polenchuk1-1/+1
ODL Oxygen has only 1 connector by default, so unite web and rest ports together. Change-Id: Idd5bdd5da3dcc85fa25b82ab2d19107b2d005974 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2018-03-19Update xtesting to 0.31Cédric Ollivier1-0/+1
It mainly fixes regex when INSTALLER_TYPE is unset [1] [1] https://gerrit.opnfv.org/gerrit/#/c/54089/ Change-Id: I57430e87ec7b988337697417e319cf4f9b207e0d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute all rally messagesCédric Ollivier2-41/+23
The are now printed in functest.log only. JIRA: FUNCTEST-950 Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Precise tempest regexCédric Ollivier1-1/+1
It stops running neutron tests which matched the former regex. Change-Id: Ica5a0d1f4858d01533156c98da87f9ed4662489f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Create 2 images and flavors for tempest testsLinda Wang1-15/+0
Also 1. remove the obsolete function: generate_test_accounts_file 2. Use patch mechanism to get config Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-14Merge "Refactor TempestCommon to simplify subclasses"valentin boucher2-15/+5
2018-03-14Refactor TempestCommon to simplify subclassesCédric Ollivier2-15/+5
Change-Id: I8d265b6939861fd9d02a3d0f31aef53b9bfcb035 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-14Get odl ip from env on CompassLinda Wang1-1/+2
Change-Id: I9ed2cdeef461c27381ecdfd56e5347ded61b5cb8 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-13Implement trunk ports testcasePanagiotis Karalis1-1/+5
The tempest testcases have been integrated from Neutron trunk testcases. It also enables every Neutron extension which may raise side effects [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html JIRA: FUNCTEST-926 Change-Id: I05015acf119f504ce0a5539d677719de874594ad Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-12Remove orchestra testcasesCédric Ollivier2-242/+0
They are incompatible with Pike and they have to be removed without any deep update. The testcases will be re-renabled if updated before 03/16/18. Change-Id: Ibf656db6ba4177eae44feb41cd5d314b7408d4de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Rewrite refstack testcaseCédric Ollivier2-148/+0
It now leverages on rally to factorize code between all tempest-based testcases. refstack-client is also added as requirement. JIRA: FUNCTEST-942 Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-11Fix many pylint warningsCédric Ollivier1-8/+10
Only pylint warnings in vnf modules has to be fixed now. Change-Id: Ie71230072a51bb72ec0b1d4fef2652494d29948e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Improve tempest files managementCédric Ollivier1-3/+17
Calling apply_tempest_blacklist() is no longer mandatory. Change-Id: Id9a4e970c8acca066a36be89920745127867cd63 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Allow overriding tempest output dirCédric Ollivier2-8/+10
Change-Id: I31a5d2772bab168b3cb4e6b0713d6e95aa5b6fd7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Add a new env var for nameserverLinda Wang1-4/+7
We should still consider that the nameserver must be handled by all installers instead [1]: - by configuring one or more DNS resolvers in dhcp_agent.ini - by asking a local resolv It eases setting the nameserver in testcases and then allows gating them. 8.8.8.8 is still defined by default. [1] https://docs.openstack.org/neutron/pike/admin/config-dns-res.html Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Id58dd5ebee612a0fce2ebc40f089769e60899416 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-02Leverage on XtestingCédric Ollivier20-1745/+55
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-28Merge "Support different user/project domain values"valentin boucher1-2/+12
2018-02-26Remove obsolete Functest utilsCédric Ollivier1-85/+2
Only 3 functions are kept as part of our framework: - execute_command_raise() - execute_command() - get_parameter_from_yaml() Change-Id: I966a1d6122391dae85aa3c77813ad2f1698ceb45 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-26Raise exceptions when SDN_CONTROLLER_IP is NoneCédric Ollivier1-4/+13
Change-Id: Ia0d00a6b3c4c4936dc10602e838f507beea0c592 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-26Stop raising keystoneauth1 exceptions in odl unit testsCédric Ollivier1-2/+1
It simply raises Exceptions to avoid depending on keystoneauth1. Snaps may also reraise another exception. Change-Id: Ib3041b2d8ff51ee098f2bf0b9918079b7945abf3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-26Remove openstack utilsCédric Ollivier1-1784/+0
They have been obsolete since we fully switched to snaps. The files are being moved to SDNVPN which is the last project using them [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/52631/ Change-Id: I277b92a04cf6bc7b30015eed76f03f17830fad2b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-24Print env vars and env_fileCédric Ollivier1-2/+1
It simply eases detecting wrong inputs [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/796/console Change-Id: I0784c29265c69a6ba4a049226196bcdd70b0a572 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-24Automatically download defcore.txtCédric Ollivier3-66/+22
It stops writing files in Functest package dirs and cleans instance variables in refstack modules too. Change-Id: Iaddbe4fbaf12d1af207b86d4e44258efdc6d6f3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-24Update Functest to meet last snaps updatesCédric Ollivier1-4/+0
It removes obsolete mockey patches in Rally unit tests and adds keystone client as params when needed in orchestra_*ims.py [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/52473/ Change-Id: Id02954d16f5f54cc0c390fadb498e14c6bab6ff9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Switch from CONST to CONFCédric Ollivier2-55/+16
It also removes constants.CONST and env.Environment which are now useless. Depends-On: I764a0a2a24447c941d1e726f3116593b29dd1c1e Depends-On: I6cfa832466dcefd737314633d807512e46267a69 Change-Id: Ife41c59d9f2e6ec4e49df38af962039f99554bc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Support different user/project domain valuesValentin Boucher1-2/+12
For the moment, VNF works well only if OS_PROJECT_DOMAIN_NAME=Default OS_USER_DOMAIN_NAME=Default It's now possible to use domain != Default JIRA: FUNCTEST-935 Change-Id: I779a93538662ff32906d91d7cf3b2c5c3e872765 Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-02-22Use constants for Functest config fileCédric Ollivier1-4/+5
env_file can't be defined in a config file simply because it's an entry point (Jenkins jobs, end users) Change-Id: Ie23c0ef90efc839d60f0f3a9754c58746b1f3a00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-20Merge "Remove deprecated monkey patches"Cedric Ollivier1-18/+1
2018-02-19Remove deprecated monkey patchesCédric Ollivier1-18/+1
OpenStack utils are being removed. Change-Id: I2a41297034654f678afa5a7a818961a4cd0cee73 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Generate tempest verification report (HTML)Juha Kosonen1-4/+19
JIRA: FUNCTEST-934 Change-Id: I2befbd3f2b2311f69b24321c7e9544fb43df3a9d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-19Precise Tempest tests listCédric Ollivier1-2/+2
Else full mode could run tests defined in tempest plugins too [1]. [1] https://docs.openstack.org/tempest/latest/plugin-registry.html Change-Id: I4355b03ba1b9ba47938f748c4f1a8822fd412142 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Enhance variable manipulation in tempestJuha Kosonen1-12/+13
Use getattr/setattr to read/write CONST. JIRA: FUNCTEST-932 Change-Id: Ic9a944100c60563b16f5d89b622ef7f04183cceb Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-16Mock additional methods related to OpenStackFlavorCédric Ollivier3-0/+10
keystone_utils.keystone_client() and keystone_utils.get_project() have to be mocked when unit testing flavor creation since [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/52157/ Change-Id: I898cde1001c14d0b450c3dd43ade7dca47b1ffb3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-16Get properly env vars or their default valuesCédric Ollivier3-6/+102
It defines env.get() as an unique way to get Functest env vars or their default values. It can be considered as a wrapper above os.environ. It enforces backward compatibility via CONST which mustn't be used for that purpose. It should be noted that it also stops using CONST for getting OpenStack env vars. Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-15Stop reading SDN_CONTROLLER env var.Cédric Ollivier1-10/+0
Joid doesn't support ODL and this exception is no longer needed. It will be a simple switch from SDN_CONTROLLER to SDN_CONTROLLER_IP if Joid supports ODL again. Change-Id: I925965f9c1adf24914e4110ff3206443f4063ac8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Merge "Remove INSTALLER_IP from Functest"Cedric Ollivier2-7/+0
2018-02-13Merge "Enhance variable manipulation in rally"Cedric Ollivier1-9/+8
2018-02-13Remove INSTALLER_IP from FunctestCédric Ollivier2-7/+0
It's mandatory for testcases which are out of Functest. Change-Id: Ia5f5134334ad9f69d44409d817616fa9033fae95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Enhance variable manipulation in rallyJuha Kosonen1-9/+8
- utilize env vars directly via os module - use getattr to read CONST JIRA: FUNCTEST-931 Change-Id: I893a91331e26846f8effe2d3d58522950bd096fd Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-13Merge "Export env vars instead of CONST in refstack"Cedric Ollivier1-4/+4
2018-02-13Merge "Improve the way of getting env values"Cedric Ollivier2-0/+3
2018-02-13Merge "Fix the config of fixed_network_name in tempest"Cedric Ollivier1-2/+3
2018-02-13Improve the way of getting env valuesCédric Ollivier2-0/+3
It simply reads env vars instead of calling CONST.__getattribute__() Change-Id: If3137f3cfb9f3102388988a82393b9b2f4e99f60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Simplify functest/cli/commands/cli_env.pyCédric Ollivier1-6/+0
CONST shouldn't be used for getting/setting env vars. It adds complexity and may raise side effects. It also removes the obsolete env var CI_DEBUG. Change-Id: I8a8fde0fa781351d5eabd2698ca8aae9dee76fb8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>