aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack/tempest
AgeCommit message (Collapse)AuthorFilesLines
2018-05-04Functest fail to parse refstack resultsxudan1-3/+6
1. The regular expression can't work well for refstack results 2. Refer to http://testresults.opnfv.org/test/api/v1/results?project=functest&case_name=refstack_defcore&last=1 3. There are 88 success test cases but the list of success is empty 4. Refstack test case name is not always begin with {0}, it maybe any number 5. The test case whose name has the keyword 'fail' will also be list in 'failures' Change-Id: I5187aaaabdca762256be9162cc85ba42263169bc Signed-off-by: xudan <xudan16@huawei.com>
2018-04-30Rewrite TempestResourcesManagerCédric Ollivier2-147/+104
It now leverages on OpenStack Shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky) requires to change only one line. It stops dedicating the network to the user possibly created because the support is incomplete (the users have to be registed in tempest.conf and the multiprocessing has to be enforced). It also writes the second image and the second flavor in tempest.conf. Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Install new neutron-tempest-pluginCédric Ollivier1-1/+1
Change-Id: Id43e7cd5efa4a78397238bf27ef7e6b476704557 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Merge "Fix role processing in Patrole"Cedric Ollivier2-16/+13
2018-04-13Merge "Pass kwargs in TempestCommon:configure()"Cedric Ollivier1-1/+1
2018-04-13Update regex to get verification_idCédric Ollivier1-6/+4
Rally changes the sentence which our testcase was unable to parse. Change-Id: I9bab3109adc37d349c6fbec73cea9052d09cedb1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Switch to stestrCédric Ollivier1-1/+1
It also updates rally and installs rally-openstack. It completes the update to OpenStack Queens. Change-Id: Iabf436ac6e7facfa21a3d7c8a3dfaffa9142da98 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Fix role processing in PatroleCédric Ollivier2-16/+13
Role has to be listed in tempest.conf before calling testr. It also saves the right config file. Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Pass kwargs in TempestCommon:configure()Cédric Ollivier1-1/+1
It's required by Patrole. Change-Id: I07eb6f05b4776c3f9929b6f08c5cbfa131e09d8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-20Update the details of tempest resultsLinda Wang1-4/+6
Change-Id: Idb18c7784e44030a48208ea64c21cde2536a3387 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-18Allow exceptions when deleting a missing verifierCédric Ollivier1-2/+5
Change-Id: I2e48bdcf9bce872a4a7855f9f6cd05d2b4897244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute all rally messagesCédric Ollivier2-39/+36
The are now printed in functest.log only. JIRA: FUNCTEST-950 Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Precise tempest regexCédric Ollivier1-1/+1
It stops running neutron tests which matched the former regex. Change-Id: Ica5a0d1f4858d01533156c98da87f9ed4662489f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Set api_extensions = all for NeutronTrunk onlyCédric Ollivier2-3/+9
Change-Id: I6c019094a9cea86f5990752463a3690d4f00df0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Create 2 images and flavors for tempest testsLinda Wang2-51/+13
Also 1. remove the obsolete function: generate_test_accounts_file 2. Use patch mechanism to get config Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-14Refactor TempestCommon to simplify subclassesCédric Ollivier2-30/+25
Change-Id: I8d265b6939861fd9d02a3d0f31aef53b9bfcb035 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-14Merge "Implement trunk ports testcase"Linda Wang2-0/+15
2018-03-13Leverage on VOLUME_DEVICE_NAME if FuelCédric Ollivier1-6/+1
As Fuel sets VOLUME_DEVICE_NAME [1], the specific conditional instruction can be removed. [1] https://build.opnfv.org/ci/job/functest-fuel-baremetal-daily-master/18/console Change-Id: Iee3fd7c969cf31c8017b73c6ffd646f0e33a9e73 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-13Implement trunk ports testcasePanagiotis Karalis2-0/+15
The tempest testcases have been integrated from Neutron trunk testcases. It also enables every Neutron extension which may raise side effects [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html JIRA: FUNCTEST-926 Change-Id: I05015acf119f504ce0a5539d677719de874594ad Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-13Fix tempest_customLinda Wang1-1/+1
Change-Id: I684c06eae899d9bc468e0be6a1537f9c942e86ce Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-10Improve tempest files managementCédric Ollivier1-1/+4
Calling apply_tempest_blacklist() is no longer mandatory. Change-Id: Id9a4e970c8acca066a36be89920745127867cd63 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Allow overriding tempest output dirCédric Ollivier2-30/+32
Change-Id: I31a5d2772bab168b3cb4e6b0713d6e95aa5b6fd7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Add a new env var for nameserverLinda Wang1-1/+2
We should still consider that the nameserver must be handled by all installers instead [1]: - by configuring one or more DNS resolvers in dhcp_agent.ini - by asking a local resolv It eases setting the nameserver in testcases and then allows gating them. 8.8.8.8 is still defined by default. [1] https://docs.openstack.org/neutron/pike/admin/config-dns-res.html Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Id58dd5ebee612a0fce2ebc40f089769e60899416 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Define a new env var for volume device nameCédric Ollivier1-4/+5
It eases modifying the volume device name written in tempest config. Fuel jobs should be adapted to set the right value (vdc) which differs from default (vdb). Change-Id: I09212018f94daa800ede815bd3586cceed0d54e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-05Config volume_device_name as vdc for fuelLinda Wang1-0/+3
JIRA: FUNCTEST-947 Change-Id: I69a83dc69eaa4379c630e201e837f29311c716b9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-04Support domains when creating project/userLinda Wang1-2/+4
JIRA: FUNCTEST-945 Change-Id: Ibfce5a7d2ebb59a83ad5b2b6344c2fc87d7f3e84 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-02Leverage on XtestingCédric Ollivier1-11/+8
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-25Fix default identity version in conf_utilsCédric Ollivier1-2/+1
Change-Id: I2e78958b3c96b36a5fac636a1817424fb102afea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-24Automatically download defcore.txtCédric Ollivier2-51/+4
It stops writing files in Functest package dirs and cleans instance variables in refstack modules too. Change-Id: Iaddbe4fbaf12d1af207b86d4e44258efdc6d6f3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Switch from CONST to CONFCédric Ollivier2-86/+92
It also removes constants.CONST and env.Environment which are now useless. Depends-On: I764a0a2a24447c941d1e726f3116593b29dd1c1e Depends-On: I6cfa832466dcefd737314633d807512e46267a69 Change-Id: Ife41c59d9f2e6ec4e49df38af962039f99554bc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Generate tempest verification report (HTML)Juha Kosonen1-2/+12
JIRA: FUNCTEST-934 Change-Id: I2befbd3f2b2311f69b24321c7e9544fb43df3a9d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-19Precise Tempest tests listCédric Ollivier1-3/+3
Else full mode could run tests defined in tempest plugins too [1]. [1] https://docs.openstack.org/tempest/latest/plugin-registry.html Change-Id: I4355b03ba1b9ba47938f748c4f1a8822fd412142 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Enhance variable manipulation in tempestJuha Kosonen2-70/+55
Use getattr/setattr to read/write CONST. JIRA: FUNCTEST-932 Change-Id: Ic9a944100c60563b16f5d89b622ef7f04183cceb Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-16Get properly env vars or their default valuesCédric Ollivier2-15/+16
It defines env.get() as an unique way to get Functest env vars or their default values. It can be considered as a wrapper above os.environ. It enforces backward compatibility via CONST which mustn't be used for that purpose. It should be noted that it also stops using CONST for getting OpenStack env vars. Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-14Stop reading NODE_NAME in tempest and refstackCédric Ollivier1-12/+1
NODE_NAME should only be read by TestCase when publishing the results to the database. Other debug data are already printed by run_tests. INSTALLER_TYPE and DEPLOY_SCENARIO are also unused by refstack. Change-Id: Ib82d5c1512553beba2c56f4ec2860cb2593f801e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Remove INSTALLER_IP from FunctestCédric Ollivier1-1/+0
It's mandatory for testcases which are out of Functest. Change-Id: Ia5f5134334ad9f69d44409d817616fa9033fae95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Fix the config of fixed_network_name in tempestLinda Wang2-16/+21
Change-Id: I58726d0fec5b2da4ea8ac1f9925fe56d2f9d7ce0 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-09Fix pylint errors/warnings in tempest modulesJuha Kosonen2-141/+168
JIRA: FUNCTEST-913 Change-Id: I37b25bbcf43fb1d6f7de0c815ad49070d1e1af12 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-08Refactor tempest resource managerJuha Kosonen1-109/+89
Split resource creation into several methods. Implements partly JIRA: FUNCTEST-913 Change-Id: Ic0dd5782c604498066c636deef10b0c18c1cb48d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-02Do not use shell to execute commands in tempestJuha Kosonen1-15/+12
Change-Id: I4d699481fdc63058c12ca9cfe18138e87025e9b3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-31Use snaps_utils to get credentials in tempestJuha Kosonen1-8/+1
Change-Id: I1d240d5edd536d71c87a7dff4e2676715697d0e2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-29Create subnet and net within the same projectLinda Wang1-0/+1
It is required to create a network and subnet within the same project for some SUTs. Change-Id: Icd02edb0aebee93713f315cdbbeb021e9ae82dae Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-16Update set of region identity attributSamuel Bartel1-1/+2
Use OS_REGION_NAME environment variable if defined Change-Id: Ifcdfc468fa4931ab62ac0f3ead103e15af7c0de6 Signed-off-by: Samuel Bartel <samuel.bartel@orange.com>
2018-01-11Fix tempest error on ApexLinda Wang1-2/+3
1. Reconfigure v3_endpoint_type only when it is not None. It is adminURL by default. 2. Ignore the setting of api_v2_admin, as it only applies if api_v2 is set to True. Change-Id: I48b166bdb274467519390af3c1aa5ebf30b38c6d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-09Remove the judgement of OS_ENDPOINT_TYPELinda Wang1-5/+6
Remove the judgement of OS_ENDPOINT_TYPE when configuring [identity-feature-enabled] section in tempest.conf Change-Id: Ia0f6926cdd6e063c953358df5108b537917418bc Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-04Merge "Config physical network when creating tempest net"Cedric Ollivier1-0/+18
2017-12-29Disable keystone v2 if keystone v3 is availableLinda Wang1-4/+2
Change-Id: I9ae18ac6702b6bc1df80e5ff794307929e4aefb9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Config physical network when creating tempest netLinda Wang1-0/+18
When the network_type is vlan, physical_network and segmentation_id could be configured. This also supports to config physical network when creating rally net. Change-Id: I9770968537c1509c5712eada66925a4bf8f6678c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-11Set the ram of flavor 1024Linda Wang1-0/+1
The setting of hw:mem_page_size=large indicates larger page sizes for guest RAM, eg., either 2MB or 1GB on x86. When tested on compass, 1GB is required. Change-Id: Iefd2e8ff30e0a496157e0bd118e63ab3c402abab Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-06Fix the yamllint errors in functest/ciLinda Wang2-24/+20
And also, remove the params "tempest_use_custom_images" and "unique_names" of vping, rally and tempest. Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2 Signed-off-by: Linda Wang <wangwulin@huawei.com>