Age | Commit message (Collapse) | Author | Files | Lines |
|
1. The regular expression can't work well for refstack results
2. Refer to http://testresults.opnfv.org/test/api/v1/results?project=functest&case_name=refstack_defcore&last=1
3. There are 88 success test cases but the list of success is empty
4. Refstack test case name is not always begin with {0}, it maybe any number
5. The test case whose name has the keyword 'fail' will also be list in 'failures'
Change-Id: I5187aaaabdca762256be9162cc85ba42263169bc
Signed-off-by: xudan <xudan16@huawei.com>
|
|
It now leverages on OpenStack Shade to allow gating OpenStack master
as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky)
requires to change only one line.
It stops dedicating the network to the user possibly created because
the support is incomplete (the users have to be registed in
tempest.conf and the multiprocessing has to be enforced).
It also writes the second image and the second flavor in tempest.conf.
Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Id43e7cd5efa4a78397238bf27ef7e6b476704557
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
Rally changes the sentence which our testcase was unable to parse.
Change-Id: I9bab3109adc37d349c6fbec73cea9052d09cedb1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also updates rally and installs rally-openstack.
It completes the update to OpenStack Queens.
Change-Id: Iabf436ac6e7facfa21a3d7c8a3dfaffa9142da98
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Role has to be listed in tempest.conf before calling testr.
It also saves the right config file.
Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's required by Patrole.
Change-Id: I07eb6f05b4776c3f9929b6f08c5cbfa131e09d8e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Idb18c7784e44030a48208ea64c21cde2536a3387
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Change-Id: I2e48bdcf9bce872a4a7855f9f6cd05d2b4897244
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The are now printed in functest.log only.
JIRA: FUNCTEST-950
Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It stops running neutron tests which matched the former regex.
Change-Id: Ica5a0d1f4858d01533156c98da87f9ed4662489f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I6c019094a9cea86f5990752463a3690d4f00df0c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Also
1. remove the obsolete function: generate_test_accounts_file
2. Use patch mechanism to get config
Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Change-Id: I8d265b6939861fd9d02a3d0f31aef53b9bfcb035
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
As Fuel sets VOLUME_DEVICE_NAME [1], the specific conditional
instruction can be removed.
[1] https://build.opnfv.org/ci/job/functest-fuel-baremetal-daily-master/18/console
Change-Id: Iee3fd7c969cf31c8017b73c6ffd646f0e33a9e73
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The tempest testcases have been integrated from Neutron trunk
testcases. It also enables every Neutron extension which may raise
side effects [1].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
JIRA: FUNCTEST-926
Change-Id: I05015acf119f504ce0a5539d677719de874594ad
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
|
|
Change-Id: I684c06eae899d9bc468e0be6a1537f9c942e86ce
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Calling apply_tempest_blacklist() is no longer mandatory.
Change-Id: Id9a4e970c8acca066a36be89920745127867cd63
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I31a5d2772bab168b3cb4e6b0713d6e95aa5b6fd7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
We should still consider that the nameserver must be handled by all
installers instead [1]:
- by configuring one or more DNS resolvers in dhcp_agent.ini
- by asking a local resolv
It eases setting the nameserver in testcases and then allows gating
them. 8.8.8.8 is still defined by default.
[1] https://docs.openstack.org/neutron/pike/admin/config-dns-res.html
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Id58dd5ebee612a0fce2ebc40f089769e60899416
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It eases modifying the volume device name written in tempest config.
Fuel jobs should be adapted to set the right value (vdc) which
differs from default (vdb).
Change-Id: I09212018f94daa800ede815bd3586cceed0d54e7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-947
Change-Id: I69a83dc69eaa4379c630e201e837f29311c716b9
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
JIRA: FUNCTEST-945
Change-Id: Ibfce5a7d2ebb59a83ad5b2b6344c2fc87d7f3e84
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It removes all the files which have moved to Xtesting.
Vnf inheritances and env management will be improved in other
changes.
It keeps the same tree thanks to a symlink to allow publishing
artifacts.
Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I2e78958b3c96b36a5fac636a1817424fb102afea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It stops writing files in Functest package dirs and cleans instance
variables in refstack modules too.
Change-Id: Iaddbe4fbaf12d1af207b86d4e44258efdc6d6f3a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also removes constants.CONST and env.Environment which are now
useless.
Depends-On: I764a0a2a24447c941d1e726f3116593b29dd1c1e
Depends-On: I6cfa832466dcefd737314633d807512e46267a69
Change-Id: Ife41c59d9f2e6ec4e49df38af962039f99554bc5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-934
Change-Id: I2befbd3f2b2311f69b24321c7e9544fb43df3a9d
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Else full mode could run tests defined in tempest plugins too [1].
[1] https://docs.openstack.org/tempest/latest/plugin-registry.html
Change-Id: I4355b03ba1b9ba47938f748c4f1a8822fd412142
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Use getattr/setattr to read/write CONST.
JIRA: FUNCTEST-932
Change-Id: Ic9a944100c60563b16f5d89b622ef7f04183cceb
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It defines env.get() as an unique way to get Functest env vars or
their default values. It can be considered as a wrapper above os.environ.
It enforces backward compatibility via CONST which mustn't be used
for that purpose. It should be noted that it also stops using CONST
for getting OpenStack env vars.
Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
NODE_NAME should only be read by TestCase when publishing the results
to the database. Other debug data are already printed by run_tests.
INSTALLER_TYPE and DEPLOY_SCENARIO are also unused by refstack.
Change-Id: Ib82d5c1512553beba2c56f4ec2860cb2593f801e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's mandatory for testcases which are out of Functest.
Change-Id: Ia5f5134334ad9f69d44409d817616fa9033fae95
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I58726d0fec5b2da4ea8ac1f9925fe56d2f9d7ce0
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
JIRA: FUNCTEST-913
Change-Id: I37b25bbcf43fb1d6f7de0c815ad49070d1e1af12
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Split resource creation into several methods.
Implements partly JIRA: FUNCTEST-913
Change-Id: Ic0dd5782c604498066c636deef10b0c18c1cb48d
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Change-Id: I4d699481fdc63058c12ca9cfe18138e87025e9b3
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Change-Id: I1d240d5edd536d71c87a7dff4e2676715697d0e2
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It is required to create a network and subnet within the same project
for some SUTs.
Change-Id: Icd02edb0aebee93713f315cdbbeb021e9ae82dae
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Use OS_REGION_NAME environment variable if defined
Change-Id: Ifcdfc468fa4931ab62ac0f3ead103e15af7c0de6
Signed-off-by: Samuel Bartel <samuel.bartel@orange.com>
|
|
1. Reconfigure v3_endpoint_type only when it is not None. It is
adminURL by default.
2. Ignore the setting of api_v2_admin, as it only applies if api_v2
is set to True.
Change-Id: I48b166bdb274467519390af3c1aa5ebf30b38c6d
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Remove the judgement of OS_ENDPOINT_TYPE when configuring
[identity-feature-enabled] section in tempest.conf
Change-Id: Ia0f6926cdd6e063c953358df5108b537917418bc
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
Change-Id: I9ae18ac6702b6bc1df80e5ff794307929e4aefb9
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
When the network_type is vlan, physical_network and
segmentation_id could be configured.
This also supports to config physical network when creating
rally net.
Change-Id: I9770968537c1509c5712eada66925a4bf8f6678c
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
The setting of hw:mem_page_size=large indicates larger page sizes
for guest RAM, eg., either 2MB or 1GB on x86.
When tested on compass, 1GB is required.
Change-Id: Iefd2e8ff30e0a496157e0bd118e63ab3c402abab
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
And also, remove the params "tempest_use_custom_images" and
"unique_names" of vping, rally and tempest.
Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|