aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack/rally
AgeCommit message (Collapse)AuthorFilesLines
2018-02-27Clean all OpenStack related modulesCédric Ollivier34-4028/+0
Xtesting is only focused on the framework and entry points. Change-Id: I1a4146ed8519438b13810a20ddf1140c35bb6ecd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Switch from CONST to CONFCédric Ollivier1-20/+22
It also removes constants.CONST and env.Environment which are now useless. Depends-On: I764a0a2a24447c941d1e726f3116593b29dd1c1e Depends-On: I6cfa832466dcefd737314633d807512e46267a69 Change-Id: Ife41c59d9f2e6ec4e49df38af962039f99554bc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-16Get properly env vars or their default valuesCédric Ollivier1-2/+3
It defines env.get() as an unique way to get Functest env vars or their default values. It can be considered as a wrapper above os.environ. It enforces backward compatibility via CONST which mustn't be used for that purpose. It should be noted that it also stops using CONST for getting OpenStack env vars. Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-14Merge "Only filter boot_server_from_volume_and_delete via scenario"Juha Kosonen1-1/+1
2018-02-13Only filter boot_server_from_volume_and_delete via scenarioCédric Ollivier1-1/+1
It can be safely merged as only joid supports '^os-nosdn-lxd-(no)?ha$' scenarios. It aims at testing all installers in the same way which would have made much sense if another installer supported this scenarios. Change-Id: I145102df3f6394b6fff28590923100e0f1e6cb66 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Enhance variable manipulation in rallyJuha Kosonen1-36/+22
- utilize env vars directly via os module - use getattr to read CONST JIRA: FUNCTEST-931 Change-Id: I893a91331e26846f8effe2d3d58522950bd096fd Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-06Fix rally cinder volume attach scenariosJuha Kosonen1-0/+6
Add network id to following scenarios: CinderVolumes.create_snapshot_and_attach_volume CinderVolumes.create_nested_snapshots_and_attach_volume JIRA: FUNCTEST-929 Change-Id: If95babebf9ea6205684494395bdfd72d5203f4bf Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-05Blacklist Quotas.nova_update_and_delete testJuha Kosonen1-0/+10
Excluded since the test occasionally fails due to race condition issue on quota manipulation in nova [1]. [1] https://bugs.launchpad.net/nova/+bug/1552622 Change-Id: Ib979c1e371727aa3adea9dc0b5955e7ed24881cf Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-30Fix pylint errors/warnings in rallyJuha Kosonen1-7/+14
JIRA: FUNCTEST-906 Change-Id: I484f9a291d5adbedb855450e4ff067dfa4a3b2ae Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-30Remove duplicated code related to snaps credsJuha Kosonen1-14/+1
Add support for providing credentials in snaps_utils. JIRA: FUNCTEST-916 Change-Id: I3e027229d213d3791a115920f7012309cc027712 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-26Refactor rally report generationJuha Kosonen1-111/+64
- statistic data based on Rally results report - fix statistics calculations - use PrettyTable in generating the report Change-Id: Ic84adc5e30d446aea1f3045ba997c3ddf895e9f5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-16Fix Rally output retrievalJuha Kosonen1-4/+2
Read stdout until nothing left instead of stopping once the child process is terminated. Change-Id: I46a2eb93fd614e2e7ff676727eb9dc132c29d03f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-12-27Config physical network when creating tempest netLinda Wang1-0/+18
When the network_type is vlan, physical_network and segmentation_id could be configured. This also supports to config physical network when creating rally net. Change-Id: I9770968537c1509c5712eada66925a4bf8f6678c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-21Update cirros image to 0.4.0Michael Polenchuk2-2/+2
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-19Blacklist rally ceilometer scenariosJuha Kosonen1-0/+10
Exclude ceilometer test cases since Rally is still utilizing the API which was deprecated in Pike. Change-Id: I33be7358c14988f94d38d4b9d42995bd5f022617 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-12-11Set the ram of flavor 1024Linda Wang1-3/+7
The setting of hw:mem_page_size=large indicates larger page sizes for guest RAM, eg., either 2MB or 1GB on x86. When tested on compass, 1GB is required. Change-Id: Iefd2e8ff30e0a496157e0bd118e63ab3c402abab Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-07Merge "Fix the yamllint errors in functest/ci"Cedric Ollivier1-3/+1
2017-12-06Assign heat_stack_owner role to the new userLinda Wang2-0/+34
For heat scenario in rally, assign heat_stack_owner role to the new created users. Change-Id: I86a74ca88993ed3782d21b22eb5933d639d86c94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-06Fix the yamllint errors in functest/ciLinda Wang1-3/+1
And also, remove the params "tempest_use_custom_images" and "unique_names" of vping, rally and tempest. Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-22Merge "Removal of deprecated SNAPS-OO classes."Cedric Ollivier1-10/+12
2017-11-21Removal of deprecated SNAPS-OO classes.spisarski1-10/+12
JIRA: SNAPS-202 Change-Id: I115b4927b287a5525f4c1b95128d91f5229c7856 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-11-21Fix "Broken pipe" IOErrors of rally runJuha Kosonen1-23/+21
Replace obsolete os.popen with subprocess module usage in command output retrieval. Do not use shell as the program to execute. Change-Id: Ic63bb0f393750c3b85a35a37fecd46c1c1b96602 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-13Move rally and tempest out of functest-coreLinda Wang1-0/+2
JIRA: FUNCTEST-889 Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-05Merge "Add new cinder scenarios for rally sanity/full"Cedric Ollivier2-0/+157
2017-11-04Fix rally cinder scenariosJuha Kosonen1-10/+2
Remove network and servers context and set image and flavor as a scenario parameters. Change-Id: I5181ccce61c4f58af3737619d1b7d259cf539937 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-03Add new cinder scenarios for rally sanity/fullJuha Kosonen2-0/+157
Included several CinderQos and CinderVolumeTypes scenarios introduced by the recent Rally version. Change-Id: Ibd2affa2e0d24ec79d3b4518456ca0f0457ace9f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-02Add new neutron scenarios for rally sanity/fullJuha Kosonen2-0/+168
Included several new NeutronNetworks and NeutronSecurityGroup scenarios introduced by the recent Rally version. Change-Id: I87ad0947ab6b4e1faf8fcad9006dbe34251c313b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Add new nova scenarios for rally sanity/fullJuha Kosonen2-0/+123
Several new NovaServers and NovaServerGroups scenarios available along with the recent Rally update. Change-Id: Iee27174923da5a1a25991d8ab5e18f1d404b09ef Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Merge "Add new glance scenarios for rally 0.10"Linda Wang2-1/+92
2017-10-31Add new glance scenarios for rally 0.10Linda Wang2-1/+92
Some new glance scenarios have been added in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I91ffe31b8cc5c94991c9bdd6e33b756c447d82ce Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-31Remove some obsolete scenarios for rally 0.10Linda Wang2-72/+0
Nova-Network are not alive any more and have been removed in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 JIRA: FUNCTEST-883 Change-Id: I45a20504589003a39ff27770709de6881e69aee3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-17Update blacklist about migration tests for rallyLinda Wang2-5/+6
The test NovaServers.boot_and_migrate_server needs at least 2 compute nodes: https://github.com/openstack/rally/blob/stable/0.9/rally/plugins/openstack/scenarios/nova/servers.py#L763-L765 Change-Id: I4ddf99188094ced57225d886037b00e91f3b68e6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-05Live migration support determination in rallyJuha Kosonen1-20/+11
Live migration test cases were excluded if tempest was not executed before rally since tempest config file is created during the execution of tempest. Remove the dependency to config file and define the support based on the number of computes as done in tempest. Change-Id: I57c18b7c57e6a4bc8bfbdfb4beb5f8d67c6269c4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-20Dedicated flavors for rally testsJuha Kosonen2-3/+31
Create flavors and use them in rally scenarios instead of expecting certain flavors to pre-exist. Change-Id: I77c94ab80fcabd7b80ffb36f9856a48121858009 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-18Fix image name in rally scenariosJuha Kosonen1-6/+6
Change-Id: I0a78a16d44c1e0e0b2edec2e43954c1f08e8bb09 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-15Refactor resource creation and cleanup in rallyJuha Kosonen1-33/+79
Use SNAPS to create and delete resources. Change-Id: Ic4d390382acea2be196e8a7518cb8cce25276a45 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-11Remove volume type handlingJuha Kosonen2-42/+0
Rally scenarios don't require volume type to exist as a precondition. Change-Id: Id735346e062af084635fd8f76f3686005b9b8add Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-11Allow live migration related tests to runLinda Wang1-1/+1
For tempest or rally, if there are more than 1 compute node, live migration related tests should not be skipped or blacklisted if shared storage is enabled via ceph. Change-Id: Ic93e4f508b597c657abe8d246f0cf9c2b5dfd020 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-06Merge "Add UEFI support in functest"Morgan Richomme1-1/+6
2017-09-04Blacklist CeilometerTraits testsJuha Kosonen1-0/+1
Requires a deprecated Ceilometer API which was removed in ocata. Panko provides the API but is not yet supported by OPNFV installers. Change-Id: I85ab97099b8adfa1d15fe4195bc5703f2f4e83b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-01Add UEFI support in functestCatalina Focsa1-1/+6
Add extra properties to the cirros image for ARM architecture. In the glanceclient repository, the create method expects **kwargs as parameters, thus an extra_properties variable containing a dictionary of property-value pairs can be added (if given) to the image to be created. If the properties do not appear, the call should not affect the image properties because the dictionary is initialized as empty. Change-Id: I690da90e6c6f250bd0a3d99cce39aa250e19b9c2 Signed-off-by: Catalina Focsa <catalina.focsa@enea.com>
2017-08-31Blacklist CeilometerEvents testsJuha Kosonen1-0/+10
Ceilometer Events API is deprecated and removed in ocata. Panko provides the API but is not yet supported by OPNFV installers. Change-Id: I4bf29ca9371fa87a43df3ce32ac206a5e9363468 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-24Add Rally scenarios for telemetryMartin Kulhavy5-2/+743
Ceilometer scenarios were added. Reasons for testcase blacklisting: - Deprecated ceilometer client used by Rally. This depends on the confuguration of the system, currently it seems to affect all installers. - A bug in ceilometer client (already fixed and merged in OpenStack repository). JIRA: FUNCTEST-849 Change-Id: I0bd7e1e9817538165b7b9705bcec213d7d275359 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-07-11Add decorators in testcases for energy recording.Benoit HERARD1-70/+98
Test cases are: - rally (sanity and full) - refstack - cloudify_ims - vping_ssh It also fix a bug on "energy_recording" decorator of energy module. Change-Id: I625c214552ad1b89eaf7e196e706d7c69b37da33 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-07-10Allow regex for blacklist scenarios/installersMartin Kulhavy2-11/+36
Reasoning: Some blacklisted test cases apply to a range of scenarios, e.g. both 'ha' and 'noha' and possibly even to all scenarios for a specific installer -- therefore the list of excluded scenarios can get long and unclear. For consistency with rally test case scenarios also allow regex for installers specification. Additionally, log the excluded test cases (if any) to debug log. Change-Id: Ie0bec35d1a6443203d4719ea5428c437c12e5e12 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-06-30Define download_images.sh and check_os.sh as scriptsCédric Ollivier1-0/+0
It also updates all python scripts which call check_os.sh. The former healthcheck.sh is removed. No shell script must be executable in git. Change-Id: If4e8deb50ebd635a9091e3bb79ef61c07b9660dc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-27Remove Rally requests scenarioJuha Kosonen3-19/+1
HttpRequests scenario is not directly related to OpenStack and not supported by Rally in https environment. Change-Id: I2e91d129d82dfaba62eca25e3e4890ff54f52ac6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-06-20Remove all references to /home/opnfv/repos/functestCédric Ollivier1-6/+9
It also removes relative (and incomplete) references which could be defined in modules instead of this global configuration. Change-Id: Ie20dc3547e49b6224aa8100cd380d37b87ece5a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-30Merge "Define create_snapshot() and clean() in TestCase"Cedric Ollivier1-1/+1
2017-05-30Define create_snapshot() and clean() in TestCaseCédric Ollivier1-1/+1
They replace the former calls in run_tests which are not suitable for all test cases. Now any test case can define how to clean its resources. If the snapshot cannot be created, the test case is considered as failed. Only a message is printed if any failure during cleaning. It also defines a new class called OSGCTestCase useful for test cases which don't clean their OpenStack resources. All test cases located in opnfv_tests/openstack inherit from it to keep the global behavior unchanged. It also deletes exit instructions in openstack_clean and openstack_snapshot, removes clean flags in testcases.yaml and updates the related utils. All Docs are modified as well. JIRA: FUNCTEST-438 Change-Id: I8938e6255708012380389763a24059ace4ce45d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>