aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack/snaps
AgeCommit message (Collapse)AuthorFilesLines
2018-07-15Temporarily disable CreateInstanceSingleNetworkTestsCédric Ollivier1-6/+7
It can only work if tests are executed via admin (+default domain) [1]. [1] https://jira.opnfv.org/browse/SNAPS-322 Change-Id: I80dbb46a2197af77fe83ee8768f46bb70b2a810c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-14Temporarily disable HOT including OS::Nova::FloatingIPAssociationCédric Ollivier1-11/+13
Change-Id: I31b76c5b3604845367c10f6e5d55c415042f6d47 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-08Temporarily disable Snaps CreateRouterSuccessTestsCédric Ollivier1-7/+10
The test could be falsy regarding the possible external network configs [1]. This patch will be reverted as soon as the bug is closed [2]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/246/console [2] https://jira.opnfv.org/browse/SNAPS-320 Change-Id: I680656b300f0d669e8d96bec6c94a4a804ebbecb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Implement connection_check via shade tooCédric Ollivier2-44/+5
SNAPS connection_check tests are merged into api_check. It would ease debugging deployment as well [1] [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/127/console Change-Id: I30254a46c3dc6874881d687e36903c6b7878d63d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-19Fix pylint errorsCédric Ollivier2-7/+8
They are highlighted by the last pylint version. Change-Id: I473212a413013492716993fb536903b13bff66ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-12SNAPS via functest with flavor metadata configurablePanagiotis Karalis1-1/+2
The required data for the SNAPS flavors are sent through the config_functest yaml file in order for the SNAPS scenarios to be configured accordingly. If the config_functest yaml file includes empty flavor_extra_specs or there is not included this parameter, the SNAPS scenarios will be executed using the hardcoded value. Change-Id: I4ef46d1fe93497d658414170a72c4520d8f37808 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-15Create 2 images and flavors for tempest testsLinda Wang1-7/+1
Also 1. remove the obsolete function: generate_test_accounts_file 2. Use patch mechanism to get config Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-02Leverage on XtestingCédric Ollivier1-3/+3
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Switch from CONST to CONFCédric Ollivier2-9/+11
It also removes constants.CONST and env.Environment which are now useless. Depends-On: I764a0a2a24447c941d1e726f3116593b29dd1c1e Depends-On: I6cfa832466dcefd737314633d807512e46267a69 Change-Id: Ife41c59d9f2e6ec4e49df38af962039f99554bc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Use constants for Functest config fileCédric Ollivier1-6/+5
env_file can't be defined in a config file simply because it's an entry point (Jenkins jobs, end users) Change-Id: Ie23c0ef90efc839d60f0f3a9754c58746b1f3a00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Remove last CONST.__getattribute__()Cédric Ollivier2-8/+6
Change-Id: I82f6aa1e723c88eebd4c7410da4b9741a482e9bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-16Get properly env vars or their default valuesCédric Ollivier2-3/+5
It defines env.get() as an unique way to get Functest env vars or their default values. It can be considered as a wrapper above os.environ. It enforces backward compatibility via CONST which mustn't be used for that purpose. It should be noted that it also stops using CONST for getting OpenStack env vars. Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-07Revert "Temporary disable one unstable snaps test"Cédric Ollivier1-7/+5
This reverts commit 728e77ab3dbf075a21829a56d83cf34751bcdef6. Change-Id: I6e5d3fa2cdf423b3c4c149108afbd9a18f0fc4b3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-07Temporary disable one unstable snaps testCédric Ollivier1-5/+7
Else all verify jobs are failing [1] [1] https://jira.opnfv.org/browse/SNAPS-263 Change-Id: Ic2dca7f2387af1f98d3720b8db05dc3ccd54098c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Fix docstringsCédric Ollivier1-0/+3
Else sphinx can't parse snaps_suite_builder.py and IxRestUtils.py. Change-Id: Iab231a043120154bce708263474b9f9926c1f715 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Add modules docstrings in snapsLinda Wang6-6/+12
JIRA: FUNCTEST-922 Change-Id: I058486427fe55e1d1ce939fce20d75ff7afde85c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-01Rename a common credential file for OS and K8SLinda Wang1-1/+1
Change-Id: Ib8d24be4b29ab1de00d5dd5e3442146b2437cb94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-30Remove duplicated code related to snaps credsJuha Kosonen2-12/+20
Add support for providing credentials in snaps_utils. JIRA: FUNCTEST-916 Change-Id: I3e027229d213d3791a115920f7012309cc027712 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-28Fix warnings in all snaps-related modulesCédric Ollivier7-6/+35
It also adds vping/__init__.py to stop skipping vping unit tests. It removes the useless import os which is not required for mock (here the mock patch was simply false). It should be noted that the code is partially duplicated between snaps_test_runner.py and vping_base_base.py. A small part of code has been rewritten to fix that without multi inheritance. Change-Id: I2e3e181ad7dab8aa41afb1e63d0b6795ff0d1610 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-03Configure physical_network when creating networkLinda Wang4-8/+18
When the network_type is vlan, configuring physical_network and segmentation_id should be supported by snaps. JIRA: SNAPS-252 Change-Id: I2d3270a82991230385fdc18889ed5c5e979672b5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-06Fix the yamllint errors in functest/ciLinda Wang1-2/+4
And also, remove the params "tempest_use_custom_images" and "unique_names" of vping, rally and tempest. Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-20Support to specify the valid external network nameLinda Wang1-1/+9
In some deployments, the retrieved external network by the def get_external_networks in Snaps checked by "router:external" is not available. So it is necessary to specify the available external network as an env by user. Change-Id: I333e91dd106ed307541a9a197280199fde86bd30 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15Add shebang in snaps_suite_builder.pyCédric Ollivier1-0/+2
Change-Id: I3392068b4a47d35bf0d91fe6d93f2de268f198bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-10Select the subset of snaps test casesLinda Wang4-9/+434
Change-Id: I03e422d5dae0ced9cd7a5477c31359ffc7795c42 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-06Protect vs exceptions when ext_nets is emptyCédric Ollivier1-1/+1
Otherwise several exceptions are raised in TestCase constructors (those defined in heathcheck). Change-Id: I4cb054f7092ea9db02cb8c4469e99848533c556b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-02Enable tempest multinode testsJuha Kosonen1-1/+12
JIRA: FUNCTEST-774 Change-Id: I259a9a37e40dba6a6594941d989e5aa1858e4a04 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-28Obtain scenario by CONST instead of get functionLinda Wang1-2/+1
JIRA: FUNCTEST-763 Change-Id: Ic9fa3243b50a09de8a5e531fed8298997367dd84 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-21Added means to override the RC file credentials.spisarski1-1/+6
This has been done primarily to support tests using SNAPS-OO JIRA: FUNCTEST-847 Change-Id: Icf02c085a95c20d4088e5aafd6380c70689a4ee0 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-07-14Change calls to SNAPS library exposing OpenStack instance objects.spisarski1-1/+1
Openstack object structures can change when new API versions are released and SNAPS no longer is exposing OpenStack object implementations as this makes the library brittle. The only two SNAPS method calls affected are when functest needs to query for external networks and when vPing Userdata needs to obtain the console logs. JIRA: SNAPS-125 Change-Id: If6000e50eaa274713d9a6c964eabd1f73ded684e Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-06-27SNAPS tests now support offline testing.spisarski4-25/+12
Images by type (cirros, centos, ubuntu) can now have the download URL be overridden, told to leverage a local file, or have custom configuration when using the snaps.openstack.tests.openstack_tests.py image settings helper functions. JIRA: FUNCTEST-809 Change-Id: I790094a7a26eb5a55f53d6e875c658dc5e7ac2f9 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-06-20Added unit tests for api_check, health_check, and smoke tests.spisarski3-3/+27
In addition to the creation of the unit tests, this patch simplifies the mocks for connection check as there was an unused annotation. This patch also refactors the building of the test suite from the constructor to the run() method. JIRA: FUNCTEST-813 Change-Id: I7ff5d0389db36141a33ee3a8f76e04b922f8a95f Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-31Added unit tests for the connection_check test case.spisarski2-6/+22
JIRA: FUNCTEST-813 Change-Id: Ib851a3942e181b1a91cad695504613868a340d15 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-30Merge "vping&snaps_xxx support not_hugepage_supported pod"Serena Feng1-1/+1
2017-05-25vping&snaps_xxx support not_hugepage_supported podSerenaFeng1-1/+1
if flavor_metadata is set to {'hw:mem_page_size': 'any'}, it means hugepage must be support by pod. but actually hugepage is not supported by all pods Change-Id: Ib0b716ecedacf7eeba2c0d0080be2707b1a87e73 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-05-23Rename the class TestSuiteRunner to SuiteCédric Ollivier1-1/+1
It conforms with [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/35211/ Change-Id: I11bbdcd63a1691835fb7c6198549edbaf6b758a1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-23Rename pytest_suite_runner.py to unit.pyCédric Ollivier1-2/+2
It also adds the rst files to include this module in apidoc. Change-Id: Iabbb17bc8601265bd9436c75d1afc0b470df1eb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Converted vPing to leverage the object-oriented SNAPS library.spisarski3-12/+9
JIRA: FUNCTEST-577 1. Replaced procedural openstack_utils with the object-oriented SNAPS library 2. Tests now clean themselves up. 3. Improved code documentation. 4. Removed dependency on file-based Cirros image and now leveraging the download URL. 5. Removed hardcoded location to the testcases.yaml file to leverage the value in config_functest.yaml 6. Included optional flavor metadata based on the scenario being tested 7. Included support for multi-part images. 8. Added enhanced support for configurable images. see SNAPS-76 Fixed line length verification problem with the previous submission Fixed retrieval of external network name to be dynamic. Changed external network name retrieval to leverage the newly merged snap_util.get_ext_net_name() function Added the creation and deletion of flavors. SNAPS now has the ability to add/remove security groups from running instances. Changed VMInstance constructor by moving userdata to configuration object. Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-09Bugfix: initialize the logger for snapsLinda Wang1-0/+3
Testcases about snaps failed due to the absence of attribute 'logger'. Change-Id: I78c85e51f63afa767fa73aa12faea066ad432371 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-30Fix pylint warnings in snapsCédric Ollivier3-9/+9
Pylint only warns about missing module docstrings now. Change-Id: I989ff800cd2628fed80a2d3510ef37ce2876cbd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-13Updated method calls to SNAPS tests.spisarski6-28/+28
Due to the refactoring performed in gerrit patch 31435, the calls to the SNAPS tests needed to be updated. JIRA: SNAPS-23 Change-Id: I9069ea61b1d15b52a081501b03ae8bf73da10f29 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier5-10/+18
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-06Bugfix: Add case_name as constructor arg for snaps_smokeLinda Wang1-3/+2
JIRA: FUNCTEST-791 When running snaps_smoke, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I4a59828ba735ba14a286d000d1d061be14878d1c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-05Bugfix: Add case_name as constructor arg for snaps and rallyLinda Wang4-11/+8
When running healthcheck tier and rally, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I078094921f08b457b88beabee60eabf40b657411 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-24Printing the flavor_metadata for SnapsTestRunnerrandyl1-1/+4
Need to print what is being tested to debug and verify results. JIRA : FUNCTEST-768 This is needed by the Apex team for the danube release. Change-Id: Ie7400af14f7e54d1deb5b2b5d2fc91eb5b14ca91 Signed-off-by: randyl <r.levensalor@cablelabs.com>
2017-03-14[snaps] Pass flavor metadata to smoke testsMichael Polenchuk1-0/+1
Change-Id: I774d3625d35e3d264d609ba9aa7538a723923bcf Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-03-08Aarch64 adaption in functest for snaps smokeCristina Pauna1-0/+7
This commit sends the aarch64 custom config to the snaps integration tests. Since these are the same as the snaps healthcheck, no additional values were added to config_aarch64_patch.yaml Change-Id: I5f2302a3c65d47ec8fca661888268489e2c6ba35 Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-08Added support for scenario-based flavor creation.spisarski5-22/+49
As certain scenarios such as, DPDK, FDIO, and OVS use cases require special 'hw:' settings to flavors, SNAPS-OO has just implemented the ability to take in these configuration values to apply to its integration tests. This change checks the scenario and should be configuring the flavor metadata accordingly. Also see SNAPS-38 Used this as an opportunity to refactor the SNAPS test classes as well... JIRA: FUNCTEST-746 Change-Id: I63535776acde088a7461f602966a324b6207592d Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-03-06Aarch64 adaption in functest for snaps healthcheckCristina Pauna1-1/+6
This commit is half of the fix for adapting the snaps healthcheck to run on an aarch64 POD. The fix consists in reading the custom parameters and passing them to the snaps test The snaps part that uses this info is https://gerrit.opnfv.org/gerrit/29853 JIRA: ARMBAND-222 Change-Id: I2027f2ef3afe0caddef781771f2190fc173aff8c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-02-07Integrating PyTest contained in SNAPS as a replacement to the oldspisarski1-0/+34
bash healthcheck. JIRA: FUNCTEST-570 Change-Id: Ia90dc152d48144c9c53967d5c30256389793ce91 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2016-12-23refactor snaps and example using new constants providerSerenaFeng4-28/+35
JIRA: FUNCTEST-673 Change-Id: If20be3c614f729c17bf6484676de7889747a98c0 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>