aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests
AgeCommit message (Collapse)AuthorFilesLines
2018-01-29Merge "Fix last Pylint error in Functest"Cedric Ollivier9-55/+75
2018-01-26Fix last Pylint error in FunctestCédric Ollivier9-55/+75
It also fixes all pylint warnings in router and the related unit tests. tox.ini is updated to ensure that no error is introduced. Change-Id: Iddd74b0dac7b6581d72b04369140006c9e19f998 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Refactor rally report generationJuha Kosonen1-111/+64
- statistic data based on Rally results report - fix statistics calculations - use PrettyTable in generating the report Change-Id: Ic84adc5e30d446aea1f3045ba997c3ddf895e9f5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-20Configure password for the user in vnfLinda Wang3-9/+9
For some SUTs, the password for creating user is not allowed to be the same as user name, and some even is required to contain at least 8 characters and three types of characters for security. It also turns yamllint warnings into errors and fixes the remaining warnings. Change-Id: Icf25a7b9ff1c8cee55899198f1e519c9209877ff Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-17Merge "Fix Rally output retrieval"Linda Wang1-4/+2
2018-01-16Fix Rally output retrievalJuha Kosonen1-4/+2
Read stdout until nothing left instead of stopping once the child process is terminated. Change-Id: I46a2eb93fd614e2e7ff676727eb9dc132c29d03f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-16Update set of region identity attributSamuel Bartel1-1/+2
Use OS_REGION_NAME environment variable if defined Change-Id: Ifcdfc468fa4931ab62ac0f3ead103e15af7c0de6 Signed-off-by: Samuel Bartel <samuel.bartel@orange.com>
2018-01-11Fix tempest error on ApexLinda Wang1-2/+3
1. Reconfigure v3_endpoint_type only when it is not None. It is adminURL by default. 2. Ignore the setting of api_v2_admin, as it only applies if api_v2 is set to True. Change-Id: I48b166bdb274467519390af3c1aa5ebf30b38c6d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-09Remove the judgement of OS_ENDPOINT_TYPELinda Wang1-5/+6
Remove the judgement of OS_ENDPOINT_TYPE when configuring [identity-feature-enabled] section in tempest.conf Change-Id: Ia0f6926cdd6e063c953358df5108b537917418bc Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-04Merge "Config physical network when creating tempest net"Cedric Ollivier2-0/+36
2018-01-03Configure physical_network when creating networkLinda Wang4-8/+18
When the network_type is vlan, configuring physical_network and segmentation_id should be supported by snaps. JIRA: SNAPS-252 Change-Id: I2d3270a82991230385fdc18889ed5c5e979672b5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-29Disable keystone v2 if keystone v3 is availableLinda Wang1-4/+2
Change-Id: I9ae18ac6702b6bc1df80e5ff794307929e4aefb9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Config physical network when creating tempest netLinda Wang2-0/+36
When the network_type is vlan, physical_network and segmentation_id could be configured. This also supports to config physical network when creating rally net. Change-Id: I9770968537c1509c5712eada66925a4bf8f6678c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-23Dynamic region name of juju cloudsoumaya1-9/+14
Region name in juju cloud has been made dynamic now, region name will be added in cloud file from os environment variable. It fixes the issues when runnit juju_epc vs Apex [1]. It also updates ubuntu images to xenial. [1] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-master/628/console Change-Id: I9422af3086141cd40b99e6482883a7081f58c2ea Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-21Update cirros image to 0.4.0Michael Polenchuk2-2/+2
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-19Blacklist rally ceilometer scenariosJuha Kosonen1-0/+10
Exclude ceilometer test cases since Rally is still utilizing the API which was deprecated in Pike. Change-Id: I33be7358c14988f94d38d4b9d42995bd5f022617 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-12-19Merge "Switch to public keystone endpoint"Cedric Ollivier2-28/+28
2017-12-18Switch to public keystone endpointCédric Ollivier2-28/+28
It also reorders imports and removes dead code. Change-Id: I1e7bd03a4bc07df4705c9beed83a37a022ddbd52 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-16Enforce a versioned public identity endpointCédric Ollivier1-12/+21
juju simply adds /auth/tokens to the public identity endpoint wich fails vs an unversioned endpoint as currently advised. It enforces a versioned endpoint till juju implements the right discovery. It may be improved to detect the right API version instead of forcing v3. But v2 is hugely deprecated and no longer used by all OPNFV installers. It also fixes errors/warnings listed by pylint. Change-Id: I6e8ba4b2122c19629426530d2d34e51e1bc609ba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-14[vyos_vrouter] Support https endpointsShuyaNakama4-42/+11
JIRA: FUNCTEST-881 vyos_vrouter did not support https endpoints [1]. I fixed the following two points. 1. Modifying blueprint of Cloudify. 2. Changing nova client of utilvnf module. Point 1 I added command of support https endpoint to blueprint of vyos_vrouter. The Blueprint of vyos_vrouter is on our github repository [2]. I updated our repository. Point 2 I changed nova client of utilvnf module. Utilvnf module is utility module of vyos_vrouter. Nova client of utilvnf module did not support https endpoints. So, I changed to use nova client of snaps. After fixed the source code, I confirmed the vyos_vrouter was succeeded in the following two environments. 1. Our labs (Instoller:fuel, environment of https endpoints) 2. Orange POD (Instoller:compass, environment of http endpoints) [1] https://jira.opnfv.org/browse/FUNCTEST-881 [2] https://github.com/oolorg/opnfv-vnf-vyos-blueprint/blob/master/function-test-openstack-blueprint.yaml Change-Id: I468df0f2486a34bc558ad161eb7de44264549006 Signed-off-by: ShuyaNakama <shuya.nakama@okinawaopenlabs.org>
2017-12-14Merge "Change the name of flavor and disabled ssh-hostname verification."Linda Wang2-6/+12
2017-12-13Change the name of flavor and disabled ssh-hostname verification.soumaya2-6/+12
Change-Id: Ia801e8a37288606a325b5dd010ab9f6acbfdadf4 Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-12Merge "Set the ram of flavor 1024"Linda Wang3-5/+12
2017-12-11vEPC tests with juju as an VNF managersoumaya27-0/+1489
juju_epc testcase validate EPC setup with the help of ABoT which acting as test executor. Functest-abot-epc-bundle deploys OAI charms alongwith mysql and ABoT. JUJU is acting as a VNF manager. Change-Id: I45d7b37f21f6b8c7049ab2bf42a4678e30b67a72 Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-11Set the ram of flavor 1024Linda Wang3-5/+12
The setting of hw:mem_page_size=large indicates larger page sizes for guest RAM, eg., either 2MB or 1GB on x86. When tested on compass, 1GB is required. Change-Id: Iefd2e8ff30e0a496157e0bd118e63ab3c402abab Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-11Fix yaml format errors in vnfCédric Ollivier5-81/+102
All Rally yaml files are skipped because they leverage on jinja2. Now last errors are in functest/api directories [1]. [1] https://jira.opnfv.org/browse/FUNCTEST-897 Change-Id: I4d6c9b3b7c1f3602bd51c9cf7e1c5babf581ab82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-07Merge "Fix the yamllint errors in functest/ci"Cedric Ollivier5-33/+27
2017-12-06Assign heat_stack_owner role to the new userLinda Wang2-0/+34
For heat scenario in rally, assign heat_stack_owner role to the new created users. Change-Id: I86a74ca88993ed3782d21b22eb5933d639d86c94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-06Fix the yamllint errors in functest/ciLinda Wang5-33/+27
And also, remove the params "tempest_use_custom_images" and "unique_names" of vping, rally and tempest. Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-05Fix pylint errors of vpingLinda Wang3-22/+25
Change-Id: I272f0eb6fb0f2a274484a3dcfacd8ed65e4a5b23 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-30Adjust timeouts in VnfsCédric Ollivier3-6/+6
When testcases fail, the jjobs is aborted and the result isn't printed. Change-Id: Ibda6268873303e631705c695a41c50980a3d29e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Skip modifying creds if Variables.robot is missingCédric Ollivier1-12/+15
Variable.robot is missing in functest-features [1]. As it's related to ODL csit suites, modifying it could be safely skipped as odl.py is designed for testing multiple ODL testcases. [1] https://gerrit.opnfv.org/gerrit/#/c/46225/ Change-Id: Id5f1947a073d251ef7480f418218a4c85fe078c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-27Create RobotFramework classCédric Ollivier1-88/+25
It moves the capability to run any robot script from ODL TestCase into a new class: RobotFramework. It updates ODL TestCase and the related unit tests to inherit from the new parent class. Change-Id: I73e59ee9652fb63d9d89d7c75c58cce9cf62b0d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-25Remove os_utils call from cloudify ims and vrouterLinda Wang2-6/+9
Change-Id: I333551125616113484ad275820f2176dae79da6e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-23Fix relative imports in cloudify_ims_perfCédric Ollivier2-46/+35
It also fixes wrong indents. JIRA: FUNCTEST-893 Change-Id: Ic54e01c03c14f39c69242c41922fc124c1b45c23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-23Remove openstack utils calls in rally and tempestLinda Wang1-9/+5
Mainly, update "rally deployment create --file=rally_conf.json" to "rally deployment create --fromenv" Change-Id: I6dd4c7ea2d9d6f47dee49a4fd416e62bd557f45e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-22Merge "Removal of deprecated SNAPS-OO classes."Cedric Ollivier10-265/+270
2017-11-21Removal of deprecated SNAPS-OO classes.spisarski10-265/+270
JIRA: SNAPS-202 Change-Id: I115b4927b287a5525f4c1b95128d91f5229c7856 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-11-21Merge "Fix "Broken pipe" IOErrors of rally run"Linda Wang1-23/+21
2017-11-21Fix "Broken pipe" IOErrors of rally runJuha Kosonen1-23/+21
Replace obsolete os.popen with subprocess module usage in command output retrieval. Do not use shell as the program to execute. Change-Id: Ic63bb0f393750c3b85a35a37fecd46c1c1b96602 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-20Support to specify the valid external network nameLinda Wang1-1/+9
In some deployments, the retrieved external network by the def get_external_networks in Snaps checked by "router:external" is not available. So it is necessary to specify the available external network as an env by user. Change-Id: I333e91dd106ed307541a9a197280199fde86bd30 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15Merge "Update the version of refstack set to 2017.09"Jose Lausuch1-10/+68
2017-11-15Merge "Fix the regular expression for refstack"Jose Lausuch1-3/+3
2017-11-15Update the version of refstack set to 2017.09Linda Wang1-10/+68
JIRA: FUNCTEST-890 Change-Id: Iac2f833fa2b704cd7caa6083e39e48e2df315890 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15Fix the regular expression for refstackLinda Wang1-3/+3
Otherwise, this line could not be matched: {0} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token [0.143237s] ... ok -> the matched result: tempest.api.identity.v3.test_t Change-Id: I97282a9c98a889a015a40f9ad2d700906bb88fb1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15Add shebang in snaps_suite_builder.pyCédric Ollivier1-0/+2
Change-Id: I3392068b4a47d35bf0d91fe6d93f2de268f198bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-13Move rally and tempest out of functest-coreLinda Wang2-1/+63
JIRA: FUNCTEST-889 Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-10Select the subset of snaps test casesLinda Wang4-9/+434
Change-Id: I03e422d5dae0ced9cd7a5477c31359ffc7795c42 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-06Protect vs exceptions when ext_nets is emptyCédric Ollivier1-1/+1
Otherwise several exceptions are raised in TestCase constructors (those defined in heathcheck). Change-Id: I4cb054f7092ea9db02cb8c4469e99848533c556b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-05Merge "Add new cinder scenarios for rally sanity/full"Cedric Ollivier2-0/+157