aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-01-26Fix last Pylint error in FunctestCédric Ollivier12-99/+123
It also fixes all pylint warnings in router and the related unit tests. tox.ini is updated to ensure that no error is introduced. Change-Id: Iddd74b0dac7b6581d72b04369140006c9e19f998 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Fix pylint warnings/errors in cliCédric Ollivier10-142/+111
cli_testcase and cli_tier have been refactored to avoid duplicating code. Then functest/cli and funtest/unit/cli can be added to the list of modules rated 10/10. Change-Id: Iec90e806397248a10f39080ec554e3f0a6eda7c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Delete functest_vacation.pyCédric Ollivier3-66/+4
Change-Id: Id0e2769a1989e6778ae41f67ed634e2e5002a83d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Merge RegexMatch into test_cli_env.pyCédric Ollivier2-34/+13
It also deletes SubstrMatch which is not called (then uncovered). Change-Id: Ifde1e2491ab5e0e75652eb4b25b359e859c2aa95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Disable all missing-docstring warnings in unit testsCédric Ollivier18-2/+33
Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Partially rewrite test_run_tests.pyCédric Ollivier2-88/+85
It mainly fixes pylint issues and leverages on decorators. It should be noted that run_tests.py is not fully covered (see xtesting requirements). Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Fully test and cover functest/ci/tier_*Cédric Ollivier6-251/+332
It also fixes check_deployment.py and ci unit tests which were wrong when testing exceptions. Now ci modules are rated 10/10 and fully covered. Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Move push_results_to_db to TestCaseCédric Ollivier6-309/+192
It removes the link between TestCase and Functest utils (xtesting). It should be noted that testresults url can only be set by env var. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ie072c675890d0ae2e63619c599d2684a8c7d762d Signed-off-by: Jose Lausuch <jalausuch@suse.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-20Configure password for the user in vnfLinda Wang5-14/+15
For some SUTs, the password for creating user is not allowed to be the same as user name, and some even is required to contain at least 8 characters and three types of characters for security. It also turns yamllint warnings into errors and fixes the remaining warnings. Change-Id: Icf25a7b9ff1c8cee55899198f1e519c9209877ff Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-17Merge "Fix Rally output retrieval"Linda Wang2-15/+4
2018-01-16Fix Rally output retrievalJuha Kosonen2-15/+4
Read stdout until nothing left instead of stopping once the child process is terminated. Change-Id: I46a2eb93fd614e2e7ff676727eb9dc132c29d03f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-16Update set of region identity attributSamuel Bartel2-2/+4
Use OS_REGION_NAME environment variable if defined Change-Id: Ifcdfc468fa4931ab62ac0f3ead103e15af7c0de6 Signed-off-by: Samuel Bartel <samuel.bartel@orange.com>
2018-01-11Fix tempest error on ApexLinda Wang1-2/+3
1. Reconfigure v3_endpoint_type only when it is not None. It is adminURL by default. 2. Ignore the setting of api_v2_admin, as it only applies if api_v2 is set to True. Change-Id: I48b166bdb274467519390af3c1aa5ebf30b38c6d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-09Remove the judgement of OS_ENDPOINT_TYPELinda Wang1-5/+6
Remove the judgement of OS_ENDPOINT_TYPE when configuring [identity-feature-enabled] section in tempest.conf Change-Id: Ia0f6926cdd6e063c953358df5108b537917418bc Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-04Merge "Config physical network when creating tempest net"Cedric Ollivier3-0/+42
2018-01-04Merge "Configure physical_network when creating network"Cedric Ollivier5-8/+23
2018-01-03Remove the obsolete configs in config yamlLinda Wang1-5/+0
Change-Id: I389f3f4b09274529f92d7a74ebfb0cdd257c493a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-03Configure physical_network when creating networkLinda Wang5-8/+23
When the network_type is vlan, configuring physical_network and segmentation_id should be supported by snaps. JIRA: SNAPS-252 Change-Id: I2d3270a82991230385fdc18889ed5c5e979672b5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-29Disable keystone v2 if keystone v3 is availableLinda Wang1-4/+2
Change-Id: I9ae18ac6702b6bc1df80e5ff794307929e4aefb9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Execute feature command by subprocess directlyLinda Wang2-28/+33
Change-Id: I77e86af4e96310c6520d743e4d16c9a7b2e9adf5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Config physical network when creating tempest netLinda Wang3-0/+42
When the network_type is vlan, physical_network and segmentation_id could be configured. This also supports to config physical network when creating rally net. Change-Id: I9770968537c1509c5712eada66925a4bf8f6678c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-23Dynamic region name of juju cloudsoumaya1-9/+14
Region name in juju cloud has been made dynamic now, region name will be added in cloud file from os environment variable. It fixes the issues when runnit juju_epc vs Apex [1]. It also updates ubuntu images to xenial. [1] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-master/628/console Change-Id: I9422af3086141cd40b99e6482883a7081f58c2ea Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-21Update cirros image to 0.4.0Michael Polenchuk5-13/+13
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-21Enable orchestra testcases for Daisy onlyCédric Ollivier1-2/+2
The current testcases have several issues which limit the possible successful runs to Daisy [1]. [1] https://jira.opnfv.org/browse/ORCHESTRA-17 Change-Id: Iecaf21738e19aae6a88171385f11afcffd28a348 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-21Merge "Get auth token when checking deployment"Cedric Ollivier2-2/+18
2017-12-21Merge "Remove logger_test_results"Cedric Ollivier3-68/+0
2017-12-21Merge "Remove openstack_[clean,snapshot]"Linda Wang9-1737/+0
2017-12-20Remove logger_test_resultsCédric Ollivier3-68/+0
It was only called in Feature which the result is already printed (see __str__()). It also eases moving Feature to xtesting as it breaks the link to functest_utils. Change-Id: Ib72d651dc7d89598704ff4d52d8b1ecb2bdade5b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-20Merge "Delete TestCase.create_snapshot()"Cedric Ollivier3-18/+0
2017-12-20Get auth token when checking deploymentLinda Wang2-2/+18
JIRA: FUNCTEST-900 Change-Id: Ie313d273a357a35b176b3918de108d85164776fa Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-19Merge "Blacklist rally ceilometer scenarios"Cedric Ollivier1-0/+10
2017-12-19Remove openstack_[clean,snapshot]Cédric Ollivier9-1737/+0
It also removes the related unit tests and updates docs and cli. Change-Id: Ie11f77402f2b5b7055a0c7c5d931c8ff21124482 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-19Delete TestCase.create_snapshot()Cédric Ollivier3-18/+0
OSGC has been removed then this method can be safely removed. It also updates run_tests.py. Change-Id: I4030b7f0351d24d095313ae990b08e65d8f69115 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-19Blacklist rally ceilometer scenariosJuha Kosonen1-0/+10
Exclude ceilometer test cases since Rally is still utilizing the API which was deprecated in Pike. Change-Id: I33be7358c14988f94d38d4b9d42995bd5f022617 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-12-19Merge "Filter out orchestra for ssl enabled deployments"Cedric Ollivier1-2/+2
2017-12-19Merge "Remove OSGCTestCase"Cedric Ollivier2-76/+5
2017-12-19Merge "Switch to public keystone endpoint"Cedric Ollivier2-28/+28
2017-12-19Remove OSGCTestCaseCédric Ollivier2-76/+5
This class is no longer used and must be removed before working on xtesting. JIRA: FUNCTEST-887 Change-Id: I3ac1db6ec90d9db301e5461cd79cfcf77291dffc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-18Switch to public keystone endpointCédric Ollivier2-28/+28
It also reorders imports and removes dead code. Change-Id: I1e7bd03a4bc07df4705c9beed83a37a022ddbd52 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-18Merge "Enforce a versioned public identity endpoint"Linda Wang1-12/+21
2017-12-18Merge "Inject all envs in openrc into CONST"Cedric Ollivier2-13/+1
2017-12-18Merge "Improve the pylint score of functest-core"Cedric Ollivier8-81/+113
2017-12-16Enforce a versioned public identity endpointCédric Ollivier1-12/+21
juju simply adds /auth/tokens to the public identity endpoint wich fails vs an unversioned endpoint as currently advised. It enforces a versioned endpoint till juju implements the right discovery. It may be improved to detect the right API version instead of forcing v3. But v2 is hugely deprecated and no longer used by all OPNFV installers. It also fixes errors/warnings listed by pylint. Change-Id: I6e8ba4b2122c19629426530d2d34e51e1bc609ba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-15Filter out orchestra for ssl enabled deploymentsMichael Polenchuk1-2/+2
Skip orchestra tests for the Compass & Fuel/MCP installers until OpenBaton have updated to version 4.x+ with SSL support. JIRA: ORCHESTRA-17 Change-Id: I894a08fb5ac83a6b1d59d7bcf3a681a8d596968f Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-15Inject all envs in openrc into CONSTLinda Wang2-13/+1
After "env_prepare" is removed, some specific vars in openrc (eg,."EXTERNAL_NETWORK") loaded to os.environ should be injected into CONST in one python process. Change-Id: Iaa5c6047033dc2a30c533174e2016111759aec31 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-14[vyos_vrouter] Support https endpointsShuyaNakama5-43/+12
JIRA: FUNCTEST-881 vyos_vrouter did not support https endpoints [1]. I fixed the following two points. 1. Modifying blueprint of Cloudify. 2. Changing nova client of utilvnf module. Point 1 I added command of support https endpoint to blueprint of vyos_vrouter. The Blueprint of vyos_vrouter is on our github repository [2]. I updated our repository. Point 2 I changed nova client of utilvnf module. Utilvnf module is utility module of vyos_vrouter. Nova client of utilvnf module did not support https endpoints. So, I changed to use nova client of snaps. After fixed the source code, I confirmed the vyos_vrouter was succeeded in the following two environments. 1. Our labs (Instoller:fuel, environment of https endpoints) 2. Orange POD (Instoller:compass, environment of http endpoints) [1] https://jira.opnfv.org/browse/FUNCTEST-881 [2] https://github.com/oolorg/opnfv-vnf-vyos-blueprint/blob/master/function-test-openstack-blueprint.yaml Change-Id: I468df0f2486a34bc558ad161eb7de44264549006 Signed-off-by: ShuyaNakama <shuya.nakama@okinawaopenlabs.org>
2017-12-14Merge "Change the name of flavor and disabled ssh-hostname verification."Linda Wang2-6/+12
2017-12-14Improve the pylint score of functest-coreLinda Wang8-81/+113
It also modifies the file list to ensure the rating of ci modules. Change-Id: Ia1e414be5364cb3da3d54882db428024ed6bd99f Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-13Change the name of flavor and disabled ssh-hostname verification.soumaya2-6/+12
Change-Id: Ia801e8a37288606a325b5dd010ab9f6acbfdadf4 Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-13Merge "Fix yamllint errors in functest/api"Jose Lausuch12-323/+327