aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-01-29Merge "Fix pylint errors in several utils modules"Cedric Ollivier4-59/+51
2018-01-29Merge "Avoid duplicating get_parameter_from_yaml"Cedric Ollivier2-38/+24
2018-01-29Merge "Fix last Pylint error in Functest"Cedric Ollivier12-99/+123
2018-01-29Fix the connect issue when checking deploymentLinda Wang2-5/+5
Socket.connect() requires only one param with type tuple. Change-Id: I63aa4633e80bde3ad5e1b5af9d67d8f46eb84571 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-27Merge "Refactor rally report generation"Cedric Ollivier2-113/+76
2018-01-26Fix pylint errors in several utils modulesCédric Ollivier4-59/+51
All utils which are moving to xtesting are now fixed. It remains OpenStack and Functest utils (+ the related unit tests) which doesn't move to the new package. Change-Id: If13c627c8444c62d5c6bf9c8057d6413aa0e56c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Avoid duplicating get_parameter_from_yamlCédric Ollivier2-38/+24
It switches to this helper which was locally copied. Change-Id: Iaa30d83e8c0e2d4472f4ef8fe1da4943e424ebb3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Fix last Pylint error in FunctestCédric Ollivier12-99/+123
It also fixes all pylint warnings in router and the related unit tests. tox.ini is updated to ensure that no error is introduced. Change-Id: Iddd74b0dac7b6581d72b04369140006c9e19f998 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Refactor rally report generationJuha Kosonen2-113/+76
- statistic data based on Rally results report - fix statistics calculations - use PrettyTable in generating the report Change-Id: Ic84adc5e30d446aea1f3045ba997c3ddf895e9f5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-24Fix pylint warnings/errors in cliCédric Ollivier10-142/+111
cli_testcase and cli_tier have been refactored to avoid duplicating code. Then functest/cli and funtest/unit/cli can be added to the list of modules rated 10/10. Change-Id: Iec90e806397248a10f39080ec554e3f0a6eda7c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Delete functest_vacation.pyCédric Ollivier3-66/+4
Change-Id: Id0e2769a1989e6778ae41f67ed634e2e5002a83d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Merge RegexMatch into test_cli_env.pyCédric Ollivier2-34/+13
It also deletes SubstrMatch which is not called (then uncovered). Change-Id: Ifde1e2491ab5e0e75652eb4b25b359e859c2aa95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Disable all missing-docstring warnings in unit testsCédric Ollivier18-2/+33
Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Partially rewrite test_run_tests.pyCédric Ollivier2-88/+85
It mainly fixes pylint issues and leverages on decorators. It should be noted that run_tests.py is not fully covered (see xtesting requirements). Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Fully test and cover functest/ci/tier_*Cédric Ollivier6-251/+332
It also fixes check_deployment.py and ci unit tests which were wrong when testing exceptions. Now ci modules are rated 10/10 and fully covered. Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Move push_results_to_db to TestCaseCédric Ollivier6-309/+192
It removes the link between TestCase and Functest utils (xtesting). It should be noted that testresults url can only be set by env var. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ie072c675890d0ae2e63619c599d2684a8c7d762d Signed-off-by: Jose Lausuch <jalausuch@suse.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-20Configure password for the user in vnfLinda Wang5-14/+15
For some SUTs, the password for creating user is not allowed to be the same as user name, and some even is required to contain at least 8 characters and three types of characters for security. It also turns yamllint warnings into errors and fixes the remaining warnings. Change-Id: Icf25a7b9ff1c8cee55899198f1e519c9209877ff Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-17Merge "Fix Rally output retrieval"Linda Wang2-15/+4
2018-01-16Fix Rally output retrievalJuha Kosonen2-15/+4
Read stdout until nothing left instead of stopping once the child process is terminated. Change-Id: I46a2eb93fd614e2e7ff676727eb9dc132c29d03f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-16Update set of region identity attributSamuel Bartel2-2/+4
Use OS_REGION_NAME environment variable if defined Change-Id: Ifcdfc468fa4931ab62ac0f3ead103e15af7c0de6 Signed-off-by: Samuel Bartel <samuel.bartel@orange.com>
2018-01-11Fix tempest error on ApexLinda Wang1-2/+3
1. Reconfigure v3_endpoint_type only when it is not None. It is adminURL by default. 2. Ignore the setting of api_v2_admin, as it only applies if api_v2 is set to True. Change-Id: I48b166bdb274467519390af3c1aa5ebf30b38c6d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-09Remove the judgement of OS_ENDPOINT_TYPELinda Wang1-5/+6
Remove the judgement of OS_ENDPOINT_TYPE when configuring [identity-feature-enabled] section in tempest.conf Change-Id: Ia0f6926cdd6e063c953358df5108b537917418bc Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-04Merge "Config physical network when creating tempest net"Cedric Ollivier3-0/+42
2018-01-04Merge "Configure physical_network when creating network"Cedric Ollivier5-8/+23
2018-01-03Remove the obsolete configs in config yamlLinda Wang1-5/+0
Change-Id: I389f3f4b09274529f92d7a74ebfb0cdd257c493a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-03Configure physical_network when creating networkLinda Wang5-8/+23
When the network_type is vlan, configuring physical_network and segmentation_id should be supported by snaps. JIRA: SNAPS-252 Change-Id: I2d3270a82991230385fdc18889ed5c5e979672b5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-29Disable keystone v2 if keystone v3 is availableLinda Wang1-4/+2
Change-Id: I9ae18ac6702b6bc1df80e5ff794307929e4aefb9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Execute feature command by subprocess directlyLinda Wang2-28/+33
Change-Id: I77e86af4e96310c6520d743e4d16c9a7b2e9adf5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Config physical network when creating tempest netLinda Wang3-0/+42
When the network_type is vlan, physical_network and segmentation_id could be configured. This also supports to config physical network when creating rally net. Change-Id: I9770968537c1509c5712eada66925a4bf8f6678c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-23Dynamic region name of juju cloudsoumaya1-9/+14
Region name in juju cloud has been made dynamic now, region name will be added in cloud file from os environment variable. It fixes the issues when runnit juju_epc vs Apex [1]. It also updates ubuntu images to xenial. [1] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-master/628/console Change-Id: I9422af3086141cd40b99e6482883a7081f58c2ea Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-21Update cirros image to 0.4.0Michael Polenchuk5-13/+13
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-21Enable orchestra testcases for Daisy onlyCédric Ollivier1-2/+2
The current testcases have several issues which limit the possible successful runs to Daisy [1]. [1] https://jira.opnfv.org/browse/ORCHESTRA-17 Change-Id: Iecaf21738e19aae6a88171385f11afcffd28a348 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-21Merge "Get auth token when checking deployment"Cedric Ollivier2-2/+18
2017-12-21Merge "Remove logger_test_results"Cedric Ollivier3-68/+0
2017-12-21Merge "Remove openstack_[clean,snapshot]"Linda Wang9-1737/+0
2017-12-20Remove logger_test_resultsCédric Ollivier3-68/+0
It was only called in Feature which the result is already printed (see __str__()). It also eases moving Feature to xtesting as it breaks the link to functest_utils. Change-Id: Ib72d651dc7d89598704ff4d52d8b1ecb2bdade5b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-20Merge "Delete TestCase.create_snapshot()"Cedric Ollivier3-18/+0
2017-12-20Get auth token when checking deploymentLinda Wang2-2/+18
JIRA: FUNCTEST-900 Change-Id: Ie313d273a357a35b176b3918de108d85164776fa Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-19Merge "Blacklist rally ceilometer scenarios"Cedric Ollivier1-0/+10
2017-12-19Remove openstack_[clean,snapshot]Cédric Ollivier9-1737/+0
It also removes the related unit tests and updates docs and cli. Change-Id: Ie11f77402f2b5b7055a0c7c5d931c8ff21124482 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-19Delete TestCase.create_snapshot()Cédric Ollivier3-18/+0
OSGC has been removed then this method can be safely removed. It also updates run_tests.py. Change-Id: I4030b7f0351d24d095313ae990b08e65d8f69115 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-19Blacklist rally ceilometer scenariosJuha Kosonen1-0/+10
Exclude ceilometer test cases since Rally is still utilizing the API which was deprecated in Pike. Change-Id: I33be7358c14988f94d38d4b9d42995bd5f022617 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-12-19Merge "Filter out orchestra for ssl enabled deployments"Cedric Ollivier1-2/+2
2017-12-19Merge "Remove OSGCTestCase"Cedric Ollivier2-76/+5
2017-12-19Merge "Switch to public keystone endpoint"Cedric Ollivier2-28/+28
2017-12-19Remove OSGCTestCaseCédric Ollivier2-76/+5
This class is no longer used and must be removed before working on xtesting. JIRA: FUNCTEST-887 Change-Id: I3ac1db6ec90d9db301e5461cd79cfcf77291dffc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-18Switch to public keystone endpointCédric Ollivier2-28/+28
It also reorders imports and removes dead code. Change-Id: I1e7bd03a4bc07df4705c9beed83a37a022ddbd52 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-18Merge "Enforce a versioned public identity endpoint"Linda Wang1-12/+21
2017-12-18Merge "Inject all envs in openrc into CONST"Cedric Ollivier2-13/+1
2017-12-18Merge "Improve the pylint score of functest-core"Cedric Ollivier8-81/+113