aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-01-29Fix the connect issue when checking deploymentLinda Wang2-5/+5
Socket.connect() requires only one param with type tuple. Change-Id: I63aa4633e80bde3ad5e1b5af9d67d8f46eb84571 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-29Create subnet and net within the same projectLinda Wang1-0/+1
It is required to create a network and subnet within the same project for some SUTs. Change-Id: Icd02edb0aebee93713f315cdbbeb021e9ae82dae Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-28Fix warnings in all snaps-related modulesCédric Ollivier13-184/+263
It also adds vping/__init__.py to stop skipping vping unit tests. It removes the useless import os which is not required for mock (here the mock patch was simply false). It should be noted that the code is partially duplicated between snaps_test_runner.py and vping_base_base.py. A small part of code has been rewritten to fix that without multi inheritance. Change-Id: I2e3e181ad7dab8aa41afb1e63d0b6795ff0d1610 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-27Merge "Refactor rally report generation"Cedric Ollivier2-113/+76
2018-01-26Fix pylint errors in several utils modulesCédric Ollivier4-59/+51
All utils which are moving to xtesting are now fixed. It remains OpenStack and Functest utils (+ the related unit tests) which doesn't move to the new package. Change-Id: If13c627c8444c62d5c6bf9c8057d6413aa0e56c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Avoid duplicating get_parameter_from_yamlCédric Ollivier2-38/+24
It switches to this helper which was locally copied. Change-Id: Iaa30d83e8c0e2d4472f4ef8fe1da4943e424ebb3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Fix last Pylint error in FunctestCédric Ollivier12-99/+123
It also fixes all pylint warnings in router and the related unit tests. tox.ini is updated to ensure that no error is introduced. Change-Id: Iddd74b0dac7b6581d72b04369140006c9e19f998 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Refactor rally report generationJuha Kosonen2-113/+76
- statistic data based on Rally results report - fix statistics calculations - use PrettyTable in generating the report Change-Id: Ic84adc5e30d446aea1f3045ba997c3ddf895e9f5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-26proper instance status handlingPeriyasamy Palanisamy1-1/+4
This would fix the exception happening in the SDNVPN CI testsuite. Example: http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-01-21_17-18-06/bgpvpn.log Change-Id: Ie22dcdbba5299177d4e98e5995433553df5bfa68 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-01-24Fix pylint warnings/errors in cliCédric Ollivier10-142/+111
cli_testcase and cli_tier have been refactored to avoid duplicating code. Then functest/cli and funtest/unit/cli can be added to the list of modules rated 10/10. Change-Id: Iec90e806397248a10f39080ec554e3f0a6eda7c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Delete functest_vacation.pyCédric Ollivier3-66/+4
Change-Id: Id0e2769a1989e6778ae41f67ed634e2e5002a83d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Merge RegexMatch into test_cli_env.pyCédric Ollivier2-34/+13
It also deletes SubstrMatch which is not called (then uncovered). Change-Id: Ifde1e2491ab5e0e75652eb4b25b359e859c2aa95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Disable all missing-docstring warnings in unit testsCédric Ollivier18-2/+33
Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Partially rewrite test_run_tests.pyCédric Ollivier2-88/+85
It mainly fixes pylint issues and leverages on decorators. It should be noted that run_tests.py is not fully covered (see xtesting requirements). Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Fully test and cover functest/ci/tier_*Cédric Ollivier6-251/+332
It also fixes check_deployment.py and ci unit tests which were wrong when testing exceptions. Now ci modules are rated 10/10 and fully covered. Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Move push_results_to_db to TestCaseCédric Ollivier6-309/+192
It removes the link between TestCase and Functest utils (xtesting). It should be noted that testresults url can only be set by env var. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ie072c675890d0ae2e63619c599d2684a8c7d762d Signed-off-by: Jose Lausuch <jalausuch@suse.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-20Configure password for the user in vnfLinda Wang5-14/+15
For some SUTs, the password for creating user is not allowed to be the same as user name, and some even is required to contain at least 8 characters and three types of characters for security. It also turns yamllint warnings into errors and fixes the remaining warnings. Change-Id: Icf25a7b9ff1c8cee55899198f1e519c9209877ff Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-17Merge "Fix Rally output retrieval"Linda Wang2-15/+4
2018-01-16Fix Rally output retrievalJuha Kosonen2-15/+4
Read stdout until nothing left instead of stopping once the child process is terminated. Change-Id: I46a2eb93fd614e2e7ff676727eb9dc132c29d03f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-16Update set of region identity attributSamuel Bartel2-2/+4
Use OS_REGION_NAME environment variable if defined Change-Id: Ifcdfc468fa4931ab62ac0f3ead103e15af7c0de6 Signed-off-by: Samuel Bartel <samuel.bartel@orange.com>
2018-01-11Fix tempest error on ApexLinda Wang1-2/+3
1. Reconfigure v3_endpoint_type only when it is not None. It is adminURL by default. 2. Ignore the setting of api_v2_admin, as it only applies if api_v2 is set to True. Change-Id: I48b166bdb274467519390af3c1aa5ebf30b38c6d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-09Remove the judgement of OS_ENDPOINT_TYPELinda Wang1-5/+6
Remove the judgement of OS_ENDPOINT_TYPE when configuring [identity-feature-enabled] section in tempest.conf Change-Id: Ia0f6926cdd6e063c953358df5108b537917418bc Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-04Merge "Config physical network when creating tempest net"Cedric Ollivier3-0/+42
2018-01-04Merge "Configure physical_network when creating network"Cedric Ollivier5-8/+23
2018-01-03Remove the obsolete configs in config yamlLinda Wang1-5/+0
Change-Id: I389f3f4b09274529f92d7a74ebfb0cdd257c493a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-03Configure physical_network when creating networkLinda Wang5-8/+23
When the network_type is vlan, configuring physical_network and segmentation_id should be supported by snaps. JIRA: SNAPS-252 Change-Id: I2d3270a82991230385fdc18889ed5c5e979672b5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-29Disable keystone v2 if keystone v3 is availableLinda Wang1-4/+2
Change-Id: I9ae18ac6702b6bc1df80e5ff794307929e4aefb9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Execute feature command by subprocess directlyLinda Wang2-28/+33
Change-Id: I77e86af4e96310c6520d743e4d16c9a7b2e9adf5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Config physical network when creating tempest netLinda Wang3-0/+42
When the network_type is vlan, physical_network and segmentation_id could be configured. This also supports to config physical network when creating rally net. Change-Id: I9770968537c1509c5712eada66925a4bf8f6678c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-23Dynamic region name of juju cloudsoumaya1-9/+14
Region name in juju cloud has been made dynamic now, region name will be added in cloud file from os environment variable. It fixes the issues when runnit juju_epc vs Apex [1]. It also updates ubuntu images to xenial. [1] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-master/628/console Change-Id: I9422af3086141cd40b99e6482883a7081f58c2ea Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-21Update cirros image to 0.4.0Michael Polenchuk5-13/+13
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-21Enable orchestra testcases for Daisy onlyCédric Ollivier1-2/+2
The current testcases have several issues which limit the possible successful runs to Daisy [1]. [1] https://jira.opnfv.org/browse/ORCHESTRA-17 Change-Id: Iecaf21738e19aae6a88171385f11afcffd28a348 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-21Merge "Get auth token when checking deployment"Cedric Ollivier2-2/+18
2017-12-21Merge "Remove logger_test_results"Cedric Ollivier3-68/+0
2017-12-21Merge "Remove openstack_[clean,snapshot]"Linda Wang9-1737/+0
2017-12-20Remove logger_test_resultsCédric Ollivier3-68/+0
It was only called in Feature which the result is already printed (see __str__()). It also eases moving Feature to xtesting as it breaks the link to functest_utils. Change-Id: Ib72d651dc7d89598704ff4d52d8b1ecb2bdade5b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-20Merge "Delete TestCase.create_snapshot()"Cedric Ollivier3-18/+0
2017-12-20Get auth token when checking deploymentLinda Wang2-2/+18
JIRA: FUNCTEST-900 Change-Id: Ie313d273a357a35b176b3918de108d85164776fa Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-19Merge "Blacklist rally ceilometer scenarios"Cedric Ollivier1-0/+10
2017-12-19Remove openstack_[clean,snapshot]Cédric Ollivier9-1737/+0
It also removes the related unit tests and updates docs and cli. Change-Id: Ie11f77402f2b5b7055a0c7c5d931c8ff21124482 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-19Delete TestCase.create_snapshot()Cédric Ollivier3-18/+0
OSGC has been removed then this method can be safely removed. It also updates run_tests.py. Change-Id: I4030b7f0351d24d095313ae990b08e65d8f69115 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-19Blacklist rally ceilometer scenariosJuha Kosonen1-0/+10
Exclude ceilometer test cases since Rally is still utilizing the API which was deprecated in Pike. Change-Id: I33be7358c14988f94d38d4b9d42995bd5f022617 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-12-19Merge "Filter out orchestra for ssl enabled deployments"Cedric Ollivier1-2/+2
2017-12-19Merge "Remove OSGCTestCase"Cedric Ollivier2-76/+5
2017-12-19Merge "Switch to public keystone endpoint"Cedric Ollivier2-28/+28
2017-12-19Remove OSGCTestCaseCédric Ollivier2-76/+5
This class is no longer used and must be removed before working on xtesting. JIRA: FUNCTEST-887 Change-Id: I3ac1db6ec90d9db301e5461cd79cfcf77291dffc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-18Switch to public keystone endpointCédric Ollivier2-28/+28
It also reorders imports and removes dead code. Change-Id: I1e7bd03a4bc07df4705c9beed83a37a022ddbd52 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-18Merge "Enforce a versioned public identity endpoint"Linda Wang1-12/+21
2017-12-18Merge "Inject all envs in openrc into CONST"Cedric Ollivier2-13/+1
2017-12-18Merge "Improve the pylint score of functest-core"Cedric Ollivier8-81/+113