aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-01-27Merge "Refactor rally report generation"Cedric Ollivier2-113/+76
2018-01-26Refactor rally report generationJuha Kosonen2-113/+76
- statistic data based on Rally results report - fix statistics calculations - use PrettyTable in generating the report Change-Id: Ic84adc5e30d446aea1f3045ba997c3ddf895e9f5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-24Fix pylint warnings/errors in cliCédric Ollivier11-142/+113
cli_testcase and cli_tier have been refactored to avoid duplicating code. Then functest/cli and funtest/unit/cli can be added to the list of modules rated 10/10. Change-Id: Iec90e806397248a10f39080ec554e3f0a6eda7c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Delete functest_vacation.pyCédric Ollivier3-66/+4
Change-Id: Id0e2769a1989e6778ae41f67ed634e2e5002a83d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Merge RegexMatch into test_cli_env.pyCédric Ollivier2-34/+13
It also deletes SubstrMatch which is not called (then uncovered). Change-Id: Ifde1e2491ab5e0e75652eb4b25b359e859c2aa95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Disable all missing-docstring warnings in unit testsCédric Ollivier18-2/+33
Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Partially rewrite test_run_tests.pyCédric Ollivier3-91/+86
It mainly fixes pylint issues and leverages on decorators. It should be noted that run_tests.py is not fully covered (see xtesting requirements). Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Fully test and cover functest/ci/tier_*Cédric Ollivier7-252/+338
It also fixes check_deployment.py and ci unit tests which were wrong when testing exceptions. Now ci modules are rated 10/10 and fully covered. Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Move push_results_to_db to TestCaseCédric Ollivier6-309/+192
It removes the link between TestCase and Functest utils (xtesting). It should be noted that testresults url can only be set by env var. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ie072c675890d0ae2e63619c599d2684a8c7d762d Signed-off-by: Jose Lausuch <jalausuch@suse.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-20Configure password for the user in vnfLinda Wang6-15/+16
For some SUTs, the password for creating user is not allowed to be the same as user name, and some even is required to contain at least 8 characters and three types of characters for security. It also turns yamllint warnings into errors and fixes the remaining warnings. Change-Id: Icf25a7b9ff1c8cee55899198f1e519c9209877ff Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-17Merge "Fix Rally output retrieval"Linda Wang2-15/+4
2018-01-16Fix Rally output retrievalJuha Kosonen2-15/+4
Read stdout until nothing left instead of stopping once the child process is terminated. Change-Id: I46a2eb93fd614e2e7ff676727eb9dc132c29d03f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-16Update set of region identity attributSamuel Bartel2-2/+4
Use OS_REGION_NAME environment variable if defined Change-Id: Ifcdfc468fa4931ab62ac0f3ead103e15af7c0de6 Signed-off-by: Samuel Bartel <samuel.bartel@orange.com>
2018-01-13Build functest-parser for arm64 via travis-ciCédric Ollivier1-1/+6
Even if clearwater-live-test dependencies have been updated [1], the next containers can be built for ARM (ruby raises SEGFAULT via qemu-user-static): - functest-vnf - functest-restapi The related manifest is also updated. [1] https://gerrit.opnfv.org/gerrit/#/c/50295/8 Change-Id: Ie1eb78436a3da5eb7b5c1028b7f8323e8c3e73a2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-12Merge "Switch to absolute paths in Dockerfiles"Cedric Ollivier2-4/+4
2018-01-12Switch to absolute paths in DockerfilesCédric Ollivier2-4/+4
It updates functest-smoke and functest-restapi. Change-Id: If4d48f8a6ead1b9b7726a9b7b7baf6b51340a926 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-12Delete the updated Alpine imageCédric Ollivier1-1/+1
It completes "Update Alpine to 3.7" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/49741/ Change-Id: If836a7ca80f5869c9ffeea65a1c0eacf1042ffab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-11Merge "Build vnf and restapi containers for ARM"Cedric Ollivier1-2/+1
2018-01-11Build vnf and restapi containers for ARMDelia Popescu1-2/+1
The root cause of the problem was the installation of unf_ext packet. The Gemfile.lock in https://github.com/boucherv-orange/clearwater-live-test asked for version 0.0.6 and this version was not found for arm. When it tried to build the package, the conversion from int to char error was thrown (issue reported here https://github.com/knu/ruby-unf_ext/issues/15). As now version 0.0.7.4 is selected, then the vnf docker images are built without any other errors. Gemfile.lock was updated in the original repo, this fix enables vnf and restapi containers build for ARM. JIRA: FUNCTEST-899 Change-Id: Id2c5fe82cb3705f58a8175fcf0a17f443e9b7d9d Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-01-11Fix tempest error on ApexLinda Wang1-2/+3
1. Reconfigure v3_endpoint_type only when it is not None. It is adminURL by default. 2. Ignore the setting of api_v2_admin, as it only applies if api_v2 is set to True. Change-Id: I48b166bdb274467519390af3c1aa5ebf30b38c6d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-11Merge "Introduce Euphrates main changes"Linda Wang2-0/+333
2018-01-10Introduce Euphrates main changesMorgan Richomme2-0/+333
6 topics: - functest framework - requirement management - python packages - docker slicing - docker builds - REST API Change-Id: Ib25a2df9f1a723861606355aea95f61d53495794 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-09Remove the judgement of OS_ENDPOINT_TYPELinda Wang1-5/+6
Remove the judgement of OS_ENDPOINT_TYPE when configuring [identity-feature-enabled] section in tempest.conf Change-Id: Ia0f6926cdd6e063c953358df5108b537917418bc Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-04Merge "Config physical network when creating tempest net"Cedric Ollivier3-0/+42
2018-01-04Merge "Configure physical_network when creating network"Cedric Ollivier5-8/+23
2018-01-04Merge "Remove the obsolete configs in config yaml"Cedric Ollivier1-5/+0
2018-01-03Modify cmd for parsershangxdy1-1/+1
The modification is related to https://gerrit.opnfv.org/gerrit/#/c/49649/ Change-Id: I51ec841da49dd05ee454896514a9e1b7761ee035 Signed-off-by: shangxdy <shang.xiaodong@zte.com.cn>
2018-01-03Remove the obsolete configs in config yamlLinda Wang1-5/+0
Change-Id: I389f3f4b09274529f92d7a74ebfb0cdd257c493a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-03Configure physical_network when creating networkLinda Wang5-8/+23
When the network_type is vlan, configuring physical_network and segmentation_id should be supported by snaps. JIRA: SNAPS-252 Change-Id: I2d3270a82991230385fdc18889ed5c5e979672b5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-29Disable keystone v2 if keystone v3 is availableLinda Wang1-4/+2
Change-Id: I9ae18ac6702b6bc1df80e5ff794307929e4aefb9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-29Merge "Update Alpine to 3.7"Linda Wang3-4/+4
2017-12-29Merge "Execute feature command by subprocess directly"Linda Wang2-28/+33
2017-12-28Update Alpine to 3.7Cédric Ollivier3-4/+4
It conforms with the last release [1] and Docker latest [2]. [1] https://alpinelinux.org/posts/Alpine-3.7.0-released.html [2] https://hub.docker.com/_/alpine/ Change-Id: I731b455bd9eb9900c7794643b8605bf73a15726d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-28Merge "Clean base images only if 1 container was built"Linda Wang1-4/+4
2017-12-27Execute feature command by subprocess directlyLinda Wang2-28/+33
Change-Id: I77e86af4e96310c6520d743e4d16c9a7b2e9adf5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-27Config physical network when creating tempest netLinda Wang3-0/+42
When the network_type is vlan, physical_network and segmentation_id could be configured. This also supports to config physical network when creating rally net. Change-Id: I9770968537c1509c5712eada66925a4bf8f6678c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-25Merge "Dynamic region name of juju cloud"Cedric Ollivier1-9/+14
2017-12-25Clean base images only if 1 container was builtCédric Ollivier1-4/+4
Change-Id: I0134082d2d150a6dc58e679f9ade81eb6c040266 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-23Clean Docker images after buildsJose Lausuch1-0/+4
Compared to the related Releng script, it only focuses on cleaning images. It's considered out of scope to remove remaining docker containers. It doesn't force to remove images because base images (e.g. Alpine) could be selected by other OPNFV projects too. It ensures O is returned even if one image cannot be removed. functest-core is removed at the end because all Functest containers depend on it. The script works well in a nominal building env. Any remaining Functest images or containers must be removed by hand. JIRA: FUNCTEST-898 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I72d8214b711680ec7958af1d427b23dee6337bf6 Signed-off-by: Jose Lausuch <jalausuch@suse.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-23Dynamic region name of juju cloudsoumaya1-9/+14
Region name in juju cloud has been made dynamic now, region name will be added in cloud file from os environment variable. It fixes the issues when runnit juju_epc vs Apex [1]. It also updates ubuntu images to xenial. [1] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-master/628/console Change-Id: I9422af3086141cd40b99e6482883a7081f58c2ea Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-23Add Docker build optsCédric Ollivier1-8/+3
Change-Id: I91fcb833b6b6216338b4fcb888f093a2086264a7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-22Add euphrates as a docker tag to the release notesJose Lausuch1-1/+2
Change-Id: I35080b3e701de6341926f86e8aa1910ef777f565 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-12-21Update cirros image to 0.4.0Michael Polenchuk7-18/+18
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-21Enable orchestra testcases for Daisy onlyCédric Ollivier2-4/+4
The current testcases have several issues which limit the possible successful runs to Daisy [1]. [1] https://jira.opnfv.org/browse/ORCHESTRA-17 Change-Id: Iecaf21738e19aae6a88171385f11afcffd28a348 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-21Merge "Get auth token when checking deployment"Cedric Ollivier2-2/+18
2017-12-21Merge "Remove logger_test_results"Cedric Ollivier3-68/+0
2017-12-21Merge "Suggest to pull manifests instead of arch tags"Cedric Ollivier1-3/+1
2017-12-21Merge "Remove openstack_[clean,snapshot]"Linda Wang13-1744/+1
2017-12-20Suggest to pull manifests instead of arch tagsCédric Ollivier1-3/+1
Change-Id: I17d45782feb38946f9524859354f24d392b56f25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-20Remove logger_test_resultsCédric Ollivier3-68/+0
It was only called in Feature which the result is already printed (see __str__()). It also eases moving Feature to xtesting as it breaks the link to functest_utils. Change-Id: Ib72d651dc7d89598704ff4d52d8b1ecb2bdade5b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>