aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-02-05Increase Rally full criteriaCédric Ollivier2-2/+2
Even if several tests are currently under investigation, it seems relevant to expect a full success here. Change-Id: I6a8c5fb5a7dd4bfb5c3a2e7a93de1c0bec77c878 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-04Update results printed in configguide.rstCédric Ollivier1-78/+77
It updates the entry points and all results. It also takes into account that: - juju_epc was added - fds was moved to features It should be noted that refstack_defcore, parser and several vnfs are failing from the time being. Change-Id: I918a7767005569f03115749ad121a6c7a04c04a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-04Fix links in configguide.rstCédric Ollivier1-13/+13
It also removes trailing whitespaces. Change-Id: I6a7e4aaff700a85ff1c0c2741624e9359441e0ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-03Fix JujuEpc prepare() and deploy_orchestrator()Cédric Ollivier1-173/+177
It bypasses a known unfixed Juju bug [1] by creating a second '_member_' user [1]. An 'admin' user is still required to create flavors and by snaps when listing virtual machines. It highlights a possible bug in user_creator.get_os_creds(). It partially rewrites the testcase by cleaning instance attributes and by taking several os.system() returns into account. It sets the new password automatically generated [2] and starts switching from openstack utils to snaps in vEPC. This patchset must be completed by unit tests and by another patch fully switching to snaps in the last methods. It should be noted that the testcase sets 8.8.8.8 as dns server which could raise side effects. [1] https://bugs.launchpad.net/juju/+bug/1710848 [2] https://gerrit.opnfv.org/gerrit/#/c/50747/ Change-Id: Id18b4b185aa1825196e91f6692338169f51faea8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-03Merge "Do not use shell to execute commands in tempest"Linda Wang2-19/+15
2018-02-02Merge "Stop setting ext net in config"Cedric Ollivier2-4/+1
2018-02-02Merge "Install vEPC dependencies in Dockerfile"Cedric Ollivier2-17/+9
2018-02-02Do not use shell to execute commands in tempestJuha Kosonen2-19/+15
Change-Id: I4d699481fdc63058c12ca9cfe18138e87025e9b3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-02Stop setting ext net in configCédric Ollivier2-4/+1
It simply relies on the related env var as expected. Change-Id: Ibbb1a2ab2cccdff8cafe6f409af383a24778b1f5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-02Merge "Fix a typo in docstring"Linda Wang1-1/+1
2018-02-01Rename a common credential file for OS and K8SLinda Wang14-70/+48
Change-Id: Ib8d24be4b29ab1de00d5dd5e3442146b2437cb94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-01Install vEPC dependencies in DockerfileCédric Ollivier2-17/+9
It also cleans sources and packages. Change-Id: Ie3a1a836c27af295b93386e8df63c0ae5accde84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-01Merge "Use snaps_utils to get credentials in tempest"Serena Feng3-11/+7
2018-01-31Fix a typo in docstringCédric Ollivier1-1/+1
Change-Id: I4826240a56141771df202b9b3b416d64d2db2cf4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-31Add tempest and rally in functest-featuresCédric Ollivier1-2/+21
SDNVPN also requires these packages. It would be refactored in a second step when xtesting is published. Change-Id: I069ecf8d60dc0ee1a755d0974913b686f4c7ae61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-31Merge "Removal of deprecated SNAPS-OO classes in juju_epc"Cedric Ollivier1-28/+21
2018-01-31Use snaps_utils to get credentials in tempestJuha Kosonen3-11/+7
Change-Id: I1d240d5edd536d71c87a7dff4e2676715697d0e2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-31Merge "Fix pylint errors/warnings in rally"Cedric Ollivier3-40/+41
2018-01-31Merge "proper instance status handling"Juha Kosonen1-1/+4
2018-01-30Removal of deprecated SNAPS-OO classes in juju_epcCédric Ollivier1-28/+21
It completes the first commit about that topic [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47617/ Change-Id: I1a55b45f0535ae98681546d4d24bb424cf892aa8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-30Fix pylint errors/warnings in rallyJuha Kosonen3-40/+41
JIRA: FUNCTEST-906 Change-Id: I484f9a291d5adbedb855450e4ff067dfa4a3b2ae Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-30Merge "Remove duplicated code related to snaps creds"Cedric Ollivier6-41/+24
2018-01-30Remove duplicated code related to snaps credsJuha Kosonen6-41/+24
Add support for providing credentials in snaps_utils. JIRA: FUNCTEST-916 Change-Id: I3e027229d213d3791a115920f7012309cc027712 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-29Fix pylint errors about refstackLinda Wang4-30/+37
JIRA: FUNCTEST-907 Change-Id: Ib08a88523c700d35894b9b89b7585425a02065c3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-29Merge "Create subnet and net within the same project"Cedric Ollivier1-0/+1
2018-01-29Merge "Enable epc unit tests"Cedric Ollivier3-2/+4
2018-01-29Merge "Fix warnings in all snaps-related modules"Cedric Ollivier14-184/+267
2018-01-29Merge "Fix pylint errors in several utils modules"Cedric Ollivier5-60/+56
2018-01-29Merge "Avoid duplicating get_parameter_from_yaml"Cedric Ollivier2-38/+24
2018-01-29Merge "Fix last Pylint error in Functest"Cedric Ollivier13-99/+126
2018-01-29Enable epc unit testsCédric Ollivier3-2/+4
It adds the missing __init__.py to activate vepc unit tests. They are disabled because they are currently false (otherwise it would block next changes). Change-Id: I65b32490efde4cc8f6b3d9e6ee19257dcf02c2dd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-29Fix the connect issue when checking deploymentLinda Wang2-5/+5
Socket.connect() requires only one param with type tuple. Change-Id: I63aa4633e80bde3ad5e1b5af9d67d8f46eb84571 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-29Create subnet and net within the same projectLinda Wang1-0/+1
It is required to create a network and subnet within the same project for some SUTs. Change-Id: Icd02edb0aebee93713f315cdbbeb021e9ae82dae Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-28Fix warnings in all snaps-related modulesCédric Ollivier14-184/+267
It also adds vping/__init__.py to stop skipping vping unit tests. It removes the useless import os which is not required for mock (here the mock patch was simply false). It should be noted that the code is partially duplicated between snaps_test_runner.py and vping_base_base.py. A small part of code has been rewritten to fix that without multi inheritance. Change-Id: I2e3e181ad7dab8aa41afb1e63d0b6795ff0d1610 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-27Merge "Refactor rally report generation"Cedric Ollivier2-113/+76
2018-01-26Fix pylint errors in several utils modulesCédric Ollivier5-60/+56
All utils which are moving to xtesting are now fixed. It remains OpenStack and Functest utils (+ the related unit tests) which doesn't move to the new package. Change-Id: If13c627c8444c62d5c6bf9c8057d6413aa0e56c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Avoid duplicating get_parameter_from_yamlCédric Ollivier2-38/+24
It switches to this helper which was locally copied. Change-Id: Iaa30d83e8c0e2d4472f4ef8fe1da4943e424ebb3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Fix last Pylint error in FunctestCédric Ollivier13-99/+126
It also fixes all pylint warnings in router and the related unit tests. tox.ini is updated to ensure that no error is introduced. Change-Id: Iddd74b0dac7b6581d72b04369140006c9e19f998 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Refactor rally report generationJuha Kosonen2-113/+76
- statistic data based on Rally results report - fix statistics calculations - use PrettyTable in generating the report Change-Id: Ic84adc5e30d446aea1f3045ba997c3ddf895e9f5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-26proper instance status handlingPeriyasamy Palanisamy1-1/+4
This would fix the exception happening in the SDNVPN CI testsuite. Example: http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-01-21_17-18-06/bgpvpn.log Change-Id: Ie22dcdbba5299177d4e98e5995433553df5bfa68 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-01-24Fix pylint warnings/errors in cliCédric Ollivier11-142/+113
cli_testcase and cli_tier have been refactored to avoid duplicating code. Then functest/cli and funtest/unit/cli can be added to the list of modules rated 10/10. Change-Id: Iec90e806397248a10f39080ec554e3f0a6eda7c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Delete functest_vacation.pyCédric Ollivier3-66/+4
Change-Id: Id0e2769a1989e6778ae41f67ed634e2e5002a83d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Merge RegexMatch into test_cli_env.pyCédric Ollivier2-34/+13
It also deletes SubstrMatch which is not called (then uncovered). Change-Id: Ifde1e2491ab5e0e75652eb4b25b359e859c2aa95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Disable all missing-docstring warnings in unit testsCédric Ollivier18-2/+33
Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Partially rewrite test_run_tests.pyCédric Ollivier3-91/+86
It mainly fixes pylint issues and leverages on decorators. It should be noted that run_tests.py is not fully covered (see xtesting requirements). Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Fully test and cover functest/ci/tier_*Cédric Ollivier7-252/+338
It also fixes check_deployment.py and ci unit tests which were wrong when testing exceptions. Now ci modules are rated 10/10 and fully covered. Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Move push_results_to_db to TestCaseCédric Ollivier6-309/+192
It removes the link between TestCase and Functest utils (xtesting). It should be noted that testresults url can only be set by env var. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ie072c675890d0ae2e63619c599d2684a8c7d762d Signed-off-by: Jose Lausuch <jalausuch@suse.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-20Configure password for the user in vnfLinda Wang6-15/+16
For some SUTs, the password for creating user is not allowed to be the same as user name, and some even is required to contain at least 8 characters and three types of characters for security. It also turns yamllint warnings into errors and fixes the remaining warnings. Change-Id: Icf25a7b9ff1c8cee55899198f1e519c9209877ff Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-17Merge "Fix Rally output retrieval"Linda Wang2-15/+4
2018-01-16Fix Rally output retrievalJuha Kosonen2-15/+4
Read stdout until nothing left instead of stopping once the child process is terminated. Change-Id: I46a2eb93fd614e2e7ff676727eb9dc132c29d03f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>