aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-02-06Disable orchestra_* testcasesCédric Ollivier1-0/+2
They can be simply disabled and they unsuccessfully run vs Daily only. In a second step, moving the related python modules in a new orchestra repository could be a good solution simply because they don't reach our coding criteria. The best way is still to update them according to our rules and to check all installers thanks to these two vnfs. Change-Id: If36b16f0ed95d7039db9455a32c18f7fd1a739ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Stop printing data sent to DBCédric Ollivier1-1/+1
https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastFailedBuild/console Change-Id: I0f794159d05fe21f659ecf3b5a9fa407620b723d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Fix docstringsCédric Ollivier2-1/+5
Else sphinx can't parse snaps_suite_builder.py and IxRestUtils.py. Change-Id: Iab231a043120154bce708263474b9f9926c1f715 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Blacklist Quotas.nova_update_and_delete testJuha Kosonen1-0/+10
Excluded since the test occasionally fails due to race condition issue on quota manipulation in nova [1]. [1] https://bugs.launchpad.net/nova/+bug/1552622 Change-Id: Ib979c1e371727aa3adea9dc0b5955e7ed24881cf Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-05Merge "Add modules docstrings in snaps"Juha Kosonen6-6/+12
2018-02-05Increase Rally full criteriaCédric Ollivier1-1/+1
Even if several tests are currently under investigation, it seems relevant to expect a full success here. Change-Id: I6a8c5fb5a7dd4bfb5c3a2e7a93de1c0bec77c878 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Add modules docstrings in snapsLinda Wang6-6/+12
JIRA: FUNCTEST-922 Change-Id: I058486427fe55e1d1ce939fce20d75ff7afde85c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-03Fix JujuEpc prepare() and deploy_orchestrator()Cédric Ollivier1-173/+177
It bypasses a known unfixed Juju bug [1] by creating a second '_member_' user [1]. An 'admin' user is still required to create flavors and by snaps when listing virtual machines. It highlights a possible bug in user_creator.get_os_creds(). It partially rewrites the testcase by cleaning instance attributes and by taking several os.system() returns into account. It sets the new password automatically generated [2] and starts switching from openstack utils to snaps in vEPC. This patchset must be completed by unit tests and by another patch fully switching to snaps in the last methods. It should be noted that the testcase sets 8.8.8.8 as dns server which could raise side effects. [1] https://bugs.launchpad.net/juju/+bug/1710848 [2] https://gerrit.opnfv.org/gerrit/#/c/50747/ Change-Id: Id18b4b185aa1825196e91f6692338169f51faea8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-03Merge "Do not use shell to execute commands in tempest"Linda Wang2-19/+15
2018-02-02Merge "Stop setting ext net in config"Cedric Ollivier2-4/+1
2018-02-02Merge "Install vEPC dependencies in Dockerfile"Cedric Ollivier1-17/+0
2018-02-02Do not use shell to execute commands in tempestJuha Kosonen2-19/+15
Change-Id: I4d699481fdc63058c12ca9cfe18138e87025e9b3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-02Stop setting ext net in configCédric Ollivier2-4/+1
It simply relies on the related env var as expected. Change-Id: Ibbb1a2ab2cccdff8cafe6f409af383a24778b1f5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-02Merge "Fix a typo in docstring"Linda Wang1-1/+1
2018-02-01Rename a common credential file for OS and K8SLinda Wang11-51/+29
Change-Id: Ib8d24be4b29ab1de00d5dd5e3442146b2437cb94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-01Install vEPC dependencies in DockerfileCédric Ollivier1-17/+0
It also cleans sources and packages. Change-Id: Ie3a1a836c27af295b93386e8df63c0ae5accde84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-01Merge "Use snaps_utils to get credentials in tempest"Serena Feng3-11/+7
2018-01-31Fix a typo in docstringCédric Ollivier1-1/+1
Change-Id: I4826240a56141771df202b9b3b416d64d2db2cf4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-31Merge "Removal of deprecated SNAPS-OO classes in juju_epc"Cedric Ollivier1-28/+21
2018-01-31Use snaps_utils to get credentials in tempestJuha Kosonen3-11/+7
Change-Id: I1d240d5edd536d71c87a7dff4e2676715697d0e2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-31Merge "Fix pylint errors/warnings in rally"Cedric Ollivier2-39/+38
2018-01-31Merge "proper instance status handling"Juha Kosonen1-1/+4
2018-01-30Removal of deprecated SNAPS-OO classes in juju_epcCédric Ollivier1-28/+21
It completes the first commit about that topic [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47617/ Change-Id: I1a55b45f0535ae98681546d4d24bb424cf892aa8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-30Fix pylint errors/warnings in rallyJuha Kosonen2-39/+38
JIRA: FUNCTEST-906 Change-Id: I484f9a291d5adbedb855450e4ff067dfa4a3b2ae Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-30Merge "Remove duplicated code related to snaps creds"Cedric Ollivier6-41/+24
2018-01-30Remove duplicated code related to snaps credsJuha Kosonen6-41/+24
Add support for providing credentials in snaps_utils. JIRA: FUNCTEST-916 Change-Id: I3e027229d213d3791a115920f7012309cc027712 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-29Fix pylint errors about refstackLinda Wang3-30/+35
JIRA: FUNCTEST-907 Change-Id: Ib08a88523c700d35894b9b89b7585425a02065c3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-29Merge "Create subnet and net within the same project"Cedric Ollivier1-0/+1
2018-01-29Merge "Enable epc unit tests"Cedric Ollivier3-2/+4
2018-01-29Merge "Fix warnings in all snaps-related modules"Cedric Ollivier13-184/+263
2018-01-29Merge "Fix pylint errors in several utils modules"Cedric Ollivier4-59/+51
2018-01-29Merge "Avoid duplicating get_parameter_from_yaml"Cedric Ollivier2-38/+24
2018-01-29Merge "Fix last Pylint error in Functest"Cedric Ollivier12-99/+123
2018-01-29Enable epc unit testsCédric Ollivier3-2/+4
It adds the missing __init__.py to activate vepc unit tests. They are disabled because they are currently false (otherwise it would block next changes). Change-Id: I65b32490efde4cc8f6b3d9e6ee19257dcf02c2dd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-29Fix the connect issue when checking deploymentLinda Wang2-5/+5
Socket.connect() requires only one param with type tuple. Change-Id: I63aa4633e80bde3ad5e1b5af9d67d8f46eb84571 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-29Create subnet and net within the same projectLinda Wang1-0/+1
It is required to create a network and subnet within the same project for some SUTs. Change-Id: Icd02edb0aebee93713f315cdbbeb021e9ae82dae Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-28Fix warnings in all snaps-related modulesCédric Ollivier13-184/+263
It also adds vping/__init__.py to stop skipping vping unit tests. It removes the useless import os which is not required for mock (here the mock patch was simply false). It should be noted that the code is partially duplicated between snaps_test_runner.py and vping_base_base.py. A small part of code has been rewritten to fix that without multi inheritance. Change-Id: I2e3e181ad7dab8aa41afb1e63d0b6795ff0d1610 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-27Merge "Refactor rally report generation"Cedric Ollivier2-113/+76
2018-01-26Fix pylint errors in several utils modulesCédric Ollivier4-59/+51
All utils which are moving to xtesting are now fixed. It remains OpenStack and Functest utils (+ the related unit tests) which doesn't move to the new package. Change-Id: If13c627c8444c62d5c6bf9c8057d6413aa0e56c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Avoid duplicating get_parameter_from_yamlCédric Ollivier2-38/+24
It switches to this helper which was locally copied. Change-Id: Iaa30d83e8c0e2d4472f4ef8fe1da4943e424ebb3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Fix last Pylint error in FunctestCédric Ollivier12-99/+123
It also fixes all pylint warnings in router and the related unit tests. tox.ini is updated to ensure that no error is introduced. Change-Id: Iddd74b0dac7b6581d72b04369140006c9e19f998 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Refactor rally report generationJuha Kosonen2-113/+76
- statistic data based on Rally results report - fix statistics calculations - use PrettyTable in generating the report Change-Id: Ic84adc5e30d446aea1f3045ba997c3ddf895e9f5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-26proper instance status handlingPeriyasamy Palanisamy1-1/+4
This would fix the exception happening in the SDNVPN CI testsuite. Example: http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-01-21_17-18-06/bgpvpn.log Change-Id: Ie22dcdbba5299177d4e98e5995433553df5bfa68 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-01-24Fix pylint warnings/errors in cliCédric Ollivier10-142/+111
cli_testcase and cli_tier have been refactored to avoid duplicating code. Then functest/cli and funtest/unit/cli can be added to the list of modules rated 10/10. Change-Id: Iec90e806397248a10f39080ec554e3f0a6eda7c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Delete functest_vacation.pyCédric Ollivier3-66/+4
Change-Id: Id0e2769a1989e6778ae41f67ed634e2e5002a83d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Merge RegexMatch into test_cli_env.pyCédric Ollivier2-34/+13
It also deletes SubstrMatch which is not called (then uncovered). Change-Id: Ifde1e2491ab5e0e75652eb4b25b359e859c2aa95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Disable all missing-docstring warnings in unit testsCédric Ollivier18-2/+33
Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Partially rewrite test_run_tests.pyCédric Ollivier2-88/+85
It mainly fixes pylint issues and leverages on decorators. It should be noted that run_tests.py is not fully covered (see xtesting requirements). Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Fully test and cover functest/ci/tier_*Cédric Ollivier6-251/+332
It also fixes check_deployment.py and ci unit tests which were wrong when testing exceptions. Now ci modules are rated 10/10 and fully covered. Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Move push_results_to_db to TestCaseCédric Ollivier6-309/+192
It removes the link between TestCase and Functest utils (xtesting). It should be noted that testresults url can only be set by env var. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ie072c675890d0ae2e63619c599d2684a8c7d762d Signed-off-by: Jose Lausuch <jalausuch@suse.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>