summaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-06-29Merge "Increase timeout of Open Baton installation" into stable/danubeJose Lausuch1-2/+2
2017-06-27Updated fds testcase criteriajuraj.linkes1-1/+1
Initially, we only executed fds testcase on odl_l2 fdio scenarios. Now we're extending this to all odl fdio scenarios. Change-Id: Ieb2454f02847361fdf3274b11f20a996a916ad90 Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2017-06-27Increase timeout of Open Baton installationMichael Pauls1-2/+2
Change-Id: Ifdc24a3fc9e2c315b41f9e68bccb88df36252b0c JIRA: ORCHESTRA-14 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de> Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-06-27Merge "Remove Domino from apex/Danube" into stable/danubeMorgan Richomme1-1/+1
2017-06-26Fix VIM onboarding and ims deploymentMichael Pauls2-12/+52
VIM onboarding: check for API version of OpenStack -> support of v2 and v3 ims deployment: fix userdata in order to wait for EMS registration Change-Id: Id0932232ddb1f1163ef3c37460bc88b71b9c0bdd Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de> (cherry picked from commit 0cbe545a4ebda5b37b682b46d849198648a7efe1)
2017-06-26Remove Domino from apex/DanubeMorgan Richomme1-1/+1
Change-Id: Iba8bb7b1df1686b1bba8f8e2fe8c4c6e2a88d44c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-16Merge "Remove the former results in DB url" into stable/danubeJose Lausuch2-7/+7
2017-05-15Logger must be a singletonCédric Ollivier1-0/+7
It avoids creating a python object for every message printed. Change-Id: Ia42b59db9f7ce4eadc7e91da4d193db646b54d85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0acb8eb018afd993c363c05da8a45091abc59fd9)
2017-05-13Remove the former results in DB urlCédric Ollivier2-7/+7
It conforms generate_report.py with the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/33511/ Conflicts: functest/tests/unit/ci/test_generate_report.py Change-Id: I677ebd416f462a591439fc7b637c02d7964e6173 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a212763c3e9f4cf6d52200aa614e42a911c5dbf7)
2017-05-13rename tempest.conf to refstack_tempest.confMatthewLi2-3/+3
since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 8bbfda2df0a3a10d069a41c0f074b0de69737767)
2017-05-13Stop hardcoding results suffix in push_to_dbMatthewLi3-6/+7
Adding results in url is useless as it is defined in results section in config_functest.yaml. It allows defining the full name in case of dumping to file (see decorator.py). The commented local file is the value required by dovetail. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I35ba9b34d99e138292f099934e28585ee8b85604 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7e15dbb5136b1b298d86a82c03199bf1f7a6fe46)
2017-05-13refstack client: improvement and fix of TestCase usageMatthewLi2-12/+10
JIRA: FUNCTEST-772 1, RefstackClientParser should not be a subclass of TestCase 2, tempest_conf.py used for generating reference tempest.conf file not related to functest cmd, use logger is enough Conflicts: functest/opnfv_tests/openstack/refstack_client/refstack_client.py Change-Id: If9c37331a5a7687e5704e546efcdea8175b1529c Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 2f0b1281308cb494d83240eaa5137ca0524718b7)
2017-05-13refstack: bugfix of name TestCaseMatthewLi2-4/+4
JIRA: FUNCTEST-758 Change-Id: I1b90597c9745faa67afa58e5653f72411a95aa3d Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit d2b8732ef3670586e28c40f5cec4e1ff42e22d37)
2017-05-13refstack client: manually running improvementMatthewLi2-28/+78
JIRA: FUNCTEST-758 1.python tempest_conf.py can generate a reference tempest.conf under /hom/opnfv/.../refstack_client this is based on "rally verify configure-verifier" surely, user can define his/her own tempest.conf by not using this 2.python refstack_client.py -c <tempest_conf_path> --testlist <testlist_file_path> if not given, will use default path, if file not exists, will have error Change-Id: I1ceecbe8fe86fbe0d53b736a0f3b9a9ae01f262f Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 678d5f956b1af373f61f97187ff3e66fdb315654)
2017-05-13Rename testcase_base to testcaseCédric Ollivier18-112/+112
It simply removes the useless suffix. Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 69e51470d8e9f51e02d5f0bd6e957c4e24c603c6)
2017-05-13Switch TestcaseBase to TestCaseCédric Ollivier18-108/+108
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and removes the useless suffix too. [1] https://gerrit.opnfv.org/gerrit/#/c/25391/ Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 407d27585f109e3381bb49041abc49a14b7b5bfe)
2017-05-04refstack-client userguideMatthewLi1-1/+8
JIRA: FUNCTEST-758 container setup steps are skipped, since they already included in the functest userguide documents. Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 11826f38829dd5952830d6d2e50ac4918be528f1)
2017-04-26Bugfixing the testcases execusionNikolas Hermanns1-2/+1
tempest.api.compute.servers.test_server_actions\ .ServerActionsTestJSON.test_reboot_server_hard is working in fuel so do test it. The "-" was missing on tempest.scenario.test_server_basic_ops .TestServerBasicOps.test_server_basic_ops Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com> (cherry picked from commit f85b54b8fc8843897f9c1a7b4711b489ab29f297)
2017-04-07Increase ram for tempest tests (aarch64)Cristina Pauna1-2/+2
The following tests fail on armband because the VM cannot boot. tempest.api.compute.servers.test_server_actions. ServerActionsTestJSON.test_reboot_server_hard tempest.scenario.test_network_basic_ops. TestNetworkBasicOps.test_network_basic_ops tempest.scenario.test_volume_boot_pattern. TestVolumeBootPattern.test_volume_boot_pattern tempest.scenario.test_volume_boot_pattern. TestVolumeBootPatternV2.test_volume_boot_pattern The reason for the failure is that the 128 ram is insufficient for the image to boot. The fix consists in increasing the ram to 256 JIRA: ARMBAND-61 Change-Id: I5be1a44a8038b4952cca100511e8d08b7a37681c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com> (cherry picked from commit 5a417f076549941e0dae176849045aab32bf0be5)
2017-03-31Make tempest cleanup resources after runningLinda Wang1-4/+4
JIRA: FUNCTEST-773 1. When running refstack_defcore, create tenant and user failed due to conflict with those created when runnning tempest_smoke_serial. 2. Clean all resources created for tempest_smoke_serial. Change-Id: Icf8ec95f6db0b2f93bf6c56ec10a6e8ea1a91ab1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit f94a1744e7a4d3a48466b6171a205e1ed84026d7)
2017-03-30Merge "Check a rule existence for a specific security group" into stable/danubeJose Lausuch2-0/+89
2017-03-30Check a rule existence for a specific security grouptomsou2-0/+89
Implement a functionality to check if a rule concerning a specific security group exists - function get_security_group_rules(neutron_client, sg_id) returns the list of the security rules for a specific security group - function check_security_group_rules(neutron_client, sg_id, direction, protocol, port_min=None, port_max=None) checks if a specific rule for a specific security group exists and returns True or False - implement unit tests for the two new functions This new functionality is needed for sdnvpn project Change-Id: Ib930bc9a76141932f4164d88e2640b49f3df4d77 Signed-off-by: tomsou <soth@intracom-telecom.com> (cherry picked from commit 41b103d9a6804a97ca85e2b09b628cea06219faf)
2017-03-30Re-enable rally and tempest full for weeklyjose.lausuch1-43/+31
Change-Id: I640531ebcc471adebe780c75627d822cf8fd956d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 6c9981cf03127c847481235e2b26377ecd108c2d)
2017-03-30Merge "Clean up Tempest blacklist" into stable/danubeJose Lausuch1-20/+0
2017-03-30Clean up Tempest blacklistjose.lausuch1-20/+0
This list has been generated in Colorado and there are some scenarios that are deprecated and there is no need to list them here. Change-Id: I62a30b5026ed1df65ebdb7a68a6acf3364469865 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 69de5300f0a5b75aed99a24a809f852498dc0695)
2017-03-30Disable tempest server reboot test for SDNVPN and GluonGeorg Kunz1-0/+12
Bug report: https://bugs.opendaylight.org/show_bug.cgi?id=5586 As a result, floating IPs are not working in Apex at the moment. Change-Id: I437c10b53dc01810ed757f040d3378c92320274b Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com> (cherry picked from commit 9fba4aed6b8f2ef1c939498d866f2cae57b89246)
2017-03-28Revert "Make SFC test a python call to main()"George Paraskevopoulos1-4/+2
This reverts commit d5820bef80ea4bdb871380dbfe41db12290fc5f8. Robot test runs before SFC test and it imports https://github.com/robotframework/SSHLibrary which does a monkey patching in the python runtime / paramiko. Untill now sfc run in a new python process (clean) because it run using the bash command. But when importing it as a module and call main() from python, it will run in the patched runtime and it will error out. https://hastebin.com/iyobuxutib.py Change-Id: I54237c32c957718b363d302efe84e01bc78e4f47 Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com> (cherry picked from commit e59055e29b5cc6a027d3a24803cc05fd709cca90)
2017-03-28Remove vping_ssh from bgpvpn and gluon scenarioNikolas Hermanns1-1/+1
Cause of the bug: https://bugs.opendaylight.org/show_bug.cgi?id=5586 Floating ip is not working at the moment for us. We don't want to remove the vping_ssh test from fuel. the scenarios are called different in fuel and in apex. odl-bgpvpn in apex. odl_l2-bgpvpn in fuel. Change-Id: Iaa2e6cea8a4fdb8635f018427aaf30634fd8d2d5 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com> (cherry picked from commit 5af67bcca589c275b73fe5e4bca9bea5871948aa)
2017-03-27Merge "Fix pylint warnings in test_testcase_base" into stable/danubeCedric Ollivier1-5/+6
2017-03-27Changing project name of vRouterShuyaNakama1-1/+1
JIRA: FUNCTEST-769 When pushing result to DB in vRouter module an error occurred. couse is wrong project name. We changed project name from "vRouter" to "functest". Change-Id: I8b8289b48330b17b6d6620524024dea4f488e38a Signed-off-by: Shuya Nakama <shuya.nakama@okinawaopenlabs.org> (cherry picked from commit 9439d684449825f8d580c26b1b9475ccbdde698a)
2017-03-27Fix pylint warnings in test_testcase_baseCédric Ollivier1-5/+6
It takes into account the following warnings: - wrong-import-order - no-value-for-parameter The 'no-value-for-parameter' warnings are false positive. The added default values are useless but avoid them. Change-Id: I50d0af178d9da668a3c72e75f5af467d36ca0e6a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e7440f39c66121cf915f156897c0a7d0e2af2951)
2017-03-27Fix pylint warnings in testcase_baseCédric Ollivier1-2/+3
It takes into account the following warnings: - bare-except - unused-argument - broad-except Change-Id: I3a50bf6d07823edc80a7f0f78f46681ace7f4a39 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e4d7506a5a21550a89f897dfaea3f0dcae352e5b)
2017-03-25Merge "Change api version" into stable/danubeJose Lausuch1-2/+2
2017-03-25Printing the flavor_metadata for SnapsTestRunnerrandyl1-1/+4
Need to print what is being tested to debug and verify results. JIRA : FUNCTEST-768 This is needed by the Apex team for the danube release. Change-Id: Ie7400af14f7e54d1deb5b2b5d2fc91eb5b14ca91 Signed-off-by: randyl <r.levensalor@cablelabs.com> (cherry picked from commit 16cda37220675370bb18ab06079d829fcd9f6050)
2017-03-25Change api versionDimitri Mazmanov1-2/+2
The api_version had full API url instead of just the version. Change-Id: I78b39ea5d39e1ffab54d2bca41df96aadd47ac86 Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> (cherry picked from commit 3fb0175dab6d60af2fe40274fab19abf3ea6162f)
2017-03-24Clean redundant error logs of refstack_defcore in the consoleLinda Wang2-15/+16
1. Remove the file "refstack-error.log", and all the stderr and stdout will be stored in refstack.log 2. Clean redundant error logs in the console and all the detailed error logs will be found in refstack.log. Change-Id: I7e71567c98dc89c529421eccbf1b497962b07405 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 0a07e0f686d9aaaa12b6445e99a67e0a7f7dbbd0)
2017-03-23Fix VIM onboardingMichael Pauls1-1/+7
Usage openstack client in order to get project id directly Change-Id: Id75dcd594430501152c3ba02a969ac1a2aaaadc5 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de> (cherry picked from commit 84a87e788b47d5a8fa3565195672fdddd35f4cf0)
2017-03-23Merge "Replace domain name from Default to default" into stable/danubeMorgan Richomme1-1/+5
2017-03-23Merge "Support running on openstack which enabled https" into stable/danubeMorgan Richomme3-10/+42
2017-03-23Support running on openstack which enabled httpshelenyao3-10/+42
JIRA: FUNCTEST-757 Change-Id: Ic87bee3020b9714bcd83105127440a9c1a7ff2ad Signed-off-by: helenyao <yaohelan@huawei.com> (cherry picked from commit 4a989722feca53e1baa6f64985841bd6a244d627)
2017-03-23Replace domain name from Default to defaultDimitri Mazmanov1-1/+5
The tests don't pass if the domain name is Default. Instead the domain id 'default' should be used. Change-Id: Ife919f79f007ab3fea3d53744634a92ddb172c23 Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> (cherry picked from commit d832b215a844cc2e0008eb0a86b689830e0277bb)
2017-03-23[fuel] Skip test_server_basic_ops tempest testMichael Polenchuk1-0/+16
Tempest ssh client is hanging on opendaylight enabled envs (getting deadlock in paramiko recv_exit_status method) while trying to execute a command on a vm. Change-Id: I6660cebc6bc44a5f02e6a1e83ee9a61bae141746 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 1b2db725757ef1c444e094db45287b291ad9f3a6)
2017-03-23Ignore certain modules for loggingjose.lausuch1-1/+12
Some modules are logged to functest.log or the console and are not relevant for us since they are already in the openstack logs. This causes a huge log which makes it unreadable. Change-Id: I3f0fb83e2080e41cd5bf815f8448f5bc25e3464a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit d6f4f25e6269a23120b37f58178164740f1cf0e9)
2017-03-23Enable functest offline by installing tempest system wideLinda Wang1-1/+1
JIRA: FUNCTEST-764 1. When creating verifier via rally in functest env prepare, without the parameter "--system-wide", rally will install tempest and its dependent packages into the virtual env of rally. Thus, it needs to connect internet when installing tempest, which will not enable functest offline. 2. Some packages are needed for multisite testcase, and they are installed in virtual env of rally before. But if "--system-wide" is set, there packages should be installed addtionally. Change-Id: I340701e9ed4a0f8f278ff952f0dd61470c6deed1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 264896f475e3f0975754c9fa78980051661698c0)
2017-03-23Switch test_db_url to a directoryxudan2-1/+10
We must now set a dir (e.g. /home/opnfv/db) to dump results. It avoids replacing "results" and prevent from limiting the use of this decorator. All data will be dumped into url/dump.txt As also proposed in FUNCTEST-729, missing directories are created too. The decorator will raise exceptions if dir exists or if target is not a directory. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-729 Change-Id: I9650c72493043539f17725f5c328c12639ecc059 Signed-off-by: xudan <xudan16@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 18bdde48e866f198b5d08b62fc9e26e3dfe4e818)
2017-03-23Make SFC test a python call to main()jose.lausuch1-2/+4
Instead of python -> bash -> python, call the SFC test using the execute() method that is inherited from FeatureBase and it's a bash call by default. With this change, we call the SFC test using main() of run_tests.py of SFC repo and will have real time output. Change-Id: I6d59821e603c88697a82b95c5626c5b703c11026 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com> (cherry picked from commit d5820bef80ea4bdb871380dbfe41db12290fc5f8)
2017-03-23refstack: bugfix of testcase failureMatthewLi2-2/+2
JIRA: DOVETAIL-366 JIRA: DOVETAIL-758 1)for compass, joid, failure log https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull volume_device_name should be set vdb. for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc testcase test_attach_detach_volume is not dynamic enough, to skip temporarily. 2)rename defcore_201608.txt to defcore.txt since this file is the default running file, can be changed as version changes. and will be easy for dovetail to consume with a general name rather than a special name. then dovetail can define the testcases to replace this file when running. Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 9ae14f931da5baf42a3b62eef49c644e762405fc)
2017-03-22Disable blocking status for odl_netvirtJamo Luhrsen1-1/+1
Change-Id: I4a3f10a82d3109a44f8db237cbd7beda06a361da Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com> (cherry picked from commit 569182f4b24de6b0f020754d717129a82d19930b)
2017-03-22bugfix: fail to push odl-sfc test result to TestDBSerenaFeng1-1/+1
'functest-odl-sfc"' will appear as [functest-odl-sfc"], tailing with ", it is not defined in TestDB. led to failure pushing Change-Id: I43966236e25578aed12952710b22ba99e244cf56 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 3137017fd435547abdcc2df0d73be5f1b2ef443a)
2017-03-22Update keys of details dic for refstack_defcoreLinda Wang1-3/+3
Update the keys of details in refstack_defcore ("num_tests", "num_failures", and "failed") to "tests", "failures" and "errors", in order to be consistent with those in tempest. Change-Id: I24f8a23548ffa253621083bbf6eb988306fd6edb Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 93d5bf2ad47f431bfab173ed718bb7469b67514f)