summaryrefslogtreecommitdiffstats
path: root/sdnvpn/test/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-05-29Re-enabling execution of tempest testsGeorg Kunz1-1/+2
My previous patch broke the execution of tempest tests, causing tempest to complain about a missing .testr.conf file. This fix adds the explicit use of the --config-file CLI flag back to the tempest test framework. Change-Id: If65c65a227f0058180e0d5bca47cce502948c4c9 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-23potential fix for attaching router with external network gatewayPeriyasamy Palanisamy1-0/+8
In the CI environment, whenever testcases attaches a router with external network gateway sometimes it throws the error "No more IP addresses available on network". This could be due to stale floating ip's exist in the deployment which is cleaned up now before executing sdnvpn testsuite. JIRA: SDNVPN-212 Change-Id: I027a833f13b1bdddd83dc8c7e7f7292e20b10bb8 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-05-11Fixing invocation of Tempest testsGeorg Kunz1-10/+1
Only 7 bgpvpn Tempest tests were run by the SDNVPN Tempest test instead of the full set of Tempest tests. This patch fixes and simplifies the invocation of bgpvpn Tempest tests. Change-Id: I1b207ea3da27dd43ab034b84f81992a5e0be2ec1 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-08SDNVPN-99 NAT doesn't seem to workPeriyasamy Palanisamy1-35/+42
Currently ODL is not able to accomodate both network and router in a BGPVPN instance (https://jira.opendaylight.org/browse/NETVIRT-932 - see the comment section). So until the fix is available, testing NAT functionality using router without bgpvpn instance across subnets. Change-Id: I6bedfc8e818ddd542036a87245caf4949152d66f Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-04-19Make sdnvpn logging properPeriyasamy Palanisamy13-82/+67
* Currently no log messages are getting written into log file due to file handler is registered for logger object created at different modules. Now corresponding handler is registered for logger objects. * Making sdnvpn Feature class to use its parent class logger object to avoid unnecessary logger object creation. Change-Id: I4ec61951ba4ac39cecc137dbb818da72f0b43b35 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-04-11Merge "testcase_10 intermittent failure"Periyasamy Palanisamy1-5/+12
2018-04-09testcase_10 intermittent failurePeriyasamy Palanisamy1-5/+12
There are vm monitor threads running incorrectly which causes this testcase to fail intermittently. It is fixed properly now. Change-Id: I61abf7e33700abdcb2e9ab7cfa72f6e3ad6c7a67 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-04-09router and network association failurePeriyasamy Palanisamy1-3/+4
comment few sub tests till ODL provides fix for BGPVPN having both router and network association: https://jira.opnfv.org/browse/SDNVPN-94. Till then let us comment required subtests in testcase_4.py and update the release note for fraser. Change-Id: I498ee95c74b525f65e40a540e0f1162d78ec5504 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-03-09workaround for bgpvpn tempest runPeriyasamy Palanisamy1-3/+10
Adding tempest.conf file in the /etc/tempest directory as it is needed for tempest run command. Change-Id: I754dca76908014dcbb17e82a2e7b561d4826bff0 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-03-08potential fix for custom flavor creation issuePeriyasamy Palanisamy2-4/+4
Change-Id: Ic079e6d699927a400ca5f1530b18efacf3465629 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-03-08Move import_modules inside try blockPeriyasamy Palanisamy1-1/+6
Its still sdnvpn testsuite is failing at testcase_8 for bgpvpn ha scenario whereas it runs fine in the local setup. There is no logs generated from the CI run, moving import_modules inside try block and added few info logs to find out what is going on CI setup. [1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-03-03_23-12-24/bgpvpn.log [2] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-master/827//console Change-Id: Icffa48cd56222bc1063ca16704e90a899380634d Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-03-06remove block comment for testcase_8Periyasamy Palanisamy1-11/+9
somehow bgpvpn testsuite is not running in the bgpvpn-ha ci loop because of testcase_8. when bgpvpn tries to execute this testcase, somehow execution is stopped and no logs being generated from the setup. The only different is this testcase is having block comment with delimeter and this is being imported as a module inside run_sdnvpn_tests. Hence replacing block comment with single line comments. This issue is very sporadic even in the local setup and running fine after changing it with single line comments. Change-Id: I5d71ec2a8c532b5dd77b2136ca7e95a7838683dc Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-03-02Switch to XtestingCédric Ollivier1-4/+4
It inherits from xtesting.core.feature [1]. [1] http://xtesting.readthedocs.io/en/latest/apidoc/xtesting.core.feature.html Change-Id: I3d64bce859de7132384b3cf0a6383348cc20b3b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01update python modules shebang line for python intrepreter directivePeriyasamy Palanisamy12-11/+13
Change-Id: I1929a5b86a89a96fbf5c21b3bc419c9237034aba Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-03-01fix for sdnvpn testsuite execution stops abruptlyPeriyasamy Palanisamy1-1/+1
* updated the recommended shebang line for python intrepreter directive Change-Id: Icd3023f03c8b5524afcb5d600a9d03749496acea Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-02-27Merge "Update the way of running tempest"Periyasamy Palanisamy2-7/+18
2018-02-27Update the way of running tempestLinda Wang2-7/+18
Use 'tempest run' instead of 'run_tempest.sh', which has been removed by tempest 16.0.0 Also, 'tempest.py' has been renamed to 'run_tempest.py', to avoid package importing conflict Change-Id: I61e802e0381d1f33281610e98d05813c9b96faf9 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-26Stop relying on internal Functest utilsCédric Ollivier1-2/+1
It switches from functest_utils.get_functest_config() to config.CONF(). download_url is now hosted in sfc as it's unused by Functest. The next functions will be considered as part of Functest framework (then it must be well covered and documented): - ft_utils.execute_command_raise() - ft_utils.execute_command() - ft_utils.get_parameter_from_yaml() Change-Id: I076c6ced430df8387de8eaeac6f3a94d93201b19 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-26Host openstack utils in SDNVPNCédric Ollivier11-12/+12
SDNVPN is the last project using the deprecated openstack utils which are being removed from Functest tree. All methods unused by SDNVPN could be safely removed in a second change. This patch aims at publishing them asis. Change-Id: I4e479e6def2c691799c9bd86ba325e3d1544ef0d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-23Fixing return value in tempest test suiteGeorg Kunz1-1/+1
The result processing framework of the SDNVPN project expects "FAIL" as value for failed sub-tests to determine the overall result. The value returned by the tempest sub-tests was "FAILED", causing incorrect reporting to Functest. Change-Id: I320e6f1fb1fc7ee540813e454484b11bd5b227b2 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-02-19resync and ecmp testcase failurePeriyasamy Palanisamy2-27/+32
This provide fix for resync and ecmp test case failures at the CI master runs. Please have a look at the comments in each testcase for more details. Change-Id: I26c40da144e34a48ad44897988675db8d37c062a Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-02-15Merge "fix for sdnvpn CI test failure"Periyasamy Palanisamy1-0/+1
2018-02-15Use bgvpn-delete and create instead of updatetomsou2-10/+84
Testcases 1 and 4 fail because of netvirt bug [1] The same functionality is now achieved by using bgvpn-delete and bgpvpn-create cli commands instead of bgpvpn-update [1] https://jira.opendaylight.org/browse/NETVIRT-1067 Change-Id: Iaba6e06d0f39e356bf364b0640c707b0a83470d7 Signed-off-by: tomsou <soth@intracom-telecom.com> Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-02-15fix for sdnvpn CI test failurePeriyasamy Palanisamy1-0/+1
Change-Id: Ie55ccbe68f57a9bb03efc8b6eebf23a0018a0bca Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2018-01-18Set unlimited router quotastomsou1-5/+9
Update router quotas to fix bgpvpn scenario in CIq JIRA:SDNVPN-208 Change-Id: I25353229d119459c8e961b0f3f6264f715533d13 Signed-off-by: tomsou <soth@intracom-telecom.com>
2018-01-09Intra-Data Center ECMP testcasePeriyasamy Palanisamy2-0/+236
This testcase add a scenario in which one extra route can be reachable through two VMs which are in a same network attached to a router which is later associated to a BGPVPN instance. This extra route ip address is different from subnet of VMs. After the extra route is configured with VM ips as nexthops, then when third VM is trying to reach extra route, traffic would split between two VMs. The traffic split can happen only in heavy loaded scenario, so this testcase would test only reachability. JIRA: SDNVPN-23 Change-Id: I4bb4e94f5c98c0f3c22bff7a6998af2a7a919f16 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-11-16Merge "add resync testcase"Tim Irnich2-0/+236
2017-11-10add resync testcasePeriyasamy Palanisamy2-0/+236
It is an extention of testcase_11.py to check resync happens properly between ODL and OVS when there is no changes from northbound JIRA: SDNVPN-175 Change-Id: I63bd17f5e5fdab7d5ab90a2be2836e02e7dd54fa Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-11-09Adapt bgp daemon to run properly for testcase3tomsou1-3/+11
Since apex includes a new version of zrpcd compatible with Carbon and Nitrogen [0], an adaptation is needed for bgp daemon enabling and running within testcase3 Note that zrpcd run now as a process and not as a service JIRA: SDNVPN-172 [0] https://jira.opnfv.org/projects/APEX/issues/APEX-508 Change-Id: Ia0ec4ab0f15ecf3d5c76c5fa541fe8338762ecaf Signed-off-by: tomsou <soth@intracom-telecom.com>
2017-11-09Merge "remove flavor at the end of the test"Tim Irnich1-3/+4
2017-11-09Merge "Fix instance boot when metadata exists"Tim Irnich6-34/+37
2017-11-08remove flavor at the end of the testPeriyasamy Palanisamy1-3/+4
JIRA: SDNVPN-122 Change-Id: I89f457e0d5a7c7c98bab223e722a5eb5a23387b6 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-11-08use glance_client for image cleanupPeriyasamy Palanisamy9-8/+17
Change-Id: Ia192a1b26c5f31b6d3465a060c3d8a3097e6ebd4 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-11-08Test groups are deleted after ovs reconnectionpperiyasamy2-0/+178
Create a new testcase (Testcase 11) Testing procedure: Create a Network with 2 VMs so that a group is added to ovs. Disconnect ovs. Remove the Network and the VMs. Connect ovs again. Check that the group is deleted from it. JIRA: SDNVPN-151 Change-Id: I4c6f5e16f837bbcc589cbbbf05896a2d17b9cd57 Signed-off-by: panageo2 <panageo@intracom-telecom.com> Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-11-06Fix instance boot when metadata existstomsou6-34/+37
The way that a instance is considered as UP is pretty strict and returns ERROR in case of instances with userdata This patch differentiates the instances that are supposed to boot till login prompt and those with userdata parameter JIRA: SDNVPN-177 Change-Id: Ic4755366df006669475c90cc0693ac802256f379 Signed-off-by: tomsou <soth@intracom-telecom.com>
2017-10-25use openstack api's instead of CLIsPeriyasamy Palanisamy1-12/+35
add two apis update_instance_quota_class and update_nw_subnet_port_quota and make run_sdnvpn_tests.py to use these APIs for setting quotas JIRA:SDNVPN-188 Change-Id: I764bb6897e6c4c5abad4d252c1f3b4ccc742d52e Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-10-19Merge "Remove argparse for adding argument -r"Tim Irnich3-20/+1
2017-10-19Merge "Inheritance from Feature class"Tim Irnich1-10/+6
2017-10-19Remove argparse for adding argument -rLinda Wang3-20/+1
Change-Id: Iaa2ddc3f655a2bf85785a99a519e0df78c298037 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-18Gather logs only if fuel or apex installerPeriyasamy Palanisamy1-1/+7
Change-Id: I11988ad86a916d1d7251aacf951c6362fda961ba Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-10-18Inheritance from Feature classJose Lausuch1-10/+6
Change-Id: I81aa9582452ca43a4eab32ba34a640043c89043e Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-10-16comment multiple subnet configurationPeriyasamy Palanisamy1-47/+62
* commenting multiple subnet configuration under a neutron network because ODL doesn't have a support for it yet (netvirt bug: https://bugs.opendaylight.org/show_bug.cgi?id=9239) * This has to be uncommented once the above bug is fixed. Change-Id: I4c863fbdd951891035471f1a10cf18546f5218e0 Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-10-16SDNVPN-184: resources are not cleaned if tc failsPeriyasamy Palanisamy7-918/+964
* moved the cleanup code inside the finally block in each test case Change-Id: Ifc0fee58451923117c54040c716dad6827fbc7fa Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
2017-09-28Fix the argument errorLinda Wang1-1/+1
Change-Id: Idc4ba350a8bf77ec555109ad4e7a2649e2b0880d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-14Fix testcase_10 module pathtomsou1-1/+1
Update config file with the full path for testcase 10 Change-Id: I81ec9eaecc2c36f07f4608cdd65db6f64b43c4f9 Signed-off-by: tomsou <soth@intracom-telecom.com>
2017-09-12Fix adapt path for import_moduletomsou1-2/+1
Fix the path to include each test case when the suite runs Change-Id: I3cdd55ed6af3e131c2f0b89ffc5bd74f95eeadbf Signed-off-by: tomsou <soth@intracom-telecom.com>
2017-09-08Fix the config.yaml including for each testcasetomsou8-10/+18
At each testcase, adapt the way config.yaml is included via sdnvpn.lib.config.TestcaseConfig(). The full path should be included, instead of just the testcase name JIRA: SDNVPN-180 Change-Id: I34828cc3681f08b843db49c6a221602b5b2022bf Signed-off-by: tomsou <soth@intracom-telecom.com>
2017-09-04Adapt SDNVPN Functest test according to new frameworkjose.lausuch8-152/+85
- Inherit from TestCase class in Functest - Remove any push to DB method, since Functest takes care of it After this change, we will be able to load this module from Functest and make a python call instead of a bash call. Change-Id: I80bdb7eaac3a2d1f48e32bafa381a42cadb36138 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-08-28Merge "Add/Remove testcase"Tim Irnich2-0/+290
2017-08-23Fix import module functionality for each testcasetomsou1-8/+8
Fix the path, from where import_module runs each testcase JIRA: SDNVPN-176 Change-Id: Ibc6880b4865d3ac0c276d1aa81a08e90af3d809e Signed-off-by: tomsou <soth@intracom-telecom.com>