aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-05-15Fix PROX throughput result calculationAbhijit Sinha1-1/+1
The success criteria needed a fix for throughput calculation. The results on success criteria were muliplied by 1000*1000 which is not correct and not needed as this was leading to false results in grafana. JIRA: YARDSTICK-1172 Change-Id: I56b24a700f8a565db80897aeab796e7039cae5c9 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-05-08Merge "Implement Virtual Switch resilience test case"Ross Brattain3-0/+329
2018-05-08Merge "Add ODL HA testcase"Ross Brattain2-0/+283
2018-05-08Merge "Add pod.yaml files for Apex"Ross Brattain1-0/+67
2018-05-03MQ startup process refactorChornyi, TarasX1-4/+29
YARDSTICK-1112 Change-Id: Id30236e190bae9fb0f5b5ebd4c5e04798e4fd443 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-05-03Merge "Remove unused methods in SampleVNF"Abhijit Sinha1-46/+0
2018-05-03Implement Virtual Switch resilience test caseDimitrios Markou3-0/+329
This testcase tests the resilience of the Virtual Switch in an OpenStack environment. It can only run in a non Ubuntu distro because it is limited by this bug [0] [0]: JIRA: YARDSTICK-1140 Change-Id: Ia1480fba9f3549d1144c80699056b501d3b07a0f Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-05-02Move tests: unit/network_services/{lib/,collector/,*.py}Emma Foley8-1287/+0
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Idc2e70291b6d9b4cf7e7249a10c4a290b999206c
2018-04-25Fix "os.path" mock problems during testsRoss Brattain1-6/+2
This patch removes the global mocking applied on "os.path". Change-Id: Ia18d2c90195c5408a1852792bdf05b6f0c1ad21f Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-04-23remove more old apexlake testcasesRoss Brattain2-8/+0
fix fraser failures Change-Id: I8bb12a762054a4c3274cc6e0297e948b92700e7e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-04-20Merge "extra loopback cleanup"Ross Brattain1-0/+9
2018-04-20disable NSB (DPDK) image load for ARMRoss Brattain1-1/+3
we skip the building now but we also need to skip the image loading JIRA: YARDSTICK-1124 Change-Id: I27c40d6319e74374282203132cfc2c7ebff9b094 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-04-20Add ODL HA testcaseDimitrios Markou2-0/+283
This testcase confirms the resiliency of Opendaylight in a HA deployment SPEC: https://gerrit.opnfv.org/gerrit/#/c/50991 JIRA: HA-33 JIRA: YARSTICK-955 Change-Id: I4cb39d1970ed0333a43fbb58f8c7138908379dcb Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-04-20Add pod.yaml files for ApexDimitrios Markou1-0/+67
JIRA: YARDSTICK-1097 Change-Id: If116174c562bc08c0b7602324599bc85d8c60be0 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-04-19extra loopback cleanupRoss Brattain1-0/+9
try to cleanup in the shell script in case ansible errors maybe it is hopeless because of docker JIRA: YARDSTICK-1096 JIRA: YARDSTICK-1054 Change-Id: I759ded4731a7710a194a81530cfb35376eb7800d Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-04-19disable DPDK images for ARMRoss Brattain1-1/+3
We are trying to compile DPDK for the os-nosdn-ovs-ha scenario because we added TC042  "Measure network latency using testpmd and pktgen-dpdk". However it looks like TC042 is only enabled for compass in opnfv_os-nosdn-kvm_ovs_dpdk-ha https://gerrit.opnfv.org/gerrit/#/c/54659/1/tests/opnfv/test_suites/opnfv_os-nosdn-kvm_ovs_dpdk-ha_daily.yaml - file_name: opnfv_yardstick_tc042.yaml constraint: installer: compass pod: huawei-pod1 We don't actually need TC042 and DPDK or os-nosdn-ovs-ha. But in order to run TC042 we have to know beforehand that we are going to use DPDK, so we have a conditional in the load_images.sh script that tries to guess when we will need a DPDK image. The conditional only checks for *[_-]ovs[_-]* if [[ $DEPLOY_SCENARIO == *[_-]ovs[_-]* ]]; then ansible-playbook \ -e img_property="nsb" \ -e YARD_IMG_ARCH=${YARD_IMG_ARCH} \ -vvv -i inventory.ini build_yardstick_image.yml if [ ! -f "${QCOW_NSB_IMAGE}" ]; then echo "Failed building QCOW NSB image" exit 1 fi fi For this release we won't be able to get DPDK images to compile on ARM, we should fix this conditional and not try to compile. Also change the shell glob to match *[_-]ovs_dpdk[_-]* to only enable DPDK images for ovs_dpdk scenarios JIRA: YARDSTICK-1124 Change-Id: I03142e6b8aa00dc9cdf9b446868fb723cd10198b Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-04-17remove apex lake tc007 from test suitesRoss Brattain4-52/+0
fixes opnfv_os-nosdn-fdio-noha_daily.yaml failures due to missing testcase Change-Id: I5f050d72334da46b94de5fa3662047bf694f7e3e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-04-17Remove unused methods in SampleVNFEmma Foley1-46/+0
The following private methods are unused in yardstick/network_services/vnf_generic/vnf/sample_vnf.py:SampleVNF * _build_ports(self) * _get_route_data(self, route_index, route_type) * _get_port0localip6(self) * _get_port1localip6(self) * _get_port0prefixlen6(self) * _get_port1prefixlen6(self) * _get_port0gateway6(self) * _get_port1gateway6(self) They are being removed as: * _get_port* functions are already implemented and used in MultiPortConfig * _get_route_data is an auxillary functions used by the previous ones * _build_ports is implemented in the helpers JIRA: YARDSTICK-1122 Change-Id: Ie7a706cd87b610ea56f89214118a02e612a70dc0 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-04-13Bugfix: interface down HA tc050 attack and monitor logistic wrongrexlee87761-64/+17
1. simplify the attack to be one interface 2. move monitor step before attack 3. update rst doc to match JIRA: YARDSTICK-1120 Change-Id: Icfa21d58e7ccdbeaca8a9a1a3098cceb21c981c3 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-04-03Bugfix: k8 scenario fixrexlee87762-45/+19
JIRA: YARDSTICK-1109 Change-Id: Ic61a63099c3d2d4af5fa5634299e4b2946d53eaf Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-31ADD tc042 into CIliyin3-0/+31
JIRA: YARDSTICK-1108 We add this test case in ovs_dpdk-ha and ovs_dpdk-noha testsuites also add image build into load_images script Change-Id: I2b0c6b106dd98c3693df18dba46259ff8ef0a76e Signed-off-by: liyin <liyin11@huawei.com>
2018-03-28add new Fraser scenariosRoss Brattain10-0/+304
New scenarios from wiki: https://wiki.opnfv.org/display/SWREL/Fraser+Scenario+Statu Change-Id: Ifd6e45e73be2bbb99743aa3f4981d22899aab92a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-23Merge "TC042 bug fix"Ross Brattain1-2/+9
2018-03-23Merge "Test case description and configuration file for ↵Ross Brattain1-0/+78
yardstick_tc090:Control Node Openstack Service High Availability - Database Instances"
2018-03-22Merge "Make Sample VNF hugepages size configurable"Ross Brattain1-2/+20
2018-03-22Merge "update ci pod in the test suite according to Fraser"Rex Lee1-28/+36
2018-03-22Add k8-nosdn-stor4nfv-ha/noha scenariochenjiankun2-0/+0
JIRA: YARDSTICK-1090 We have k8-nosdn-stor4nfv-ha/noha scenario in compass, so we need to add this files to trigger it. Change-Id: I79709c53b8542434f7324ad907fa95b4855839d3 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-22update ci pod in the test suite according to Fraserrexlee87761-28/+36
Change-Id: I999b44cc4e0ec1029c6efca224e691298a007689 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-22Merge "fix Dummy test context name"Jing Lu2-1/+2
2018-03-22Merge "Test case description and configuration file for ↵Rex Lee1-0/+59
yardstick_tc091:Control Node Openstack Service High Availability - Heat Api"
2018-03-22fix Dummy test context namerexlee87762-1/+2
more dummy test fix base on I0ccb7e9fabdf6bc2890d2e4763f53baee06c87b2 Since I1447fb5ed447691eaeb0a97f928c0b3333799d07, the context name is a mandatory parameter for every context. JIRA: YARDSTICK-886 Change-Id: I10ee6bcc0507fa90b6e99261a98a96655fc66947 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-22Merge "Add k8-nosdn-stor4nfv-ha/noha scenario"Jack Chan2-0/+36
2018-03-21TC042 bug fixliyin1-2/+9
JIRA:YARDSTICK-786 yardstick DPDK image have problems to build. We will fix this by using nsb image the pktgen DPDK testcase will use sampleVNF image Change-Id: I24b7b6a9acfe21ec956fa9c4ee7ebe7ae1787dbb Signed-off-by: liyin <liyin11@huawei.com>
2018-03-21Add k8-nosdn-stor4nfv-ha/noha scenariochenjiankun2-0/+36
JIRA: YARDSTICK-1090 We have k8-nosdn-stor4nfv-ha/noha scenario in compass, so we need to add this files to trigger it. Change-Id: Iefa3a83407bff7d3c1de1959f35b6d8e5eecd145 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-21Bugfix: update test case base on node parameters in cirexlee877644-125/+125
JIRA: YARDSTICK-1082 Change-Id: I00080d0317a54b73a6cd571198e9446962c11b5a Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-20Merge "Add "YARDSTICK_REPO_DIR" into tests path"Ross Brattain1-1/+1
2018-03-20Add "YARDSTICK_REPO_DIR" into tests pathting wu1-1/+1
In the CI flow, script "load_images.sh", variable ${YARDSTICK_REPO_DIR} needs to be added in front of tests path to avoid the error: sed: can't read tests/opnfv/test_cases/*: No such file or directory This fix is specific to arm64 JIRA: YARDSTICK-1086 Change-Id: If19b295233bb7313226dae70df016ad236bed2ac Signed-off-by: ting wu <ting.wu@enea.com>
2018-03-20update scenario test cases according to gating releaserexlee87761-67/+75
JIRA: YARDSTICK-1046 Change-Id: I12223876d1cf1f3e45152f6b7996b75a66b16fe6 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-19Bugfix: storperf fails on ci when install pluginrexlee87761-2/+2
JIRA: YARDSTICK-1060 Change-Id: I6356bf16c547a1bd15f83f3ff6390822b7980f28 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-16Merge "Add ODL noHA testcase"Ross Brattain2-0/+285
2018-03-16Merge "Replace assert statements in tests"Abhijit Sinha1-1/+1
2018-03-16Test case description and configuration file for yardstick_tc090:Controltjuyinkanglin1-0/+78
Node Openstack Service High Availability - Database Instances JIRA: YARDSTICK-960 Change-Id: Ibe47a9b4d1f095971857fcbaee57a3c7f64f9911 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2018-03-16Test case description and configuration file for yardstick_tc091:Controltjuyinkanglin1-0/+59
Node Openstack Service High Availability - Heat Api JIRA: YARDSTICK-961 Change-Id: I49fc2b2d8fc4fa090a74f1838f5ac386e39eaf49 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2018-03-14Add "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml"Rodolfo Alonso Hernandez1-0/+1
"YARD_IMG_ARCH" variable is added as input parameter to "build_yardstick_image.yml" ansible script, in order to generate the correct image for the running architecture. JIRA: YARDSTICK-1058 Change-Id: I33954c236695478eaae34fcfca2e9d5b40791bbf Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-12Merge "Update the fuel pod.yaml"Ross Brattain1-1/+9
2018-03-09Do NOT hardcode interface speed for PROX testsDanielMartinBuckley1-11/+19
JIRA: YARDSTICK-1035 Do not hardcode NIC/interface speed in PROX test. Test assumes NIC used is 10Gbps. This is incorrect. It could support 1Gbps, 10Gbps, 25Gbps, 40Gbps or something else. This is used to calculate pps (Packets Per Second) In Baremetal the NIC speed could be extracted. however when run on a virtual machine this is not possible. Solution: Add in options section of test file. eg. Options: interface_speed_gbps: 10 Where 10 refers to a 10Gbps. In a setup where multiple interfaces are used. This will refer to the speed of the slowest connection. Change-Id: I89ab16479a2cdd1d79e52cbcc5a972762c60d057 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-03-09Make Sample VNF hugepages size configurableRodolfo Alonso Hernandez1-2/+20
The amount of hugepages claimed for a Sample VNF is always 16GB. This value is excesive for most of the Sample VNF applications (except for vPE). Making this parameter configurable we allow to spawn smaller VMs by using less hugepages (in case of StandAlone and OpenStack deployments). Because this parameter depends on the Scenario and the type of VNF executed, the parameter is located in: scenarios: {options: hugepages_gb} # number of GB of hugepages claimed PENDING: document this new parameter. A new userguide section should be created to document all "scenario" sections and parameters. JIRA: YARDSTICK-1061 Change-Id: I6f082e105289bd01781be18f2fecbe0ba2fdfdee Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-08Add ODL noHA testcaseDimitrios Markou2-0/+285
This testcase confirms the resiliency of Opendaylight in a noHA deployment SPEC: https://gerrit.opnfv.org/gerrit/#/c/49245/ Change-Id: I810011c35c7bb6377f9295330cf7122d10cf74c3 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-08Update the fuel pod.yamlDimitrios Markou1-1/+9
Fuel except Controller and Compute nodes it deploys an ODL node in noHA and HA deployment and also a Gateway node in a noHA deployment. So it is essential to describe them in Fuel's pod. JIRA: YARDSTICK-1050 Change-Id: Iee6c25c5b2e2e4e661ceb0591bf2437f7f7fa7f8 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-07bugfix: fix prepare_env.sh shell quoteRoss Brattain1-2/+2
JIRA: YARDSTICK-1051 Change-Id: If28bc0f2fe2e3cdec95882bb2abedf839e6ac2e0 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>