summaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-06-26Stop running tests from tests/unitEmma Foley2-26/+0
Since all tests have been moved into yardstick/tests, temperary code to run tests in both tests and yardstick/tests should be removed. JIRA: YARDSTICK-837 Change-Id: I3bf3c9ece9bc8457d992e53ee8cc5cadb1dec8f0 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry-picked from commit 64add9a435e9455b3bff6971d2717857cdce8193)
2018-06-26Move tests: unit/network_services/helpersEmma Foley6-2073/+0
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: If0b77a6e0b102071ecfb212362647c62a621e4f9 (cherry-picked from commit 065c00d3147d12c692d43179d9c1c9afadb97825)
2018-06-26Move tests: unit/network_services/vnf_genericEmma Foley21-10554/+0
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: I3d95537a64bde923703421510d27bac0d6dd92bd (cherry-picked from commit 98294f2c8153f663c3b3a4e4cb98910e9d5cb602)
2018-06-25Move tests: unit/network_services/nfviEmma Foley3-450/+0
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Id330ee1c89d54ef487edb7fe160e5a31d9a3094f (cherry-picked from commit e12f98c2bbed5191714bdc553e7b269b1437cecd)
2018-06-25Improve IXIA IxNetwork library and traffic profile (4)Rodolfo Alonso Hernandez2-9/+21
This patch implements an active wait for the traffic injection. Once the traffic is started, the traffic generator class will poll periodically the IXIA traffic generator chassis to retrieve the status of the traffic ("started", "stopped"). Now the latency statistics are retrieved and reported for each injection period. JIRA: YARDSTICK-1116 Change-Id: I4422e2c88b4fc97b7cac3de8a82b2d75467c4117 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit a3399d07b83ce0e50d9c0144d00a7ba83a73390f)
2018-06-25Improve IXIA IxNetwork library and traffic profile (1)Rodolfo Alonso Hernandez1-25/+33
This patch introduces a new way to configure the TCL IxNetwork server. All the configuration is done using the TCL API, removing the need of using the pre-saved configuration file. "IxNextgen.assign_ports" creates and assigns the virtual ports for each physical port defined in the test case. "IxNextgen.create_traffic_item" creates one traffic item and two flow groups per pair of ports, in both directions. "IxNextgen.gt_statistics" retrieves only the required statistics to generate the samples blob in the traffic generator. JIRA: YARDSTICK-1116 Change-Id: I8f1c0c55e99c274b2ed8276ed9a385c502e16d93 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit ee721fd3e8b77ccfe4252a107a9af8dc41ccc389)
2018-06-22Merge "Configure ACL via static file" into stable/fraserEmma Foley5-64/+154
2018-06-22Move tests: unit/network_services/traffic_profileEmma Foley12-2192/+0
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Id983a2e415d66633331e7fea96a377e2a7589980 (cherry-picked from commit cfc40ad1bb36889e54bc99cb779cfcfa1f3b04dd)
2018-06-22Merge "MQ startup process refactor" into stable/fraserAbhijit Sinha1-3/+29
2018-06-22Merge "Move IncorrectConfig, IncorrectSetup and IncorrectNodeSetup to ↵Emma Foley1-7/+5
exceptions" into stable/fraser
2018-06-22Configure ACL via static fileMytnyk, Volodymyr5-64/+154
This patch allows user to configure ACL/vFW SampleVNF ACL via configuration file provided in TC definition. The Yardstick applies the rules to SampleVNF from specified config file + rules generated by Yardstick (default rules). The example of SampleVNF ACL CLI commands generated/applied by Yardstick can be found at (using default ACL config file): ACL VNF ACL CLI commands: acl/tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml http://paste.openstack.org/show/723303/ vFW VNF ACL CLI commands: vfw/tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml http://paste.openstack.org/show/723304/ Change-Id: I76a630261a982083b628e3985fc3bec14ca495db Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 3fdca97ff5053770161059a34a95fd39463eaecd)
2018-06-22MQ startup process refactorChornyi, TarasX1-3/+29
JIRA: YARDSTICK-1112 Change-Id: Id30236e190bae9fb0f5b5ebd4c5e04798e4fd443 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com> (cherry picked from commit d38bd854fb2c3eb6c0c4dd34ace2a52af7cf892d)
2018-06-22Merge "Do not start collectd twice when SampleVNF is running on Baremetal" ↵Rodolfo Alonso Hernandez2-3/+63
into stable/fraser
2018-06-22Merge "Add --hwlb options as a command line argument for SampleVNF" into ↵Rodolfo Alonso Hernandez5-3/+82
stable/fraser
2018-06-21Move IncorrectConfig, IncorrectSetup and IncorrectNodeSetup to exceptionsRodolfo Alonso Hernandez1-7/+5
JIRA: YARDSTICK-1218 Change-Id: I804065e9bce3e728f5bf9e756a78df8fd28f74ac Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit dc0e675f47f4dbf1b54ce9c22878e2e876bc26e8)
2018-06-20Convert SSH custom exceptions to Yardstick exceptionsRodolfo Alonso Hernandez1-2/+3
JIRA: YARDSTICK-1215 Change-Id: I5ecfd3dccd91b07cd8de5309dfa1a372eff16ed0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit dde8fa628483deec352e176cea8decdbf6bed7e8)
2018-06-20Add --hwlb options as a command line argument for SampleVNFChornyi, TarasX5-3/+82
To enable HWLB queues in samplevnf on supported hardware (e.g Intel Fortville) --hwlb option needs to be passed as a VNF command line argument. JIRA: YARDSTICK-1159 Change-Id: I6e5c098dc71a711252b545c7622ee52085fa81f0 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com> (cherry picked from commit 1c8bfeb11a620c63ffd9fcd7f8735ded4521e077)
2018-06-20Do not start collectd twice when SampleVNF is running on BaremetalChornyi, TarasX2-3/+63
JIRA: YARDSTICK-1167 Change-Id: I7591bbb2a84ee4039a20c5da2914f1e374299015 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com> (cherry picked from commit ba2ca2819a8b0312627742d126030c3dac15052f)
2018-06-20Move tests: unit/network_services/{lib/,collector/,*.py}Emma Foley8-1287/+0
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Idc2e70291b6d9b4cf7e7249a10c4a290b999206c (cherry picked from commit 2e75e6d27240945ec985998bbe9ec6241d11626a)
2018-05-17Merge "Remove unused methods in SampleVNF" into stable/fraserRex Lee1-46/+0
2018-05-08Implement Virtual Switch resilience test caseDimitrios Markou3-0/+329
This testcase tests the resilience of the Virtual Switch in an OpenStack environment. It can only run in a non Ubuntu distro because it is limited by this bug [0] [0]: JIRA: YARDSTICK-1140 Change-Id: Ia1480fba9f3549d1144c80699056b501d3b07a0f Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit 53f5951a47fcaa5a3f8bcd6ea1020e54a1b285d3)
2018-05-08Add ODL HA testcaseDimitrios Markou2-0/+283
This testcase confirms the resiliency of Opendaylight in a HA deployment SPEC: https://gerrit.opnfv.org/gerrit/#/c/50991 JIRA: HA-33 JIRA: YARSTICK-955 Change-Id: I4cb39d1970ed0333a43fbb58f8c7138908379dcb Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit d16b2e14fe420a646d4399986bd9f4d1ae3a606d)
2018-05-08Add pod.yaml files for ApexDimitrios Markou1-0/+67
JIRA: YARDSTICK-1097 Change-Id: If116174c562bc08c0b7602324599bc85d8c60be0 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit 6f374141466640655cc57277b4b49d6deffa9092)
2018-05-03Remove unused methods in SampleVNFEmma Foley1-46/+0
The following private methods are unused in yardstick/network_services/vnf_generic/vnf/sample_vnf.py:SampleVNF * _build_ports(self) * _get_route_data(self, route_index, route_type) * _get_port0localip6(self) * _get_port1localip6(self) * _get_port0prefixlen6(self) * _get_port1prefixlen6(self) * _get_port0gateway6(self) * _get_port1gateway6(self) They are being removed as: * _get_port* functions are already implemented and used in MultiPortConfig * _get_route_data is an auxillary functions used by the previous ones * _build_ports is implemented in the helpers JIRA: YARDSTICK-1122 Change-Id: Ie7a706cd87b610ea56f89214118a02e612a70dc0 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 50bcd3e477bc29abb43ed73643d551ff55a73403)
2018-04-24Merge "extra loopback cleanup" into stable/fraserRoss Brattain1-0/+9
2018-04-23remove more old apexlake testcasesRoss Brattain2-8/+0
fix fraser failures Change-Id: I8bb12a762054a4c3274cc6e0297e948b92700e7e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-04-22extra loopback cleanupRoss Brattain1-0/+9
try to cleanup in the shell script in case ansible errors maybe it is hopeless because of docker JIRA: YARDSTICK-1096 JIRA: YARDSTICK-1054 Change-Id: I759ded4731a7710a194a81530cfb35376eb7800d Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-04-20disable NSB (DPDK) image load for ARMRoss Brattain1-1/+3
we skip the building now but we also need to skip the image loading JIRA: YARDSTICK-1124 Change-Id: I27c40d6319e74374282203132cfc2c7ebff9b094 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 15cec319ab06f161c239ead78da9ecdf1673b7ce)
2018-04-20disable DPDK images for ARMRoss Brattain1-1/+3
We are trying to compile DPDK for the os-nosdn-ovs-ha scenario because we added TC042  "Measure network latency using testpmd and pktgen-dpdk". However it looks like TC042 is only enabled for compass in opnfv_os-nosdn-kvm_ovs_dpdk-ha https://gerrit.opnfv.org/gerrit/#/c/54659/1/tests/opnfv/test_suites/opnfv_os-nosdn-kvm_ovs_dpdk-ha_daily.yaml - file_name: opnfv_yardstick_tc042.yaml constraint: installer: compass pod: huawei-pod1 We don't actually need TC042 and DPDK or os-nosdn-ovs-ha. But in order to run TC042 we have to know beforehand that we are going to use DPDK, so we have a conditional in the load_images.sh script that tries to guess when we will need a DPDK image. The conditional only checks for *[_-]ovs[_-]* if [[ $DEPLOY_SCENARIO == *[_-]ovs[_-]* ]]; then ansible-playbook \ -e img_property="nsb" \ -e YARD_IMG_ARCH=${YARD_IMG_ARCH} \ -vvv -i inventory.ini build_yardstick_image.yml if [ ! -f "${QCOW_NSB_IMAGE}" ]; then echo "Failed building QCOW NSB image" exit 1 fi fi For this release we won't be able to get DPDK images to compile on ARM, we should fix this conditional and not try to compile. Also change the shell glob to match *[_-]ovs_dpdk[_-]* to only enable DPDK images for ovs_dpdk scenarios JIRA: YARDSTICK-1124 Change-Id: I03142e6b8aa00dc9cdf9b446868fb723cd10198b Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 50154694f8dc37726d456cfb8efddc6d3e126dbd)
2018-04-18remove apex lake tc007 from test suitesRoss Brattain4-52/+0
fixes opnfv_os-nosdn-fdio-noha_daily.yaml failures due to missing testcase Change-Id: I5f050d72334da46b94de5fa3662047bf694f7e3e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 01ef85fc8234c8ddeaae65eceaf5bbb9545b9e98)
2018-04-16Bugfix: interface down HA tc050 attack and monitor logistic wrongrexlee87761-64/+17
1. simplify the attack to be one interface 2. move monitor step before attack 3. update rst doc to match JIRA: YARDSTICK-1120 Change-Id: Icfa21d58e7ccdbeaca8a9a1a3098cceb21c981c3 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit af7f0bea3a0d24bdf084622acc9932ccd261e42e)
2018-04-10Bugfix: k8 scenario fixrexlee87762-45/+19
JIRA: YARDSTICK-1109 Change-Id: Ic61a63099c3d2d4af5fa5634299e4b2946d53eaf Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 3b1316647b50bc3bbb1eb6216aa07fd4dff34edf)
2018-03-31ADD tc042 into CIliyin3-0/+31
JIRA: YARDSTICK-1108 We add this test case in ovs_dpdk-ha and ovs_dpdk-noha testsuites also add image build into load_images script Change-Id: I2b0c6b106dd98c3693df18dba46259ff8ef0a76e Signed-off-by: liyin <liyin11@huawei.com>
2018-03-28add new Fraser scenariosRoss Brattain10-0/+304
New scenarios from wiki: https://wiki.opnfv.org/display/SWREL/Fraser+Scenario+Statu Change-Id: Ifd6e45e73be2bbb99743aa3f4981d22899aab92a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-23Merge "TC042 bug fix"Ross Brattain1-2/+9
2018-03-23Merge "Test case description and configuration file for ↵Ross Brattain1-0/+78
yardstick_tc090:Control Node Openstack Service High Availability - Database Instances"
2018-03-22Merge "Make Sample VNF hugepages size configurable"Ross Brattain1-2/+20
2018-03-22Merge "update ci pod in the test suite according to Fraser"Rex Lee1-28/+36
2018-03-22Add k8-nosdn-stor4nfv-ha/noha scenariochenjiankun2-0/+0
JIRA: YARDSTICK-1090 We have k8-nosdn-stor4nfv-ha/noha scenario in compass, so we need to add this files to trigger it. Change-Id: I79709c53b8542434f7324ad907fa95b4855839d3 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-22update ci pod in the test suite according to Fraserrexlee87761-28/+36
Change-Id: I999b44cc4e0ec1029c6efca224e691298a007689 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-22Merge "fix Dummy test context name"Jing Lu2-1/+2
2018-03-22Merge "Test case description and configuration file for ↵Rex Lee1-0/+59
yardstick_tc091:Control Node Openstack Service High Availability - Heat Api"
2018-03-22fix Dummy test context namerexlee87762-1/+2
more dummy test fix base on I0ccb7e9fabdf6bc2890d2e4763f53baee06c87b2 Since I1447fb5ed447691eaeb0a97f928c0b3333799d07, the context name is a mandatory parameter for every context. JIRA: YARDSTICK-886 Change-Id: I10ee6bcc0507fa90b6e99261a98a96655fc66947 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-22Merge "Add k8-nosdn-stor4nfv-ha/noha scenario"Jack Chan2-0/+36
2018-03-21TC042 bug fixliyin1-2/+9
JIRA:YARDSTICK-786 yardstick DPDK image have problems to build. We will fix this by using nsb image the pktgen DPDK testcase will use sampleVNF image Change-Id: I24b7b6a9acfe21ec956fa9c4ee7ebe7ae1787dbb Signed-off-by: liyin <liyin11@huawei.com>
2018-03-21Add k8-nosdn-stor4nfv-ha/noha scenariochenjiankun2-0/+36
JIRA: YARDSTICK-1090 We have k8-nosdn-stor4nfv-ha/noha scenario in compass, so we need to add this files to trigger it. Change-Id: Iefa3a83407bff7d3c1de1959f35b6d8e5eecd145 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-21Bugfix: update test case base on node parameters in cirexlee877644-125/+125
JIRA: YARDSTICK-1082 Change-Id: I00080d0317a54b73a6cd571198e9446962c11b5a Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-20Merge "Add "YARDSTICK_REPO_DIR" into tests path"Ross Brattain1-1/+1
2018-03-20Add "YARDSTICK_REPO_DIR" into tests pathting wu1-1/+1
In the CI flow, script "load_images.sh", variable ${YARDSTICK_REPO_DIR} needs to be added in front of tests path to avoid the error: sed: can't read tests/opnfv/test_cases/*: No such file or directory This fix is specific to arm64 JIRA: YARDSTICK-1086 Change-Id: If19b295233bb7313226dae70df016ad236bed2ac Signed-off-by: ting wu <ting.wu@enea.com>
2018-03-20update scenario test cases according to gating releaserexlee87761-67/+75
JIRA: YARDSTICK-1046 Change-Id: I12223876d1cf1f3e45152f6b7996b75a66b16fe6 Signed-off-by: rexlee8776 <limingjiang@huawei.com>