summaryrefslogtreecommitdiffstats
path: root/tests/opnfv/test_cases
AgeCommit message (Collapse)AuthorFilesLines
2019-01-24[dovetail] split the sla check results into process recovery and servicerexlee877612-24/+0
recovery for HA tcs make sla check for process recovery optional: only check when sla is set. JIRA: YARDSTICK-1512 Change-Id: I717d39614a1af2ee9e62dec3b8a32d7d611f557e Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 39d89761aca4aaf724010a9f8cac73725b798b33)
2018-10-30Adds option parameters to TC074Ameed Ashour1-0/+10
Add option parameters to TC074 to allow the user to specify volume type, volume count, availability zone, stack name, and subnet cidr. JIRA:YARDSTICK-1294 Change-Id: I161f44b5f2c7e70fcfb80a3b916efc34bd06824c Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit 43c28852a9c9abfe7fc66fca0dcc703b468db0cf)
2018-08-10Disk Initialization and Custom Workloadmbeierl1-4/+14
Removes the deprecated nowarm and nosdd parameters from the call to StorPerf. Adds a call to initialize the disk right after the stack creation is complete so that the results from the performance run are valid and not skewed by a disk that is not operating at a consistent level of performance. Adds the jobs API v2.0 when the custom parameter 'workloads' is used instead of workload. Improves documentation and adds more info about the workload and workloads parameters. Co-Authored-By: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> Change-Id: I17e96028f6a82e2c800c8f73c7be866e1cab6ad8 JIRA: YARDSTICK-1322 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-11Change "monitor" to "assert" in SLADimitrios Markou3-9/+9
Change "monitor" to "assert" in SLA to make an Overall testcase to fail if a subtest Scenario fails JIRA: YARDSTICK-1305 Change-Id: I90f5c95f0ddace160d751a435d60ae09a42101f2 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-06-15Bugfix: heat conext of test case yamls jinja2 bypass sriov typerexlee877622-25/+22
the "if provider" condition bypass when provider = "sriov", related to https://gerrit.opnfv.org/gerrit/#/c/32789/ networks: test: cidr: '10.0.1.0/24' {% if provider == "vlan" %} provider: {{provider}} physical_network: {{physical_network}} {% if segmentation_id %} segmentation_id: {{segmentation_id}} {% endif %} {% endif %} JIRA: YARDSTICK-1242 Change-Id: I6a611e839654f401648d9bd6188589816f7b4946 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-05-17Merge changes from topics 'YARDSTICK-1154', 'YARDSTICK-1160'Rodolfo Alonso Hernandez2-3/+9
* changes: Kubernetes API "delete_service" missing parameter Bump Kubernetes Python client to version 6.0.0 Avoid "volumeMounts" with "configMap" fixed permissions
2018-05-16Merge "Test case description and configuration file for yardstick_tc088"Jing Lu1-0/+80
2018-05-16Merge "Test case description and configuration file for yardstick_tc089"Jing Lu1-0/+80
2018-05-09Avoid "volumeMounts" with "configMap" fixed permissionsRodolfo Alonso Hernandez2-3/+9
To access to the container without using a password, the jumphost RSA public key is copied to each container, using "volumeMounts" defined as "configMap", to /root/.ssh/authorized_keys. To work properly, the following permissions must be set: - /root/.ssh: 700 - /root/.ssh/authorized_keys: 600 Because of [1][2], the mounted folders have fixed permissions and cannot be modified. [1]https://groups.google.com/forum/#!topic/kubernetes-dev/eTnfMJSqmaM [2]https://github.com/kubernetes/kubernetes/issues/28317 JIRA: YARDSTICK-1149 Change-Id: I821064da56699c5b4f509d233c33e55af119fd56 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-05-08Merge "Implement Virtual Switch resilience test case"Ross Brattain1-0/+313
2018-05-08Merge "Add ODL HA testcase"Ross Brattain1-0/+276
2018-05-03Implement Virtual Switch resilience test caseDimitrios Markou1-0/+313
This testcase tests the resilience of the Virtual Switch in an OpenStack environment. It can only run in a non Ubuntu distro because it is limited by this bug [0] [0]: JIRA: YARDSTICK-1140 Change-Id: Ia1480fba9f3549d1144c80699056b501d3b07a0f Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-04-20Add ODL HA testcaseDimitrios Markou1-0/+276
This testcase confirms the resiliency of Opendaylight in a HA deployment SPEC: https://gerrit.opnfv.org/gerrit/#/c/50991 JIRA: HA-33 JIRA: YARSTICK-955 Change-Id: I4cb39d1970ed0333a43fbb58f8c7138908379dcb Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-04-13Bugfix: interface down HA tc050 attack and monitor logistic wrongrexlee87761-64/+17
1. simplify the attack to be one interface 2. move monitor step before attack 3. update rst doc to match JIRA: YARDSTICK-1120 Change-Id: Icfa21d58e7ccdbeaca8a9a1a3098cceb21c981c3 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-23Merge "TC042 bug fix"Ross Brattain1-2/+9
2018-03-23Merge "Test case description and configuration file for ↵Ross Brattain1-0/+78
yardstick_tc090:Control Node Openstack Service High Availability - Database Instances"
2018-03-22Merge "fix Dummy test context name"Jing Lu2-1/+2
2018-03-22Merge "Test case description and configuration file for ↵Rex Lee1-0/+59
yardstick_tc091:Control Node Openstack Service High Availability - Heat Api"
2018-03-22fix Dummy test context namerexlee87762-1/+2
more dummy test fix base on I0ccb7e9fabdf6bc2890d2e4763f53baee06c87b2 Since I1447fb5ed447691eaeb0a97f928c0b3333799d07, the context name is a mandatory parameter for every context. JIRA: YARDSTICK-886 Change-Id: I10ee6bcc0507fa90b6e99261a98a96655fc66947 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-21TC042 bug fixliyin1-2/+9
JIRA:YARDSTICK-786 yardstick DPDK image have problems to build. We will fix this by using nsb image the pktgen DPDK testcase will use sampleVNF image Change-Id: I24b7b6a9acfe21ec956fa9c4ee7ebe7ae1787dbb Signed-off-by: liyin <liyin11@huawei.com>
2018-03-16Test case description and configuration file for yardstick_tc090:Controltjuyinkanglin1-0/+78
Node Openstack Service High Availability - Database Instances JIRA: YARDSTICK-960 Change-Id: Ibe47a9b4d1f095971857fcbaee57a3c7f64f9911 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2018-03-16Test case description and configuration file for yardstick_tc091:Controltjuyinkanglin1-0/+59
Node Openstack Service High Availability - Heat Api JIRA: YARDSTICK-961 Change-Id: I49fc2b2d8fc4fa090a74f1838f5ac386e39eaf49 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2018-03-08Add ODL noHA testcaseDimitrios Markou1-0/+278
This testcase confirms the resiliency of Opendaylight in a noHA deployment SPEC: https://gerrit.opnfv.org/gerrit/#/c/49245/ Change-Id: I810011c35c7bb6377f9295330cf7122d10cf74c3 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-08Test case description and configuration file for yardstick_tc088tjuyinkanglin1-0/+80
JIRA: YARDSTICK-958 Change-Id: I4b9633deca5b88c836aaeea02454495381fe5843 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2018-03-07Test case description and configuration file for yardstick_tc089tjuyinkanglin1-0/+80
JIRA: YARDSTICK-959 Change-Id: Ib2f99c9c00f4549a8a721cb06324d5b3356bdda7 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-12-25SPEC cpu2006 test case for VMJingLu51-0/+67
JIRA: YARDSTICK-906 This test case is for benchmarking VM(VNF) compute performance using SPEC CPU2006. Change-Id: Ida87aa4d394e38b398acb0af3176dd1b4c858c35 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-12-16Merge "bugfix: tc078 fails in some situations"Ross Brattain1-6/+10
2017-12-16Merge "bugfix: kill process do not accurately kill "nova-api""Ross Brattain10-19/+29
2017-12-15bugfix: kill process do not accurately kill "nova-api"rexlee877610-19/+29
JIRA: YARDSTICK-849 1. update the kill process RegEx pattern to be more accurate 2. make attack_process to be parameter so it can be customized if the SUT is using a different name of attack_process Change-Id: I569730ced6c24aafbffcf2fc5752d3560d0adac5 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-12-14Change testcases 'cirros' image to 'yardstick-image'Rodolfo Alonso Hernandez1-2/+2
The default OpenStack 'cirros-0.3.5' image doesn't exist anymore. The image included by default in any testing OpenStack deployment is now called 'cirros-0.3.5-x86_64-disk', but this name can change. Because Yardstick, during the installation, deploys a customized image, 'yardstick-image', it makes sense to use it as the default image. JIRA: YARDSTICK-873 Change-Id: I8fd7cbc01d4fa52e9107f2fac7d2d9ff5d1091c7 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-12-13bugfix: tc078 fails in some situationsrexlee87761-6/+10
1. make "SPECint_benchmark, runspec_iterations, runspec_tune, runspec_size, runspec_rate" parameterized and change the default value "int^429" to "int" 2. remove "become: true" in some roles since it does not need root privilege JIRA: YARDSTICK-852 Change-Id: Icb384bddc12911e2681a981d0504e0e142d1a8ec Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-11-20bugfix: tc023 miss description and tc050-58 wrong descriptionrexlee877616-29/+34
also modify tc019,025,045-49 descrition to be unified JIRA: YARDSTICK-850 Change-Id: I3f775f1ebff4063edc53b9bc26d7ba10b8af8a9d Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-10-18Merge "Docs: test case description for TC080 and TC081"Ross Brattain2-4/+7
2017-10-18Docs: test case description for TC080 and TC081JingLu52-4/+7
JIRA: YARDSTICK-825 Change-Id: Ib2f8d0b88378c0dd0bd20ba38141a205fa7ae486 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-18Merge "Fio: support input job file configuration"Jing Lu1-2/+6
2017-10-17Fio: support input job file configurationJingLu51-2/+6
Change-Id: I4bb15a398819e54f7fb3e9eac17daa4059c03376 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-13bugfix: remove pod_name in host and unify host parameterrexlee877616-45/+56
for none-ha test case, use host to be parameter for ha test case, use attack_host as parameter Change-Id: I053df00adab17814dd54584a1ae081548163dc68 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-10-12Merge "Use "protocol" parameters in iperf3 yaml and task file"Ross Brattain1-2/+2
2017-10-11Use "protocol" parameters in iperf3 yaml and task fileAce Lee1-2/+2
JIRA: YARDSTICK-755 There is a history problem that iperf use udp to set a net protocol. This code will change it to protocol. so you could use 'tcp','udp' and other protocol. Change-Id: I1a101013dfe58165a3ed08aa77f0aa2f73d57a12 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-10-04Add intermediate variables for attacker,monitor,result_checkerqiujuan2-6/+6
JIRA: YARDSTICK-790 Change-Id: I6bb36c98b8673155d3142fc54cfb39315d5ce613 Signed-off-by: qiujuan <juan_qiu@tongji.edu.cn>
2017-09-29bugfix: tc054 default value is wrongrexlee87761-60/+5
management route ip is not common in most SUTs, so it should be removed. also huawei pod1 ipmi info should updated so this test case can be added into ci later Change-Id: I3a29c59c473ee7087d4d61753ffc955b061571fb Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-09-26bugfix: tc055 fail due to options with no valuerexlee87761-1/+0
JIRA: YARDSTICK-816 Change-Id: Ib7eb411b940775915c6c9f87ac5cdc9825069467 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-09-21bugfix: tc025 should use ipmi to poweroffroot1-1/+1
if it use shutdown, it'll take several minutes to shutdown, leads to the ipmi power on command fails Change-Id: I74b61325cbcc3a6ec070d2fa103accf84f29b0fa Signed-off-by: root <limingjiang@huawei.com>
2017-09-15Merge "tc006: fio job_file.ini the volume should be configed"Rex Lee1-1/+2
2017-09-15Merge "tc063: make node parameter can be pass"Rex Lee1-2/+2
2017-09-14tc011: make parameters to be able to configrexlee87761-4/+8
Change-Id: Ic8a85b762f5204a9b759bf57c3189df97aa52d0c Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-09-14tc006: fio job_file.ini the volume should be configedrexlee87761-1/+2
Change-Id: Ie03dfe7d1227578bb50e5e4460e50b9dc59dd202 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-09-13tc063: make node parameter can be passrexlee87761-2/+2
Change-Id: I7af9706085508f2391957dc5633db4152f828bfc Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-09-11Merge "change outage_time from 20 to 30s"Kubi9-18/+18
2017-09-08Merge "testcase: add rate parameter for spec cpu 2006"Jing Lu1-1/+5