summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-10-11Test case override of traffic profile settings.DanielMartinBuckley3-8/+49
JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-09-13Merge "Update configure_uwsgi run in baremetal/container"Rex Lee2-1/+9
2018-09-13Merge "Revert "Bugfix: ansible version should be the same both in Dockerfile ↵Rex Lee2-2/+2
and requirements.txt""
2018-09-13Merge "Create a sample fio test case base on kubernetes"Rex Lee1-2/+28
2018-09-13Merge "Create a sample lmbench test case base on kubernetes"Rex Lee1-5/+28
2018-09-13Merge "tc046 kill keystone process condition incorrect - dovetail"Rex Lee1-2/+2
2018-09-11Update configure_uwsgi run in baremetal/containerStepan Andrushko2-1/+9
Now "daemonize" prevents from installing Yardstick on baremetal. Configuring: "daemonize" in case "container" installation mode; "logto" in case "baremetal" installation mode; JIRA: YARDSTICK-1395 Change-Id: Ie390464db9c0816583edc711ed6526629d091bd3 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-09-11Merge "Add IxNextgen API for creating PPPoX configurations"Abhijit Sinha2-0/+218
2018-09-11Create a sample fio test case base on kubernetesrexlee87761-2/+28
make samples/fio.yaml to support both Openstack and K8s with context_type specified. It defaultly use Heat context, if for k8s, yardstick -d task start samples/fio.yaml --task-args '{"context_type": "Kubernetes"}' JIRA: YARDSTICK-1309 Change-Id: I2b0d61cf2f197ec8c60bda0ab4ff51594709f482 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-09-11Merge "Add container pull option to install.yaml"Rodolfo Alonso Hernandez3-13/+50
2018-09-11Create a sample lmbench test case base on kubernetesrexlee87761-5/+28
make samples/lmbench.yaml to support both Openstack and K8s with context_type specified. It defaultly use Heat context, if for k8s, yardstick -d task start samples/lmbench.yaml --task-args '{"context_type": "Kubernetes"}' JIRA: YARDSTICK-1310 Change-Id: Ifa542e830fb5ab7823bd4f994ab5d7a8e8a5b415 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-09-11Merge "Add k8s scenario test suite in Gambia"Rex Lee5-0/+90
2018-09-10Revert "Bugfix: ansible version should be the same both in Dockerfile and ↵Rex Lee2-2/+2
requirements.txt" This reverts commit 662de49b9f6c116d15882aed9e678cd3cf67494b. JIRA: YARDSTICK-1411 Change-Id: Id277aa8711c9ff77e085d26c90546eecc3490535 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-09-10tc046 kill keystone process condition incorrect - dovetailrexlee87761-2/+2
Change-Id: If01abfd5a99b4cea74f835e258f3a982af9446cd Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-09-07Add IxNextgen API for creating PPPoX configurationsSerhiy Pshyk2-0/+218
New IxNextgen API allows to perform the following configurations on IxNetwork: - add topology - add device group to topology - add ethernet protocol layer to device group - add ipv4 protocol layer to device group - add pppox protocol layer to device group JIRA: YARDSTICK-1408 Change-Id: Icf5bb5f24784cf2c167c515b04c81471ac425e38 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-09-07Add k8s scenario test suite in Gambiarexlee87765-0/+90
JIRA: YARDSTICK-1410 Change-Id: I23b4c0bcfa9aa431e259930a41d4171ff5b4e8a1 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-09-04Fix CLI argument handling in nsb_setup.shPatrice Buriez1-10/+67
CLI argument $1 was used for both admin-openrc file with OpenStack credentials and Yardstick Docker image, so obviously one of them would be wrong, and NSB setup would fail at some point. Historically, admin-openrc could be supplied as CLI argument $1, but change https://gerrit.opnfv.org/gerrit/56493 broke it, which means specifying Yardstick Docker image as CLI argument never worked. This fix implements support for the following CLI options: -o openrc Specify admin-openrc file with OpenStack credentials -i image Specify Yardstick Docker image -h Provide usage information For backward compatibility reasons, admin-openrc file can be supplied either with the -o option, or as a CLI argument. JIRA: YARDSTICK-1137 Change-Id: I3e9904970560468c24b21738203bc67b7591f9e4 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-09-04Merge "Merge latest changes to Dashboard from L2FWD to L3FWD dashboard"Abhijit Sinha2-12735/+12491
2018-09-04Merge "NSB NFVi PROX Missing VNF Statistics for CPU Utilization"Abhijit Sinha38-7/+155
2018-09-04Merge latest changes to Dashboard from L2FWD to L3FWD dashboardDanielMartinBuckley2-12735/+12491
Come changes re: Status == "Result" and Status == "Success" and L3FWD changes onto latest L3FWD Dashboard Change-Id: I62d0cfc30167085ad5efe348ab118f1defbc4901 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-09-04NSB NFVi PROX Missing VNF Statistics for CPU UtilizationDanielMartinBuckley38-7/+155
JIRA: YARDSTICK-1404 The test scripts require an extra argument to support collectd. Also the CPU utilization is a different variable name structure in the JSON file. Change-Id: I127b7e86c0f93f7743331a2d71eb81d690e42471 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-08-31TRex IMIX data must return percentage valueRodolfo Alonso Hernandez2-3/+10
Function "_create_imix_data" must return the weight in percentage, not in absolute value. JIRA: YARDSTICK-1406 Change-Id: I3bc409bab17ae5778a6783f4319699009a5437fa Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-31Add container pull option to install.yamlStepan Andrushko3-13/+50
Supported Yardstick installation modes in yardstick.yaml: baremetal and container. First is used to install Yardstick on baremetal, another is used during docker build to install Yardstick in container. Added third option: 'container pull': to pull docker image (opnfv/yardstick) from Docker hub and start container. JIRA: YARDSTICK-1392 Change-Id: I4158de3eb6fcbe0018a15fdda89a3e3ab29c26bb Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-30Merge "Adopt infra_deploy to spawn VM on LTS Ubuntu 18"Rodolfo Alonso Hernandez4-2/+61
2018-08-30Merge "Add source and destination seed value in IXIA RFC2544"Rodolfo Alonso Hernandez7-20/+39
2018-08-30Adopt infra_deploy to spawn VM on LTS Ubuntu 18Stepan Andrushko4-2/+61
Add possibility ro reuse infra_deploy.yaml to spawn VMs on jump host, depending on jump host Ubuntu version: either 16 or 18. JIRA: YARDSTICK-1396 Change-Id: Id0682c03098e611fe3a51cbd24d8ff2dda7c552a Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-30Merge "Assign static IP to VM for standalone context"Rodolfo Alonso Hernandez6-23/+62
2018-08-29Updated documentation for stanalone contextStepan Andrushko1-15/+85
Added details about hosts configurations in order to run tests for standalone context. Changes made to '13-nsb-installation.rst'. JIRA: YARDSTICK-1402 Change-Id: I4e3304065343014a80b85fc712cdde3ca62d8b2e Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-29Assign static IP to VM for standalone contextStepan Andrushko6-23/+62
During VM spawning IP address should be assigned by DHCP server in the local network. Sometimes DHCP server is not capable to assign IP address. So, need to add static IP address. JIRA: YARDSTICK-1402 Change-Id: Ie59c340eb88eddcaff043496fc20aa48b49205ec Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-29Bugfix: ansible version should be the same both in Dockerfile and ↵rexlee87762-2/+2
requirements.txt Because Dockerfile is using ansible script to install yardstick requirements. Or it may lead to exception when installing Yardstick. Change-Id: Ia83cf76675a7f3f1d0aa5c311e7b72be5c7ca5c3 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-28Merge "Bugfix: openstack router list broken in Yardstick container - dovetail"Rex Lee2-2/+2
2018-08-27Merge "Change tc_trex files to execute standalone tests"Rodolfo Alonso Hernandez9-53/+53
2018-08-27Add source and destination seed value in IXIA RFC2544Rodolfo Alonso Hernandez7-20/+39
Add source and destination seed value in IXIA RFC2544 traffic profile. The default value for both parameters is 1. JIRA: YARDSTICK-1401 Change-Id: I3351194c8be9ac42cbf5655996d50b9b69884c72 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-27Merge "Make TRex IMIX traffic mode configurable"Rodolfo Alonso Hernandez3-9/+60
2018-08-27ping bottlenecks failed when security group rule do not support ipv6 - dovetailrexlee87761-0/+12
JIRA: YARDSTICK-1380 Change-Id: I2163eeb9ab17e4f0216ddaed688e78acdf51a1ff Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-27Merge "Make security group configurable - dovetail"Jing Lu5-58/+165
2018-08-24Bugfix: openstack router list broken in Yardstick container - dovetailrexlee87762-2/+2
Dependancy of python-openstackclient is not constrained. This patch specify openstacksdk and openstackclient's version according to [1]. This patch apply for bugfix and need to backported to fraser stable branch. Continual work need to be done in Gambia according to YARDSTICK-1398. [1] https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt JIRA: DOVETAIL-728 Change-Id: I57c718e192699ac322150458d18508b06c93d22b Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-23Make TRex IMIX traffic mode configurableRodolfo Alonso Hernandez3-9/+60
Enable TRex IMIX generation using two modes: - Distribution in packages. - Distribution in byes. The default one will be distribution in packages, like the default one in IxNetwork. JIRA: YARDSTICK-1397 Change-Id: I86b2527968496218b0515349fc0a2680a84261e5 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-23Merge "Fix setting `flow` configuration in TC yaml"Rodolfo Alonso Hernandez3-10/+12
2018-08-23Merge "Fix issues with 'Success_' stats reported by ProxBinSearchProfile"Abhijit Sinha3-200/+243
2018-08-23Merge "Runners crash on test startup."Abhijit Sinha2-3/+5
2018-08-23Merge "Provide access to VM in Standalone context"Rodolfo Alonso Hernandez6-52/+261
2018-08-23Merge "Provide average latency results in IXIA KPIs"Rodolfo Alonso Hernandez2-14/+60
2018-08-23Runners crash on test startup.DanielMartinBuckley2-3/+5
JIRA: YARDSTICK-1393 The problem resides in this traffic generator class: this class is inheriting from SampleVNFTrafficGen and overriding the __init__ method but is NOT calling the parent class __init__ one. Change-Id: I206a66e361a3e2eb50bb5fa01ddadae25b4a9f54 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-08-23Provide access to VM in Standalone contextStepan Andrushko6-52/+261
Add possibility to access VM with SampleVNF image, which is spawned on baremetal server using password or key pairs (provided or generated). Changes provided for OVS-DPDK and SRIOV cases. JIRA: YARDSTICK-1260 Change-Id: I89cf17dc83f02abe23d206b24b9d0ec1298d3231 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-23Fix issues with 'Success_' stats reported by ProxBinSearchProfileSerhiy Pshyk3-200/+243
List of changes: - Added 'Status' field to indicate status of each search iteration. Possible values are 'Success', 'Failure', 'Result'. - Removed reporting of duplicated stats with 'Success_' prefix. Instead 'Status' field is set to 'Success' - Removed reporting of duplicated stats with 'Result_' prefix. Instead 'Status' field is set to 'Result' - Updated Prox_BM_L2FWD-4Port_MultiSize-1518452496550.json dashboard to query success and result status by 'Status' field value. JIRA: YARDSTICK-1386 Change-Id: I9a21a102af6cb4db137e805011b5d81c4943d77b Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-08-22Provide average latency results in IXIA KPIsRodolfo Alonso Hernandez2-14/+60
IXIA KPIs will provide an average value of all port latency values: max, min and avg. JIRA: YARDSTICK-1394 Change-Id: Ib7c7b5300e8343a1af0a20cb4e49c0bd669c1143 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-21Merge "Add virtual image generation to install script"Rodolfo Alonso Hernandez13-26/+513
2018-08-21Merge "Improvie TRex RFC2544 throughput calculation"Rodolfo Alonso Hernandez3-33/+37
2018-08-21Merge "Convert IXIA latency statistics to integer"Rodolfo Alonso Hernandez4-3/+45