aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-11-29Merge "Move test scripts to tools/"Ross Brattain4-4/+4
2017-11-29Merge "tox: Split tests into separate tox environments"Ross Brattain2-14/+40
2017-11-29Merge "Tox: add a pep8 target"Ross Brattain5-36/+221
2017-11-20fix docker client don't have trex_clientAce Lee2-0/+10
JIRA: YARDSTICK-854 Add trex_client in docker, so we could run NSB testcase in docker container. Change-Id: Iac1393d6e3a175137973190936ab69a1f2ce8272 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-11-20Merge "update docker version to 16.04"Ross Brattain5-15/+30
2017-11-17Move test scripts to tools/Emma Foley4-4/+4
Move the scripts that tox uses for running tests to the tools/ directory: * run_tests.sh -> tools/run_tests.sh * tests/ci/cover.{sh,awk} -> tools/ JIRA: YARDSTICK-837 Change-Id: I817c9e5f58c06b45f1de3f369318f4bb24168677 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-17tox: Split tests into separate tox environmentsEmma Foley2-14/+40
* Add argument parsing to run_tests.sh so tests can be selected * Define tox environments for: * Coverage * Unit tests * Functional tests * for py27 and py3 * Add environments to default env * Behaviour is the same when the tests are run * Updates the py27 environment config, and adds a py3 config. * Commands from testenv are moved to py27 * py3 env uses the same commands, but runs with python3 Change-Id: I22f17c0103101f01ec268b1de9d146780ae67a6d JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-17Tox: add a pep8 targetEmma Foley5-36/+221
Adds a pep8, pep8-full targets to tox: * pep8 target: runs pylint on the changed files * pep8-full target: runs pylint on whole repo Adds scripts to run pylint: * stored in tools/ Documentation: changeed the command for running tests (run_tests.sh -> tox). This runs the same set of tests as before. JIRA: YARDSTICK-832 Change-Id: I652da87723682d958f3fcbc2eb4cd88422636a3b Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-17Merge "Dockerfile: apt-get clean to save layer space"Ross Brattain1-1/+1
2017-11-17Make GenericTrafficGen class abstractRodolfo Alonso Hernandez9-140/+65
GenericTrafficGen class is now an abstract class. Only optional methods are implemented. - 'run_traffic' and 'terminate' are mandatory. - 'listen_traffic', 'verify_traffic' and 'wait_for_instance' are optional. By default these methods doesn't execute any action. JIRA: YARDSTICK-853 Change-Id: I2befdaa337af79cc2364bdd7c66183c31c5ab69a Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-11-17Merge "Add vfw ixload testcase for heat"Ross Brattain7-11/+2953
2017-11-17Merge "NSB: update vfw tc_heat_external tests"Ross Brattain2-11/+107
2017-11-17Merge "Check requirements against OpenStack requirements"Ross Brattain3-1/+127
2017-11-17Merge "NSB Prox BM test case fixes for scale up"Ross Brattain28-337/+99
2017-11-17Merge "Fix controller IP parsing in "nsb_setup.sh" script"Ross Brattain1-1/+1
2017-11-17Merge "Clean functional tests in "test_cli_scenario""Ross Brattain1-13/+7
2017-11-17Merge "Create get_description and get_scenario_type for Scenario"Ross Brattain3-4/+70
2017-11-17Fix controller IP parsing in "nsb_setup.sh" scriptRodolfo Alonso Hernandez1-1/+1
Fixed the controller IP parsing in "nsb_setup.sh" script. The new regex expression now accepts "OS_AUTH_URL" as: * http://10.237.223.168/identity * http://10.237.223.168:5000/identity * http://hostname/identity * http://hostname:5000/identity JIRA: YARDSTICK-829 Change-Id: Ifaeab991bcbb6aa7b22c3533ab7554527184878b Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-11-17update docker version to 16.04Ace Lee5-15/+30
JIRA: YARDSTICK-690 This patch is for Yardstick Docker base image upgrade to 16.04 This patch will enable ansible build image in yardstick env prepare. Add qemu-img convert to ansible build image. Change-Id: I43127b6020bd20bd9f4aac4fca0df75353b24346 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-11-16NSB "Prox" : Cleanup duplicated traffic profileAbhijit Sinha3-195/+1
JIRA: YARDSTICK-848 The NSB PROX MPLS test uses Binsearch traffic profile and the mpls traffic profile is a duplicate. Change-Id: Ie2124cebf306fd6917b70ecd7c23ae12ef4850dc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-11-14NSB TRex: convert DPDK port number to logical TRex port numberRoss Brattain4-7/+87
when we create TRex config we sort based on PCI bus address and create a logical port ordering. We need to save this port ordering and re-use it everywhere. redirect vnfd_helper.port_num() to resource_helper.port_num() to use the logical mapping Change-Id: Ibff628556d5e11e686e15716a66a3210758c4ff0 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-11-14NSB Prox BM test case fixes for scale upAbhijit Sinha28-337/+99
YARDSTICK-839 In a scale-up test the VNF number can start from 0 to MAX (num_vnf-1) The NSB PROX BM test nodes are currently marked as: tg__0: trafficgen_1.yardstick vnf__0: vnf.yardstick They need to be changed to the below: tg__0: tg_0.yardstick vnf__0: vnf_0.yardstick Changes done are: - All BM Prox test cases have tg_0 and vnf_0 as default test nodes - The prox-baremetal-1/2/4.yaml sample pod file - Cleaned Up some unused Prox test/config files Change-Id: I819011bcb35eda62b17dd3e1035918918c582b13 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-11-10Merge "Remove ↵Ross Brattain2-19/+0
network_services.vnf_generic.vnf.prox_helpers.ProxSocketHelper.rx_stats"
2017-11-10Merge "tc053 kill haproxy wrong mismatch"Ross Brattain1-0/+5
2017-11-10Merge "Heat: add availability_zone"Ross Brattain3-22/+48
2017-11-10Merge "Update links to documentation in README.rst"Ross Brattain1-3/+3
2017-11-10Merge "NSB: fix vpe_config license"Ross Brattain1-27/+10
2017-11-10Merge "pmu: remove event_download_local workaround script"Ross Brattain4-239/+0
2017-11-10NSB: fix vpe_config licenseRoss Brattain1-27/+10
Use Apache 2.0 Change-Id: I199d09f04a5c84a25bd91dceba5e4ed1f93075f6 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-11-10Check requirements against OpenStack requirementsRodolfo Alonso Hernandez3-1/+127
Added a new tox environment to check the project requirements against the OpenStack requirements. The openstack/requirements branch used will depends on Yardstick release development. At this point, Yardstick F release must be compliant with OpenStack Pike release. Change-Id: I77a4cfa4f99674176c3f5711dc1b6787bb400ecf Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-11-09Addition of IPv6 icpm, udp and tcp to Neutron Security GroupDanielMartinBuckley1-2/+15
When creating a Neutron security group for a heat template. Add IPv6 security group rules to access the resouces. Change-Id: I0b541dfe400121e35908a70778665ee1576f0622 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-11-09Merge "NSB Prox LW_AFTR Test"Ross Brattain11-3/+68726
2017-11-08Remove network_services.vnf_generic.vnf.prox_helpers.ProxSocketHelper.rx_statsEmma Foley2-19/+0
* Remove the method which is unused and is marked as deprecated. Change-Id: Ie64084fcd26985283c664445b173a757d3d908ab JIRA: YARDSTICK-838 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-08pmu: remove event_download_local workaround scriptRoss Brattain4-239/+0
intel_pmu needs to download a config file based on the CPU model. When generating VNF images we don't have access to the actual vCPU that will be used, so we can't predownload. This code was meant to be a fix for that by downloading all the configs and then selecting one that matched the vCPU. However we have license issues with intel_pmu enven GPLv2 code, so remove it for now. Change-Id: I5257ff7c4ddc1d40537dadb29efa40d1d68cb852 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-11-07Fixed incorrect Copyright NoticeDanielMartinBuckley1-27/+10
Changed Copyright notice on tuples.lua from "Intel Copyright" to Apache 2.0 Change-Id: I85e6f9eb86c116d552f86cddf05b3b368b32f776 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-11-07Clean functional tests in "test_cli_scenario"Rodolfo Alonso Hernandez1-13/+7
Changed how "test_cli_scenario" tests check the presence of a string. Fixed "test_scenario_show_Lmbench": logic in [1] was incorrectly assigning an string value instead of the result of the "in" clause. [1] https://github.com/opnfv/yardstick/blob/stable/euphrates/tests/functional/test_cli_scenario.py#L35-L36 Change-Id: I71fceabad972e4c0d9e78cbfeb85dcd6a5ae4bda Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-11-07Create get_description and get_scenario_type for ScenarioRodolfo Alonso Hernandez3-4/+70
Created two new class functions for Scenario class: * "get_description" will return the first line of the docstring, if exists. * "get_scenario_type" will return the value of "__scenario_type__" variable. Change-Id: I8e3b47e33e0bae101b874c3975bb9c383397d188 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-11-07NSB Prox LW_AFTR TestDanielMartinBuckley11-3/+68726
JIRA: YARDSTICK-802 Addition of PROX LW_AFTR basked on PROX/DATS v037 test_104_lw_aftr.py - This support BM and Openstack Heat - This supports 4 Ports ONLY - Grafana Dashboards included - Code Coverage / Unit testing Change-Id: If2170ab458bf687256d5f1a1e840a3b9d2788ef7 Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-11-02test_sample_vnf: mock timeRoss Brattain1-1/+2
Change-Id: Id8aa734fee431d90cbdc1e0eb2173784ada822fe Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-11-02Update links to documentation in README.rstEmma Foley1-3/+3
The links to the docs in README were pointing to Colorodo documentation. For master, this should not be pinned to a particular release, but should show the most recent docs at all times. Change-Id: I3186ea0dbc5105812407a0f87e02d99899a951a0 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-01Heat: add availability_zoneRoss Brattain3-22/+48
Users would like to ensure placement of VMs on specific compute nodes so that the measurements are meaningful. Examples: Measure network performance in different scenarios (VMs in same host, in different hosts, across fabric, across tenants) Example: context: name: yardstick placement_groups: pgrp1: policy: "availability" servers: tg_0: floating_ip: true placement: "pgrp1" availability_zone: "zone2" vnf_0: floating_ip: true placement: "pgrp1" availability_zone: "zone1" Change-Id: I28a757c25ae3f5b3571ab3edd82d51ceba32c302 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-31NSB: remove validate_cpu_cfg and all app cpu methodsRoss Brattain2-147/+0
We don't really know what core we are going to use for the VNF before we generate the MultiPortConfig, so these methods are incorrect. We may need some more advanced method to validate the vCPU topology, but that will probably happen in the MultiPortConfig Change-Id: Ifee7ae4589ce0fce67771fb8d8b8dce0a0f06409 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-31Merge "resource: remove cores args"Ross Brattain3-6/+3
2017-10-30ixia: add 1024 and 1280 byte packet size to Ixia ipv4 traffic profileRoss Brattain1-0/+8
This brings it to parity with its non-Ixia counterpart (ipv4_throughput.yaml). Change-Id: I4c91d1ae507c7b5e0a23dcf49606b16891b400bd Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-28tc053 kill haproxy wrong mismatchrexlee87761-0/+5
JIRA: YARDSTICK-831 Change-Id: I587c486572f439952b8a31da664d1e2c1fb8dc27 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-10-27resource: remove cores argsRoss Brattain3-6/+3
We used to try to probe all the cores that the VNF was using and only dump CPU stats for those cores. We can't really detect those core accurately and we would rather dump all the core information and let influxdb and grafana filter the information. We do end up with excessive KPI output, especially on systems with 88 cores, but this is manageable. The core logic was partially removed, this finishes the removal. Change-Id: I5cbb694fd982519e2df54db49a21ed5948e13537 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-26Merge "KVMFORNFV: To avoid livemigration result update to json"Jing Lu2-12/+13
2017-10-25KVMFORNFV: To avoid livemigration result update to jsonNavya2-12/+13
This patch is used to remove the livemigration testcase result loaded to json as there is no dashboard implemented for the testcase Change-Id: I7a9589a0bbc5f2a28587c2878da042fc50af18e0 Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
2017-10-25Removing trailing whitespaceJingLu51-3/+3
Change-Id: I0380deec3e41a6dc02571ed9c4fa16e304f7f85e Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-25Add "How to work with test case" into devguidekubi1-0/+250
JIRA: YARDSTICK-73 add a new chapter about how to work with test case, now just add three sub chapter, sample test case, release test case, test case description file, will update more for how to write a new test case. Change-Id: I44906917e76ad6d4890f345c963b9e4440f6be39 Signed-off-by: kubi <jean.gaoliang@huawei.com>