aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-10-18Added required ubuntu packages to run IxLoad clientMaciej Skrocki2-1/+6
To fully enable IxLoad, after installing the IXIA client, check /opt/ixia/ixload/<ver>/bin/ixloadpython and make sure you can run this cmd inside the yardstick container. Usually user is required to copy or link /opt/ixia/python/<ver>/bin/ixiapython to /usr/bin/ixiapython<ver>. Change-Id: I6bc633802ad6c70329581014ec89c75bb7f8d688 Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-10-18pmu mirror creation ansible error fixDhaval Patel1-0/+2
While creating the mirror for pmu event list generation, some of the links would fail, throwing error. This fixes that. Change-Id: I52e96b1a6eacb5a9611845e815ecff9052df168a Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
2017-10-18Enable static cgnapt functionality.Deepak S6-49/+34
Change-Id: Ie770ca69ebdc66589ed6ca5c25bfc9a75afb8938 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-18BugFix: Fix to Load Balancer - Previously Dropped packets was acceptableDanielMartinBuckley1-1/+1
Dropped packets were tolerated. Now no longer tolerated (except 0.01%) Change-Id: I69d4f1a84d82e03a091a61419fa05fea13176c1c Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-10-18validate_non_string_sequence: use six.string_typesRoss Brattain1-1/+1
Change-Id: I7248d97a55974091daf20f0fba4b612101a0e4c5 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-18Disable spoof check on vfs in sriov setupDeepak S1-0/+3
Change-Id: I8577231c2e78776cb30f7f7ded353a4fbc585aaa Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-18Adding cpu set to enable affinity for given vcpuDeepak S4-56/+24
Change-Id: If2e079966939b7faa33d2833d81caad0a3669036 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-18Adding sample multi-port ansible scriptDeepak S25-0/+1511
- trex - ixia - ixia correlated Change-Id: I7d1414227c27c2bb03454eac94592e07c434f070 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-18fix invalid chracters in ansible scriptsDeepak S18-36/+111
Change-Id: I3d1a491e4c0f0554a861d9bb24fbd0ac94835759 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-18Update the traffic profile to support sample multi-portDeepak S5-0/+62
Change-Id: Iaf8b3e0aa3855443b0628573a1df98d177f27c76 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-18Relocate iniparser to yardstick.network_services.helpersEdward MacGillivray4-14/+13
Change-Id: I1f457c9c24f2ca84dde61b64f58edaff8952670a Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
2017-10-18BugFix: Fix to negative dropped packets appearing in results.DanielMartinBuckley1-1/+1
As per defect: the "VNF packets dropped" time series is negative - negative number of packets dropped is not meaningful. Solution: Return a positive value. Change-Id: I358006a691f2d6b5954333b9f7a745aba97ae44f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-10-18BugFix: limit the count to supported range in min/maxDeepak S1-6/+24
In trex, giving count beyond the allowed range causes trex client to fail. Check the range and reset the count before starting the traffic Change-Id: I58e54f47edb5f249087b8f7178b807ddfb13b03c Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-18Docs: test case description for TC080 and TC081JingLu57-7/+256
JIRA: YARDSTICK-825 Change-Id: Ib2f8d0b88378c0dd0bd20ba38141a205fa7ae486 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-18Fio: support input job file configurationJingLu52-3/+22
Change-Id: I4bb15a398819e54f7fb3e9eac17daa4059c03376 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit a5d0491b47fd1bab27fa603353861ea8eaba8da5)
2017-10-18add opnfv_os-odl-fdio_dvr-noha testsutie for ApexJingLu51-0/+38
Change-Id: Idd60153e6097cbef6513942653429d2ec96a8c17 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit b122091bcc2e780be3694cf0faa1b771994798f6)
2017-10-17NSB: rename private->uplink, public->downlink in exampleRoss Brattain1-2/+2
Change-Id: Ieb8943a432a59375b7e68a708666ad4caa4affd2 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-17resource: move make_resource_profile to ResourceProfileRoss Brattain2-13/+13
move factory method from Collector to ResourceProfile Change-Id: I1ddf3cffed7a3b2d45aa9cbffd3c0a5925c325d6 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-16bugfix: remove pod_name in host and unify host parameterrexlee877616-45/+56
for none-ha test case, use host to be parameter for ha test case, use attack_host as parameter Change-Id: I053df00adab17814dd54584a1ae081548163dc68 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 18b2c357c3d281fbdf5261958ef60abb98915486)
2017-10-16Create test suite opnfv_os-nosdn-openbaton-ha_dailychenjiankun1-0/+62
JIRA: YARDSTICK-823 We need to create test sutie opnfv_os-nosdn-openbaton-ha_daily.yaml to enable this scenario. Change-Id: Ia800a9c74aaecf0d73e6f0fd559630b741ad2432 Signed-off-by: chenjiankun <chenjiankun1@huawei.com> (cherry picked from commit 164d60cedff53c520e4c36a37cb1a02bf873f7fb)
2017-10-13Support to add multiple src/dst ports in flowDeepak S1-0/+6
Change-Id: I888a6029efaad8308de8df6b6787dd46af5f1c55 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-13task: use CONF_FILE from constantsRoss Brattain1-2/+2
I'm not sure why we hardcoded config_file when the CONF_FILE constant will work. Change-Id: I45a1dc17ac2b185c659725f55462214acb74838d Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13collectd: set intel_pmu events path and OVS socket pathRoss Brattain7-60/+119
switch from hardcoded path to dynamic path based on bin_path also enable proxy for install_collectd add barometer settings for virt and ovs_stats Change-Id: Id138aef548332a3e3fcb3963b746e7c9f10c0948 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13Version changes for collectd, pmu-tools, intel_cmt_catDhaval Patel3-3/+3
Bumping collectd version to include pmu plugin enablement, bounding pmu-tools and intel_cmt_cat to a commit-id Change-Id: I666d52c5574cec0caebb07535332984fa77e5b65 Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
2017-10-13NSB Prox Grafana dashboard updatesAbhijit Sinha34-3742/+6514
JIRA: YARDSTICK-802 Updating the Grafana dashboards with common data format for all BM and Opensatck Prox tests and adding minor improvements - Correct the test description - Re-run the tests and verify that all the fields are graph correct - Label the axes correctly. eg: For Throughput added label "MPPS" Change-Id: I62b471926fe3c4c8876b70053a92d06f4373e296 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-10-13KVMFORNFV: To verify the execution of the bash scriptNavya1-5/+20
This patch is used to verify the parameters passed and the flow of qemu_migrate_benchmark.bash script to handle the bugs Change-Id: Ifc1bfa7a91a2eed178b9dc984c222074f06e0599 Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
2017-10-13Move arp route tbl to script and update defailt vnf config filesDeepak S9-143/+21
Change-Id: I8674caa15c9fc32cfacb17f558da5fb31094877e Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13cgnat: duplicate keys are not allowedRoss Brattain1-2/+0
the current ConfigParser does not handle duplicate keys in ini files. Change-Id: Iaafbbab740a809a59edfd93c84d0029ef10ac6f3 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13increase number of open files for collectdRoss Brattain5-1/+41
for collectd KPIs we need may need to open 10,000+ files one file for each core * number of CPU counters we read. Use the ansible pam_limits moules to increase the nofile setting. This should allow the VNF to boot with increased number of files open Change-Id: I46b75d5ca59e8e359c985a1e37daaee89897884c Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13task: drain background runner queuesRoss Brattain2-6/+18
We were not draining the queues in the background runners. Modify the main runner_join loop to loop over all the runners and drain them. The runner join method does extra work for periodic actions so we can't change its behavior. Instead create a new poll() method and use that to check runner status Change-Id: I9466ba40a6a4c45c82cedff279cbb4817c6b66ad Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13Bug in NSB Prox ACL Test 4 PortDanielMartinBuckley1-1/+1
JIRA: YARDSTICK-802 Generator was incorrectly configured to generated traffic for p0, p1 (twice), and p3 Should be p0, p1, p2 and p3 Change-Id: Ib62a3c6523b1eda635b8c727c36e140fd480003e Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-10-13Updating NSBperf to print right testcaseDeepak S1-2/+18
Change-Id: I7be7bc61624fa14eb552477bdc701a44d65e68b7 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-13private-> uplink and public->downlinkDeepak S60-129/+135
changing private and public to new uplink/downlink name Change-Id: I8c3f582ba5592418a397e2500e0b998c3eed54f2 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-13Enable intel_pmu plugin in collectdDeepak S1-5/+5
Change-Id: I62c6416e5c79d0b90880985bb5c076b65e34192e Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-13ping: always save rtt data, influxdb ignore empty dataRoss Brattain7-14/+35
If the SLA was failing we were raising AssertionError and not storing the rtt in the data dict. This caused influxdb parse errors because the data was empty. Fixup influxdb to ignore records with no data, so we don't try to parse no data. Change the ping logic to always record the rtt result even if the SLA was not met. Also fixup ping logic in cases where ping does not return results. If SLA is defined use SLA * 10 otherwise use large float that doesn't break the grafana scale too much, maybe 999999 JIRA: YARDSTICK-809 Change-Id: Id2d51216581644a80e8c7b9aa98919a766008adf Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit af011b16787e8fd9fc6f918b1d1427dd1be562ec)
2017-10-13Bugfix: Add opnfv_os-nosdn-ovs_dpdk testsuite for Compass4nfvJingLu52-0/+124
Change-Id: I35e6471bb561eb773bd188b36b912969188955d2 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-13Bugfix: Add opnfv_os-odl_l2-moon-ha_daily testsuite for Compass4nfvJingLu51-0/+62
Change-Id: I46c6b56e1293c3d594804d77a73c391922f03653 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-12Change 'SUCCESS' to 'PASS' when report to MongoDBchenjiankun1-2/+2
JIRA: YARDSTICK-822 To keep consistent with other testing project, we need to change 'SUCCESS' to 'PASS', 'FAILED' to 'FAIL'. Change-Id: I392e4dc6dd2e028cd43cba0d1bf8ee04618326d7 Signed-off-by: chenjiankun <chenjiankun1@huawei.com> (cherry picked from commit f4680c872fbb34816d809c41852740f5cb960fd1)
2017-10-12Bugfix: Reference for the tool used in TC044 mentioned in the user guide is ↵JingLu51-1/+1
wrong JIRA: YARDSTICK-821 Change-Id: I09b189008df4ec2e6db92cf24c45d8206ed2062f Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-12Merge "Doc amendment: env prepare command" into stable/euphratesJing Lu1-22/+8
2017-10-12Doc amendment: env prepare commandJingLu51-22/+8
JIRA: YARDSTICK-637 Change-Id: I7e5e1afb7b5a7e97aa070c03cded3be285d97cc2 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit d91ddc83daa7ac112c764e74621b48455d038e7f)
2017-10-12Use "protocol" parameters in iperf3 yaml and task fileAce Lee3-12/+34
JIRA: YARDSTICK-755 There is a history problem that iperf use udp to set a net protocol. This code will change it to protocol. so you could use 'tcp','udp' and other protocol. Change-Id: I1a101013dfe58165a3ed08aa77f0aa2f73d57a12 Signed-off-by: Ace Lee <liyin11@huawei.com> (cherry picked from commit 10f85b332c4b1f55e651aeb9c45b328e1ebdc2af)
2017-10-10TC008 Interrupt Affinity FixJing Zhang1-3/+8
The smp_affinity takes hex mask, currently it is given hex number. Change-Id: Id738bfe10551dad1f5df48910a230b12f50d1b3d JIRA: YARDSTICK-818 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-10-10Bugfix: Update HW lb config VNF thread to start from core 1Deepak S1-0/+3
Change-Id: Ib0007fa3689b90346598baaef5c6e88d4fdf444a Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-10install pmu tools collectd pluginRoss Brattain11-2/+325
Added review dependency, removed collectd commit-id replicating bash script, added pmu roles to playbook Create local mirror for event list generation, copy script to image, and run event list generation at runtime if intel_pmu is enabled. Change-Id: Ie46a2b197f4d2037cf3eed194764ce9eb5670415 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-10NSB Prox vPE TestAbhijit Sinha14-78/+7628
JIRA: YARDSTICK-802 Addition of Prox vPE test case - The tests supports BM, Openstack Heat - Supports 4 ports - Grafana dashboards included - Added support for parameters.lua for prox additional files - Unit tests for code coverage Change-Id: I5cccb351dacba88a293ae4b8aba1f0a803d62e6d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-10KVMFORNFV:Livemigration testcase changes in YardstickNavya1-2/+3
This patch includes changing the function call to place the respective bash file to the given TARGET_SCRIPT path. Change-Id: Iba2adf4bdb6d9045493f5099e29ade4e8e6b5cd3 Signed-off-by: Navya <navyax.bathula@intel.com>
2017-10-10libyajl: install from pkgDhaval Patel9-110/+3
libyajl needed for ovs_events and ovs_stats, removed installing from src and rather installing as deb pkg Change-Id: Ic1ebf88304bbc7f4fa7b9b51c95f1e8e729e71e3 Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
2017-10-08Update load_images.sh to MCP@aarch64Cristina Pauna1-33/+9
The load_images.sh script still contained old functionality. The changes are: - don't use TestVM anymore, MCP does not load that by default like Fuel did upload the cirros image instead - don't upload the kernel separately for aarch64, one part image works now - add the needed extra-properties accordingly to each image The script was tested on arm, the test are running now without errors JIRA: ARMBAND-285 Change-Id: Iee8ce6cde43bebceb2edbb1310ea81c665876aff Signed-off-by: Cristina Pauna <cristina.pauna@enea.com> (cherry picked from commit af71c468fe83a5149e0e18cdb233e059302209e3)
2017-10-06fix random test_task unittest fail due to os.environ mockRoss Brattain1-10/+13
sometime Jenkins fails due to what I guess are concurrency problems in os.environ mock ====================================================================== FAIL: tests.unit.benchmark.core.test_task.TaskTestCase.test_parse_suite_with_constraint_no_args tags: worker-10 ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python3.5/unittest/mock.py", line 1157, in patched return func(*args, **keywargs) File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-euphrates/tests/unit/benchmark/core/test_task.py", line 208, in test_parse_suite_with_constraint_no_args task_files, task_args, task_args_fnames = t.parse_suite() File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-euphrates/yardstick/benchmark/core/task.py", line 455, in parse_suite cur_pod = os.environ.get('NODE_NAME', None) File "/usr/lib/python3.5/unittest/mock.py", line 917, in __call__ return _mock_self._mock_call(*args, **kwargs) File "/usr/lib/python3.5/unittest/mock.py", line 976, in _mock_call result = next(effect) StopIteration Ran 1262 tests in 2.375s FAILED (id=0, failures=1) error: testr failed (1) + testr failing Replace the mock decorator with a context manager to try to reduce the scope and duration of the mock. Change-Id: I342fe6c403e66c53ac4c39fd88fa9047cdfae5d9 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 2fadf7aec9e2761c39d29d8af1ee7d69d154652d)