aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-10-12ping: always save rtt data, influxdb ignore empty dataRoss Brattain7-14/+35
If the SLA was failing we were raising AssertionError and not storing the rtt in the data dict. This caused influxdb parse errors because the data was empty. Fixup influxdb to ignore records with no data, so we don't try to parse no data. Change the ping logic to always record the rtt result even if the SLA was not met. Also fixup ping logic in cases where ping does not return results. If SLA is defined use SLA * 10 otherwise use large float that doesn't break the grafana scale too much, maybe 999999 JIRA: YARDSTICK-809 Change-Id: Id2d51216581644a80e8c7b9aa98919a766008adf Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13Merge "task: drain background runner queues"Ross Brattain2-6/+18
2017-10-13Merge "KVMFORNFV: To verify the execution of the bash script"Jing Lu1-5/+20
2017-10-13Merge "Bugfix: Add opnfv_os-nosdn-ovs_dpdk testsuite for Compass4nfv"Jing Lu2-0/+124
2017-10-13Bugfix: Add opnfv_os-nosdn-ovs_dpdk testsuite for Compass4nfvJingLu52-0/+124
Change-Id: I35e6471bb561eb773bd188b36b912969188955d2 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-13Bugfix: Add opnfv_os-odl_l2-moon-ha_daily testsuite for Compass4nfvJingLu51-0/+62
Change-Id: I46c6b56e1293c3d594804d77a73c391922f03653 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-12Merge "increase number of open files for collectd"Ross Brattain5-1/+41
2017-10-12collectd: set intel_pmu events path and OVS socket pathRoss Brattain7-60/+119
switch from hardcoded path to dynamic path based on bin_path also enable proxy for install_collectd add barometer settings for virt and ovs_stats Change-Id: Id138aef548332a3e3fcb3963b746e7c9f10c0948 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-12Merge "NSB Prox Grafana dashboard updates"Ross Brattain34-3742/+6514
2017-10-12Version changes for collectd, pmu-tools, intel_cmt_catDhaval Patel3-3/+3
Bumping collectd version to include pmu plugin enablement, bounding pmu-tools and intel_cmt_cat to a commit-id Change-Id: I666d52c5574cec0caebb07535332984fa77e5b65 Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
2017-10-12NSB Prox Grafana dashboard updatesAbhijit Sinha34-3742/+6514
JIRA: YARDSTICK-802 Updating the Grafana dashboards with common data format for all BM and Opensatck Prox tests and adding minor improvements - Correct the test description - Re-run the tests and verify that all the fields are graph correct - Label the axes correctly. eg: For Throughput added label "MPPS" Change-Id: I62b471926fe3c4c8876b70053a92d06f4373e296 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-10-12KVMFORNFV: To verify the execution of the bash scriptNavya1-5/+20
This patch is used to verify the parameters passed and the flow of qemu_migrate_benchmark.bash script to handle the bugs Change-Id: Ifc1bfa7a91a2eed178b9dc984c222074f06e0599 Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
2017-10-12Change 'SUCCESS' to 'PASS' when report to MongoDBchenjiankun1-2/+2
JIRA: YARDSTICK-822 To keep consistent with other testing project, we need to change 'SUCCESS' to 'PASS', 'FAILED' to 'FAIL'. Change-Id: I392e4dc6dd2e028cd43cba0d1bf8ee04618326d7 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-10-12Bugfix: Reference for the tool used in TC044 mentioned in the user guide is ↵JingLu51-1/+1
wrong JIRA: YARDSTICK-821 Change-Id: I09b189008df4ec2e6db92cf24c45d8206ed2062f Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-12Merge "Bug in NSB Prox ACL Test 4 Port"Ross Brattain1-1/+1
2017-10-12Merge "Doc amendment: env prepare command"Ross Brattain1-22/+8
2017-10-12Merge "Use "protocol" parameters in iperf3 yaml and task file"Ross Brattain3-12/+34
2017-10-11cgnat: duplicate keys are not allowedRoss Brattain1-2/+0
the current ConfigParser does not handle duplicate keys in ini files. Change-Id: Iaafbbab740a809a59edfd93c84d0029ef10ac6f3 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-11increase number of open files for collectdRoss Brattain5-1/+41
for collectd KPIs we need may need to open 10,000+ files one file for each core * number of CPU counters we read. Use the ansible pam_limits moules to increase the nofile setting. This should allow the VNF to boot with increased number of files open Change-Id: I46b75d5ca59e8e359c985a1e37daaee89897884c Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-11task: drain background runner queuesRoss Brattain2-6/+18
We were not draining the queues in the background runners. Modify the main runner_join loop to loop over all the runners and drain them. The runner join method does extra work for periodic actions so we can't change its behavior. Instead create a new poll() method and use that to check runner status Change-Id: I9466ba40a6a4c45c82cedff279cbb4817c6b66ad Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-11Bug in NSB Prox ACL Test 4 PortDanielMartinBuckley1-1/+1
JIRA: YARDSTICK-802 Generator was incorrectly configured to generated traffic for p0, p1 (twice), and p3 Should be p0, p1, p2 and p3 Change-Id: Ib62a3c6523b1eda635b8c727c36e140fd480003e Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-10-11Use "protocol" parameters in iperf3 yaml and task fileAce Lee3-12/+34
JIRA: YARDSTICK-755 There is a history problem that iperf use udp to set a net protocol. This code will change it to protocol. so you could use 'tcp','udp' and other protocol. Change-Id: I1a101013dfe58165a3ed08aa77f0aa2f73d57a12 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-10-11private-> uplink and public->downlinkDeepak S60-129/+135
changing private and public to new uplink/downlink name Change-Id: I8c3f582ba5592418a397e2500e0b998c3eed54f2 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-10Enable intel_pmu plugin in collectdDeepak S1-5/+5
Change-Id: I62c6416e5c79d0b90880985bb5c076b65e34192e Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-10TC008 Interrupt Affinity FixJing Zhang1-3/+8
The smp_affinity takes hex mask, currently it is given hex number. Change-Id: Id738bfe10551dad1f5df48910a230b12f50d1b3d JIRA: YARDSTICK-818 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-10-10Doc amendment: env prepare commandJingLu51-22/+8
JIRA: YARDSTICK-637 Change-Id: I7e5e1afb7b5a7e97aa070c03cded3be285d97cc2 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-09Bugfix: Update HW lb config VNF thread to start from core 1Deepak S1-0/+3
Change-Id: Ib0007fa3689b90346598baaef5c6e88d4fdf444a Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-09install pmu tools collectd pluginRoss Brattain11-2/+325
Added review dependency, removed collectd commit-id replicating bash script, added pmu roles to playbook Create local mirror for event list generation, copy script to image, and run event list generation at runtime if intel_pmu is enabled. Change-Id: Ie46a2b197f4d2037cf3eed194764ce9eb5670415 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-06Merge "libyajl: install from pkg"Ross Brattain9-110/+3
2017-10-06Merge "NSB Prox vPE Test"Ross Brattain14-78/+7628
2017-10-06NSB Prox vPE TestAbhijit Sinha14-78/+7628
JIRA: YARDSTICK-802 Addition of Prox vPE test case - The tests supports BM, Openstack Heat - Supports 4 ports - Grafana dashboards included - Added support for parameters.lua for prox additional files - Unit tests for code coverage Change-Id: I5cccb351dacba88a293ae4b8aba1f0a803d62e6d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-06Merge "fix random test_task unittest fail due to os.environ mock"Ross Brattain1-10/+13
2017-10-06fix random test_task unittest fail due to os.environ mockRoss Brattain1-10/+13
sometime Jenkins fails due to what I guess are concurrency problems in os.environ mock ====================================================================== FAIL: tests.unit.benchmark.core.test_task.TaskTestCase.test_parse_suite_with_constraint_no_args tags: worker-10 ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python3.5/unittest/mock.py", line 1157, in patched return func(*args, **keywargs) File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-euphrates/tests/unit/benchmark/core/test_task.py", line 208, in test_parse_suite_with_constraint_no_args task_files, task_args, task_args_fnames = t.parse_suite() File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-euphrates/yardstick/benchmark/core/task.py", line 455, in parse_suite cur_pod = os.environ.get('NODE_NAME', None) File "/usr/lib/python3.5/unittest/mock.py", line 917, in __call__ return _mock_self._mock_call(*args, **kwargs) File "/usr/lib/python3.5/unittest/mock.py", line 976, in _mock_call result = next(effect) StopIteration Ran 1262 tests in 2.375s FAILED (id=0, failures=1) error: testr failed (1) + testr failing Replace the mock decorator with a context manager to try to reduce the scope and duration of the mock. Change-Id: I342fe6c403e66c53ac4c39fd88fa9047cdfae5d9 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-06Update load_images.sh to MCP@aarch64Cristina Pauna1-33/+9
The load_images.sh script still contained old functionality. The changes are: - don't use TestVM anymore, MCP does not load that by default like Fuel did upload the cirros image instead - don't upload the kernel separately for aarch64, one part image works now - add the needed extra-properties accordingly to each image The script was tested on arm, the test are running now without errors JIRA: ARMBAND-285 Change-Id: Iee8ce6cde43bebceb2edbb1310ea81c665876aff Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-10-05KVMFORNFV:Livemigration testcase changes in YardstickNavya1-2/+3
This patch includes changing the function call to place the respective bash file to the given TARGET_SCRIPT path. Change-Id: Iba2adf4bdb6d9045493f5099e29ade4e8e6b5cd3 Signed-off-by: Navya <navyax.bathula@intel.com>
2017-10-05Fixed compilation of latest samplevnfMaciej Skrocki7-1/+105
added download_civetweb and install_civetweb roles. Change-Id: Id4f60cc07b3befc7edb3cfc38773fe1a73a44c1f Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-10-05libyajl: install from pkgDhaval Patel9-110/+3
libyajl needed for ovs_events and ovs_stats, removed installing from src and rather installing as deb pkg Change-Id: Ic1ebf88304bbc7f4fa7b9b51c95f1e8e729e71e3 Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
2017-10-05Merge "Adding scale out templates for ovs_dpdk/sriov using 2 node setup"Ross Brattain19-0/+1378
2017-10-05Merge "Adding 2 node ixia generic scale-out test case generation"Ross Brattain18-0/+1367
2017-10-05Merge "Adding auto generate scale-out support for correlated traffic"Ross Brattain14-0/+1263
2017-10-05Merge "Added example TC with collectd on compute node"Ross Brattain2-9/+92
2017-10-05Merge "heat: add port name as port"Ross Brattain2-0/+3
2017-10-05Merge "add wait_for_instantiate"Ross Brattain1-0/+7
2017-10-05Merge "Add intermediate variables for attacker,monitor,result_checker"Ross Brattain12-52/+69
2017-10-05Merge "Adding sample testcases to run on standalone context"Ross Brattain25-0/+1799
2017-10-05Merge "rewrite _generate_pod_yaml to combine name and pkey setting"Ross Brattain1-16/+13
2017-10-05add wait_for_instantiateRoss Brattain1-0/+7
Change-Id: Idc54fc907dba4603984712fc43a0db8dfd4b7374 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-05heat: add port name as portRoss Brattain2-0/+3
Change-Id: Ibd159359c6f57d573a909d6841c121c15bf692c1 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-05Merge "NSB Prox minor refactor of BNG"Ross Brattain2-7/+10
2017-10-04Making sure yardstick container uses hosts timezoneMaciej Skrocki1-1/+2
This is required for influxdb results being reported "in the future" when the timezones do not match. Change-Id: Ic41e19d26c46b6ccfa6dacddb595236af19e437a Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>