summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-10-17resource: move make_resource_profile to ResourceProfileRoss Brattain2-13/+13
move factory method from Collector to ResourceProfile Change-Id: I1ddf3cffed7a3b2d45aa9cbffd3c0a5925c325d6 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-16bugfix: remove pod_name in host and unify host parameterrexlee877616-45/+56
for none-ha test case, use host to be parameter for ha test case, use attack_host as parameter Change-Id: I053df00adab17814dd54584a1ae081548163dc68 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 18b2c357c3d281fbdf5261958ef60abb98915486)
2017-10-16Create test suite opnfv_os-nosdn-openbaton-ha_dailychenjiankun1-0/+62
JIRA: YARDSTICK-823 We need to create test sutie opnfv_os-nosdn-openbaton-ha_daily.yaml to enable this scenario. Change-Id: Ia800a9c74aaecf0d73e6f0fd559630b741ad2432 Signed-off-by: chenjiankun <chenjiankun1@huawei.com> (cherry picked from commit 164d60cedff53c520e4c36a37cb1a02bf873f7fb)
2017-10-13Support to add multiple src/dst ports in flowDeepak S1-0/+6
Change-Id: I888a6029efaad8308de8df6b6787dd46af5f1c55 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-13task: use CONF_FILE from constantsRoss Brattain1-2/+2
I'm not sure why we hardcoded config_file when the CONF_FILE constant will work. Change-Id: I45a1dc17ac2b185c659725f55462214acb74838d Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13collectd: set intel_pmu events path and OVS socket pathRoss Brattain7-60/+119
switch from hardcoded path to dynamic path based on bin_path also enable proxy for install_collectd add barometer settings for virt and ovs_stats Change-Id: Id138aef548332a3e3fcb3963b746e7c9f10c0948 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13Version changes for collectd, pmu-tools, intel_cmt_catDhaval Patel3-3/+3
Bumping collectd version to include pmu plugin enablement, bounding pmu-tools and intel_cmt_cat to a commit-id Change-Id: I666d52c5574cec0caebb07535332984fa77e5b65 Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
2017-10-13NSB Prox Grafana dashboard updatesAbhijit Sinha34-3742/+6514
JIRA: YARDSTICK-802 Updating the Grafana dashboards with common data format for all BM and Opensatck Prox tests and adding minor improvements - Correct the test description - Re-run the tests and verify that all the fields are graph correct - Label the axes correctly. eg: For Throughput added label "MPPS" Change-Id: I62b471926fe3c4c8876b70053a92d06f4373e296 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-10-13KVMFORNFV: To verify the execution of the bash scriptNavya1-5/+20
This patch is used to verify the parameters passed and the flow of qemu_migrate_benchmark.bash script to handle the bugs Change-Id: Ifc1bfa7a91a2eed178b9dc984c222074f06e0599 Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
2017-10-13Move arp route tbl to script and update defailt vnf config filesDeepak S9-143/+21
Change-Id: I8674caa15c9fc32cfacb17f558da5fb31094877e Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13cgnat: duplicate keys are not allowedRoss Brattain1-2/+0
the current ConfigParser does not handle duplicate keys in ini files. Change-Id: Iaafbbab740a809a59edfd93c84d0029ef10ac6f3 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13increase number of open files for collectdRoss Brattain5-1/+41
for collectd KPIs we need may need to open 10,000+ files one file for each core * number of CPU counters we read. Use the ansible pam_limits moules to increase the nofile setting. This should allow the VNF to boot with increased number of files open Change-Id: I46b75d5ca59e8e359c985a1e37daaee89897884c Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13task: drain background runner queuesRoss Brattain2-6/+18
We were not draining the queues in the background runners. Modify the main runner_join loop to loop over all the runners and drain them. The runner join method does extra work for periodic actions so we can't change its behavior. Instead create a new poll() method and use that to check runner status Change-Id: I9466ba40a6a4c45c82cedff279cbb4817c6b66ad Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-13Bug in NSB Prox ACL Test 4 PortDanielMartinBuckley1-1/+1
JIRA: YARDSTICK-802 Generator was incorrectly configured to generated traffic for p0, p1 (twice), and p3 Should be p0, p1, p2 and p3 Change-Id: Ib62a3c6523b1eda635b8c727c36e140fd480003e Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-10-13Updating NSBperf to print right testcaseDeepak S1-2/+18
Change-Id: I7be7bc61624fa14eb552477bdc701a44d65e68b7 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-13private-> uplink and public->downlinkDeepak S60-129/+135
changing private and public to new uplink/downlink name Change-Id: I8c3f582ba5592418a397e2500e0b998c3eed54f2 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-13Enable intel_pmu plugin in collectdDeepak S1-5/+5
Change-Id: I62c6416e5c79d0b90880985bb5c076b65e34192e Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-13ping: always save rtt data, influxdb ignore empty dataRoss Brattain7-14/+35
If the SLA was failing we were raising AssertionError and not storing the rtt in the data dict. This caused influxdb parse errors because the data was empty. Fixup influxdb to ignore records with no data, so we don't try to parse no data. Change the ping logic to always record the rtt result even if the SLA was not met. Also fixup ping logic in cases where ping does not return results. If SLA is defined use SLA * 10 otherwise use large float that doesn't break the grafana scale too much, maybe 999999 JIRA: YARDSTICK-809 Change-Id: Id2d51216581644a80e8c7b9aa98919a766008adf Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit af011b16787e8fd9fc6f918b1d1427dd1be562ec)
2017-10-13Bugfix: Add opnfv_os-nosdn-ovs_dpdk testsuite for Compass4nfvJingLu52-0/+124
Change-Id: I35e6471bb561eb773bd188b36b912969188955d2 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-13Bugfix: Add opnfv_os-odl_l2-moon-ha_daily testsuite for Compass4nfvJingLu51-0/+62
Change-Id: I46c6b56e1293c3d594804d77a73c391922f03653 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-12Change 'SUCCESS' to 'PASS' when report to MongoDBchenjiankun1-2/+2
JIRA: YARDSTICK-822 To keep consistent with other testing project, we need to change 'SUCCESS' to 'PASS', 'FAILED' to 'FAIL'. Change-Id: I392e4dc6dd2e028cd43cba0d1bf8ee04618326d7 Signed-off-by: chenjiankun <chenjiankun1@huawei.com> (cherry picked from commit f4680c872fbb34816d809c41852740f5cb960fd1)
2017-10-12Bugfix: Reference for the tool used in TC044 mentioned in the user guide is ↵JingLu51-1/+1
wrong JIRA: YARDSTICK-821 Change-Id: I09b189008df4ec2e6db92cf24c45d8206ed2062f Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-12Merge "Doc amendment: env prepare command" into stable/euphratesJing Lu1-22/+8
2017-10-12Doc amendment: env prepare commandJingLu51-22/+8
JIRA: YARDSTICK-637 Change-Id: I7e5e1afb7b5a7e97aa070c03cded3be285d97cc2 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit d91ddc83daa7ac112c764e74621b48455d038e7f)
2017-10-12Use "protocol" parameters in iperf3 yaml and task fileAce Lee3-12/+34
JIRA: YARDSTICK-755 There is a history problem that iperf use udp to set a net protocol. This code will change it to protocol. so you could use 'tcp','udp' and other protocol. Change-Id: I1a101013dfe58165a3ed08aa77f0aa2f73d57a12 Signed-off-by: Ace Lee <liyin11@huawei.com> (cherry picked from commit 10f85b332c4b1f55e651aeb9c45b328e1ebdc2af)
2017-10-10TC008 Interrupt Affinity FixJing Zhang1-3/+8
The smp_affinity takes hex mask, currently it is given hex number. Change-Id: Id738bfe10551dad1f5df48910a230b12f50d1b3d JIRA: YARDSTICK-818 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-10-10Bugfix: Update HW lb config VNF thread to start from core 1Deepak S1-0/+3
Change-Id: Ib0007fa3689b90346598baaef5c6e88d4fdf444a Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-10install pmu tools collectd pluginRoss Brattain11-2/+325
Added review dependency, removed collectd commit-id replicating bash script, added pmu roles to playbook Create local mirror for event list generation, copy script to image, and run event list generation at runtime if intel_pmu is enabled. Change-Id: Ie46a2b197f4d2037cf3eed194764ce9eb5670415 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-10NSB Prox vPE TestAbhijit Sinha14-78/+7628
JIRA: YARDSTICK-802 Addition of Prox vPE test case - The tests supports BM, Openstack Heat - Supports 4 ports - Grafana dashboards included - Added support for parameters.lua for prox additional files - Unit tests for code coverage Change-Id: I5cccb351dacba88a293ae4b8aba1f0a803d62e6d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-10KVMFORNFV:Livemigration testcase changes in YardstickNavya1-2/+3
This patch includes changing the function call to place the respective bash file to the given TARGET_SCRIPT path. Change-Id: Iba2adf4bdb6d9045493f5099e29ade4e8e6b5cd3 Signed-off-by: Navya <navyax.bathula@intel.com>
2017-10-10libyajl: install from pkgDhaval Patel9-110/+3
libyajl needed for ovs_events and ovs_stats, removed installing from src and rather installing as deb pkg Change-Id: Ic1ebf88304bbc7f4fa7b9b51c95f1e8e729e71e3 Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com>
2017-10-08Update load_images.sh to MCP@aarch64Cristina Pauna1-33/+9
The load_images.sh script still contained old functionality. The changes are: - don't use TestVM anymore, MCP does not load that by default like Fuel did upload the cirros image instead - don't upload the kernel separately for aarch64, one part image works now - add the needed extra-properties accordingly to each image The script was tested on arm, the test are running now without errors JIRA: ARMBAND-285 Change-Id: Iee8ce6cde43bebceb2edbb1310ea81c665876aff Signed-off-by: Cristina Pauna <cristina.pauna@enea.com> (cherry picked from commit af71c468fe83a5149e0e18cdb233e059302209e3)
2017-10-06fix random test_task unittest fail due to os.environ mockRoss Brattain1-10/+13
sometime Jenkins fails due to what I guess are concurrency problems in os.environ mock ====================================================================== FAIL: tests.unit.benchmark.core.test_task.TaskTestCase.test_parse_suite_with_constraint_no_args tags: worker-10 ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python3.5/unittest/mock.py", line 1157, in patched return func(*args, **keywargs) File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-euphrates/tests/unit/benchmark/core/test_task.py", line 208, in test_parse_suite_with_constraint_no_args task_files, task_args, task_args_fnames = t.parse_suite() File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-euphrates/yardstick/benchmark/core/task.py", line 455, in parse_suite cur_pod = os.environ.get('NODE_NAME', None) File "/usr/lib/python3.5/unittest/mock.py", line 917, in __call__ return _mock_self._mock_call(*args, **kwargs) File "/usr/lib/python3.5/unittest/mock.py", line 976, in _mock_call result = next(effect) StopIteration Ran 1262 tests in 2.375s FAILED (id=0, failures=1) error: testr failed (1) + testr failing Replace the mock decorator with a context manager to try to reduce the scope and duration of the mock. Change-Id: I342fe6c403e66c53ac4c39fd88fa9047cdfae5d9 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 2fadf7aec9e2761c39d29d8af1ee7d69d154652d)
2017-10-06Fixed compilation of latest samplevnfMaciej Skrocki7-1/+105
added download_civetweb and install_civetweb roles. Change-Id: Id4f60cc07b3befc7edb3cfc38773fe1a73a44c1f Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-10-06add wait_for_instantiateRoss Brattain1-0/+7
Change-Id: Idc54fc907dba4603984712fc43a0db8dfd4b7374 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-06heat: add port name as portRoss Brattain2-0/+3
Change-Id: Ibd159359c6f57d573a909d6841c121c15bf692c1 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-06Making sure yardstick container uses hosts timezoneMaciej Skrocki1-1/+2
This is required for influxdb results being reported "in the future" when the timezones do not match. Change-Id: Ic41e19d26c46b6ccfa6dacddb595236af19e437a Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-10-06rewrite _generate_pod_yaml to combine name and pkey settingRoss Brattain1-16/+13
just deepcopy and change. This will probably break in the future if we use anything other than dicts and list. Change-Id: I9a9b0c5b09b3e3ebd7ed593bf6339ea030605f93 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-06Disable VNF deploy by defaultDeepak S3-9/+9
Change-Id: I27bcc41c855f34fb1fd0332fc24e7bf0b2af4ec2 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-06NSB Prox minor refactor of BNGAbhijit Sinha2-7/+10
JIRA: YARDSTICK-802 - Updated the BNG code with minor refactor. - Corrected the CPE core name - Update binsearch traffic profile with 64B Change-Id: Iae0be766edb986520045655fa567651711813a8b Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-10-06Add intermediate variables for attacker,monitor,result_checkerqiujuan12-52/+69
JIRA: YARDSTICK-790 Change-Id: I6bb36c98b8673155d3142fc54cfb39315d5ce613 Signed-off-by: qiujuan <juan_qiu@tongji.edu.cn>
2017-10-06Added example TC with collectd on compute nodeMaciej Skrocki2-9/+92
To be used with yardstick/etc/yardstick/nodes/pod.yaml.collectd.sample Change-Id: I6eff4f6adf57596e06c685ab87b83699696ad7b6 Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-10-06Adding sample testcases to run on standalone contextDeepak S25-0/+1799
- vFW - vCGNAPT - vACL - UDP Replay - vPE (Only OVS supported) Change-Id: Idbc4d1d6bc1283e40d2fcb9457a871a9198ad147 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-06Adding auto generate scale-out support for correlated trafficDeepak S14-0/+1263
Change-Id: I2755b596068545c1a3a672ceff47d814a44ae050 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-06Adding 2 node ixia generic scale-out test case generationDeepak S18-0/+1367
Change-Id: I7da2d5bcd7c58c669e28a7271e4c6848c003e84a Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-06Adding scale out templates for ovs_dpdk/sriov using 2 node setupDeepak S19-0/+1378
2 - node setup: - Traffic generator starts new stream on both uplink and downlink This patch addes amsible scripts to enable scale_out testcases - vfw Change-Id: I0340636bce3e74cd6175f728b9e7e014a4eb2fd5 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-10-04NSB PROX test hang fixesRoss Brattain30-130/+440
The PROX tests were hanging in the duration runner. These are fixes for various errors: raise error in collect_kpi if VNF is down move prox dpdk_rebind after collectd stop fix dpdk nicbind rebind to group by drivers prox: raise error in collect_kpi if the VNF is down prox: add VNF_TYPE for consistency sample_vnf: debug and fix kill_vnf pkill is not matching some executable names, add some debug process dumps and try switching back to killall until we can find the issue sample_vnf: add default timeout, so we can override default 3600 SSH timeout collect_kpi is the point at which we check the VNFs and TGs for failures or exits queues are the problem make sure we aren't silently blocking on non-empty queues by canceling join thread in subprocess fixup duration runner to close queues and other attempt to stop duration runner from hanging VnfdHelper: memoize port_num resource: fail if ssh can't connect at the end of 3600 second test our ssh connection is dead, so we can't actually stop collectd unless we reconnect fix stop() logic to ignore ssh errors Change-Id: I6c8e682a80cb9d00362e2fef4a46df080f304e55 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-03Switched nsb_setup to pull stable yardstick docker imageMaciej Skrocki1-1/+1
Change-Id: I4474ee65899d5f60e657835e8d80de0d372abd22 Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-10-03Enable multi-port perf in trex as TGDeepak S5-22/+29
set TRex -c option for threads per port based on hardware number of queues. We can't auto-detect number of queues and we can't use more than one thread per core on systems with single-queue interfaces, so move the option to the config file options: tg_0: queues_per_port: 2 also enable trex debug by removing >/dev/null redirection options: tg_0: trex_server_debug: true Change-Id: I46da187849282bf28f4ef5b333e1ae890e202768 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-03runners: add timeout to queue putRoss Brattain2-6/+14
we don't want to block the test waiting to put KPIs Add moderate timeout. In case we do timeout, it doesn't matter if we drop intermitten KPIs Change-Id: I049c785355993e6b286748a5c897d54dd2923dc9 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>