aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-03-09Do NOT hardcode interface speed for PROX testsDanielMartinBuckley10-42/+75
JIRA: YARDSTICK-1035 Do not hardcode NIC/interface speed in PROX test. Test assumes NIC used is 10Gbps. This is incorrect. It could support 1Gbps, 10Gbps, 25Gbps, 40Gbps or something else. This is used to calculate pps (Packets Per Second) In Baremetal the NIC speed could be extracted. however when run on a virtual machine this is not possible. Solution: Add in options section of test file. eg. Options: interface_speed_gbps: 10 Where 10 refers to a 10Gbps. In a setup where multiple interfaces are used. This will refer to the speed of the slowest connection. Change-Id: I89ab16479a2cdd1d79e52cbcc5a972762c60d057 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-03-09Add context name to Dummy testRodolfo Alonso Hernandez1-0/+1
Since I1447fb5ed447691eaeb0a97f928c0b3333799d07, the context name is a mandatory parameter for every context. JIRA: YARDSTICK-886 Change-Id: I0ccb7e9fabdf6bc2890d2e4763f53baee06c87b2 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-09[Bug Fix] Support nova create instance operationDimitrios Markou2-0/+50
Add the ability to create a nova instance through the operation perspective JIRA: YARDSTICK-1038 Change-Id: Idac141958d65cc6c53b6bd27df83ac74ae8804ec Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-08Reduce the log level if TRex client is no connectedRodolfo Alonso Hernandez1-1/+1
If the TRex client is no connected, the testcase will write an exception log that will be thrown to the CLI. There is no need to show the traceback in the CLI in this case. The log level is reduced to "error". JIRA: YARDSTICK-1059 Change-Id: I22a52cedd6479f4cf692ba16a8415f7b8f574ab1 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-08Merge "Fix numbering and html (generated) alignment"Emma Foley1-3/+5
2018-03-08Merge "[bugfix] report generate command print error"Rodolfo Alonso Hernandez1-1/+1
2018-03-08Supporting user config task parameters in GUIchenjiankun7-29/+143
JIRA: YARDSTICK-981 We need to add function to enable user to config task parameters in GUI. The way to config must be more friendly. Change-Id: I8746149084f1d554b48ed392f2fef4748e279dfb Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-08Fetch Nova instance's private IPDimitrios Markou2-0/+28
Add the capability to fetch the private IP of a Nova instance through the operation perspective. JIRA: YARDSTICK-1040 Change-Id: Idc3d62bcd3f477a03a89f7dcc8d8616f3cfa2742 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-08Assign nova instance to security groupDimitrios Markou3-0/+55
Support the assigning of a nova instance to an existing security group through the operation perspective Change-Id: Ic1c26031c25d400fede2ecb298a66aec42dcfbc5 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-08[bugfix] report generate command print errorrexlee87761-1/+1
JIRA: YARDSTICK-1056 Change-Id: I32ab9ae7482f6b81e00d6d3e7e858d980a2dd95f Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-08Add ODL noHA testcaseDimitrios Markou2-0/+285
This testcase confirms the resiliency of Opendaylight in a noHA deployment SPEC: https://gerrit.opnfv.org/gerrit/#/c/49245/ Change-Id: I810011c35c7bb6377f9295330cf7122d10cf74c3 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-08Merge "Allow VMs to access internet"Rodolfo Alonso Hernandez7-4/+62
2018-03-08Update the fuel pod.yamlDimitrios Markou2-1/+22
Fuel except Controller and Compute nodes it deploys an ODL node in noHA and HA deployment and also a Gateway node in a noHA deployment. So it is essential to describe them in Fuel's pod. JIRA: YARDSTICK-1050 Change-Id: Iee6c25c5b2e2e4e661ceb0591bf2437f7f7fa7f8 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-07Fix numbering and html (generated) alignmentDino Madarang1-3/+5
Fix numbering from 3,5,6 to 3,4,5 and alignment of the numbered list in HTML output. Trim lines to 79 chars or less. Change-Id: Icf233ef6bbf99ac0dcd8a9fc2599aee9dc1a46fd Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com> Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> Reviewed-by: Emma Foley <emma.l.foley@intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-07Merge "NFVi Test stops after one hour even if configured context duration is ↵Ross Brattain1-2/+4
longer"
2018-03-07bugfix: fix prepare_env.sh shell quoteRoss Brattain1-2/+2
JIRA: YARDSTICK-1051 Change-Id: If28bc0f2fe2e3cdec95882bb2abedf839e6ac2e0 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-07NFVi Test stops after one hour even if configured context duration is longerDanielMartinBuckley1-2/+4
JIRA: YARDSTICK-1021 If the Test is to take longer than the Default Duration timer use defined test time. If not use Default Duration time Change-Id: Idacc188e199ff031310b9826238b63ed3f2ea409 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-03-07Merge "ansible: fix urlsplit('hostname') in convert_openrc"Emma Foley1-1/+1
2018-03-07Merge "Add l2fwd module in Tgen mode"Jack Chan8-0/+1028
2018-03-07Merge "Add test case sample to enable mixed network"Jack Chan1-0/+65
2018-03-07Merge "add opnfv_k8-nosdn-lb_ceph-noha_daily.yaml"Ross Brattain1-0/+18
2018-03-07Merge "[bugfix]tc006 failed due to volume attached to different location ↵Rex Lee2-6/+26
"/dev/vdc""
2018-03-06Merge "Add start service operation"Ross Brattain1-0/+3
2018-03-06add opnfv_k8-nosdn-lb_ceph-noha_daily.yamlRoss Brattain1-0/+18
https://build.opnfv.org/ci/job/yardstick-joid-baremetal-daily-master/2206/console Change-Id: Ib5fc186caa285ef8f6a879fd1fd2f786b07a257a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-06Merge "Move SSH key generation from "init" to "deploy""Emma Foley2-37/+91
2018-03-06Move SSH key generation from "init" to "deploy"Rodolfo Alonso Hernandez2-37/+91
In [1], the Context SSH key generation was modified; the SSH now has a name matching the name context (which depends on the given name and the task ID). In a test suite, the task ID is the same for all test cases executed in the same batch. If the context name of different test cases is the same (there is no impediment, e.g.: "demo", "yardstick"), the SSH key filename will be the same. Currently the SSH key generation is done during the initialization process, at the begining of the test suite executing. If, by coincidence, two test cases have the same context name, the first one will remove the SSH key file during the "undeploy" process; then the second one will rise an exception because the SSH key file is deleted. This patch moves the SSH key file generation from the initialization process to the context deploy process: TEST SUITE: - init: parse all test cases - test case 1: - deploy (generate SSH keys) - run - undeploy (delete SSH keys) - test case 2: ... [1] Id175061d6cfe23a068bb3d12ce176c1f176e8236 JIRA: YARDSTICK-1045 Change-Id: I05dc46db20d2a0cba3092c415ce9b248513406fb Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-06Add start service operationDimitrios Markou1-0/+3
Support the capability to start a service through the operation perspective. JIRA: YARDSTICK-1041 Change-Id: If817f4a522546de2e4a826c1e85b3545e6f3efed Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-03-06Replace assert statements in testsEmma Foley3-21/+21
JIRA: YARDSTICK-966 Change-Id: Ic98711fa1a31d27fcb60bd96b1b3e22b5cca86b3 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-03-06Allow VMs to access internetJohn O Loughlin7-4/+62
Add option to the config file for default network. Check to see if 1 default network is defined. Enable nat on all defined networks. Add default gateway to VM JIRA: YARDSTICK-1016 Change-Id: Ie943a7c7b4f1a9673774cf8fedaba0af352cd7f4 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-03-06Merge "Enable heat context to support existing network"Jack Chan9-34/+205
2018-03-06testcase start service script fail on centos envJingLu510-21/+74
JIRA: YARDSTICK-676 In the HA test cases, script 'start_serice.bash' is used to restart the OpenStack service to recover killed process. It uses 'lsb_release' command to determine the host linux distribution and the target Openstack service name. In some environments, the 'lsb_release' is not installed hence will cause process-recovery failure. This patch states the software precondions in the HA test case descriptions. Change-Id: Ie3f503b8185deec13eebbcacbeac57c0a018cb73 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-03-05Merge "Bug fix ansible scripts"Ross Brattain1-1/+1
2018-03-05Merge "Error in string format in HeatTemplateError message"Ross Brattain1-1/+1
2018-03-05Error in string format in HeatTemplateError messageRodolfo Alonso Hernandez1-1/+1
There is a missing "s" in HeatTemplateError message [1]. [1]https://github.com/opnfv/yardstick/blob/8400c1895c49cb0c7802692f75d820fb5b8b7dc4/yardstick/common/exceptions.py#L70 JIRA: YARDSTICK-1047 Change-Id: Ieb6fbf0af35d624015dbf34f34de7c7cc9145dd5 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-05Merge "Fix report generation"Ross Brattain1-3/+5
2018-03-05assertTrue(mock.called) -> mock.assert_calledEmma Foley33-92/+92
When checking whether a mocked method has been called, mock.assert_called or mock.assert_called_once should be used, and not unittest.assertTrue(mock.called) This change does this update. It can be verified with: grep -irn "self.assertTrue(.*called)" --exclude-dir=.tox And the replacement was done with: sed -i 's/self.assertTrue(\(.*\).called)/\1.assert_called_once()/g' <list_of_files> Change-Id: I4f26e0c736bf33e0b2413c8e8c33dbdb91f090e2 JIRA: YARDSTICK-865 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-03-05Bug fix ansible scriptsJohn O Loughlin1-1/+1
For 'qemu-img version 2.10.1' unit 'MB' is not acceptable Changing to 'M' JIRA: YARDSTICK-1019 Change-Id: Ic9153e9e9c85d949d15b1d15cc8cddfad986b4a3 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-03-05Fix report generationXavier Simonart1-3/+5
The command "yardstick report generate task_id yaml_name" was returning some errors and failing to generate a html report. With this fix an html report will be generated with all data from influx. JIRA: YARDSTICK-1023 Change-Id: If9aab4b85cfb2b5809f608568e1adb2ddeec8b78 Signed-off-by: Xavier Simonart <xavier.simonart@intel.com>
2018-03-05Merge "prepare_env.sh: fix some shellcheck warnings"Ross Brattain1-14/+15
2018-03-03prepare_env.sh: fix some shellcheck warningsRoss Brattain1-14/+15
prepare_env.sh:13:3: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:14:3: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:15:3: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:16:3: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:17:3: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:18:3: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:22:8: warning: Declare and assign separately to avoid masking return values. [SC2155] prepare_env.sh:28:1: warning: INSTALLERS appears unused. Verify it or export it. [SC2034] prepare_env.sh:36:5: warning: Can't follow non-constant source. Use a directive to specify location. [SC1090] prepare_env.sh:42:1: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:46:5: warning: Can't follow non-constant source. Use a directive to specify location. [SC1090] prepare_env.sh:46:12: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:53:5: warning: i appears unused. Verify it or export it. [SC2034] prepare_env.sh:54:27: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:68:25: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:73:19: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:73:49: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:76:27: note: Useless cat. Consider 'cmd < file | ..' or 'cmd file | ..' instead. [SC2002] prepare_env.sh:77:24: note: Useless cat. Consider 'cmd < file | ..' or 'cmd file | ..' instead. [SC2002] prepare_env.sh:80:46: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:83:46: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:86:46: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:89:43: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:92:43: note: Double quote to prevent globbing and word splitting. [SC2086] prepare_env.sh:96:71: note: Double quote to prevent globbing and word splitting. [SC2086] Change-Id: I96a1f591b825d21e3ba202f1d681449347d940a6 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-02heat: replace neutronclient with shadeRoss Brattain1-7/+6
neutronclient is deprecated and also has bunches of issues with SSL and such. JIRA: YARDSTICK-890 JIRA: YARDSTICK-1032 Change-Id: I41c9aac0ea69e1307560a001f7dc34178fcd7e71 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-02Merge "VNF interfaces are sorted by "vpci" address before being populated"Ross Brattain3-23/+32
2018-03-02Merge "Prohibit the importation of a list of libraries"Ross Brattain8-3/+127
2018-03-02Merge "Layout fixes to test case descriptions"Ross Brattain3-11/+16
2018-03-02Merge "Remove main() and __main__ from tests."Ross Brattain120-701/+1
2018-03-02Add yardstick.benchmark.contexts.heat.HeatContext._delete_key_file()Emma Foley2-7/+13
* Move logic for removing key file into its own method * Update the log message to be more useful JIRA: YARDSTICK-1026 Change-Id: I8c131720ed91c939698c41ad63d586396fcce1fe Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-03-02VNF interfaces are sorted by "vpci" address before being populatedRodolfo Alonso Hernandez3-23/+32
In [1], VNF interfaces in TG PROX are sorted by "vpci" address, before this value is populated in "vnfd_helper". "vpci_if_name_ascending" is only used in TP ProxPofile [2] to generate the stats. This patch delays this sorting process until the stats generation. [1]https://github.com/opnfv/yardstick/blob/a74ad5a1ec1a73389c5983440b2031b0bc72cea1/yardstick/network_services/vnf_generic/vnf/tg_prox.py#L62-L64 [2]https://github.com/opnfv/yardstick/blob/a74ad5a1ec1a73389c5983440b2031b0bc72cea1/yardstick/network_services/traffic_profile/prox_profile.py#L33 JIRA: YARDSTICK-1044 Change-Id: I988dc48f9a82baa1c64f728d9e6d54f2f4bae010 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-02Remove main() and __main__ from tests.Emma Foley120-701/+1
Removes the unnecessary main() functions from tests. Also removes shebang (#!) where it appears at the top of files. JIRA: YARDSTICK-861 Change-Id: I79180d1eb9c5bce640142dd62ce28c7437c1b210 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-03-02Merge "Replace assertEqual(None, xx) with assertIsNone(xx)"Abhijit Sinha20-71/+61
2018-03-02Merge "Make files pep8 compliant before replacing assertEqual(None, xx)"Abhijit Sinha3-266/+200