aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-01-15Merge "Testcase 084 documentation"Jing Lu1-0/+140
2018-01-13Do not hide unit tests execution failRodolfo Alonso Hernandez1-0/+7
While moving tests from ./tests/ to ./yardstick/tests, both unit tests directories are executed. If the first test run fails, do not hide the error and exit immediately. Change-Id: Ib6c64ccf2f4b19722722eb43b3d45d5ad5f0169d Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-11Move tests: unit/commonEmma Foley9-7/+10
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Change-Id: I2847c380556985fae2c92bb8a7da9c47e91e1338 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-11pylint: try to change formatting for Jenkins againRoss Brattain2-2/+2
looks like we have to add var to tox passenv Change-Id: Iba2da2123ae531e026897308769aa832c7eb6d04 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-11Merge "Move tests: functional/"Ross Brattain5-7/+2
2018-01-11Merge "Move tests: unit/apiserver/"Ross Brattain4-10/+18
2018-01-11Move tests: unit/apiserver/Emma Foley4-10/+18
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: I30d3f61e5ea479758f9a2f39cf415da18e49b9d6
2018-01-11Move tests: unit/test_ssh.pyEmma Foley1-1/+1
Change-Id: I0eabdd5d7e918dcf0df747119a104dedf125606f Jira: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-11Move tests: functional/Emma Foley5-7/+2
All tests in tests/functional have been moved to yardstick/tests/functional JIRA: YARDSTICK-837 Change-Id: I89276b36635de74dd7b8f70e961c71aa0d2c494e Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-11pylint: make Jenkins output parseableRoss Brattain1-2/+7
Jenkins doesn't handle the color and the output is hard to read in Jenkins logs Change-Id: Ie8fc5a78e89f72c829e4bbbcbd1291a723dfde72 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-11Merge "Run tests in yardstick/tests/"Ross Brattain6-17/+97
2018-01-11Run tests in yardstick/tests/Emma Foley6-17/+97
* Edit .testr.conf and tools/run_tests.sh * Run functional and unit tests in tests/ and yardstick/tests/ * Add yardstick/tests/unit/__init__.py and yardstick/tests/__init__.py * Update pylintrc rules to disable: * missing-docstring * fixme * protected-access Test will run in both tests/ and yardstick/tests/ initially Change-Id: Iccd0df0d1b85b5d08f7faa56669bc32687925f7e JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-11Merge "pyOpenSSL missing: cause 'git review' failed"Ross Brattain1-1/+1
2018-01-11pyOpenSSL missing: cause 'git review' failedJingLu51-1/+1
JIRA: YARDSTICK-905 In the latest Yardstick container, when use git review to upload patches, an Attribute Error will cause failure. root@a80081a4dccd:/home/opnfv/repos/yardstick# git review Traceback (most recent call last): File "/usr/bin/git-review", line 6, in <module> from git_review.cmd import main File "/usr/lib/python2.7/dist-packages/git_review/cmd.py", line 32, in <module> import requests File "/usr/local/lib/python2.7/dist-packages/requests/_init_.py", line 52, in <module> from .packages.urllib3.contrib import pyopenssl File "/usr/local/lib/python2.7/dist-packages/requests/packages/urllib3/contrib/pyopenssl.py", line 46, in <module> import OpenSSL.SSL File "/usr/lib/python2.7/dist-packages/OpenSSL/_init_.py", line 8, in <module> from OpenSSL import rand, crypto, SSL File "/usr/lib/python2.7/dist-packages/OpenSSL/SSL.py", line 118, in <module> SSL_ST_INIT = _lib.SSL_ST_INIT AttributeError: 'module' object has no attribute 'SSL_ST_INIT' pyOpenSSL is required. Change-Id: I88a4916c9c2dfcdee45320f6b1a37eaae0803671 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-01-10Merge "Bump requirements to match OpenStack Pike release"Ross Brattain2-57/+36
2018-01-10Merge "Remove unnecessary function definition in IxLoadTrafficGen"Ross Brattain1-5/+2
2018-01-09Testcase 084 documentationJingLu51-0/+140
JIRA: YARDSTICK-906 TC084 is to evaluate the IaaS compute performance by using SPEC CPU 2006 benchmark Change-Id: I628edf1d73e12d9f18eaf9609fa862ca456a1c71 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-01-08Merge "Rename test/unit/cmd directory"Ross Brattain5-2/+7
2018-01-08Remove unnecessary function definition in IxLoadTrafficGenRodolfo Alonso Hernandez1-5/+2
Removed call to 'instantiate' base class in IxLoadTrafficGen. JIRA: YARDSTICK-894 Change-Id: I0ebee1f5e0f22cfd3a67eaac8accc67ecd35ad0c Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-08Merge "ansible image build improvement"Rex Lee3-9/+19
2018-01-04Merge "delete obsoleted zte pod info"Ross Brattain1-50/+0
2018-01-04Merge "SPEC cpu2006 test case for VM"Jing Lu3-0/+321
2018-01-04delete obsoleted zte pod infozhihui wu1-50/+0
Delete zte pod info in yardstick/etc/yardstick/nodes. Change-Id: Ie22fd9fa4b84529f0b2a7d113776d3559106e67a Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2018-01-04Remove tool provisioning in PROX helperRodolfo Alonso Hernandez4-111/+98
Tool provisioning in PROX setup environment helper is not needed [1]. The tool (PROX traffic injector) is already provided during the VNF building: ./ansible/nsb_setup.yml --> ./ansible/build_yardstick_image.yml --> ./ansible/ubuntu_server_cloudimg_modify_samplevnfs.yml --> ./ansible/roles/install_samplevnf [1]https://github.com/opnfv/yardstick/blob/master/yardstick/network_services/vnf_generic/vnf/prox_helpers.py#L641 JIRA: YARDSTICK-872 Change-Id: I0f925a7967a35a97901fbe5053793a791a7b1b01 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-03Make GenericVNF an abstract classRodolfo Alonso Hernandez20-457/+349
GenericVNF class is now an abstract class. Only optional methods are implemented. Mandatory methods: - instantiate - wait_for_instantiate - terminate - scale - collect_kpi. JIRA: YARDSTICK-866 Change-Id: Ia8766f9f98816e11894d1e72b0f3bd573d091d99 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-03Remove 'inconsistent-return-statements' check from PylintRodolfo Alonso Hernandez1-0/+1
There are several bugs in Pylint [1] [2] affecting 'inconsistent-return-statements' check. It will be temporarily removed. [1] https://github.com/PyCQA/pylint/issues/1782 [2] https://github.com/PyCQA/pylint/issues/1794 JIRA: YARDSTICK-911 Change-Id: Ib655ef1befdc734c646cdfb9b48f1db0ccdf676d Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-03Merge "Fix inventory.ini for build_yardstick_image"zhihui wu1-0/+3
2018-01-02Merge "Adding vFW RFC2544 and ixload test cases with various packet sizes"Ross Brattain11-0/+714
2017-12-28ansible image build improvementAce Lee3-9/+19
JIRA: YARDSTICK-879 Add some image build vars Add automatic image build of nsb yardstick_image: ansible-playbook -e img_property="normal" -vvv -i inventory.ini build_yardstick_image.yml nsb_image_build: ansible-playbook -e img_property="nsb" -vvv -i inventory.ini build_yardstick_image.yml prepare for yardstick image uploading Change-Id: I9fdf30084511ca9a008df3b53887b06273bbd549 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-12-25SPEC cpu2006 test case for VMJingLu53-0/+321
JIRA: YARDSTICK-906 This test case is for benchmarking VM(VNF) compute performance using SPEC CPU2006. Change-Id: Ida87aa4d394e38b398acb0af3176dd1b4c858c35 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-12-25Fix inventory.ini for build_yardstick_imageAlex Yang1-0/+3
In [1], 'no hosts matched' occured because 'jumphost' was not defined in inventory.ini. [1]: https://build.opnfv.org/ci/job/yardstick-daisy-baremetal-daily-master/72/console Change-Id: I8cb36bf083ce589e94f5f8b115e99556f0bcb053 Signed-off-by: Alex Yang <yangyang1@zte.com.cn>
2017-12-25Add get function in ssh.pyJingLu52-0/+15
JIRA: YARDSTICK-904 This task is about to implement a get function in ssh.py to fetch desired files/folder in a remote VM to a local path. In some test cases, test tools will produce results in files. We want retain the original result files and archive them in Yardstick docker for future usage. Change-Id: Ifd333eb044ce31cffa6f5b2a8f6a46648a8858d1 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-12-22Merge "Replace subprocess "check_output" with "Popen""Ross Brattain6-46/+267
2017-12-22Merge changes from topics 'YARDSTICK-875', 'YARDSTICK-874'Ross Brattain2-1/+11
* changes: Check if multiverse repository is available in Ubuntu Specify supported architectures for Ubuntu backports repository
2017-12-22Merge "Bugfix in role enable_hugepages_on_boot"Ross Brattain3-35/+39
2017-12-22Replace subprocess "check_output" with "Popen"Rodolfo Alonso Hernandez6-46/+267
"check_output" is a blocking wrapper for "Popen" which returns the output of the command execution or raises an exception in case of error. "Popen" is a non-blocking function that allows to create asynchronous tasks. It returns any possible execution error but doesn't raise an exception; this is delegated to the developer. This code is used in the Yardstick CLI base test class. Change-Id: Ie3e1228b2d40cb306354447653678bf581bc9697 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-12-22Merge "Bugfix:proxy env, ansible multinode support"Ross Brattain9-55/+204
2017-12-22Merge "Remove "flake8" and "pep8" from test-requirements"Ross Brattain2-3/+1
2017-12-22Merge "Variable local_iface_name is read before it is set"Ross Brattain2-6/+5
2017-12-22Check if multiverse repository is available in UbuntuRodolfo Alonso Hernandez2-0/+10
In Ubuntu, multiverse repository is needed to install the image dependencies [1]. If this repository is not enabled, it should be added as part of the role "add_custom_repos". [1] https://github.com/opnfv/yardstick/tree/master/ansible/roles/install_image_dependencies JIRA: YARDSTICK-875 Change-Id: Ie37ebf87bf245185447f2b675568af9bd38219c0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-12-22Specify supported architectures for Ubuntu backports repositoryRodolfo Alonso Hernandez1-1/+1
Currently Trusty (Ubuntu 14.04 LTS) and Xenial (Ubuntu 16.04 LTS) doesn't have support for arch=ARM64 in backports repository: - http://archive.ubuntu.com/ubuntu/dists/xenial-backports/ - http://archive.ubuntu.com/ubuntu/dists/trusty-backports/ During the Yardstick image building process, the repository is added to the APT repository list. In order to avoid errors during the repository retrival, the available architectures must be specified [1]. [1]https://github.com/opnfv/yardstick/blob/stable/euphrates/ansible/roles/add_custom_repos/templates/sources.list.j2#L4 JIRA: YARDSTICK-874 Change-Id: I7774189fbdd7d74ff5df29526ba0da2693b3b53a Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-12-22Bugfix in role enable_hugepages_on_bootJan Malanik3-35/+39
Make role idempotent. Current regex doesn't match for: linux /boot/vmlinuz-4.10.0-30-generic root=/dev/nvme0n1p1 ro vga=788 text Change-Id: If5eb20fce4ddc35bb109c00eb7565853b3763950 Signed-off-by: Jan Malanik <janx.malanik@intel.com> Signed-off-by: Malanik Jan <janx.malanik@intel.com>
2017-12-22Merge "Fix the pylint version for pep8 tox target"Ross Brattain1-1/+1
2017-12-21Add doc about installing YardStick on OpenSUSErossella2-1/+87
Add guide to install YardStick on OpenSUSE and modify the README to state that OpenSUSE is supported. Change-Id: Id107b24e0ec1ab441426bb150d9e863986d20fc1 Signed-off-by: Rossella Sblendido <rsblendido@suse.com>
2017-12-21Bump requirements to match OpenStack Pike releaseRoss Brattain2-57/+36
Bumped requirements to match OpenStack Pike release requirements [1]. [1] https://github.com/openstack/requirements/tree/stable/pike JIRA: YARDSTICK-889 Change-Id: I18ccdc01c14693cb63bd74d29c14554f610629e3 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-12-21Rename test/unit/cmd directoryRoss Brattain5-2/+7
Renamed test/unit/cmd directory to test/unit/test_cmd, in order to avoid importing errors during the execution of unit tests. This directory name collides with Python "cmd" library. Change-Id: Ie06d58d4faace33df684c8e511a398aa0667b098 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-12-19Fix the pylint version for pep8 tox targetMartin Banszel1-1/+1
Change-Id: I5e1c169a6ca13b3f46129b2c4a15ccbab2677a63 Signed-off-by: Martin Banszel <martinx.banszel@intel.com>
2017-12-19Variable local_iface_name is read before it is setJiri Prokes2-6/+5
Moving variable setting before reading Verified via TC: yardstick/samples/vnf_samples/nsut/ping/tc_ping_heat_context.yaml JIRA: YARDSTICK-899 Change-Id: Ia2feac1ed4e67dccd02446ba27afc9d40e87be35 Signed-off-by: Jiri Prokes <jirix.x.prokes@intel.com>
2017-12-18Merge "pretty cli format: runner/scenario/testcase list"Rex Lee6-51/+30
2017-12-16update release notes for Euphrates 5.1.0Ross Brattain1-24/+61
Change-Id: I11b248882dd314baebd3ab4e7e676a1f3e0b50cd Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>