summaryrefslogtreecommitdiffstats
path: root/docs/testing
AgeCommit message (Collapse)AuthorFilesLines
2018-03-09Do NOT hardcode interface speed for PROX testsDanielMartinBuckley1-1/+9
JIRA: YARDSTICK-1035 Do not hardcode NIC/interface speed in PROX test. Test assumes NIC used is 10Gbps. This is incorrect. It could support 1Gbps, 10Gbps, 25Gbps, 40Gbps or something else. This is used to calculate pps (Packets Per Second) In Baremetal the NIC speed could be extracted. however when run on a virtual machine this is not possible. Solution: Add in options section of test file. eg. Options: interface_speed_gbps: 10 Where 10 refers to a 10Gbps. In a setup where multiple interfaces are used. This will refer to the speed of the slowest connection. Change-Id: I89ab16479a2cdd1d79e52cbcc5a972762c60d057 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-03-07Fix numbering and html (generated) alignmentDino Madarang1-3/+5
Fix numbering from 3,5,6 to 3,4,5 and alignment of the numbered list in HTML output. Trim lines to 79 chars or less. Change-Id: Icf233ef6bbf99ac0dcd8a9fc2599aee9dc1a46fd Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com> Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> Reviewed-by: Emma Foley <emma.l.foley@intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-02Layout fixes to test case descriptionsMika Rautakumpu3-11/+16
Change-Id: I9658b023e4f3db7e22d67c71dfbba61511d981c6 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-02-28Deprecate authentication variable OS_TENANT_NAMERodolfo Alonso Hernandez3-9/+5
OS_TENANT_NAME was deprecated as authentication variable in Keystone when moved from v2 to v3, in Icehouse (2014). Because this project doesn't support oldest versions, by default the only identification API version supported is v3. JIRA: YARDSTICK-902 Change-Id: I273fb0151ba583f7c8a5a809e5e8864e92c27d31 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-02-27Addition of NSB Prox developer guide.DanielMartinBuckley16-0/+1226
JIRA: YARDSTICK-840 This provides a developer guide to enable the reader to add NSB PROX tests based on existing PROX functionality. This allows the user to configure, run and debug NSB Prox tests for Baremetal and Openstack (both 2 and 4 ports) Change-Id: I2cb9eb6064e501dd9abe0d2cc4ed8ce4b369f174 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-02-12Fixed document for Grafana Port usageAbhijit Sinha1-3/+3
JIRA: YARDSTICK-992 The Grafana port has been changed to 1948 from 3000, as the port 3000 may be not free in some environments. The document still says it uses port 3000, which leads to confusion. Proposed Solution: The document needs to be updated with correct Grafana port number "http://host_ip:1948" Change-Id: I9078783849aec14602585f4d1b3bc293214ae737 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-02-06Merge "Adding three missing test case descriptions"Rodolfo Alonso Hernandez2-1/+4
2018-02-02Removed zero from tc numberMika Rautakumpu1-1/+1
Originally tc number was TC0042, after fix TC042. Change-Id: I3c36e39a141ec8eb74f9f00d7218bd511a56fbc9 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-02-01Adding three missing test case descriptionsMika Rautakumpu2-1/+4
HA tests TC056, TC057 and TC058 are missing from Yardstick test case list. Missing white space added to tc056.rst. Change-Id: Id56a22ad96af8c3d05d95fb58259e9683ce9fab0 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-01-20Merge "update docs for procedure after host reboot"Ross Brattain1-6/+10
2018-01-15update docs for procedure after host rebootJohn O Loughlin1-6/+10
Added instructions to restart nginx and uwsgi after the host is rebooted. Added instructions to start yardstick container if the host is rebooted. Removed section on virtual python environment as it is not needed. JIRA: YARDSTICK-919 Change-Id: I6e8bd1d52954c2aa138ce7879211b91b3644ecb2 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-01-15bugfix:Incorrect title for testcase 081JingLu51-2/+2
JIRA: YARDSTICK-915 fix the wrongly numbered testcase title Change-Id: I61f94b66e3f9dac655b5c71646524b19bae7307c Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-01-09Testcase 084 documentationJingLu51-0/+140
JIRA: YARDSTICK-906 TC084 is to evaluate the IaaS compute performance by using SPEC CPU 2006 benchmark Change-Id: I628edf1d73e12d9f18eaf9609fa862ca456a1c71 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-12-22Merge "Bugfix:proxy env, ansible multinode support"Ross Brattain1-4/+44
2017-12-22Merge "Remove "flake8" and "pep8" from test-requirements"Ross Brattain1-1/+1
2017-12-21Add doc about installing YardStick on OpenSUSErossella1-0/+85
Add guide to install YardStick on OpenSUSE and modify the README to state that OpenSUSE is supported. Change-Id: Id107b24e0ec1ab441426bb150d9e863986d20fc1 Signed-off-by: Rossella Sblendido <rsblendido@suse.com>
2017-12-16Merge "Addition of NSB Prox test documentation of vPE and LW-AFTR test cases"Ross Brattain3-0/+217
2017-12-14Bugfix:proxy env, ansible multinode supportMalanik Jan1-4/+44
JIRA: YARDSTICK-893 - hosts and plays in ansible/nsb_setup.yml refactored Fixed proxy configuration from env or /etc/environment in nsb_setup.sh Fixed ansible parameter 'environment: "{{ proxy_env }}"' in: - roles for components download. - roles for components dependencies install. Now, you can use ansible to modify all yardstick-standalone hosts at once. 1) Configure http[s]_proxy in - /etc/environment or - env variables 2) Modify ansible/yardstick-install-inventory.ini: [jumphost] localhost ansible_connection=local [yardstick-standalone] yardstick-standalone-node ansible_host=192.168.1.2 yardstick-standalone-node-2 ansible_host=192.168.1.3 [all:vars] ansible_user=root ansible_pass=root 3) start: ./nsb_setup.sh # for baremetal/sriov ./nsb_setup.sh <path to admin-openrc.sh> #for openstack heat Change-Id: I167db8bae8303210f21e8ae6f3870ef054bbedce Signed-off-by: Malanik Jan <janx.malanik@intel.com>
2017-12-14Merge "Refactor userguide "Yardstick Installation""Ross Brattain1-320/+392
2017-12-14Change testcases 'cirros' image to 'yardstick-image'Rodolfo Alonso Hernandez1-2/+2
The default OpenStack 'cirros-0.3.5' image doesn't exist anymore. The image included by default in any testing OpenStack deployment is now called 'cirros-0.3.5-x86_64-disk', but this name can change. Because Yardstick, during the installation, deploys a customized image, 'yardstick-image', it makes sense to use it as the default image. JIRA: YARDSTICK-873 Change-Id: I8fd7cbc01d4fa52e9107f2fac7d2d9ff5d1091c7 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-12-13Remove "flake8" and "pep8" from test-requirementsRodolfo Alonso Hernandez1-1/+1
Removed "flake8" and "pep8" from test-requirements. Since 44070670c798d2cde2824f3150b2b11bf35c6319, "pylint" is the code style checker, instead of "flake8" or "pep8". JIRA: YARDSTICK-832 Change-Id: Iee598b0b1793d71dc74be36fa1875387b17d1e25 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-11-22Addition of NSB Prox test documentation of vPE and LW-AFTR test casesDanielMartinBuckley3-0/+217
YARDSTICK-840 NSB Prox test documentation of vPE and LW-AFTR test cases documenation. Change-Id: Ic6da6546faf0494fdee71962a515083e6e10a410 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-11-17Tox: add a pep8 targetEmma Foley1-1/+1
Adds a pep8, pep8-full targets to tox: * pep8 target: runs pylint on the changed files * pep8-full target: runs pylint on whole repo Adds scripts to run pylint: * stored in tools/ Documentation: changeed the command for running tests (run_tests.sh -> tox). This runs the same set of tests as before. JIRA: YARDSTICK-832 Change-Id: I652da87723682d958f3fcbc2eb4cd88422636a3b Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-13Refactor userguide "Yardstick Installation"Rodolfo Alonso Hernandez1-320/+392
[1] must be refactored in order to: * Include proxy options. * Use OpenStack client, instead of project CLI. * Use sudo in some commands. * Adapt the document to rst coding style. * Fix minor errors. JIRA: YARDSTICK-828 [1] https://github.com/opnfv/yardstick/blob/923aa1738cbf5a8053e77e00937fc26f2142f6a3/docs/testing/user/userguide/04-installation.rst Change-Id: Ice63f344a8a87221bdf4daa6153b9ccac321e5b7 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-10-25Removing trailing whitespaceJingLu51-3/+3
Change-Id: I0380deec3e41a6dc02571ed9c4fa16e304f7f85e Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-25Add "How to work with test case" into devguidekubi1-0/+250
JIRA: YARDSTICK-73 add a new chapter about how to work with test case, now just add three sub chapter, sample test case, release test case, test case description file, will update more for how to write a new test case. Change-Id: I44906917e76ad6d4890f345c963b9e4440f6be39 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2017-10-20Merge "Fix Malformed Table in User Guide docs"Jing Lu1-2/+2
2017-10-20Merge "Added NSB sample Test Case documentation."Jing Lu10-0/+911
2017-10-20Fix Malformed Table in User Guide docsTrevor Bramwell1-2/+2
Change-Id: I2f98b75e9bbcd3d0cd4666c097a3280dd89eb02a Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-10-20Added NSB sample Test Case documentation.Maciej Skrocki10-0/+911
Update: Added Prox NSB test case documentation Change-Id: Ia2f47d823581fc7f193d3123f080dd87f29d4b99 Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-10-20Docs: add yardstick gui descrption in userguideJingLu51-0/+10
Change-Id: I09bc55e296d2c641f10819972ec0d48a289432b8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-19nsb_installation: updatesRoss Brattain5-787/+1168
JIRA: YARDSTICK-500 Change-Id: I6eef884ef6262abe49fc13bc353ca14a72a5b648 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> Signed-off-by: Martin Banszel <martinx.banszel@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-10-19Docs: update new implemented APIsJingLu51-18/+503
Change-Id: If6b70791213099d53c82993bd22ac9eed6000c32 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-18Merge "Docs: test case description for TC080 and TC081"Ross Brattain5-3/+249
2017-10-18Hamonization of the titles of the documents (Testing group)Morgan Richomme2-6/+6
Change-Id: I6065fb416a90544539316666aac92735ee84177a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-18Docs: test case description for TC080 and TC081JingLu55-3/+249
JIRA: YARDSTICK-825 Change-Id: Ib2f8d0b88378c0dd0bd20ba38141a205fa7ae486 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-12Bugfix: Reference for the tool used in TC044 mentioned in the user guide is ↵JingLu51-1/+1
wrong JIRA: YARDSTICK-821 Change-Id: I09b189008df4ec2e6db92cf24c45d8206ed2062f Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-10Doc amendment: env prepare commandJingLu51-22/+8
JIRA: YARDSTICK-637 Change-Id: I7e5e1afb7b5a7e97aa070c03cded3be285d97cc2 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-09-15Merge "add tc083 rst and tc073/tc083 netperf local dashboard"Rex Lee1-0/+81
2017-09-15add tc083 rst and tc073/tc083 netperf local dashboardrexlee87761-0/+81
Change-Id: I382b2a711d6659f94982c4386c2f25c144705831 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-09-12[DRAFT] add yardstick cli info in userguiderexlee87761-2/+136
Change-Id: Ib52f0f0629c27b35774804be81276427ac29bac2 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-09-05Adding NSB documentation for SV and BaremetalDeepak S2-21/+530
Change-Id: I6db301b88af67256b52f5d197dfffe3c0719e132 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-08-26Merge "Test case: Fio volume benchmark testcase using job file"Jing Lu1-0/+119
2017-08-24Standardized TRex client library pathMaciej Skrocki1-1/+2
- path should be defined via TREX_CLIENT_LIB environmental variable e.g. TREX_CLIENT_LIB=/opt/trex_client/stl - refactored unit tests Change-Id: I18767e48daf774432c010f1b88d18a4f0ee4e156 Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-23Add test case file, document and related scripts of yardsticktjuyinkanglin1-0/+165
tc057(HA_TC014) JIRA: YARDSTICK-779 Change-Id: I6a812b1c88229b20a0dd0ce5bc135c9ba15266db Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-08-23Merge "Add test case file and document of Tardstick TC056(HA_TC013)"Jing Lu1-0/+149
2017-08-22Test case: Fio volume benchmark testcase using job fileJingLu51-0/+119
JIRA: YARDSTICK-791 In some use cases, Fio is used with a job file instead of parameters. This work is about adding support for the job file and add a new test case for volume testing. Change-Id: I312d61bf6e7d95f23eedb0b6487f6103b7d76355 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-08-11Add test case file, document and related scripts of yardsticktjuyinkanglin1-0/+148
tc058(HA_TC015) JIRA: YARDSTICK-780 Change-Id: I4406776cb6b91265a0d2674b5dd200ca7d13ef14 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-08-11Add test case file and document of Tardstick TC056(HA_TC013)tjuyinkanglin1-0/+149
JIRA: YARDSTICK-778 Change-Id: I271b42a24e9d1ee48e54bceb4517252d1f664d51 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-08-11Merge "New storage test case: Bonnie++"Jing Lu1-0/+109