summaryrefslogtreecommitdiffstats
path: root/docs/testing
AgeCommit message (Collapse)AuthorFilesLines
2018-11-09[docs] Resolve "document isn't included in any toctree" warningopnfv-7.0.0Emma Foley2-1/+7
Some test cases and test results weren't included in the test case lists. This change updates the lists of TC to included the previously omitted TCs and add test results to index. JIRA: YARDSTICK-1335 Change-Id: I5ca3b679b308889e60b7db2679629dc9144a3226 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit f2a27e64dc6a1375af23b0b99e6cfdddeceb19f8)
2018-11-09[docs][userguide] Update formatting for Influx instructions in ch04Emma Foley1-15/+15
JIRA: YARDSTICK-1335 Change-Id: I2422d12a8c34fe2afaab349cbbb4dfe579057cb1 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit a0811c8c5f57038c567c15974c9128591bc1d283)
2018-11-09[docs][devguide] Fix line lengths in devguide_nsb_prox.rstEmma Foley1-132/+201
JIRA: YARDSTICK-1335 Change-Id: I863da3318a71dbcf2dc3f2b43fda6a92feed2089 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 3914b4028025fee9f5037ba29453201f99720f24)
2018-11-09[userguide] Update the directory structure listingEmma Foley1-12/+13
Change-Id: I4ff6f94a6d309e1604672a41c581d0768c91a5d2 JIRA: YARDSTICK-1335 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit b7c2a088b375bb6895c52383c4348b1cb1d4edb9)
2018-11-09[docs] Fix "Error in xxx directive" warningEmma Foley3-5/+2
JIRA: YARDSTICK-1416 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: I58c511454e052496e0b72ea28142b331514475c5 (cherry picked from commit d5ff53dbdbcb1d97343a3122aabf312d81649eaa)
2018-11-09[docs] Fix docs {un,}indent warnings in Testcase definitionsEmma Foley16-106/+148
Mostly, the issues were with un/indentation. This has been fixed, and `tox -e docs` now issues less warnings. JIRA: YARDSTICK-1416 Change-Id: Ie58a8dba42e9868357e1dce414cb1a01af8ad1f4 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 28e64c520fc2a52c1d3eb736f88ad4608b87c142)
2018-11-09Merge "[docs] Remove vtc results chapter and references" into stable/gambiaRex Lee1-11/+0
2018-11-09[docs] Update header levelsEmma Foley4-49/+70
JIRA: YARDSTICK-1335 Change-Id: I202634a7427a409f0e2ca786c8bb5e05a5b4351d Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 5456b070a8e05cd49d5626b002f6eeee71bcd67d)
2018-11-09[docs] Remove vtc results chapter and referencesEmma Foley1-11/+0
The vTC chapter in the userguide was previously removed [1] Some references and results still remained and needed to be removed. [1] https://gerrit.opnfv.org/gerrit/gitweb?p=yardstick.git;a=commit;h=114a486558c96152fffb5050840460a54de64d15 JIRA: YARDSTICK-1335 Change-Id: I17806d90ae8bc4dbf813ef89bbc22dc012b4a686 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 766d498f9f4abcb79710d077c6a1886ae11a4c0a)
2018-11-09[docs] Fix unresolved reference warningEmma Foley1-2/+2
JIRA: YARDSTICK-1416 Change-Id: Ibdc9b48e31aff171c59278f9ca19767392f4eeba Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit e9db0b0e22ddfaa879aa08128d17ea6308355455)
2018-11-09[docs] Update broken and redirected linksEmma Foley10-27/+27
A number of links were broken, or permenently redirected. Some literal include directives pointed to the wrong location. These have been updated, so the links are valid. JIRA: YARDSTICK-1416 Change-Id: Icd20113e0ab099850fa58fa41bb27a00670f57ca Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 44a507c5aa92d4f4a518983bd4b6ecc244e7a66c)
2018-11-09[docs] Fix links to remove references to submodulesAric Gardner1-4/+4
All references to submodules must be removed for docs to work going forward. Can be tested once your project has a local tox file Change-Id: Id74581cc584f70ae0b31e31c9dd91593c7be6615 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org> (cherry picked from commit 2ba5ef8eeac9f92436fcaed807fdd4ecaa79d2c0)
2018-11-09Merge "[docs] Update mailing list to use #yardstick" into stable/gambiaRex Lee2-4/+4
2018-11-06Merge "[docs] Add vEPC test case preparation steps" into stable/gambiaAbhijit Sinha2-3/+157
2018-11-06[docs] Update mailing list to use #yardstickEmma Foley2-4/+4
The mailing list is on a new system that lets you use #topics instead of [topics]. The contact information has been updated to reflect this. JIRA: YARDSTICK-1335 Change-Id: Ida9af98f00761a3bff8903165fd2806163787ccd Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 3fec49e7a3926ddf4f9303ee47a33d109421a573)
2018-11-06Merge "[docs] Test case documentation for vEPC testing" into stable/gambiaRex Lee6-0/+810
2018-11-06Merge changes I526c328f,I7bb14112,Idfe77900 into stable/gambiaRex Lee3-0/+253
* changes: [docs] Update on Yardstick installation [docs] Add conventions for writing unit tests. [docs] Add developer guidelines for contribution
2018-11-05[docs] Add vEPC test case preparation stepsOrest Voznyy2-3/+157
Add documentation to review the changes to original vEPC infrastructure files to configure NSB test run in a specific test setup. Add initial steps to prepare NSB to use Spirent Landslide for vEPC tests. JIRA: YARDSTICK-1459 Change-Id: I3b937b1a21d6ec6851a92946e46c679385fdff9c Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit dc55a775f7aa62be7ed17cc33aa1b0bac54c081f)
2018-11-01[docs] Test case documentation for vEPC testingAbhijit Sinha6-0/+810
JIRA: YARDSTICK-1349 The test case document will cover the following: - test purpose - test configuration - pre-test conditions - test sequence - test verdict Change-Id: I2841a7ff3d248bb3e4739579fad722dc02b5504f Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit c8bde3b59031b352bf09302ae7644436860602d7)
2018-10-31Merge "[docs] Update the glossary" into stable/gambiaEmma Foley1-13/+62
2018-10-30[docs] Update the glossaryEmma Foley1-13/+62
Add some new terms (OpenStack, Docker, PROX). JIRA: YARDSTICK-1335 Change-Id: I948957cf7b1540f7a027ab9da2d829e5e05c87c8 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 78b5a19e3071cbc080eeae0bdf22f5ab80c03180)
2018-10-30[docs] Update on Yardstick installationStepan Andrushko2-0/+113
Added details how to install Yardstick using install.yaml. Updated: - 04-installation.rst - 13-nsb-installation.rst JIRA: YARDSTICK-1335 Change-Id: I526c328f1b197833a2cf496cfef15ba89c11fab1 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-30[docs] Add conventions for writing unit tests.Emma Foley1-0/+51
Added details of conventions used when writing unit tests. JIRA: YARDSTICK-1335 Change-Id: I7bb141126968c88c8a2d7e0dce4f33ed6f79cee4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30[docs] Add developer guidelines for contributionEmma Foley1-0/+89
A new section was added to the devguide, stating expectations for code contributions. * What to include in a change * Code style guidelines * How to run tests JIRA: YARDSTICK-1335 Change-Id: Idfe7790042a3a3fe6cd8763374b10f2268bd63cd Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30Adds option parameters to TC074Ameed Ashour1-0/+11
Add option parameters to TC074 to allow the user to specify volume type, volume count, availability zone, stack name, and subnet cidr. JIRA:YARDSTICK-1294 Change-Id: I161f44b5f2c7e70fcfb80a3b916efc34bd06824c Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit 43c28852a9c9abfe7fc66fca0dcc703b468db0cf)
2018-08-29Updated documentation for stanalone contextStepan Andrushko1-15/+85
Added details about hosts configurations in order to run tests for standalone context. Changes made to '13-nsb-installation.rst'. JIRA: YARDSTICK-1402 Change-Id: I4e3304065343014a80b85fc712cdde3ca62d8b2e Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-16Merge "Disk Initialization and Custom Workload"Rex Lee1-19/+53
2018-08-10Disk Initialization and Custom Workloadmbeierl1-19/+53
Removes the deprecated nowarm and nosdd parameters from the call to StorPerf. Adds a call to initialize the disk right after the stack creation is complete so that the results from the performance run are valid and not skewed by a disk that is not operating at a consistent level of performance. Adds the jobs API v2.0 when the custom parameter 'workloads' is used instead of workload. Improves documentation and adds more info about the workload and workloads parameters. Co-Authored-By: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> Change-Id: I17e96028f6a82e2c800c8f73c7be866e1cab6ad8 JIRA: YARDSTICK-1322 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-07-23[docs] Remove the VTC chapter in the userguideEmma Foley7-139/+1
Other references to VTC have also been removed. Change-Id: Ia5592e29ddca1bf05cefa5b1364e0757ac78bc79 JIRA: YARDSTICK-1335 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-07-16Propose the backporting processEmma Foley1-0/+26
Change-Id: I0b0fddf8dfdd68fa144b28dba911352e9a4974fd JIRA: YARDSTICK-1253 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-07-04Merge "Fix up formatting on devguide"Rodolfo Alonso Hernandez1-77/+151
2018-06-29Update PROX_NSB_DEVGUIDE for F ReleaseDanielMartinBuckley10-25/+119
Contains Updates :- New Description of Grafana output New Description of ProxDuration Runner Update Description of Openstack Network Change-Id: I861bb7eab4aeed207c0151be6766c48c5f10c6ef Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-29Fix up formatting on devguideEmma Foley1-77/+151
* Change the notation used for heading levels and add a key at the top of the file. * Wrap lines at 80 characters. * Highlight keywords Change-Id: Ic6e7194270bbffb3ddaf688c774b632287b0c201 JIRA: YARDSTICK-1253 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-06-27Corrected scale-up command line argumentsChornyi, TarasX1-1/+1
Change-Id: If308fde797dcb01e58f37ad81bb116fde542366a Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-06-21Merge "Add scale out TCs with availability zone support"Rodolfo Alonso Hernandez1-1/+111
2018-06-18Update pmd/lcore mask for OVS-DPDK contextStepan Andrushko1-0/+36
Added default values for pmd/lcore mask to the SampleVNF test case for Trex TG. lcore mask - specifies the CPU cores used for non-datapath OVS-DPDK threads. pmd mask - specifies the CPU cores used for data path packet processing. Updated documentation for Standalone OVS-DPDK context. JIRA: YARDSTICK-1246 Change-Id: I8d008a185c94d2047ffa4769d7974bc4d283fd7f Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-05-25Add scale out TCs with availability zone supportMytnyk, Volodymyr1-1/+111
Add PROX and vFW scale out TCs with availability zone configuration. To be able to specify the availability zone for specific VNF or TG the following example of command line option shoud be used: yardstick -d task start --task-args='{ "num_vnfs": 2, "availability_zone": { "vnf_0": "az_0", "tg_0": "az_0", "vnf_1": "az_1", "tg_1": "az_1", ... }}' <SCALE-OUT-TC-FILE> The steps to run new scale-out TCs is documented in the userguide. JIRA: YARDSTICK-1203 Change-Id: Ib3878485c5483981fe9b48ab02995712bcc31ae5 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-05-23Test case spec for SDN controller resilience in HA configGeorg Kunz2-0/+197
This is the test case specification for verifying the HA capabilities of a SDN controller running in a HA configuration. JIRA: HA-33 JIRA: YARDSTICK-955 Change-Id: I016ec1ef7bb51b79f8c21440abf8f04c923ef9dc Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-20Merge "Test case spec for SDN Virtual Switch resilience."Emma Foley2-0/+185
2018-05-16Merge "Test case description and configuration file for yardstick_tc088"Jing Lu1-0/+129
2018-05-16Merge "Test case description and configuration file for yardstick_tc089"Jing Lu1-0/+129
2018-05-11[docs] Add info on gerrit groups to the devguide.Emma Foley1-1/+2
Added the yardstick-reviewers and yardstick-committers groups as an alternative to adding individual developers to a code review. Change-Id: I1ebba56ba27dac00f7e7af7858b3c599a0f1eae8 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-05-07Test case spec for SDN Virtual Switch resilience.Dimitrios Markou2-0/+185
This is a test case for verifying the proper functionality of SDN Vswitches which are located in the Compute nodes of an OpenStack environment. This test case is unaware of the configuration (non-HA,HA) JIRA: HA-34 JIRA: YARDSTICK-955 Change-Id: I701bf1f9527b1a31b9cb52e102734e10c4162766 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-05-04Add IxNetwork API Python Binding packageRodolfo Alonso Hernandez2-75/+41
Add IxNetwork python package to the requirements list. This module is needed for the "NSPerf" scenarios using IXIA as traffic generator, when IxNetwork is the program used to handle the IXIA generator. The latest version of this module is 8.40.1124.9 [1]. The license type is MIT. [1] https://pypi.python.org/pypi/ixnetwork JIRA: YARDSTICK-1106 Change-Id: I279933c95994f5120930256a104c4192a0b9900d Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-04-23Merge "[docs] Updated baremetal instalation instructions"Rodolfo Alonso Hernandez1-0/+9
2018-04-13Bugfix: interface down HA tc050 attack and monitor logistic wrongrexlee87761-27/+25
1. simplify the attack to be one interface 2. move monitor step before attack 3. update rst doc to match JIRA: YARDSTICK-1120 Change-Id: Icfa21d58e7ccdbeaca8a9a1a3098cceb21c981c3 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-04-06[docs] Updated baremetal instalation instructionsChornyi, TarasX1-0/+9
JIRA: YARDSTICK-1111 Change-Id: Iefab24f74c87a0855c2d70090ac34256ffa9200c Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-04-03[userguide] Use literalinclude directive in 05-operationEmma Foley1-75/+9
Uses literalinclude directive instead of having a copy of the file content in documentation. This means that any update to this file is detected, and the most up-to-date content is used. If a testcase is updated, the updates wil be picked up. The examples used are ones that are tested reqularly. JIRA: YARDSTICK-1066 Change-Id: I15d967eb04d1e6f4348683d8746fa9989dceda94 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-04-03[docs] update the user guide for "yardstick-operation"Emma Foley3-0/+366
* Add a new chapter: operation which shows how to use Yardstick and how to create test cases * Include details on how to reuse and keep VNFs between testcases JIRA: YARDSTICK-885 JIRA: YARDSTICK-886 Change-Id: I365152e8812427a3c54259adbc18d5ddb216d775 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-04-03[docs] Move user guide chapters to make room for new chapter.Emma Foley14-551/+400
* Increment the numbering on chapters * Fix some of the changes flagged by doc8 Change-Id: Ie03d165297671dfd50b9de339612cdc8bf00b988 Signed-off-by: Emma Foley <emma.l.foley@intel.com>