aboutsummaryrefslogtreecommitdiffstats
path: root/docs/testing
AgeCommit message (Collapse)AuthorFilesLines
2018-04-15Update configguide (latest results)Cédric Ollivier1-27/+23
Change-Id: I5eb2f3b0096e57c9f72c07a8adea3bbe4aae3ec7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5270142e02cb28f88ea63fb8210e80f8a769eed7)
2018-04-15Remove odl_netvirt testcaseCédric Ollivier4-11/+2
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 13e4c5838b732bf9fd246cd4f97cb9b4e2b8e0b9)
2018-04-10Update userguideLinda Wang2-100/+26
Change-Id: I2725ffcb4101496c2019d22215b1585fa3444775 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 29874d5585b9f726e71feb1697411152aa851434)
2018-04-09Remove Ceilometer test scenariosJuha Kosonen2-2/+0
The API utilized by Rally in Ceilometer scenarios was deprecated in OpenStack Pike and scenarios were blacklisted. Remove these scenarios from respository. JIRA: FUNCTEST-949 Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 2e0dad6e9a49ad9fdd349387b72f145e53bc4da0)
2018-04-04Fix Functest Internship ReportsCédric Ollivier8-100/+813
It allows building these documentations via tox. rst files are now checked via doc8. Change-Id: I06096d466b672e4c171240c918d1c91e1b3dfd13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2b63550f650c2ae412b5515cd596f38261619d27)
2018-04-04Fix Functest Developer GuideCédric Ollivier2-12/+197
It allows building this documentation via tox. rst files are now checked via doc8. Change-Id: I4f45dc2b6657466b05e7ceec60a751656552584e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1f0a0085222337691e8209851cac4ef57333a064)
2018-04-04Fix Functest User GuideCédric Ollivier9-300/+508
It allows building this documentation via tox. rst files are now checked via doc8. Intro is moved into a new file. Change-Id: If1dbe2cbde2f39ca4948ada2b2743594bc387dbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3756ff6fbd17269fd9d2a585d3d0ef4bea6f6f9e)
2018-04-04Fix Functest Config GuideCédric Ollivier6-115/+310
It allows building this documentation via tox. rst files are now checked via doc8. Intro is moved into a new file. Change-Id: Ic5c0108cf1cbb0fc69f7e2cc73cf2fb69e44baa1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 87a9ed4c08b2c7781f97bf03c08f2d4788f4653d)
2018-03-20Implement trunk ports - Documentation partPanagiotis Karalis2-1/+11
The tempest testcases have been integrated from Neutron trunk testcases. The relevant documentation has been updated. JIRA: FUNCTEST-926 Change-Id: I56cbd0ebb211a283e4e11df28ad6d1520d18e25a Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-08Remove duplicate ubuntu trusty/14.04 os imageValentin Boucher1-1/+0
VNF testcase use some Operating System image 2 of those are the same but not with the same name Change-Id: Ide5ae683f606f7f58535c0a59cec45e4a30d225c Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-02-16Get properly env vars or their default valuesCédric Ollivier1-0/+4
It defines env.get() as an unique way to get Functest env vars or their default values. It can be considered as a wrapper above os.environ. It enforces backward compatibility via CONST which mustn't be used for that purpose. It should be noted that it also stops using CONST for getting OpenStack env vars. Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Remove INSTALLER_IP from FunctestCédric Ollivier1-5/+0
It's mandatory for testcases which are out of Functest. Change-Id: Ia5f5134334ad9f69d44409d817616fa9033fae95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Simplify functest/cli/commands/cli_env.pyCédric Ollivier1-6/+0
CONST shouldn't be used for getting/setting env vars. It adds complexity and may raise side effects. It also removes the obsolete env var CI_DEBUG. Change-Id: I8a8fde0fa781351d5eabd2698ca8aae9dee76fb8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-04Update results printed in configguide.rstCédric Ollivier1-78/+77
It updates the entry points and all results. It also takes into account that: - juju_epc was added - fds was moved to features It should be noted that refstack_defcore, parser and several vnfs are failing from the time being. Change-Id: I918a7767005569f03115749ad121a6c7a04c04a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-04Fix links in configguide.rstCédric Ollivier1-13/+13
It also removes trailing whitespaces. Change-Id: I6a7e4aaff700a85ff1c0c2741624e9359441e0ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-01Rename a common credential file for OS and K8SLinda Wang3-19/+19
Change-Id: Ib8d24be4b29ab1de00d5dd5e3442146b2437cb94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-21Update cirros image to 0.4.0Michael Polenchuk2-5/+5
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-21Merge "Remove openstack_[clean,snapshot]"Linda Wang2-4/+1
2017-12-20Fix typos in test_details.rst and test_overview.rstCédric Ollivier2-25/+25
Change-Id: I12e9b17927ab9b52d0a727a82975cda7074bd994 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-19Remove openstack_[clean,snapshot]Cédric Ollivier2-4/+1
It also removes the related unit tests and updates docs and cli. Change-Id: Ie11f77402f2b5b7055a0c7c5d931c8ff21124482 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-29Update documentation of FunctestLinda Wang3-25/+31
Mainly update the robotframework part, according to this patch: https://gerrit.opnfv.org/gerrit/#/c/47841/ Change-Id: If4dee6233ba65dd83734e0465d0dc6e8d5753da3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-28Fix the doc of snaps testLinda Wang1-2/+2
snaps_health_check does not allocate a floating ip to the vm, but a fixed ip instead. Change-Id: Ia43885993135dec56aba08b0e157ac2c9f715e06 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-22Remove prepare_envJose Lausuch3-36/+1
After moving the rally installation out of prepare_env It doesn't much sense to keep this script as it doesn't do useful things any more. Change-Id: I9ab3b2dd30c8ec0fbb825ee4302a83cce80f1cbe Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-11-17Update documentation for FunctestLinda Wang4-45/+7
1. Remove the reference of ubuntu based container 2. Remove the domino (terminated) and promise (not in F), and move fds to features tier Change-Id: I62af47a3f873f0a77d5f7e0a1df493651c805834 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-20Wrap Functest Ascii Diagram in literal text blockTrevor Bramwell1-15/+15
Sphinx currently thinks this diagram is a table and outputing a warning. Using '::' provides a hint to sphinx that the ascii diagram is literal text and not a table. Change-Id: Ie005cc059b9e97aacda0d75d0213b18477e55d38 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-10-18Harmonization titles of the testing projectMorgan Richomme3-22/+4
Change-Id: I9ebb488d77274219fca556760f0408a2bb1f6880 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-11Update userguide and configguideLinda Wang4-49/+24
Mainly remove the duplicated declaration of cloudify_ims_perf. Change-Id: Ic23cee0e2dbb863cfddc98b08eabdab7d52e0476 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-11Merge "Include tempest_custom in the documentation"Jose Lausuch3-16/+37
2017-10-10Include tempest_custom in the documentationJose Lausuch3-16/+37
Change-Id: I86300fff399d1bc73eeeed76b5057e3f6d2f85f3 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-10-10Fix the format issue of documentationLinda Wang3-55/+55
Also update the structure of functest code. Change-Id: Id3fa012d6c3204a0a8d7e6e4ba3159c52b68c6f5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-05Update Config GuideJose Lausuch3-51/+32
Change-Id: If7295f553f203171f5a6efebc8d553d5dca8433a Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-28Merge "Update Functest documentation for Euphrates"Jose Lausuch12-1036/+657
2017-09-28Update Functest documentation for EuphratesMorgan Richomme12-1036/+657
- Better description of Alpine docker (default artifact) - Reorganization of config and user guide - Upgrade of the developer guide Change-Id: Ie8e10f027bfcdb01c992cd161a1af2d6d6e29536 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-14New testcase creation named "cloudify_ims_perf"boucherv1-0/+23
* IMS deployment with "cloudify_ims" testcase * IXIA infrastructure creation with SNAPS * Module configuration with REST API * Configure and run the perf tests with REST API Change-Id: I3dfddda87f9e9f4f03df375f6a032ded26a627b3 Signed-off-by: boucherv <valentin.boucher@orange.com> Co-Authored-By: Arturo Sordo Miralles <asordo@ixiacom.com>
2017-08-25Remove Onos in FunctestMorgan Richomme5-58/+4
No feedback from onos projects for Euphrates for MS6 Change-Id: I8d295c65e4b621df87752e15b5f41e04a80b32ca Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-22Functest Doc: first update for EuphratesMorgan Richomme11-2075/+1374
- move part of the dev group to the testing document - move reporting into user guide - update logs - introduce alpine - introduce functest API - split documents per chapter Change-Id: I08268091ce50309e891a648333da2054e902bcea Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-18Remove multisite supportJuha Kosonen4-8/+1
JIRA: FUNCTEST-866 Change-Id: I55a4416688b2aca0897910cac69b33e154e73095 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-12Remove copper refsCédric Ollivier4-6/+0
Copper withdrew from E release (see comments in [1]). [1] https://gerrit.opnfv.org/gerrit/#/c/38851/ Change-Id: I1af463f5d60a6099592c1005ce27d3ca0c40cbbf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-12Remove netready refsCédric Ollivier4-6/+1
Netready withdrew from E release [1] [1] https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-August/017453.html Change-Id: I456b91e0bb454a4205df98d0e96032302d3b20a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-31Fixed test description for snaps_smoke.spisarski1-2/+2
Change-Id: Ia533337a07c3a47579d0fa97b6bb3b4b3daf94e5 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-07-14Merge "Release notes for Danube 2.0"Jose Lausuch1-7/+8
2017-07-13Release notes for Danube 2.0jose.lausuch1-7/+8
Change-Id: Ibe121dad771f0df36ffa15ec13d637b835cf09a8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-07-12Switch to check_deployment instead of check_os.shjose.lausuch1-1/+1
Change-Id: Idcc67643f813068c3cd06f4c0dfd3289bb7df138 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-07-04Merge "Remove the former link /home/opnfv/repos/functest"Cedric Ollivier4-10/+4
2017-07-02Remove the former link /home/opnfv/repos/functestCédric Ollivier4-10/+4
All operations required have been applied [1]. All documentations are updated as well to close the topic. It should be noted that runfunctest.rst must be hugely updated because all $PS1 are wrong. [1] https://gerrit.opnfv.org/gerrit/#/q/project:functest+branch:master+topic:dockerfile JIRA: FUNCTEST-836 Change-Id: I26658be109fd785d068389816be4260cff823705 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-01Fix typos in docsMartin Kulhavy3-25/+25
Fixed multiple typos and minor spelling errors found in the documentation. Change-Id: I102e3b7d3d421042dbef66f261e2183b0dfe24a8 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-06-06Remove call to fetch_os_creds.shjose.lausuch1-45/+19
After [1], the openstack credentials are provided to Functest as a volume directly from CI. The same has to be done manually. Functest doesn't need the script fetch_os_creds.sh any longer. [1] https://gerrit.opnfv.org/gerrit/#/c/35199/ Change-Id: I0883ad7b248526cfe9df3fde984345bd41869e82 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-30Define create_snapshot() and clean() in TestCaseCédric Ollivier1-8/+2
They replace the former calls in run_tests which are not suitable for all test cases. Now any test case can define how to clean its resources. If the snapshot cannot be created, the test case is considered as failed. Only a message is printed if any failure during cleaning. It also defines a new class called OSGCTestCase useful for test cases which don't clean their OpenStack resources. All test cases located in opnfv_tests/openstack inherit from it to keep the global behavior unchanged. It also deletes exit instructions in openstack_clean and openstack_snapshot, removes clean flags in testcases.yaml and updates the related utils. All Docs are modified as well. JIRA: FUNCTEST-438 Change-Id: I8938e6255708012380389763a24059ace4ce45d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-23Call fetch_os_creds.sh from $PATHLinda Wang1-1/+1
Now it's defined as script in releng/modules' setup.py [1] [1] https://gerrit.opnfv.org/gerrit/#/c/35183/ Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Depends-On: Ic77f4e46d6d3396f9891b73105a0eb7aa037754f JIRA: FUNCTEST-829 Change-Id: Ief821b7326e0a6c2bbcab31bb21629455e4bc9ea Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Merge "Documentation for unit test project"Morgan Richomme1-10/+66