summaryrefslogtreecommitdiffstats
path: root/tox.ini
AgeCommit message (Collapse)AuthorFilesLines
2018-09-03Refactor RallyBaseJuha Kosonen1-1/+0
This provides a more generic way to integrate test case lists which are not hosted in Functest. Also removes vm scenarios since they have never been a part of actual rally runs. Change-Id: Ib0a020fe72800915bbf2d10ecc690a248d33c246 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-01Publish unit test reportCédric Ollivier1-0/+1
It leverages on nosehtmloutput [1] [1] https://github.com/openstack-infra/nose-html-output Change-Id: I94e94c2127b4ff8e032e121dd2bd56b3c22809f8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-27Support VIO (VMware in OpenStack)Cédric Ollivier1-0/+1
It allows converting all images to vmdk and then patching all testcases. DEPLOY_SCENARIO should match vio to do so. convert_images.sh has to be called as prerequisite. JIRA: FUNCTEST-992 JIRA: FUNCTEST-993 Change-Id: Ie35bf80af1cd9610a8c416ec01b81b61c6148cfe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Publish Functest daily and gate jobsCédric Ollivier1-0/+1
As opposed to the Releng ones, they are designed to be easily executed by endusers as well. They can be considered as a first step towards a full Functest CI/CD toolchain deployed via docker-compose. All components testcases are enabled here. They hugely leverage on templates to load the right yamls per branch and multijobs to run testcases in parallel. Many steps are proposed allowing running part of the chain. Executors have to be increased to allow running them (it was tested vs 10 and more). At first, all docker images are downloaded to avoid different versions between testcases. They will be improved in a second change to ensure that only one node is selected and to take all Functest env vars into account. Change-Id: I99c7b8ee5d0ddbb00102b3147739b5e8b5c65c23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Remove VnfOnBoardingCédric Ollivier1-1/+0
All the vnfs are now inherating from scenarios. Change-Id: I63509102067676ca0676b773db542086caa02d84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-20Cover cinder testcasesDelia Popescu1-0/+2
JIRA: FUNCTEST-908 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ie9662877cba89ea96de4403ee2b736c118a044d5 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-07-09Add Vmtp as a new testcaseCédric Ollivier1-1/+3
VMTP is a small python application that will automatically perform ping connectivity, round trip time measurement (latency) and TCP/UDP throughput. JIRA: FUNCTEST-980 Change-Id: I8e94fc52a429f505ac14e14bbb9d0a3b20996ba4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-07Cover vping_sshCédric Ollivier1-0/+2
Change-Id: I37c52057a45d76e081a1a0145baee96041ca25a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-19Fix pylint errorsCédric Ollivier1-2/+3
They are highlighted by the last pylint version. Change-Id: I473212a413013492716993fb536903b13bff66ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-17Run unit tests vs different upper-constraintsCédric Ollivier1-1/+1
It allows setting different upper-constraints (i.e. run unit test vs OpenStack master). Change-Id: Ie4f433a9f6b4c68a43ea259abb0f95270fc908ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-15Remove cli and apiCédric Ollivier1-5/+0
cli has been deprecated for a while and restapi is uncovered and unverified. This patch will be partially reverted as soon as next unit tests cover functest/api. It partially updates troubleshooting docs which has to be completed in a second change [1]. [1] https://jira.opnfv.org/browse/FUNCTEST-982 Change-Id: I08e0bd212fcf5f5c5c220eb2500a6b0a6ff46df7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-14Support py3 in uncovered packagesCédric Ollivier1-2/+3
It has to be noted that cloudify_rest_client doesn't support py3 then next unit tests vs cloudify-based testcases would be excluded. Change-Id: I0b0e64929d1238665c778ce51fd6abd5ccf06b6c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-14Add py3 support in tempest and rallyCédric Ollivier1-0/+2
Change-Id: I009d38a0db409ab4ec641cba9173ab2386d0ce2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-25Add cinder_test testcaseDelia Popescu1-0/+3
Create 2 instances with Floating IPs Attach data volume to instance 1 Write data on the volume Detach volume from instance 1 Attach volume to instance 2 Read data from volume JIRA: FUNCTEST-908 Change-Id: I10efdfb3b7f9d7e6ab5c6a538052437585d52fb0 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-07Simplify vping_sshCédric Ollivier1-1/+0
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Check shell scripts via bashateCédric Ollivier1-1/+10
It also removes functest/cli/functest-complete.sh. Change-Id: I5d9313be6a155b4adf1b82ce2b111ec06823cd8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Update to stable/queensCédric Ollivier1-1/+1
It allows getting first results before the blackout between MS0 and MS2.1. Testcases could work thanks to backward compatibility provided by openstack clients. It disables all features which are not synced (patches are under review). It will ease verifying installers which are following master because it reduces the gap between releases. Change-Id: If0893f6dbaed76d4bafbd10a4f0934e6c5057477 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-07Check .travis.yml via yamllintCédric Ollivier1-0/+1
Change-Id: I6f526c4c153ac6769a36c10e6480563c4345cfba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-04Check API doc via doc8Cédric Ollivier1-1/+3
It also cleans unseless dirs. Change-Id: I13be1359b36c49e8f199087fe2a23818c6d1b6e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-04Fix Functest Internship ReportsCédric Ollivier1-0/+8
It allows building these documentations via tox. rst files are now checked via doc8. Change-Id: I06096d466b672e4c171240c918d1c91e1b3dfd13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-04Fix Functest Developer GuideCédric Ollivier1-0/+2
It allows building this documentation via tox. rst files are now checked via doc8. Change-Id: I4f45dc2b6657466b05e7ceec60a751656552584e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-04Fix Functest User GuideCédric Ollivier1-2/+8
It allows building this documentation via tox. rst files are now checked via doc8. Intro is moved into a new file. Change-Id: If1dbe2cbde2f39ca4948ada2b2743594bc387dbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-04Fix Functest Config GuideCédric Ollivier1-0/+2
It allows building this documentation via tox. rst files are now checked via doc8. Intro is moved into a new file. Change-Id: Ic5c0108cf1cbb0fc69f7e2cc73cf2fb69e44baa1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-04Fix Functest Release NotesCédric Ollivier1-1/+4
It allows building this documentation via tox. rst files are now checked via doc8. Change-Id: I4cfec11b06319b5ccdcff5f7f14475375e778c01 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Rewrite refstack testcaseCédric Ollivier1-3/+4
It now leverages on rally to factorize code between all tempest-based testcases. refstack-client is also added as requirement. JIRA: FUNCTEST-942 Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-11Fix many pylint warningsCédric Ollivier1-1/+2
Only pylint warnings in vnf modules has to be fixed now. Change-Id: Ie71230072a51bb72ec0b1d4fef2652494d29948e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-02Leverage on XtestingCédric Ollivier1-16/+0
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Fix pylint errors/warnings in tempest modulesJuha Kosonen1-0/+2
JIRA: FUNCTEST-913 Change-Id: I37b25bbcf43fb1d6f7de0c815ad49070d1e1af12 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-30Fix pylint errors/warnings in rallyJuha Kosonen1-1/+3
JIRA: FUNCTEST-906 Change-Id: I484f9a291d5adbedb855450e4ff067dfa4a3b2ae Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-29Fix pylint errors about refstackLinda Wang1-0/+2
JIRA: FUNCTEST-907 Change-Id: Ib08a88523c700d35894b9b89b7585425a02065c3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-28Fix warnings in all snaps-related modulesCédric Ollivier1-0/+4
It also adds vping/__init__.py to stop skipping vping unit tests. It removes the useless import os which is not required for mock (here the mock patch was simply false). It should be noted that the code is partially duplicated between snaps_test_runner.py and vping_base_base.py. A small part of code has been rewritten to fix that without multi inheritance. Change-Id: I2e3e181ad7dab8aa41afb1e63d0b6795ff0d1610 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Fix pylint errors in several utils modulesCédric Ollivier1-1/+5
All utils which are moving to xtesting are now fixed. It remains OpenStack and Functest utils (+ the related unit tests) which doesn't move to the new package. Change-Id: If13c627c8444c62d5c6bf9c8057d6413aa0e56c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-26Fix last Pylint error in FunctestCédric Ollivier1-0/+3
It also fixes all pylint warnings in router and the related unit tests. tox.ini is updated to ensure that no error is introduced. Change-Id: Iddd74b0dac7b6581d72b04369140006c9e19f998 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-24Fix pylint warnings/errors in cliCédric Ollivier1-0/+2
cli_testcase and cli_tier have been refactored to avoid duplicating code. Then functest/cli and funtest/unit/cli can be added to the list of modules rated 10/10. Change-Id: Iec90e806397248a10f39080ec554e3f0a6eda7c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Partially rewrite test_run_tests.pyCédric Ollivier1-3/+1
It mainly fixes pylint issues and leverages on decorators. It should be noted that run_tests.py is not fully covered (see xtesting requirements). Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Fully test and cover functest/ci/tier_*Cédric Ollivier1-1/+6
It also fixes check_deployment.py and ci unit tests which were wrong when testing exceptions. Now ci modules are rated 10/10 and fully covered. Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-20Configure password for the user in vnfLinda Wang1-1/+1
For some SUTs, the password for creating user is not allowed to be the same as user name, and some even is required to contain at least 8 characters and three types of characters for security. It also turns yamllint warnings into errors and fixes the remaining warnings. Change-Id: Icf25a7b9ff1c8cee55899198f1e519c9209877ff Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-14Improve the pylint score of functest-coreLinda Wang1-0/+3
It also modifies the file list to ensure the rating of ci modules. Change-Id: Ia1e414be5364cb3da3d54882db428024ed6bd99f Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-13Fix yamllint errors in functest/apiLinda Wang1-1/+1
JIRA: FUNCTEST-897 Change-Id: I49c7c87dfded000197fe6451fb96dc0749f2ceb0 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-12Ensure that all energy modules are fully coveredCédric Ollivier1-0/+2
Change-Id: I501a404d1202cc92da5e62dbf9db2aa453ffd324 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-12Add python3 support in cliCédric Ollivier1-0/+1
Change-Id: I222fde91cf236a272176bc2d9ec6732f98b76141 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-12Add python3 support in energyCédric Ollivier1-0/+3
It also converts Exception to str when expected. All energy modules are also listed in files rated 10/10 by pylint. Change-Id: Id382d60eb35f50c98b15423f9559a920ce5dac62 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-12Add python3 for Functest utilsCédric Ollivier1-1/+1
It also fixes test_utils RegexMatch and SubstrMatch. Change-Id: I124aa7d0c4110dcd2f50220aae7ba9b299799e93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-11Add Python3 support in functest/ciCédric Ollivier1-0/+1
Change-Id: If13bfaa196b8dfab1e83feb28c5a4719c7acd8c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-11Fix yaml format errors in vnfCédric Ollivier1-12/+5
All Rally yaml files are skipped because they leverage on jinja2. Now last errors are in functest/api directories [1]. [1] https://jira.opnfv.org/browse/FUNCTEST-897 Change-Id: I4d6c9b3b7c1f3602bd51c9cf7e1c5babf581ab82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-06Fix the yamllint errors in functest/ciLinda Wang1-0/+3
And also, remove the params "tempest_use_custom_images" and "unique_names" of vping, rally and tempest. Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-04Create a tox env to check yaml filesCédric Ollivier1-0/+14
It also fixes all testcases config files. Change-Id: I81a6ffb8b7acf4239c79129dc842e283d3d32b35 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-29Force Framework to be fully coveredCédric Ollivier1-1/+14
Change-Id: Ida120fe28ea7860758a218189d905bebee2e8ba5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-15Remove the tox venv patcharm64Cédric Ollivier1-8/+0
It's now useless as Jenkins jobs call build.sh which modifies all Dockerfiles for both architectures. build.sh allows building private images as opposed to this former tox entry which only take opnfv into account. Change-Id: I21e2e5303b4310e053cf013cb7f0e0c4532d5db5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-09Remove the former DockerfileCédric Ollivier1-10/+1
opnfv/functest had been split into multiple containers based on Alpine (See Docker Slicing [1]) during Euphrates. As ARM is being switching to them, we can safely remove the related files. [1] https://git.opnfv.org/functest/tree/docs/com/pres/dockerslicing/dockerslicing.md?h=stable/euphrates Change-Id: I30294a94cc742ba80a7bc4f35db9330240385bb0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>