summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-02-13Read env vars instead of using CONST in APILinda Wang3-8/+8
Also, improve the way of getting env values. JIRA: FUNCTEST-933 Change-Id: Ia66bbaf683df03c2874fafe578b84bb78a4f3fd1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-12Merge "Export env vars via os.environ in test_cli_env.py"Cedric Ollivier1-7/+7
2018-02-12Merge "Fix pylint errors/warnings in tempest modules"Cedric Ollivier5-188/+226
2018-02-12Export env vars via os.environ in test_cli_env.pyCédric Ollivier1-7/+7
CONST shouldn't be used for getting/setting env vars. It adds complexity and may raise side effects. Change-Id: Id80a03aff6eb908a792f1d07addaad4770e8d0cb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-12Decrease log level in Energy messagesCédric Ollivier1-13/+17
Energy could be safely disabled if one env var is missing. No error message should be printed in console [1]. It could be enhanced in a second step to print the reasons (missing or incorrect env vars) instead of the full stack. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/766/console Change-Id: I9c405edae16d186f02c632113de1317c89703991 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-10Run all daily testcases if CI_LOOP is unsetCédric Ollivier1-2/+2
Then CI_LOOP is no longer mandatory and it bypasses the current jenkins jobs's issue [1][2][3]. [1] https://gerrit.opnfv.org/gerrit/#/c/51981/ [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/763/console [3] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/764/console Change-Id: I73629079d70e0f43e609d3861490573e10fd216c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Read the env file only if existsCédric Ollivier2-1/+6
Change-Id: I8e718e583a5a47a089755c31e623a44732e5ba1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Ensure logging is disabled when unit testing featureCédric Ollivier1-3/+6
Change-Id: Ibe08477a8b50a6c9b71ab4e5b0ebaaab36692b08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Unlink robotframework from constantsCédric Ollivier1-3/+2
Change-Id: Ic2c6c84c3824ec3fa208824ae67f1769d4e18c4f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Merge "Remove one obsolete var"Cedric Ollivier1-5/+0
2018-02-09Merge "Unlink feature from constants"Cedric Ollivier1-3/+2
2018-02-09Merge "Unlink vnf from constants"Cedric Ollivier2-38/+28
2018-02-09Merge "Unlink run_tests from constants"Cedric Ollivier2-18/+16
2018-02-09Fix pylint errors/warnings in tempest modulesJuha Kosonen5-188/+226
JIRA: FUNCTEST-913 Change-Id: I37b25bbcf43fb1d6f7de0c815ad49070d1e1af12 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-09Merge "Unlink Energy from functest utils and constants"Cedric Ollivier3-66/+42
2018-02-09Merge "Move get_dict_by_test() into run_tests.py"Cedric Ollivier4-58/+33
2018-02-09Merge "Conform with OpenStackUser.get_os_creds() in juju_epc"Cedric Ollivier1-8/+4
2018-02-09Merge "Get neutron endpoint via snaps in odl"Cedric Ollivier2-87/+76
2018-02-09Remove one obsolete varCédric Ollivier1-5/+0
Else it simply forces the config file into xtesting. Change-Id: I33153997f2aa422e50cea011f6a4e7eb567a83d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Unlink feature from constantsCédric Ollivier1-3/+2
Saving results dir as class attribute seems better in the context of xtesting. Change-Id: If40303d07d3be9bdc09d990f560cbeda429fd642 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Unlink vnf from constantsCédric Ollivier2-38/+28
It generates a default description which all testcases can easily override. Change-Id: I81b97c394cf064088767cc934295602f01a7f739 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Unlink run_tests from constantsCédric Ollivier2-18/+16
run_tests.py doesn't read any functest config file what is mandatory for xtesting. Change-Id: I49f672c54a606acead75f573d1ce496c81fb235a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Unlink Energy from functest utils and constantsCédric Ollivier3-66/+42
It requires an update of releng jobs which have to export ENERGY_RECORDER_API_URL = http://energy.opnfv.fr/resources Change-Id: Iecd5d49b4d4c961c9dc51e43e54df1fcd4027266 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Move get_dict_by_test() into run_tests.pyCédric Ollivier4-58/+33
It also removes functest_utils.get_criteria_by_test() Change-Id: I3f265642acd053755e32f8e92f1086b93517c247 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Conform with OpenStackUser.get_os_creds() in juju_epcCédric Ollivier1-8/+4
UserSettings are not linked to any project then abot has to be passed as arg when calling get_os_creds. Else it returns the project registered in credentials instead of the one created by this testcase. Change-Id: Ia0658cc9af155df06de3d14e21e5288dad6367f9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Merge "Move source_credentials() into run_tests.py"Cedric Ollivier6-60/+55
2018-02-08Merge "Refactor tempest resource manager"Cedric Ollivier1-109/+89
2018-02-08Get neutron endpoint via snaps in odlCédric Ollivier2-87/+76
Change-Id: Iaf0e451e7f6bd7d22459f8d3509b39773527cfea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-08Move source_credentials() into run_tests.pyCédric Ollivier6-60/+55
It's also renamed source_envfile(). Change-Id: I0e7c38c2def125961f86dc2bc9a63cfb6ad87c03 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-08Refactor tempest resource managerJuha Kosonen1-109/+89
Split resource creation into several methods. Implements partly JIRA: FUNCTEST-913 Change-Id: Ic0dd5782c604498066c636deef10b0c18c1cb48d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-07Add variablefile as possible robot.run() argsCédric Ollivier3-12/+20
Change-Id: Ic80840957b4d9c3c4a1615696a2851f3f5bf7bf4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-07Revert "Temporary disable one unstable snaps test"Cédric Ollivier1-7/+5
This reverts commit 728e77ab3dbf075a21829a56d83cf34751bcdef6. Change-Id: I6e5d3fa2cdf423b3c4c149108afbd9a18f0fc4b3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-07Temporary disable one unstable snaps testCédric Ollivier1-5/+7
Else all verify jobs are failing [1] [1] https://jira.opnfv.org/browse/SNAPS-263 Change-Id: Ic2dca7f2387af1f98d3720b8db05dc3ccd54098c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-07Remove dns server from juju_epc configCédric Ollivier2-6/+1
The dns server shoud be set by the Cloud provider via Neutron configs. Snaps is currently enforcing 8.8.8.8 as default too. Change-Id: I3e9a25d8bbfbab4cd1d44e394235b329df86e82e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-07Merge "Disable orchestra_* testcases"Linda Wang2-0/+4
2018-02-06Fix rally cinder volume attach scenariosJuha Kosonen1-0/+6
Add network id to following scenarios: CinderVolumes.create_snapshot_and_attach_volume CinderVolumes.create_nested_snapshots_and_attach_volume JIRA: FUNCTEST-929 Change-Id: If95babebf9ea6205684494395bdfd72d5203f4bf Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-06Disable orchestra_* testcasesCédric Ollivier2-0/+4
They can be simply disabled and they unsuccessfully run vs Daily only. In a second step, moving the related python modules in a new orchestra repository could be a good solution simply because they don't reach our coding criteria. The best way is still to update them according to our rules and to check all installers thanks to these two vnfs. Change-Id: If36b16f0ed95d7039db9455a32c18f7fd1a739ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Stop printing data sent to DBCédric Ollivier1-1/+1
https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastFailedBuild/console Change-Id: I0f794159d05fe21f659ecf3b5a9fa407620b723d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Fix docstringsCédric Ollivier2-1/+5
Else sphinx can't parse snaps_suite_builder.py and IxRestUtils.py. Change-Id: Iab231a043120154bce708263474b9f9926c1f715 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Switch to the readthedocs theme for api docsCédric Ollivier3-1/+5
It also adds a requirement file for external doc tools wich couldn't handle upper constraints. Change-Id: Idf8f43e5e1a845055ce248f1dc8b8d676a3ac37b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Remove yamllint from upper-constraints.txtCédric Ollivier1-1/+0
OpenStack doesn't list test requirements in upper constraints [1]. [́1] https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt Change-Id: I7472158d385beb311c159563bc3bb973c4a2d4c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Add build_sphinx section in setup.cfgCédric Ollivier1-0/+5
Change-Id: Ieac48a1a213bc5cd62a42dab1c74c80761e82fd1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Blacklist Quotas.nova_update_and_delete testJuha Kosonen1-0/+10
Excluded since the test occasionally fails due to race condition issue on quota manipulation in nova [1]. [1] https://bugs.launchpad.net/nova/+bug/1552622 Change-Id: Ib979c1e371727aa3adea9dc0b5955e7ed24881cf Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-05Merge "Add modules docstrings in snaps"Juha Kosonen6-6/+12
2018-02-05Increase Rally full criteriaCédric Ollivier2-2/+2
Even if several tests are currently under investigation, it seems relevant to expect a full success here. Change-Id: I6a8c5fb5a7dd4bfb5c3a2e7a93de1c0bec77c878 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Add modules docstrings in snapsLinda Wang6-6/+12
JIRA: FUNCTEST-922 Change-Id: I058486427fe55e1d1ce939fce20d75ff7afde85c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-04Update results printed in configguide.rstCédric Ollivier1-78/+77
It updates the entry points and all results. It also takes into account that: - juju_epc was added - fds was moved to features It should be noted that refstack_defcore, parser and several vnfs are failing from the time being. Change-Id: I918a7767005569f03115749ad121a6c7a04c04a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-04Fix links in configguide.rstCédric Ollivier1-13/+13
It also removes trailing whitespaces. Change-Id: I6a7e4aaff700a85ff1c0c2741624e9359441e0ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-03Fix JujuEpc prepare() and deploy_orchestrator()Cédric Ollivier1-173/+177
It bypasses a known unfixed Juju bug [1] by creating a second '_member_' user [1]. An 'admin' user is still required to create flavors and by snaps when listing virtual machines. It highlights a possible bug in user_creator.get_os_creds(). It partially rewrites the testcase by cleaning instance attributes and by taking several os.system() returns into account. It sets the new password automatically generated [2] and starts switching from openstack utils to snaps in vEPC. This patchset must be completed by unit tests and by another patch fully switching to snaps in the last methods. It should be noted that the testcase sets 8.8.8.8 as dns server which could raise side effects. [1] https://bugs.launchpad.net/juju/+bug/1710848 [2] https://gerrit.opnfv.org/gerrit/#/c/50747/ Change-Id: Id18b4b185aa1825196e91f6692338169f51faea8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-03Merge "Do not use shell to execute commands in tempest"Linda Wang2-19/+15