summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-03-19Put TestResults.json in the right dirCédric Ollivier1-7/+3
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/26/console Change-Id: Icfdc0030d517b1885a94c2815aeb35257fdfd590 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Fix apidoc buildsCédric Ollivier1-2/+1
Change-Id: Id5846d0c66a52fa72b6cd32333f18c485877aa8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Update xtesting to 0.31Cédric Ollivier2-1/+2
It mainly fixes regex when INSTALLER_TYPE is unset [1] [1] https://gerrit.opnfv.org/gerrit/#/c/54089/ Change-Id: I57430e87ec7b988337697417e319cf4f9b207e0d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-18Allow exceptions when deleting a missing verifierCédric Ollivier1-2/+5
Change-Id: I2e48bdcf9bce872a4a7855f9f6cd05d2b4897244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute log in vnfsCédric Ollivier2-19/+23
It also configures the nameserver when creating the subnet in juju_epc. Change-Id: I163ba99cd56f44ca3c3464398e182152b3ab74dd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Refactor refstack to limit instructionsCédric Ollivier1-24/+8
Change-Id: I3cd490d18898d0ee6f48e4c19d7ed65c0cf0c275 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute all rally messagesCédric Ollivier4-80/+59
The are now printed in functest.log only. JIRA: FUNCTEST-950 Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Decrease log levels when trying to connectCédric Ollivier3-7/+7
Only the last attempt should be printed in console. Change-Id: Ic1ed5887195c98c64ade4558ac20ebd814e38bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Precise tempest regexCédric Ollivier2-2/+2
It stops running neutron tests which matched the former regex. Change-Id: Ica5a0d1f4858d01533156c98da87f9ed4662489f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Refactor Patrole to limit instructionsCédric Ollivier1-26/+12
Change-Id: Ie0ab079b1f674587ff3d68bf170df2296303780e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Set api_extensions = all for NeutronTrunk onlyCédric Ollivier2-3/+9
Change-Id: I6c019094a9cea86f5990752463a3690d4f00df0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Set project_name arg when creating usersCédric Ollivier3-1/+8
It also print snaps_creds to ease debugging [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/22/console Change-Id: I5b0d0dcffe3e45d8fa7d1d7d8ce19172fc42aaa1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Disable features in nofeature scenarioCédric Ollivier3-3/+3
Only Funtest testcases are verifying the referent scenarios. Change-Id: I29dfa012e9cba39216fdd58e5fd59255844f335b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Merge "Create 2 images and flavors for tempest tests"Cedric Ollivier7-85/+22
2018-03-15Remove the image for orchestra testsLinda Wang1-1/+0
Change-Id: I80797fc08c03795c6e1ec604306f77da7ecefc19 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-15Create 2 images and flavors for tempest testsLinda Wang7-85/+22
Also 1. remove the obsolete function: generate_test_accounts_file 2. Use patch mechanism to get config Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-15Set blocking of patrole falseLinda Wang2-2/+2
Change-Id: Ia6f0c6fec30af5c4124f21b2bdaa3084bced6f9e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-14Merge "Refactor TempestCommon to simplify subclasses"valentin boucher6-79/+39
2018-03-14Refactor TempestCommon to simplify subclassesCédric Ollivier6-79/+39
Change-Id: I8d265b6939861fd9d02a3d0f31aef53b9bfcb035 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-14Get odl ip from env on CompassLinda Wang2-1/+3
Change-Id: I9ed2cdeef461c27381ecdfd56e5347ded61b5cb8 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-14Merge "Implement trunk ports testcase"Linda Wang7-1/+66
2018-03-13Leverage on VOLUME_DEVICE_NAME if FuelCédric Ollivier1-6/+1
As Fuel sets VOLUME_DEVICE_NAME [1], the specific conditional instruction can be removed. [1] https://build.opnfv.org/ci/job/functest-fuel-baremetal-daily-master/18/console Change-Id: Iee3fd7c969cf31c8017b73c6ffd646f0e33a9e73 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-13Bypass APEX-570 when publishing image metadataCédric Ollivier1-1/+8
This temporarily fix aims at testing juju_epc vs a non default region name [1]. It must be removed as soon as APEX is fixed [2]. It completes the previous patch which only modified credentials [3]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/lastFailedBuild/console [2] https://jira.opnfv.org/browse/APEX-570 [3] https://gerrit.opnfv.org/gerrit/#/c/53465/ Change-Id: I3e1e64ad7147ee5cdf899eb2500f8b825b818619 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-13Implement trunk ports testcasePanagiotis Karalis7-1/+66
The tempest testcases have been integrated from Neutron trunk testcases. It also enables every Neutron extension which may raise side effects [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html JIRA: FUNCTEST-926 Change-Id: I05015acf119f504ce0a5539d677719de874594ad Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-13Merge "Add patrole in smoke"Cedric Ollivier5-77/+30
2018-03-13Add patrole in smokeCédric Ollivier5-77/+30
It also removes the former container which had helped when checking possible regex issues. I should be noted that patrole is already part of opnfv/functest-restapi. Change-Id: I76783bc3d121dfcef5b709f21a5e474354e93705 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-13Fix tempest_customLinda Wang1-1/+1
Change-Id: I684c06eae899d9bc468e0be6a1537f9c942e86ce Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-12Remove orchestra testcasesCédric Ollivier7-1548/+0
They are incompatible with Pike and they have to be removed without any deep update. The testcases will be re-renabled if updated before 03/16/18. Change-Id: Ibf656db6ba4177eae44feb41cd5d314b7408d4de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Merge "Stopping setting identity-feature-enabled if Patrole"Cedric Ollivier1-1/+0
2018-03-12Merge changes from topic 'refactor_tempest'Cedric Ollivier21-452/+108
* changes: Rewrite refstack testcase Fix many pylint warnings
2018-03-12Merge changes from topic 'refactor_tempest'Cedric Ollivier3-26/+31
* changes: Refactor configure_tempest_patrole() Improve tempest files management
2018-03-12Stopping setting identity-feature-enabled if PatroleCédric Ollivier1-1/+0
It avoids differing from all other tempest-based testcases for a useless config option. Change-Id: I02e1786f0ba3c1f7da11f258e80f57ca624247f9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Merge "Add patrole in opnfv/functest-restapi"valentin boucher3-4/+33
2018-03-12Rewrite refstack testcaseCédric Ollivier13-433/+89
It now leverages on rally to factorize code between all tempest-based testcases. refstack-client is also added as requirement. JIRA: FUNCTEST-942 Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-11Fix many pylint warningsCédric Ollivier9-19/+19
Only pylint warnings in vnf modules has to be fixed now. Change-Id: Ie71230072a51bb72ec0b1d4fef2652494d29948e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-11Bypass APEX-570 to allow gating juju_epcCédric Ollivier1-1/+9
This temporarily fix aims at testing juju_epc vs a non default region name [1]. It must be removed as soon as APEX is fixed [2]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/lastFailedBuild/console [2] https://jira.opnfv.org/browse/APEX-570 Change-Id: I0724b694efb43709d43da6a30e11d1daafee47d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-11Refactor configure_tempest_patrole()Cédric Ollivier1-19/+9
Change-Id: I1c34b3bce68a7d57d63fb2e5e4b6aa003dda8f61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Improve tempest files managementCédric Ollivier3-7/+22
Calling apply_tempest_blacklist() is no longer mandatory. Change-Id: Id9a4e970c8acca066a36be89920745127867cd63 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Add patrole in opnfv/functest-restapiCédric Ollivier3-4/+33
Change-Id: I983898c27477986d9a5610e1df966fd00a8bc785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Enhance patrole configurationsCédric Ollivier2-2/+10
It allows listing the OpenStack services tested or setting test exlusions (e.g. tests requiring GRE as overlay). It should be noted that Keystone and Nova can't currently be tested without their default policy.json. Change-Id: I8909694b4ffc315959504441f5ea0b1f3023fe7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-09Add one missing res dir in refstackCédric Ollivier1-9/+9
It completes "Allow overriding tempest output dir" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/53241/ Change-Id: I236a1eb708de324dd42440897e317ce2d0787ffc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-08Remove duplicate ubuntu trusty/14.04 os imageValentin Boucher5-6/+4
VNF testcase use some Operating System image 2 of those are the same but not with the same name Change-Id: Ide5ae683f606f7f58535c0a59cec45e4a30d225c Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-03-07Add neutron and glance policy.json for patroleCédric Ollivier3-1/+7
It only runs tests about neutron and glance because their policy.json can be still downloaded. Installers could override them via docker volumes if needed. Several tests about provider networks are currently excluded because GRE is selected. Change-Id: Ic4e2274e3f53e66be0174e117993e8c307b96bf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Allow overriding tempest output dirCédric Ollivier5-51/+63
Change-Id: I31a5d2772bab168b3cb4e6b0713d6e95aa5b6fd7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Set ODL tests and refstack client refsCédric Ollivier2-4/+4
To prepare F-release, we should set git commit ids for these dependencies which follow the rolling release model (master). Change-Id: I3c791040ea5ec700cfa845ae642e6d862c49281f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Add a new env var for nameserverLinda Wang10-13/+30
We should still consider that the nameserver must be handled by all installers instead [1]: - by configuring one or more DNS resolvers in dhcp_agent.ini - by asking a local resolv It eases setting the nameserver in testcases and then allows gating them. 8.8.8.8 is still defined by default. [1] https://docs.openstack.org/neutron/pike/admin/config-dns-res.html Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Id58dd5ebee612a0fce2ebc40f089769e60899416 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-07Define a new env var for volume device nameCédric Ollivier3-6/+7
It eases modifying the volume device name written in tempest config. Fuel jobs should be adapted to set the right value (vdc) which differs from default (vdb). Change-Id: I09212018f94daa800ede815bd3586cceed0d54e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-05Merge "Fix Rally scenario parameters representation"Cedric Ollivier1-7/+7
2018-03-05Fix Rally scenario parameters representationJuha Kosonen1-7/+7
Use printable format of string in scenario input parameters. JIRA: FUNCTEST-946 Change-Id: Ic4826506a6f030e749fecdc7f880e9f911f9c987 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-03-05Merge "Load SfcFunctest instead of running a bash script"Cedric Ollivier2-8/+4