aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-04-20Fix image paths in cloudify_ims_perf.yamlCédric Ollivier1-2/+2
Change-Id: If58b5f2021df8a0de672a30459b5b0b12f3fcef2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4c140b0cc3f484ce441e0f24a6a3a8c906d4cc59)
2018-04-20Set fraser as branch in cloudify_vrouter reposCédric Ollivier1-2/+2
Change-Id: I1338c07f7eab398723b5e7599cf94b032d014cdd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-19Download fraser.zip instead of master.zip (cloudify_ims)Cédric Ollivier2-2/+2
Change-Id: I6a5ebb27f445b816cf449f8b9db60e70278b338f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-19Use timeout to wrap juju-waitCédric Ollivier1-2/+4
It allows getting logs as releng doesn't push them if global timeout. Change-Id: I4bbb3818feff37d29b4ccd586f3e940380feef2e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 251024b29199ecee86661b8850751d982b7c5797)
2018-04-17Check app workload in juju_epcCédric Ollivier1-16/+16
It avoids interpreting rsync errors in case of deployment failures. Mysql is still unchecked. Change-Id: I01b4470b86637d0fc322c422f05240a928305158 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Merge "Get debug data before cleaning juju_epc" into stable/fraserCedric Ollivier1-0/+6
2018-04-17Get debug data before cleaning juju_epcCédric Ollivier1-0/+6
It could help us to detect the issue when testing Apex (nosdn). It should be only printed on exceptions instead but this proposal is safer and straightforward. Change-Id: I2cccc737e3b3572af72c2653bf32bc02f9ab9077 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c789cca4a6e9afefba0c1622d49a181dd35437f7)
2018-04-17Set scp debug flag in juju_epcCédric Ollivier1-3/+3
Change-Id: Ic57d05416ac7c8bc459363ea479237101c22f27e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ed3a825ec90796fe72387b4bd74033a991b2351b)
2018-04-15Remove odl_netvirt testcaseCédric Ollivier1-22/+0
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 13e4c5838b732bf9fd246cd4f97cb9b4e2b8e0b9)
2018-04-15Filter only on scenarios if possibleCédric Ollivier1-3/+3
If a scenario is defined, setting installers as dependencies makes the maintenance more difficult. Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 38c67396839738cb319c797aa35fb50ec892b053)
2018-04-15Set same dependencies for all vping test casesCédric Ollivier1-1/+1
It allows a fair comparison between odl and nosdn scenarios. Gluon could also be safely removed as scenario filter. https://build.opnfv.org/ci/job/functest-compass-baremetal-daily-master/88/console Change-Id: I0a9268d2038c79320e372d1d35d276560555aa7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7c8d58fbe548f94c6cecfef7afc66270b395d6e9)
2018-04-14Print the stack traceback when cleaning juju_epcCédric Ollivier1-2/+1
Change-Id: If32557a4384cafd67b7c294f8c0592ee2769b1a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b2b1be21af5de2dd88092be268ae5f817608ecd1)
2018-04-13Merge "Fix role processing in Patrole" into stable/fraserCedric Ollivier5-41/+36
2018-04-13Merge "Pass kwargs in TempestCommon:configure()" into stable/fraserCedric Ollivier1-1/+1
2018-04-13Print the stack traceback when cleaningCédric Ollivier2-4/+3
Change-Id: I8279844f0e42378b4fe550696608054cd7418a12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 38b69d908ccf5550b1de5b9ecf170a4169fa82f1)
2018-04-12Fix role processing in PatroleCédric Ollivier5-41/+36
Role has to be listed in tempest.conf before calling testr. It also saves the right config file. Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 71c4b3b719289929c226cae60eb1b23ada16eeb2)
2018-04-12Pass kwargs in TempestCommon:configure()Cédric Ollivier1-1/+1
It's required by Patrole. Change-Id: I07eb6f05b4776c3f9929b6f08c5cbfa131e09d8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 51acd93bfe71e2cbd897f071e58b641ccd5ca1ac)
2018-04-11Precise vyos_vrouter logsCédric Ollivier2-4/+6
Aborting was written even if it worked after rebooting the vm [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/41/console Change-Id: Idb29624b8793df5d77d401b375aa3b3176778ddf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 99b72c34e92c567a47ebc3b977c7aaa290fef6de)
2018-04-11Take all cmd status into account in juju_epcCédric Ollivier1-67/+88
It also puts output in functest.log instead of /dev/stdout. Change-Id: I3a4b5f81edd20a529821c5a684b3ab269b7c6796 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 35d2dbdeeadece1b8dbac5210f05dee7028bfbb6)
2018-04-11Leverage on SDN_CONTROLLER_IP if fuelCédric Ollivier2-8/+7
It conforms with [1]. [1] https://jira.opnfv.org/browse/FUEL-352 Change-Id: Idae142de8de09203509c73c35c2e7fea5a5d880b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 492b5543103a25b51740b82a291b087f68d932eb)
2018-04-11Remove obsolete apex processing in juju_epcCédric Ollivier1-18/+5
It has been useless since [1] was merged [1] https://jira.opnfv.org/browse/APEX-570 Change-Id: Id89b75d8cad9e180a02189450e13fa1e61b1239c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 941838f1b7e574e738b359ee3bb542d04eb97176)
2018-04-09Run all VNFs vs SDN scenariosCédric Ollivier1-3/+3
It allows a fair comparison between Neutron standalone and SDN controllers. They should run successfully at least vs Daisy [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/ Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit abfdf1d28292198ef94059b5812a5987887404e0)
2018-04-09Merge "[fuel] Unite OpenDaylight ports" into stable/fraserCedric Ollivier2-2/+2
2018-04-09[fuel] Unite OpenDaylight portsMichael Polenchuk2-2/+2
ODL Oxygen has only 1 connector by default, so unite web and rest ports together. Change-Id: Idd5bdd5da3dcc85fa25b82ab2d19107b2d005974 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit bc65c4a9424a7f9b37a81b13b67ea3d86b52d9d3)
2018-04-09Remove Ceilometer test scenariosJuha Kosonen5-763/+1
The API utilized by Rally in Ceilometer scenarios was deprecated in OpenStack Pike and scenarios were blacklisted. Remove these scenarios from respository. JIRA: FUNCTEST-949 Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 2e0dad6e9a49ad9fdd349387b72f145e53bc4da0)
2018-04-03Remove NetVirt from installer dependenciesCédric Ollivier1-7/+7
Change-Id: Idb937b3ed4896208048b90b705dc3e6db6104b60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ef44d1c12fcde4cb3cea4a23078e0a984f1a7336)
2018-03-20Stop redirecting dnsmasq messagesCédric Ollivier1-1/+1
Else dnsmasq is defunct: "dnsmasq: junk found in command line". It partially reverts "Mute log in vnfs" [1] from the time being to allow gating. [1] https://gerrit.opnfv.org/gerrit/#/c/54043/ Change-Id: I660904b9e542f776f554562df2808db751cb9d2e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-20Merge "Put TestResults.json in the right dir"Linda Wang1-7/+3
2018-03-20Merge "Remove unused code in vyos_vrouter"Linda Wang1-6/+1
2018-03-20Merge "Update the details of tempest results"Cedric Ollivier1-4/+6
2018-03-20Update the details of tempest resultsLinda Wang1-4/+6
Change-Id: Idb18c7784e44030a48208ea64c21cde2536a3387 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-19Put TestResults.json in the right dirCédric Ollivier1-7/+3
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/26/console Change-Id: Icfdc0030d517b1885a94c2815aeb35257fdfd590 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Remove unused code in vyos_vrouterCédric Ollivier1-6/+1
Change-Id: I0fcfa886bfb5133d5e4b3face1e649e4cf8b9fc0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Conform with vyos descritor updatesCédric Ollivier1-0/+4
The new inputs [1] must be set else the testcase simply fails [2]. JIRA: FUNCTEST-936 [1] https://github.com/oolorg/opnfv-vnf-vyos-blueprint/commit/794f8a0594ed4c461c7d1d08d6b0ef9fb12004e2 [2] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/12/console Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I1113581feac7d4dc901ba197caed4fddd5994929
2018-03-19Update xtesting to 0.31Cédric Ollivier1-0/+1
It mainly fixes regex when INSTALLER_TYPE is unset [1] [1] https://gerrit.opnfv.org/gerrit/#/c/54089/ Change-Id: I57430e87ec7b988337697417e319cf4f9b207e0d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-18Allow exceptions when deleting a missing verifierCédric Ollivier1-2/+5
Change-Id: I2e48bdcf9bce872a4a7855f9f6cd05d2b4897244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute log in vnfsCédric Ollivier2-19/+23
It also configures the nameserver when creating the subnet in juju_epc. Change-Id: I163ba99cd56f44ca3c3464398e182152b3ab74dd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Refactor refstack to limit instructionsCédric Ollivier1-24/+8
Change-Id: I3cd490d18898d0ee6f48e4c19d7ed65c0cf0c275 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute all rally messagesCédric Ollivier4-80/+59
The are now printed in functest.log only. JIRA: FUNCTEST-950 Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Decrease log levels when trying to connectCédric Ollivier3-7/+7
Only the last attempt should be printed in console. Change-Id: Ic1ed5887195c98c64ade4558ac20ebd814e38bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Precise tempest regexCédric Ollivier2-2/+2
It stops running neutron tests which matched the former regex. Change-Id: Ica5a0d1f4858d01533156c98da87f9ed4662489f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Refactor Patrole to limit instructionsCédric Ollivier1-26/+12
Change-Id: Ie0ab079b1f674587ff3d68bf170df2296303780e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Set api_extensions = all for NeutronTrunk onlyCédric Ollivier2-3/+9
Change-Id: I6c019094a9cea86f5990752463a3690d4f00df0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Set project_name arg when creating usersCédric Ollivier3-1/+8
It also print snaps_creds to ease debugging [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/22/console Change-Id: I5b0d0dcffe3e45d8fa7d1d7d8ce19172fc42aaa1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Disable features in nofeature scenarioCédric Ollivier1-1/+1
Only Funtest testcases are verifying the referent scenarios. Change-Id: I29dfa012e9cba39216fdd58e5fd59255844f335b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Merge "Create 2 images and flavors for tempest tests"Cedric Ollivier7-85/+22
2018-03-15Remove the image for orchestra testsLinda Wang1-1/+0
Change-Id: I80797fc08c03795c6e1ec604306f77da7ecefc19 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-15Create 2 images and flavors for tempest testsLinda Wang7-85/+22
Also 1. remove the obsolete function: generate_test_accounts_file 2. Use patch mechanism to get config Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-15Set blocking of patrole falseLinda Wang1-1/+1
Change-Id: Ia6f0c6fec30af5c4124f21b2bdaa3084bced6f9e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-14Merge "Refactor TempestCommon to simplify subclasses"valentin boucher6-79/+39