aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci
AgeCommit message (Collapse)AuthorFilesLines
2018-04-30Rewrite TempestResourcesManagerCédric Ollivier1-1/+0
It now leverages on OpenStack Shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky) requires to change only one line. It stops dedicating the network to the user possibly created because the support is incomplete (the users have to be registed in tempest.conf and the multiprocessing has to be enforced). It also writes the second image and the second flavor in tempest.conf. Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-27Set image_url as filenameCédric Ollivier1-2/+1
It will be reused as soon as vping switches to openstacksdk. Change-Id: Ib84f4b35b22ead1741579ec9140d3626f9102469 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Check shell scripts via bashateCédric Ollivier1-1/+2
It also removes functest/cli/functest-complete.sh. Change-Id: I5d9313be6a155b4adf1b82ce2b111ec06823cd8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Enable sdnvpn (Gambia Release)Cédric Ollivier1-1/+0
sdnvpn has been synced to OpenStack Queens [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/55531/ Change-Id: I468752394da12023083d83f92c91b09ecf964a26 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Remove odl_netvirt testcaseCédric Ollivier1-22/+0
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Filter only on scenarios if possibleCédric Ollivier1-3/+3
If a scenario is defined, setting installers as dependencies makes the maintenance more difficult. Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Set same dependencies for all vping test casesCédric Ollivier1-1/+1
It allows a fair comparison between odl and nosdn scenarios. Gluon could also be safely removed as scenario filter. https://build.opnfv.org/ci/job/functest-compass-baremetal-daily-master/88/console Change-Id: I0a9268d2038c79320e372d1d35d276560555aa7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Disable refstack_defcore due to testrCédric Ollivier1-0/+1
refstack_client is hardcoded to testr when normalizing tests list. It's disabled till refstack_client conforms with OpenStack Queens (.testr.conf was removed from tempest). Change-Id: I10c7059e049017db994003eb5d42da83e1d5a839 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Disable volume in Patrole 0.3 by defaultCédric Ollivier1-1/+0
Else it fails without /etc/cinder/policy.json. Change-Id: Iaa5fb5b42626f2fbe00c3a89fa3edf4eae4ac166 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Enable sfcCédric Ollivier1-1/+0
Sfc has been synchronized to OpenStack queens. Change-Id: I144d2c96777a3fc2c1b84101f1b7cdb085f90d50 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Enable Doctor and BarometerCédric Ollivier1-2/+0
They are now synchronized with OpenStack stable/queens. Change-Id: Ia333268e17e997c32d0f8f0b658397048c64c0ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Update to stable/queensCédric Ollivier1-0/+4
It allows getting first results before the blackout between MS0 and MS2.1. Testcases could work thanks to backward compatibility provided by openstack clients. It disables all features which are not synced (patches are under review). It will ease verifying installers which are following master because it reduces the gap between releases. Change-Id: If0893f6dbaed76d4bafbd10a4f0934e6c5057477 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Merge "support fuel&daisy for doctor in functest"Linda Wang1-1/+1
2018-04-12support fuel&daisy for doctor in functestdongwenjuan1-1/+1
Change-Id: Ibfce5a21517e52bb5b2ea7a2d34bd22037e6964e Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn>
2018-04-09Run all VNFs vs SDN scenariosCédric Ollivier1-3/+3
It allows a fair comparison between Neutron standalone and SDN controllers. They should run successfully at least vs Daisy [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/ Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-03Remove NetVirt from installer dependenciesCédric Ollivier1-7/+7
Change-Id: Idb937b3ed4896208048b90b705dc3e6db6104b60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-27Allow check and verify as CI_LOOP valuesCédric Ollivier1-1/+1
It's required by the new promotion model [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/54501/ Change-Id: Ie12aae1c24e05a61b2afd5bbf92a97f2c71fd395 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Disable features in nofeature scenarioCédric Ollivier1-1/+1
Only Funtest testcases are verifying the referent scenarios. Change-Id: I29dfa012e9cba39216fdd58e5fd59255844f335b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Merge "Create 2 images and flavors for tempest tests"Cedric Ollivier1-4/+4
2018-03-15Remove the image for orchestra testsLinda Wang1-1/+0
Change-Id: I80797fc08c03795c6e1ec604306f77da7ecefc19 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-15Create 2 images and flavors for tempest testsLinda Wang1-4/+4
Also 1. remove the obsolete function: generate_test_accounts_file 2. Use patch mechanism to get config Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-15Set blocking of patrole falseLinda Wang1-1/+1
Change-Id: Ia6f0c6fec30af5c4124f21b2bdaa3084bced6f9e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-13Implement trunk ports testcasePanagiotis Karalis1-0/+17
The tempest testcases have been integrated from Neutron trunk testcases. It also enables every Neutron extension which may raise side effects [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html JIRA: FUNCTEST-926 Change-Id: I05015acf119f504ce0a5539d677719de874594ad Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-12Remove orchestra testcasesCédric Ollivier1-31/+0
They are incompatible with Pike and they have to be removed without any deep update. The testcases will be re-renabled if updated before 03/16/18. Change-Id: Ibf656db6ba4177eae44feb41cd5d314b7408d4de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Rewrite refstack testcaseCédric Ollivier1-3/+3
It now leverages on rally to factorize code between all tempest-based testcases. refstack-client is also added as requirement. JIRA: FUNCTEST-942 Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Add patrole in opnfv/functest-restapiCédric Ollivier1-0/+22
Change-Id: I983898c27477986d9a5610e1df966fd00a8bc785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-08Remove duplicate ubuntu trusty/14.04 os imageValentin Boucher1-1/+0
VNF testcase use some Operating System image 2 of those are the same but not with the same name Change-Id: Ide5ae683f606f7f58535c0a59cec45e4a30d225c Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-03-07Define a new env var for volume device nameCédric Ollivier1-1/+0
It eases modifying the volume device name written in tempest config. Fuel jobs should be adapted to set the right value (vdc) which differs from default (vdb). Change-Id: I09212018f94daa800ede815bd3586cceed0d54e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-05Load SfcFunctest instead of running a bash scriptCédric Ollivier1-4/+2
It allows publishing tests details. Change-Id: Iffc49f8258cdd2c145750343003f21921ac7ff67 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-03Set default volume_device_name = vdbCédric Ollivier1-1/+1
refstack_defcore is currently failing on all installers. It will highlight the right value per installer. A better way is to manage the device name by a new env var set by all installers (it may depend on kdrive configurations) JIRA: FUNCTEST-947 Change-Id: If1c12bc6798bc89136715bc78f2ac0b798e669e6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-02Merge "Leverage on Xtesting"valentin boucher5-592/+30
2018-03-02Leverage on XtestingCédric Ollivier5-592/+30
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01Enable barometer run on compassLinda Wang1-1/+1
Change-Id: Ic6f4f2a2d06dc70338da3bad53deca0a62a03232 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-24Print env vars and env_fileCédric Ollivier1-11/+4
It simply eases detecting wrong inputs [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/796/console Change-Id: I0784c29265c69a6ba4a049226196bcdd70b0a572 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-24Automatically download defcore.txtCédric Ollivier1-0/+1
It stops writing files in Functest package dirs and cleans instance variables in refstack modules too. Change-Id: Iaddbe4fbaf12d1af207b86d4e44258efdc6d6f3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Use constants for Functest config fileCédric Ollivier3-5/+4
env_file can't be defined in a config file simply because it's an entry point (Jenkins jobs, end users) Change-Id: Ie23c0ef90efc839d60f0f3a9754c58746b1f3a00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-16Get properly env vars or their default valuesCédric Ollivier1-8/+9
It defines env.get() as an unique way to get Functest env vars or their default values. It can be considered as a wrapper above os.environ. It enforces backward compatibility via CONST which mustn't be used for that purpose. It should be noted that it also stops using CONST for getting OpenStack env vars. Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-14Enable doctor-notificationCédric Ollivier1-1/+0
The testcase has been expected to work since the nova bug [1] was bypassed [2]. [1] https://bugs.launchpad.net/nova/+bug/1742827 [2] https://gerrit.opnfv.org/gerrit/#/c/52075/ Change-Id: If53da6313381cf69a0093a6677db3d9033fb8f48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Test vnf in all os-nosdn-nofeature scenariosCédric Ollivier1-7/+7
It allows setting os-nosdn-nofeature-noha as default value if DEPLOY_SCENARIO is unset. As orchestra* testcases are already disabled, it's useless to ask a specific installer. All vnf testcases should work vs any installer. Change-Id: Ia388f96348f9d06745f8d1669962d7f1c4e47d84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Temporarily disable doctor-notificationCédric Ollivier1-1/+1
It's currently forbidding gating all APEX' scenarios [1] (even os-nosdn-nofeature-* [2]). It will be enabled when it's fixed or when functest jobs are rewritten [3] [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/772/console [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/770/console [3] https://gerrit.opnfv.org/gerrit/#/c/51853/ Change-Id: I571c464aabe02f67a9e98ca1ab42d8a7efc672ee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-10Run all daily testcases if CI_LOOP is unsetCédric Ollivier1-2/+2
Then CI_LOOP is no longer mandatory and it bypasses the current jenkins jobs's issue [1][2][3]. [1] https://gerrit.opnfv.org/gerrit/#/c/51981/ [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/763/console [3] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/764/console Change-Id: I73629079d70e0f43e609d3861490573e10fd216c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Read the env file only if existsCédric Ollivier1-0/+4
Change-Id: I8e718e583a5a47a089755c31e623a44732e5ba1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Remove one obsolete varCédric Ollivier1-5/+0
Else it simply forces the config file into xtesting. Change-Id: I33153997f2aa422e50cea011f6a4e7eb567a83d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Unlink run_tests from constantsCédric Ollivier1-11/+11
run_tests.py doesn't read any functest config file what is mandatory for xtesting. Change-Id: I49f672c54a606acead75f573d1ce496c81fb235a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Unlink Energy from functest utils and constantsCédric Ollivier1-5/+0
It requires an update of releng jobs which have to export ENERGY_RECORDER_API_URL = http://energy.opnfv.fr/resources Change-Id: Iecd5d49b4d4c961c9dc51e43e54df1fcd4027266 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Move get_dict_by_test() into run_tests.pyCédric Ollivier1-3/+16
It also removes functest_utils.get_criteria_by_test() Change-Id: I3f265642acd053755e32f8e92f1086b93517c247 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-08Move source_credentials() into run_tests.pyCédric Ollivier1-2/+17
It's also renamed source_envfile(). Change-Id: I0e7c38c2def125961f86dc2bc9a63cfb6ad87c03 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-07Remove dns server from juju_epc configCédric Ollivier1-2/+0
The dns server shoud be set by the Cloud provider via Neutron configs. Snaps is currently enforcing 8.8.8.8 as default too. Change-Id: I3e9a25d8bbfbab4cd1d44e394235b329df86e82e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-06Disable orchestra_* testcasesCédric Ollivier1-0/+2
They can be simply disabled and they unsuccessfully run vs Daily only. In a second step, moving the related python modules in a new orchestra repository could be a good solution simply because they don't reach our coding criteria. The best way is still to update them according to our rules and to check all installers thanks to these two vnfs. Change-Id: If36b16f0ed95d7039db9455a32c18f7fd1a739ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Increase Rally full criteriaCédric Ollivier1-1/+1
Even if several tests are currently under investigation, it seems relevant to expect a full success here. Change-Id: I6a8c5fb5a7dd4bfb5c3a2e7a93de1c0bec77c878 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>