aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-09-02Move shaker and vmtp into functest-benchmarkingCédric Ollivier1-30/+37
It also updates all jobs and fixes Dockerhub hooks. Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Update Xtesting to 0.60Cédric Ollivier2-86/+41
Xtesting leverages on stevedore [1] which will bring much more flexibility (discovery, module or class renaming, etc). OPNFV Features have to be updated as well: - https://gerrit.opnfv.org/gerrit/61713 - https://gerrit.opnfv.org/gerrit/61715 - https://gerrit.opnfv.org/gerrit/61717 - https://gerrit.opnfv.org/gerrit/61719 [1] https://docs.openstack.org/stevedore/latest/ Change-Id: I0ce45eb6c9af66546c2c020eb962fa457f6c7e1a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-31Merge "Add concurrency parameter to refstack_defcore tests"Cedric Ollivier1-0/+3
2018-08-30Ensure len(project_name) < 64Cédric Ollivier1-1/+1
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/259/console https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/428/console Change-Id: Ib64878962a71b6b45ef039fce8bfaa43172b2498 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Merge "Create new project/user for tempest tests"Cedric Ollivier4-30/+37
2018-08-29Add concurrency parameter to refstack_defcore testsDimitrios Markou1-0/+3
In fraser release we observed that refstack tests are executed in parallel and that might causes problems in CI because without concurrency parameter it will try to use as many cpus as possible and that might lead to race condition issues. This patch is created for backporting purposes to fraser branch where the problem occurs. JIRA: DOVETAIL-662 Change-Id: I6cf0ad3a32e88f04abd00d69523aa8ac47c39470 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-08-29Create new project/user for tempest testsJuha Kosonen4-30/+37
JIRA: FUNCTEST-1009 Change-Id: I6b9bca3827ba6cc804c25689a896ca63eec6a78b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-29Merge "Support pre-Provisioned credentials"Cedric Ollivier3-3/+16
2018-08-28Support pre-Provisioned credentialsCédric Ollivier3-3/+16
If USE_DYNAMIC_CREDENTIALS = False, Functest is expected for /home/opnfv/functest/data/accounts.yaml which contains the set of pre-existing credentials to use for testing [1]. It also sets admin_domain_scope and default_credentials_domain_name. [1] https://docs.openstack.org/tempest/latest/configuration.html Change-Id: Ie7b81f0c56049260ca99b8e3a6d58cb8a2660659 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Merge "Remove installer type from rally blacklist"Cedric Ollivier3-17/+2
2018-08-28Merge "Remove installer type from tempest blacklist"Cedric Ollivier2-10/+3
2018-08-28Allow adding a specific role to users created by tempestCédric Ollivier1-0/+2
It may allow bypassing RBAC policies if required. Change-Id: I3b7ad44d7b80f8ea757846afdcd787b686c52856 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Remove installer type from tempest blacklistJuha Kosonen2-10/+3
Enables utilization of blacklist also on non-OPNFV environments since there is no link to installer type. JIRA: FUNCTEST-1008 Change-Id: I3a012b8b7e7dbd049f8794dff3c9d56dcc1cadad Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-28Remove installer type from rally blacklistJuha Kosonen3-17/+2
Enables utilization of blacklist also on non-OPNFV environments since there is no link to installer type. JIRA: FUNCTEST-1008 Change-Id: I3eb4377af153480794c1a71c5d7ef3e78dacacb9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-28Protect vs TypeErrors when cleaning stacksCédric Ollivier1-0/+3
It protects vs exceptions raised by shade when cleaning stacks. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/heat_ims.py", line 226, in clean self.cloud.delete_stack(self.stack.id, wait=True) File "/usr/lib/python2.7/site-packages/shade/openstackcloud.py", line 1416, in delete_stack marker=marker) File "/usr/lib/python2.7/site-packages/shade/_heat/event_utils.py", line 90, in poll_for_events stack_status = stack['stack_status'] TypeError: 'NoneType' object has no attribute '__getitem__' Change-Id: I1a0ed0cd669d5234ca1ff3b6bbc9d1b13f14b02f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-27Support VIO (VMware in OpenStack)Cédric Ollivier2-0/+122
It allows converting all images to vmdk and then patching all testcases. DEPLOY_SCENARIO should match vio to do so. convert_images.sh has to be called as prerequisite. JIRA: FUNCTEST-992 JIRA: FUNCTEST-993 Change-Id: Ie35bf80af1cd9610a8c416ec01b81b61c6148cfe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-27Use only one image in heat_imsCédric Ollivier2-20/+9
It calls VmReady2.run instead of publishing alt image. Change-Id: If24741fbc5bf7fa3f61ef39a054b148ce53fc4fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Remove INSTALLER_TYPE logics in odlCédric Ollivier2-40/+1
JIRA: APEX-621 JIRA: COMPASS-606 Change-Id: I76dde66aefc67f80b40496f705f2864ea9355dcf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Fully remove CreateInstanceSingleNetworkTestsCédric Ollivier1-6/+0
It's linked to a specific configuration on purpose which doesn't meet all OpenStack deployments [1]. JIRA: SNAPS-322 Change-Id: I372f8ed56600e1846383d1da76720a0d3783e901 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Merge "Integrate Stor4NFV feature openstack test case"Cedric Ollivier1-0/+14
2018-08-25Integrate Stor4NFV feature openstack test caseQiaowei Ren1-0/+14
Change-Id: I245d0fbe8f026a24138ede4041caae4dccc15cc0 Signed-off-by: Qiaowei Ren <qiaowei.ren@intel.com>
2018-08-24Merge "Create new project/user for snaps tests"valentin boucher3-16/+85
2018-08-24Create new project/user for snaps testsJuha Kosonen3-16/+85
JIRA: FUNCTEST-1003 Change-Id: Ic55998977386f95f619a355d22bd285782fe81f0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-23Create output directoryGeorg Kunz1-0/+2
The rally.conf gets copied before the target directory has been created. JIRA: FUNCTEST-1007 JIRA: DOVETAIL-730 Change-Id: Ie774fce994ada644c1163600e6c62e1231fde443 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-22Temporarily disable shelveCédric Ollivier1-0/+1
They are blocking in Orange Openlab as the support is missing. A dynamic check has to be implemented before activating it. Change-Id: I8d87251fa4589f96d3515e411aeec5e79b7e7960 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-21Fix fixed_network_name in tempest.confCédric Ollivier1-1/+7
It also copies rally.conf and tempest.log in res_dir. Change-Id: Ib907a29ba3f47ca861d3af8afc0ee74446222e89 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20ci/download_images.sh: Reduce wget dot reportingAlexandru Avadanii1-0/+1
Downloading large images outputs a lot of useless dots to show progress. Switch to 1M per dot (from 1K). Change-Id: I00e3d09ef28e7722798eeadc27649a96398aac32 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2018-08-20Add vgpu in global testcases.yamlCédric Ollivier1-0/+12
It completes the patch introducing vgpu [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/60713/ Change-Id: Ib2a22dd656d365e87a37a239f0a0ee747c95b117 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Typos (ressources)Cédric Ollivier2-14/+14
Change-Id: Ifcf1d4bd48b64bc9175c3b0d594f897f4f3f5e7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-18Generate API doc rst filesCédric Ollivier3-6/+5
It also fixes few docstrings Change-Id: I10bae7b7fab40edd931dd55ab8859946e3b38a71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Clean /etc/rally.confCédric Ollivier1-0/+17
Else rally_sanity may print logs in tempest_smoke res dir. Change-Id: Iae97d533e9b99dcf8da70229b0675228472bfe52 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Update restack defcore syncCédric Ollivier2-8/+53
It stops depending on refstack_client which cannot work till OpenStack Queens. JIRA: FUNCTEST-977 Change-Id: I2340643de82ab10d8fb83fb3a7fbfd1f412b2d7b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-15Merge "Create new project/user for rally test"Cedric Ollivier4-11/+30
2018-08-14Create new project/user for rally testJuha Kosonen4-11/+30
FUNCTEST-1002 Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-14Remove all lxd refsCédric Ollivier4-21/+0
All Joid runs are stopped, then these scenarios can't be maintained. Change-Id: Ida7c8c86cbd377024047d4abbbc1806ad65afc8a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Conforms Vmtp with create_server_timeoutCédric Ollivier1-0/+1
https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/387/console Change-Id: I3ef130bf5ad4b46f26776feeaa434ca528965f36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Disable Vmtp if POD_ARCH = aarch64Cédric Ollivier1-0/+2
Vmtp package delivers amd64 binaries in both architectures. JIRA: ARMBAND-396 Change-Id: I4c6e010e47c8aa9adfafb373c261262d23ef382a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-13Allow setting two image extra properties per testcaseCédric Ollivier1-13/+17
It conforms with the flavor extra specs model [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/60713/ Change-Id: I1555a313aaf56ae47f9ad2a4529eb8b94e636c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-13Update all patch configsCédric Ollivier3-8/+195
It takes all new testcases into account. It allows running vnfs vs dpdk scenarios too. Change-Id: I789f6bb1c3df891b1a94f2a674c15085f81f2f23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-11Merge "Test OpenStack vGPU feature"Cedric Ollivier3-3/+66
2018-08-11Fix rally args when serial (tempest_scenario)Cédric Ollivier1-1/+1
Change-Id: I04c2389310d1377452a171da9bf50fde67e94e7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-10Test OpenStack vGPU featureValentin Boucher3-3/+66
XCI will be able to deploy this feature on top of pharos lab with GPU so we have test it This test can be improved in the future with OpenCL tests etc | DEPLOY_SCENARIO | os-nosdn-vgpu-ha | +-------------------+-------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+-------------------+------------------+----------------+ | vgpu | functest | 01:00 | PASS | +-------------------+-------------------+------------------+----------------+ Change-Id: I50618f47097a0257b1834b3966054d20458715df Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-08-10Merge "Publish rally logs to ease debugging."Cedric Ollivier1-10/+17
2018-08-10Publish rally logs to ease debugging.Cédric Ollivier1-10/+17
It also redirect stderr to stdout as tempest mainly prints in stderr. JIRA: FUNCTEST-999 Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-10Remove explicit Rally task validationJuha Kosonen2-34/+5
Utilize the output of Rally task execution since it internally validates the task. Use Popen.communicate to get the output from the running Rally task. Change-Id: I9b1299bc26129ff4f89adccec611c78195a3ab02 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-09Merge "Fix method name in Vmtp"Cedric Ollivier1-1/+1
2018-08-09Fix method name in VmtpJuha Kosonen1-1/+1
Change-Id: Ie23628f39979e3497c81e23d99f30e0dc7564055 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-09Add networking-sfc Tempest test suiteCédric Ollivier1-0/+20
Change-Id: I6f1452469cb5ffaf9b538ba87edaa174977b91c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add networking-bgpvpn Tempest test suiteCédric Ollivier1-0/+19
Change-Id: If3191d8e8c16854aa059e6483b3c0ea704777c05 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add timeout when running shakerCédric Ollivier1-2/+3
Else shaker may run until job timeout if deployment misconfigurations [1] [1] https://jira.opnfv.org/browse/FUNCTEST-998 JIRA: FUNCTEST-998 Change-Id: I948ff8ffeeccdab637927614193d2c2ef03fe5c8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>