summaryrefslogtreecommitdiffstats
path: root/docker/smoke
AgeCommit message (Collapse)AuthorFilesLines
2019-04-21Update all OpenStack refs to opendev.orgCédric Ollivier1-6/+6
All gates are failing due wrong to redirections (see os-faults [1][2]). [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-tempest-latest-gate/96/console [2] https://travis-ci.org/collivier/functest/builds/522071220 Change-Id: I5a8ca67f0d95df24daa9bdca2f23eb13d896f9d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2ceebaa032f07c4162ed3701c6814dfe5cb683d4)
2019-04-02Remove 1 Patrole test with a hardcoded vxlan idCédric Ollivier1-0/+1
It may fail when testing OpenStack in production or when running testcases in parallel [1] because vxlan 200 is hardcoded [2] [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-hunter-patrole-run-75/results/patrole/tempest-report.html [2] https://github.com/openstack/patrole/blob/master/patrole_tempest_plugin/tests/api/network/test_networks_rbac.py#L208 Change-Id: Ibfaed6f3a95d016790baafebd203e49e152a889b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8ee279600186f2713b4c181965d8d290d2644cfb)
2019-03-21Revert "Allow building containers when refstack.openstack.org is down"Cédric Ollivier2-428/+3
refstack.openstack.org is up! This reverts commit c693862a4014fd444b6f75da62da4cd8c2a088fc. Change-Id: I95326167763e67baccd866a1e61611cd187ec316 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-19Do not allow testcase skipping in refstackJuha Kosonen1-0/+1
Set the result of refstack_defcore as failed if there were skipped testcases in a run. Change-Id: Id782c2dee511cefbafd5b4440f386fd66f934a47 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit cfd79ec4c39e215a25fc3d99fc5368e7d874f7bf)
2019-03-11Allow building containers when refstack.openstack.org is downCédric Ollivier2-3/+428
It has been down for days and break our gates. Change-Id: I2e18a95abaced050f85f6efb8e849e0a5d497ea1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a52900d8c926dc4370dea3b3ebe94d20d05e1357)
2019-02-18Only run bgpvpn tempest api testsCédric Ollivier1-1/+1
It conforms with SFC regex and fits OPNFV criteria. Running scenarios may force the use of bagpipe [1]. The SUT (functest-virtual) is being updated to verify SFC and BGPVPN apis. [1] https://docs.openstack.org/networking-bgpvpn/latest/user/drivers/bagpipe/index.html Change-Id: I1442b9cac7eaba1aeef04e36a2f790bd29f90976 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2b4e7955815ce27284043c03730fff6ace029a0d)
2019-02-15Harden upper-constraints.txt operationsCédric Ollivier1-6/+5
It takes into account the wget exit values and avoids manipulating a falsy empty file. It won't help fixing the network outages in LF network which have been highlighted by false failures in api_check (the wrong snaps package is installed [1]) [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-latest-api_check-run/100/console Change-Id: Ic9b75965b1ffb1f7bb342ff216bda9933ca75f0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fa8c50f4fd19576a2fde5b04077810d4ca91b330)
2019-02-02Update tempest to fix interfaces_by_fixed_ipCédric Ollivier1-1/+4
It includes [1] which allows testing even if one shared network is defined. [1] https://review.openstack.org/#/c/615425/3 Change-Id: I4fe3a6c355fd05bdac5a466816c5ed142be14fed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-27Set Gnocchi scenario as optional in rally testsJuha Kosonen1-0/+6
The execution of an optional scenario is skipped if the corresponding openstack service does not exist. Change-Id: I8721f26ebc253ce02138b85d6c88e659c5afae80 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 3b7b393ca643bcf7db0361bcc4414b74fff953be)
2018-12-20Select Rocky for Neutron Rally jobsCédric Ollivier1-1/+1
It fixes our gates (the testcase was developed just after OpenStack Rocky). Change-Id: Ic1eac9a54115a56c60e609faea818989cd2bfce8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-18Allow pulling Neutron reviews or tagsCédric Ollivier1-2/+4
It updates smoke/Dockerfile to allow pulling Neutron reviews/tags (rally_jobs). Change-Id: Ifc10eebb444bfe2c3e1fb47a9bd52d8a4f8a7007 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2d0c8cb6eaf10b7c712335beb79fae726ea3a965)
2018-12-16Fix NEUTRON_RALLY_TAG in smokeCédric Ollivier1-1/+1
It also fixes rally task name in config. Change-Id: I4f6fbbef814a5b45aeb3b6152878421fc6e998bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 58df8ab5544a5bfff43dc6c4a2546194299a7734)
2018-09-20Add support for Rally OpenStack CI test casesJuha Kosonen2-0/+17
Include Neutron rally-jobs. Change-Id: Ic1122962bd7d876d179729640a8a321bc36442d8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 5d54a533d25a989dc64a2789788ff2f2fd6ad5c6)
2018-09-13Prepare gambia Docker tagsCédric Ollivier1-2/+2
Change-Id: I409975acd1493e2f5a6bdcb3a4bd6ff6e383e02e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-05Conform with Barbican gatesCédric Ollivier1-2/+2
tempest.conf conforms with Devstack post-actions [1]. One test is still disabled as it may force to sign all images. A deeper analysis has to be done before enabling it. [1] https://github.com/openstack/barbican-tempest-plugin/blob/master/tools/pre_test_hook.sh Change-Id: I163c0e7c4671ca67f0b6c127c29fdcb12a8e426b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-04Remove vmtp and shaker from docker/smoke/testcases.yamlCédric Ollivier1-27/+0
Change-Id: Ic5754821542e873bb7d33a8864a852993947b762 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Avoid cloning reposCédric Ollivier1-6/+12
It inits the repos and fetch the required tags/ids/branches. All tags are fetched to meet pbr requirements. Change-Id: I0accd8ad04b93d63857e301dea11af69e0edf957 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Update tempest plugins tagsCédric Ollivier1-2/+2
Neutron and Barbican tempest plugins have just been released. Change-Id: Ib9c523e9a75dae31249fd84ba454d0ef8537ca1d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Move shaker and vmtp into functest-benchmarkingCédric Ollivier2-10/+5
It also updates all jobs and fixes Dockerhub hooks. Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Update Xtesting to 0.60Cédric Ollivier1-27/+12
Xtesting leverages on stevedore [1] which will bring much more flexibility (discovery, module or class renaming, etc). OPNFV Features have to be updated as well: - https://gerrit.opnfv.org/gerrit/61713 - https://gerrit.opnfv.org/gerrit/61715 - https://gerrit.opnfv.org/gerrit/61717 - https://gerrit.opnfv.org/gerrit/61719 [1] https://docs.openstack.org/stevedore/latest/ Change-Id: I0ce45eb6c9af66546c2c020eb962fa457f6c7e1a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-01Merge changes I4079fa36,I3ad7a38eCedric Ollivier1-11/+11
* changes: Allow refs as vnf requirement versions Avoid downloading git history
2018-09-01Avoid downloading git historyCédric Ollivier1-11/+11
It decreases container build duration. depth 1 is set only when TAG is not a commit id because github.com doesn't advertise commit ids. It switches to git.openstack.org as much as possible. Change-Id: I3ad7a38eda0f7023302d71bb55de23828120f599 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Add concurrency parameter to refstack_defcore testsDimitrios Markou1-0/+3
In fraser release we observed that refstack tests are executed in parallel and that might causes problems in CI because without concurrency parameter it will try to use as many cpus as possible and that might lead to race condition issues. This patch is created for backporting purposes to fraser branch where the problem occurs. JIRA: DOVETAIL-662 Change-Id: I6cf0ad3a32e88f04abd00d69523aa8ac47c39470 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-08-25Set Neutron and Barbican tempest plugins commit idsCédric Ollivier1-2/+6
They are mandatory before releasing. Change-Id: I2980536e28d183343ff0a9520ca9ee663e437fee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Update refstack test version to 2018.02Linda Wang1-1/+1
To conform with Openstack Queens Change-Id: I7d65a1d7fe7c9a30e2c00a8a0eac2ab3fe1b9428 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-08-17Update restack defcore syncCédric Ollivier2-2/+0
It stops depending on refstack_client which cannot work till OpenStack Queens. JIRA: FUNCTEST-977 Change-Id: I2340643de82ab10d8fb83fb3a7fbfd1f412b2d7b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Remove all lxd refsCédric Ollivier1-2/+0
All Joid runs are stopped, then these scenarios can't be maintained. Change-Id: Ida7c8c86cbd377024047d4abbbc1806ad65afc8a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Disable Vmtp if POD_ARCH = aarch64Cédric Ollivier1-0/+2
Vmtp package delivers amd64 binaries in both architectures. JIRA: ARMBAND-396 Change-Id: I4c6e010e47c8aa9adfafb373c261262d23ef382a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-10Switch to vmtp commit idCédric Ollivier1-1/+1
The patch "Reuse the router passed as config if available" [1] was merged. [1] https://review.openstack.org/#/c/588459/ Change-Id: Iad8a1ff694f0bff3e13922a6c248dbe49b313a11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add networking-sfc Tempest test suiteCédric Ollivier2-1/+21
Change-Id: I6f1452469cb5ffaf9b538ba87edaa174977b91c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add networking-bgpvpn Tempest test suiteCédric Ollivier2-1/+21
Change-Id: If3191d8e8c16854aa059e6483b3c0ea704777c05 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-08Conform with OpenStack gatesCédric Ollivier1-2/+22
It adds testcases and updates regexes to conform with OpenStack gates: - tempest-full - neutron-tempest-plugin-api It should be noted that tempest-smoke is no longer run in gates and two testcases are available for tempest-full as we can't manage Tempest combine. Criteria is set to 100% for tempest_full (it works in OpenStack gates). JIRA: FUNCTEST-1000 Change-Id: I77a0f533255483bdf61f0a5f60c9c437ce843591 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-03Protect VMTP vs cidr conflictsCédric Ollivier1-1/+1
It now runs vtmp via a new admin member. Else it fails due to cidr already used. It only creates a router and both tenant networks are still created by VMTP. Change-Id: I05ed41a3b7a01ee97c720176c404929bf8ea97a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-18Temporarily disable test_image_signing testsCédric Ollivier1-1/+2
They don't pass in two different Queens deployments. The topic will continue upstream. Change-Id: I43d6b8306aee6934fa1545ec3ed8130bb9b23ee4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-18Switch VMTP_TAG to the new commit idCédric Ollivier1-1/+1
The related review has been merged [1]. [1] https://review.openstack.org/#/c/580914/ Change-Id: I64dc2a38b08d02ea653582159d2af83fc7e16e31 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-16Fix typos in trunk-detailsCédric Ollivier1-1/+1
Else neutron_trunk is skipped [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/184/console Change-Id: I5d63e84414d8fc3af3ef2ac5b4d023fc5e59ef81 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-16Rename Patrole config fieldsCédric Ollivier1-2/+2
Else it conflicts with the new tempest config fields [1]. It makes sense to switch to includes here. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/566/console Change-Id: If7b3025b4003ea5704c6a3cdeae8cd00f1c5509e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Dynamically skip neutron_trunk and barbicanCédric Ollivier1-6/+7
It avoids fasly testcases in failure for end users. It also removes the neutron_trunk class which is now useless (Queens). Change-Id: I3f5a1ac84a50e061da6eadcc5c9bafb2e99050db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Include neutron_tempest_plugin in tempest-[smoke,full]Cédric Ollivier1-2/+3
Change-Id: I19f9a6ff2f76a4684bf341b2f22ffc4d09dca1cc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Leverage to Xtesting 0.51Cédric Ollivier1-26/+3
It removes ci_loop which has been useless from Docker slicing. It can filter now on any env var (e.g. CI_LOOP if required by XCI). Change-Id: Ibd685edf4636bd251c85466e8b4febcd1e20d312 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-09Merge "Refactor tempest common"Cedric Ollivier1-4/+10
2018-07-09Add Vmtp as a new testcaseCédric Ollivier2-4/+26
VMTP is a small python application that will automatically perform ping connectivity, round trip time measurement (latency) and TCP/UDP throughput. JIRA: FUNCTEST-980 Change-Id: I8e94fc52a429f505ac14e14bbb9d0a3b20996ba4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-08Refactor tempest commonCédric Ollivier1-4/+10
It also renames two testcases and updates all docs because tests run in parallel in case of tempest smoke. To force one thread as before: run: module: 'functest.opnfv_tests.openstack.tempest.tempest' class: 'TempestCommon' args: mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' option: - '--concurrency=1' JIRA: FUNCTEST-989 Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-04Install Robot dependencies in healthcheckCédric Ollivier2-6/+2
old testcase moved to opnfv/functest-healthcheck. Change-Id: If8e8fc7d8bc9c97602c05e5a4c048461351cc97e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-26Disable all new testcases for MS3.1Cédric Ollivier1-1/+1
It has been decided in TSC release meeting. Change-Id: I0a62f18c5b11fe31ac72fc301c5444e8d89b6fff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Move odl into healthcheckCédric Ollivier2-24/+1
It should be included in healthcheck as all basic tests. Change-Id: I48439fe6385a9056eed8b779290f20633d59b0fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Move vping_* and cinder_test into healthcheckCédric Ollivier1-49/+0
Change-Id: I193c6dcdf90fe8eac46884fe5a5a329b0e5a7322 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Add the Barbican test suiteCédric Ollivier2-2/+19
It eases verifying the functionality of a barbican installation. Change-Id: Iac2144ae6ba4d61b2b37bb5c7a0359edb3f222a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Integrate Shaker as a new testcaseCédric Ollivier1-0/+18
Shaker wraps around popular system network testing tools like iperf, iperf3 and netperf (with help of flent). Change-Id: Idd82ffd9642c90335ad156e899c0330473260f15 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-19Add functest in upper-constraintsCédric Ollivier1-3/+4
It's required by OPNFV Features such as sfc. Functest is removed from constraints in Dockerfile else it would conflict with the local dir. Change-Id: I2df5cd151b43eb1a4f0320510183d0f28cdf84c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>