aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-08-21Fix fixed_network_name in tempest.confCédric Ollivier1-1/+7
It also copies rally.conf and tempest.log in res_dir. Change-Id: Ib907a29ba3f47ca861d3af8afc0ee74446222e89 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20ci/download_images.sh: Reduce wget dot reportingAlexandru Avadanii1-0/+1
Downloading large images outputs a lot of useless dots to show progress. Switch to 1M per dot (from 1K). Change-Id: I00e3d09ef28e7722798eeadc27649a96398aac32 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2018-08-20Publish Functest daily and gate jobsCédric Ollivier5-0/+366
As opposed to the Releng ones, they are designed to be easily executed by endusers as well. They can be considered as a first step towards a full Functest CI/CD toolchain deployed via docker-compose. All components testcases are enabled here. They hugely leverage on templates to load the right yamls per branch and multijobs to run testcases in parallel. Many steps are proposed allowing running part of the chain. Executors have to be increased to allow running them (it was tested vs 10 and more). At first, all docker images are downloaded to avoid different versions between testcases. They will be improved in a second change to ensure that only one node is selected and to take all Functest env vars into account. Change-Id: I99c7b8ee5d0ddbb00102b3147739b5e8b5c65c23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Add vgpu in global testcases.yamlCédric Ollivier1-0/+12
It completes the patch introducing vgpu [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/60713/ Change-Id: Ib2a22dd656d365e87a37a239f0a0ee747c95b117 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Typos (ressources)Cédric Ollivier2-14/+14
Change-Id: Ifcf1d4bd48b64bc9175c3b0d594f897f4f3f5e7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Update Xtesting to 0.58.0Cédric Ollivier1-1/+1
It returns the right status if exception in constructor. Change-Id: I163c0cbb2e1f07b2ada4a5ba28e217906946fa2c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-18Split modules in apidocCédric Ollivier60-301/+341
Change-Id: Iff2bd9377efb4e8abde35ef3fc38aca120feccaf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-18Fix rtd requirement orderCédric Ollivier1-1/+1
Change-Id: Ie2fbd978ed0bb9772d66eb367f1bdad32c5afd61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-18Add rtd-requirementsCédric Ollivier2-37/+3
It's required by rtd which doesn't leverage on PBR. Change-Id: Ia7ac5ecbb626d5c8b4c9095a1238db55e20790b0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-18Generate API doc rst filesCédric Ollivier29-44/+675
It also fixes few docstrings Change-Id: I10bae7b7fab40edd931dd55ab8859946e3b38a71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-18Publish Functest doc onlineCédric Ollivier10-74/+8
It reverts Sphinx theme to the default one as it's hugely better for API docs. Change-Id: Ic489e9b65d67d71fadb8ef78176a04cc382a3f5d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Update refstack test version to 2018.02Linda Wang1-1/+1
To conform with Openstack Queens Change-Id: I7d65a1d7fe7c9a30e2c00a8a0eac2ab3fe1b9428 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-08-17Clean /etc/rally.confCédric Ollivier1-0/+17
Else rally_sanity may print logs in tempest_smoke res dir. Change-Id: Iae97d533e9b99dcf8da70229b0675228472bfe52 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Update restack defcore syncCédric Ollivier6-12/+53
It stops depending on refstack_client which cannot work till OpenStack Queens. JIRA: FUNCTEST-977 Change-Id: I2340643de82ab10d8fb83fb3a7fbfd1f412b2d7b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-15Merge "Allow overriding rally-tag if OpenStack master"Cedric Ollivier1-1/+2
2018-08-15Merge "Create new project/user for rally test"Cedric Ollivier4-11/+30
2018-08-14Allow overriding rally-tag if OpenStack masterCédric Ollivier1-1/+2
It allows setting a newer rally-openstack tag in ollivier containers to include "Fix the gates about cinder" [1]. TypeError: create() got an unexpected keyword argument 'source_replica' [1] https://github.com/openstack/rally-openstack/commit/67882d55ca453d6aa863d279ec4cfc2b52c80f0a [2] https://bugs.launchpad.net/rally/+bug/1785519 Change-Id: I5ed1002f345b0a9c51783850d09d0f336d0ed3d9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Update to Xtesting 0.57Cédric Ollivier1-1/+1
It protects vs unset POD_ARCH (It completes "Disable Vmtp if POD_ARCH = aarch64" [1]) [1] https://gerrit.opnfv.org/gerrit/#/c/60927/ Change-Id: I343c7a9047fe09aad7b9a39d0d045ac709f07a7a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Create new project/user for rally testJuha Kosonen4-11/+30
FUNCTEST-1002 Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-14Remove all lxd refsCédric Ollivier6-27/+0
All Joid runs are stopped, then these scenarios can't be maintained. Change-Id: Ida7c8c86cbd377024047d4abbbc1806ad65afc8a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Set rally-openstack tagCédric Ollivier1-2/+4
It also updates rally to the latest tag. Then it will allow updating pip if required (to clone refs). Change-Id: I6edb172954672780f627370b0dd0acf0754da635 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Conforms Vmtp with create_server_timeoutCédric Ollivier1-0/+1
https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/387/console Change-Id: I3ef130bf5ad4b46f26776feeaa434ca528965f36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-14Disable Vmtp if POD_ARCH = aarch64Cédric Ollivier2-0/+4
Vmtp package delivers amd64 binaries in both architectures. JIRA: ARMBAND-396 Change-Id: I4c6e010e47c8aa9adfafb373c261262d23ef382a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-13Allow setting two image extra properties per testcaseCédric Ollivier1-13/+17
It conforms with the flavor extra specs model [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/60713/ Change-Id: I1555a313aaf56ae47f9ad2a4529eb8b94e636c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-13Update all patch configsCédric Ollivier3-8/+195
It takes all new testcases into account. It allows running vnfs vs dpdk scenarios too. Change-Id: I789f6bb1c3df891b1a94f2a674c15085f81f2f23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-12Update to Xtesting 0.56Cédric Ollivier1-1/+1
Change-Id: Ia7eb5f6c7448bcd760ebb19e2ad66ba183242e83 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-11Merge "Test OpenStack vGPU feature"Cedric Ollivier4-3/+78
2018-08-11Fix rally args when serial (tempest_scenario)Cédric Ollivier2-2/+2
Change-Id: I04c2389310d1377452a171da9bf50fde67e94e7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-10Test OpenStack vGPU featureValentin Boucher4-3/+78
XCI will be able to deploy this feature on top of pharos lab with GPU so we have test it This test can be improved in the future with OpenCL tests etc | DEPLOY_SCENARIO | os-nosdn-vgpu-ha | +-------------------+-------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+-------------------+------------------+----------------+ | vgpu | functest | 01:00 | PASS | +-------------------+-------------------+------------------+----------------+ Change-Id: I50618f47097a0257b1834b3966054d20458715df Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-08-10Merge "Publish rally logs to ease debugging."Cedric Ollivier1-10/+17
2018-08-10Merge "Remove explicit Rally task validation"Cedric Ollivier2-34/+5
2018-08-10Publish rally logs to ease debugging.Cédric Ollivier1-10/+17
It also redirect stderr to stdout as tempest mainly prints in stderr. JIRA: FUNCTEST-999 Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-10Remove explicit Rally task validationJuha Kosonen2-34/+5
Utilize the output of Rally task execution since it internally validates the task. Use Popen.communicate to get the output from the running Rally task. Change-Id: I9b1299bc26129ff4f89adccec611c78195a3ab02 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-10Switch to vmtp commit idCédric Ollivier1-1/+1
The patch "Reuse the router passed as config if available" [1] was merged. [1] https://review.openstack.org/#/c/588459/ Change-Id: Iad8a1ff694f0bff3e13922a6c248dbe49b313a11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Merge "Fix method name in Vmtp"Cedric Ollivier1-1/+1
2018-08-09Fix method name in VmtpJuha Kosonen1-1/+1
Change-Id: Ie23628f39979e3497c81e23d99f30e0dc7564055 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-09Add networking-sfc Tempest test suiteCédric Ollivier4-1/+42
Change-Id: I6f1452469cb5ffaf9b538ba87edaa174977b91c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add networking-bgpvpn Tempest test suiteCédric Ollivier3-1/+40
Change-Id: If3191d8e8c16854aa059e6483b3c0ea704777c05 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add timeout when running shakerCédric Ollivier1-2/+3
Else shaker may run until job timeout if deployment misconfigurations [1] [1] https://jira.opnfv.org/browse/FUNCTEST-998 JIRA: FUNCTEST-998 Change-Id: I948ff8ffeeccdab637927614193d2c2ef03fe5c8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Install Tempest master if OpenStack masterCédric Ollivier1-3/+10
It seems that gates override the upper-constraints in case of Tempest [1][2]. [1] http://logs.openstack.org/80/585180/3/check/tempest-full/aa8b698/controller/logs/pip2-freeze.txt.gz [2] http://artifacts.opnfv.org/logs/functest/lf-virtual3/2018-08-08_16-26-16/tempest_smoke/tempest-report.html JIRA: FUNCTEST-1000 Change-Id: I48530083b453a4a6d6027763210259050b4d0040 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-08Conform with OpenStack gatesCédric Ollivier3-10/+92
It adds testcases and updates regexes to conform with OpenStack gates: - tempest-full - neutron-tempest-plugin-api It should be noted that tempest-smoke is no longer run in gates and two testcases are available for tempest-full as we can't manage Tempest combine. Criteria is set to 100% for tempest_full (it works in OpenStack gates). JIRA: FUNCTEST-1000 Change-Id: I77a0f533255483bdf61f0a5f60c9c437ce843591 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Fix swift operator roleCédric Ollivier1-1/+1
[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/35/console Change-Id: I7236bf5a74f36941f499da32c5c77dcd0b98b6f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Update Xtesting to 0.55.0Cédric Ollivier2-4/+32
It allows calling one skipped test via run_tests (parallel testing). Change-Id: I04e5c69f2129e28f1451815938cd5d0f8bbe9e44 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-06Change juju_epc cidrCédric Ollivier1-0/+2
juju cannot bootstrap if cidr already exists which now happens only if a shared network with the same cidr is defined (it should be considered as a bug about juju). By allocation its own cidr, it protects vs remaining rally or tempest remaining shared networks or vs parallel testing. juju_epc can already run twice in parallel as it creates a new project and a private network. Change-Id: I76c4971d631f763307315478e6cf5a383c91ed36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-04Make synchronous Shade callsCédric Ollivier3-12/+16
It makes difficult to find the issues (floating ip, boot, ssh connection, etc...) for a small benefit regarding the current testcase implementations. It increases the default floating ip timeout because it has been reached when running Functest multiple times in parallel. It may be the root cause when running singlevm vs XCI (in that case, neutron api and agents are hosted in a nested vm). Change-Id: Ia97e04902321644c207c59987283754318aee5e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-03Setup tempest_smoke images for arm64Delia Popescu1-2/+4
Configure the images to be used for tempest_smoke testcase for ARM JIRA: ARMBAND-395 Change-Id: Ia13507d70fd05ef541a5154886d52fa388731cee Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-08-03Merge "Fix timeout (switch to synchronous calls)"Cedric Ollivier2-3/+1
2018-08-03Protect VMTP vs cidr conflictsCédric Ollivier4-10/+53
It now runs vtmp via a new admin member. Else it fails due to cidr already used. It only creates a router and both tenant networks are still created by VMTP. Change-Id: I05ed41a3b7a01ee97c720176c404929bf8ea97a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-03Fix timeout (switch to synchronous calls)Cédric Ollivier2-3/+1
It completes "Switch create_server timeout to default value" [1] which forbids waiting more that 180s (create_server was asynchronous). [1] https://gerrit.opnfv.org/gerrit/#/c/60423/2 Change-Id: Icbf9ee48024fe9e10571c2bb7ca895d5828fb561 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-03Fix typo (ressources)Cédric Ollivier1-2/+2
Change-Id: Ibe131e0cf02493f0f3a82c1e179848605bd0a292 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>