aboutsummaryrefslogtreecommitdiffstats
path: root/docker/benchmarking
AgeCommit message (Collapse)AuthorFilesLines
2023-03-21Stop bashing functest scriptsguillaume.lambert1-1/+1
Though bash is a good interactive user shell and apart portability concerns, many UN*X systems and GNU+Linux distributions now prefers Almquist or Kornshell variants for scripting in order to improve the system performance and maintenability. https://wiki.ubuntu.com/DashAsBinSh https://mywiki.wooledge.org/Bashism https://en.wikipedia.org/wiki/Almquist_shell Signed-off-by: guillaume.lambert <guillaume.lambert@orange.com> Change-Id: I32c5490f9eab54e6cac594f3eac1e392edf8b272
2022-03-04Leverage xtesting 0.96.0Cédric Ollivier1-1/+1
Change-Id: Ica7d7afb041d946dc25e37d736b07a3ad13c1ef7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-18Fallback VMTP to "Support both IPv4 and IPv6 DNS servers when creating networks"Cédric Ollivier1-1/+1
Bootable volume support (bump) is breaking cinder changes removing Cinder v3 [1]. [1] https://opendev.org/x/vmtp/commit/5ac228a575153e059e3d683d5e125415dd32e89f Change-Id: Id71332f537203d45ad62dae13745f505f46734b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-18Update to Alpine 3.14Cédric Ollivier1-1/+1
It also fixes lots of new pylint warnings. Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-10Follow new pip name resolverCédric Ollivier1-2/+2
Change-Id: Ib185c90b4403a25db55ab0948c2d6bb2b2bc8dfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier1-0/+2
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier1-2/+2
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Stop leveraging on neutron plugins and extraCédric Ollivier1-2/+2
Neutron leverages on the upstream Rally task in Stein and newer. Leveraging on the upstream task may fix the side effects which sometimes occured on Vmtp and Shaker [1] and filled better the CNTT model. [1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/ Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-14Clone repositories instead of wgetting constraintsCédric Ollivier1-13/+7
It stops leveraging on wget to get constraints as it fails since opendev was created. Then functest and requirements are no longer removed for functest-core which simplifies all child Dockerfile. It also fix the current incompatibilities in OpenStack constraints ERROR: cliff 3.2.0 has requirement cmd2!=0.8.3,<0.9.0,>=0.8.0, but you'll have cmd2 1.1.0 which is incompatible. https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L230 https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L416 Change-Id: I7c044208ef26ad047fb841710b422acb6c9f0320 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Update functest/ci/testcases.yamlCédric Ollivier1-1/+3
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-30Debug rally race conditionsCédric Ollivier1-0/+1
It will be reverted as soon as the root cause is found. Change-Id: Icbff74c5fb940c1a201cbdc3fb2137c91e1ed460 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert "Increase Thread stack size"Cédric Ollivier1-1/+0
It still fails [1]. [1] https://build.opnfv.org/ci/job/functest-ovn-opnfv-functest-benchmarking-latest-rally_jobs-run/28/console Change-Id: I8560edb7dfbba804a94bb1453d5a489138d6a152 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-26Increase Thread stack sizeCédric Ollivier1-0/+1
It sets Glibc default value. https://wiki.musl-libc.org/functional-differences-from-glibc.html https://bugs.python.org/issue32307 Change-Id: I647569354b3a30f7de4116cab53c9e2aeff91a59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Revert "Keep the modified tempest"Cédric Ollivier1-1/+0
It's simply useless and may raise side effects later. Change-Id: Idaeab672480597ed39a5e29719580fee38aeb4ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Keep the modified tempestCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/CRY58ZS3031L/functest-ovn-opnfv-functest-healthcheck-jerma-tempest_smoke-run-37/tempest_smoke/tempest-report.html Change-Id: I9598a45b09151fa267294716f70e65e3050f0239 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 21b512e55eb36e38160b697baae44c464fce9034)
2020-02-17Select OpenStack requirements masterCédric Ollivier1-2/+2
https://github.com/openstack/requirements/commit/7a04f4e96205f16e74a9a08fe60b168c187516d6 Change-Id: I9ed510c45f63714b64dcb9fa90e4d7239f93ee3f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-17Bypass upstream requirement issuesCédric Ollivier1-3/+4
https://review.opendev.org/#/c/708041/ Change-Id: Iebbf0a720fe9d1c62083028d0bc0078bf7680753 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-24Update Alpine to 3.11Cédric Ollivier1-1/+1
It also updates Python to 3.8 (default version). It selects arm32v6 et arm64v8 repos and switches multiarch binfmt. https://alpinelinux.org/posts/Alpine-3.11.0-released.html Change-Id: Ib41cf0ab805ce2137658f3ff656b0a88c7b4ebf5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-1/+1
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: If09d4796d48b7d0591e7926621d3bbf5ca1b6c24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-09Remove functest-tempestCédric Ollivier1-2/+2
Functest Kubernetes directly calls Rally API which force dependencies to rally and its plugins. Then it installs rally, rally-openstack and xrally-kubernetes as Functest dependencies. Change-Id: I18e0c2ba30588707beba1746aa4bfbc1ab7509c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-28Add Barbican scenario in RallyCédric Ollivier1-0/+1
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is currently failing [1]. Barbican testing is optional as Gnocchi. [1] https://bugs.launchpad.net/rally/+bug/1819285 Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Remove PyNacl contraints in FeaturesCédric Ollivier1-0/+1
It conforms with "Install PyNaCl via package" [1]. functest-feature may raise timeouts when cross-compiling PyNacl [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67956/ [2] https://travis-ci.org/collivier/functest/jobs/538119733 Change-Id: I986677b869f62caee6be219ee1de622b7bc20ca4 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-28Install PyNaCl via packageCédric Ollivier1-1/+1
Building functest-core container sometimes reaches travis-ci timeout [0]. It currently selects the right version in master and stable/hunter. [0] https://travis-ci.org/collivier/functest/jobs/531417730 Change-Id: Ie6c8e729f76c98c6f8c8e9ca01b2c998081f7ce8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-23Enable Vmtp if py3Cédric Ollivier2-2/+1
It leverages on last Vmtp review which adds py3 support [1]. [1] https://review.opendev.org/659970 Change-Id: I8319b9e7eb88b9015961188d47657a8c67e0f8da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-13Update to Python3Cédric Ollivier2-5/+7
Functest containers leverage on Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework librairies to latest release and Vmtp to master ([1] is needed) It patches cloudify rest client to support python3. Vmtp is currently disabled because it currently supports python2 only. [1] https://github.com/openstack/vmtp/commit/a5d062881d91bf4f547d92c6e289bea30feb5d6e#diff-b4ef698db8ca845e5845c4618278f29a Change-Id: I39964a212ec2d4dbf53c9ea7c63f02e0b6a05b48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-20Update all OpenStack refs to opendev.orgCédric Ollivier1-5/+5
All gates are failing due wrong to redirections (see os-faults [1][2]). [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-tempest-latest-gate/96/console [2] https://travis-ci.org/collivier/functest/builds/522071220 Change-Id: I5a8ca67f0d95df24daa9bdca2f23eb13d896f9d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-14Speed up lxml buildCédric Ollivier1-0/+1
It allows cross-compiling it via travis-ci (benchmarking) [1][2] [1] https://lxml.de/installation.html [2] https://travis-ci.org/collivier/functest/jobs/519737041 Change-Id: I31609268d77405f036924a010cfb3dab520e9ea3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-29Use absolute dir when removing vmtp src dirCédric Ollivier1-1/+1
Change-Id: I7254201f97e9615d5d34ab9c199b33ef9de3680c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-15Harden upper-constraints.txt operationsCédric Ollivier1-5/+4
It takes into account the wget exit values and avoids manipulating a falsy empty file. It won't help fixing the network outages in LF network which have been highlighted by false failures in api_check (the wrong snaps package is installed [1]) [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-latest-api_check-run/100/console Change-Id: Ic9b75965b1ffb1f7bb342ff216bda9933ca75f0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-12Set gnocchi as optional in Rally testcasesCédric Ollivier1-0/+6
ci/testcases.yaml was copied/pasted when moving the rally testcases. It completes "Set Gnocchi scenario as optional in rally tests" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66653/ Change-Id: Ia23ae9764750775fe8983660c56ced06f3de977a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-11Move rally_full in benchmarkingCédric Ollivier1-0/+11
It allows merging all benchmarking testcases in one tiers and saves lots of time as they could all run in parallel. Change-Id: I551179709d2ce862056c1f5fcc1e16ef0b776dd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-06Move testcases in the right tiersCédric Ollivier2-2/+19
Here are the moves: - tempest_smoke in healthcheck - tempest_full and tempest_scenario in smoke - rally_jobs in benchmarking It avoids conflicts between benchmarking tools and few functional tests (short timeouts). Then it should allow running in parallel all testcases in one tiers. It also allows cleaning the additional steps defined in releng. rally_full could move in benchmarking in a second step. Change-Id: I0bc657557a61c7d9bf7679b4f2dbda08c36728ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-13Update constraints to OpenStack masterCédric Ollivier1-1/+1
Change-Id: I77765db676e06fef5ccb9ae73a9c995ad4fb76d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Avoid cloning reposCédric Ollivier1-2/+4
It inits the repos and fetch the required tags/ids/branches. All tags are fetched to meet pbr requirements. Change-Id: I0accd8ad04b93d63857e301dea11af69e0edf957 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Move shaker and vmtp into functest-benchmarkingCédric Ollivier3-0/+65
It also updates all jobs and fixes Dockerhub hooks. Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>