aboutsummaryrefslogtreecommitdiffstats
path: root/docker/benchmarking
AgeCommit message (Collapse)AuthorFilesLines
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier1-0/+2
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 80f380502edf592015df1adf542b6a143da98e7d)
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier1-2/+2
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f0cac210e048bae9b33180a799af041def5bfb05)
2020-11-11Add rally and xrally_kubernetes in upper-constraints.txtCédric Ollivier1-0/+2
It's needed by functest_kubernetes. Change-Id: I2ebd730a1d9f84a63026e8cf03cf27367d0bcfde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6d1302779501918acdbbd4047a67a010901814b1)
2020-07-15Update functest/ci/testcases.yamlCédric Ollivier1-1/+3
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f36cc92bb628b53ed3a58fa84a24f94f006d6f30)
2020-07-02Updates Kubernetes versionsCédric Ollivier1-0/+1
Kubernetes client selected by OpenStack is too old compared to K8s testing. Change-Id: I453b9518251ae3c907c17eef17a41ecc0e23dd2c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-25Use ujson version asked by OpenStack requirementCédric Ollivier1-0/+1
It's newer than the former tag selected [1]. [1] https://github.com/openstack/requirements/blob/master/upper-constraints.txt Change-Id: Ie89136da364d7e972a1d7f49c71bdfbbdd9671d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 743235f280b675cab39adb15de8bcea215a1c038)
2020-04-03Fix upper-constraints in tempest-based containersCédric Ollivier1-2/+1
Change-Id: Id7f82b314af05c6b8ec47ef3685fcc806e72f1a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Keep the modified tempestCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/CRY58ZS3031L/functest-ovn-opnfv-functest-healthcheck-jerma-tempest_smoke-run-37/tempest_smoke/tempest-report.html Change-Id: I9598a45b09151fa267294716f70e65e3050f0239 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 21b512e55eb36e38160b697baae44c464fce9034)
2019-09-14Select python 3.6 as defaultCédric Ollivier1-5/+5
It switches to Python3 as default due to new OPNFV iruya release date (December) which is very closed to Python2 EOL. Functest Iruya (first release published in April) has supported both Python2 and Python3. Change-Id: I4c1294a5361e591fc7a8a88b3d067fc3b39e00c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Select the latest tempest versionCédric Ollivier1-1/+1
It selects the first release including our fixes. Change-Id: I553abc2df3c6adc727a24b9a27a7737f78fa3f5e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-29Add Barbican scenario in RallyCédric Ollivier1-0/+1
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is currently failing [1]. Barbican testing is optional as Gnocchi. [1] https://bugs.launchpad.net/rally/+bug/1819285 Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 902b70b40e61a2afe4d92ba7759a33f1306d54ca)
2019-06-19Update tempest commit idCédric Ollivier1-1/+1
It includes "Fix region leaks after testing endpoints" [1]. [1] https://github.com/openstack/tempest/commit/e8088d1218eba0b8e4ed59fa5ca30ac9b664b7fb Change-Id: I063a9c4e2f09a27c79ea77ba0cf9307642950070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Remove PyNacl contraints in FeaturesCédric Ollivier1-0/+1
It conforms with "Install PyNaCl via package" [1]. functest-feature may raise timeouts when cross-compiling PyNacl [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67956/ [2] https://travis-ci.org/collivier/functest/jobs/538119733 Change-Id: I986677b869f62caee6be219ee1de622b7bc20ca4 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 7a628f087403089d282cda14bcba858d8b0bc6c3)
2019-05-28Install PyNaCl via packageCédric Ollivier1-1/+1
Building functest-core container sometimes reaches travis-ci timeout [0]. It currently selects the right version in master and stable/hunter. [0] https://travis-ci.org/collivier/functest/jobs/531417730 Change-Id: Ie6c8e729f76c98c6f8c8e9ca01b2c998081f7ce8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6aad708727e41eaa8f61a104323386568a163dd3)
2019-05-18Update tempest to avoid resource leaks in EndPointGroupsTestCédric Ollivier1-1/+1
It includes "Fix resource leaks in EndPointGroupsTest" [1] which removes the 2 remaining tempest services. It's worth mentioning they raised side effects when trying to connect to Horizon. Change-Id: Ic85fa38a4690c5532d10d21d2eec64d99ab1e8cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-21Update all OpenStack refs to opendev.orgCédric Ollivier1-5/+5
All gates are failing due wrong to redirections (see os-faults [1][2]). [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-tempest-latest-gate/96/console [2] https://travis-ci.org/collivier/functest/builds/522071220 Change-Id: I5a8ca67f0d95df24daa9bdca2f23eb13d896f9d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 75d581a9d3ec7c11a9a696db4b271c2691c28f15)
2019-04-14Speed up lxml buildCédric Ollivier1-0/+1
It allows cross-compiling it via travis-ci (benchmarking) [1][2] [1] https://lxml.de/installation.html [2] https://travis-ci.org/collivier/functest/jobs/519737041 Change-Id: I31609268d77405f036924a010cfb3dab520e9ea3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1d190eb4039194d049cfc97b456978853d0d77d1)
2019-03-30Set package versions instead of masterCédric Ollivier1-1/+2
It leverages on few beta releases as the official packages are being published. Tempest 20.0.0 is forced to conform with Release Plan [1]. (upper-constraints still offer 19.0.0 [2]) [1] https://releases.openstack.org/stein/ [2] https://github.com/openstack/requirements/blob/stable/stein/upper-constraints.txt#L391 Change-Id: Iaadf5bbc3b984e95cd018ac69bb9efb4eb111df9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-30Use absolute dir when removing vmtp src dirCédric Ollivier1-1/+1
Change-Id: I7254201f97e9615d5d34ab9c199b33ef9de3680c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f96e57b969220cfc1b0a5da37858aaa13d518880)
2019-03-28Prepare Functest Iruya ContainersCédric Ollivier1-3/+3
It takes into account the new branch stable/iruya. Change-Id: I802a42b07ceae2328a812a99a99057beb1b94e5b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-15Harden upper-constraints.txt operationsCédric Ollivier1-5/+4
It takes into account the wget exit values and avoids manipulating a falsy empty file. It won't help fixing the network outages in LF network which have been highlighted by false failures in api_check (the wrong snaps package is installed [1]) [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-latest-api_check-run/100/console Change-Id: Ic9b75965b1ffb1f7bb342ff216bda9933ca75f0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-12Set gnocchi as optional in Rally testcasesCédric Ollivier1-0/+6
ci/testcases.yaml was copied/pasted when moving the rally testcases. It completes "Set Gnocchi scenario as optional in rally tests" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66653/ Change-Id: Ia23ae9764750775fe8983660c56ced06f3de977a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-11Move rally_full in benchmarkingCédric Ollivier1-0/+11
It allows merging all benchmarking testcases in one tiers and saves lots of time as they could all run in parallel. Change-Id: I551179709d2ce862056c1f5fcc1e16ef0b776dd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-06Move testcases in the right tiersCédric Ollivier2-2/+19
Here are the moves: - tempest_smoke in healthcheck - tempest_full and tempest_scenario in smoke - rally_jobs in benchmarking It avoids conflicts between benchmarking tools and few functional tests (short timeouts). Then it should allow running in parallel all testcases in one tiers. It also allows cleaning the additional steps defined in releng. rally_full could move in benchmarking in a second step. Change-Id: I0bc657557a61c7d9bf7679b4f2dbda08c36728ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-13Update constraints to OpenStack masterCédric Ollivier1-1/+1
Change-Id: I77765db676e06fef5ccb9ae73a9c995ad4fb76d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Avoid cloning reposCédric Ollivier1-2/+4
It inits the repos and fetch the required tags/ids/branches. All tags are fetched to meet pbr requirements. Change-Id: I0accd8ad04b93d63857e301dea11af69e0edf957 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Move shaker and vmtp into functest-benchmarkingCédric Ollivier3-0/+65
It also updates all jobs and fixes Dockerhub hooks. Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>