aboutsummaryrefslogtreecommitdiffstats
path: root/docker/benchmarking
AgeCommit message (Collapse)AuthorFilesLines
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier1-0/+2
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 80f380502edf592015df1adf542b6a143da98e7d)
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier1-2/+2
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f0cac210e048bae9b33180a799af041def5bfb05)
2020-11-11Add rally and xrally_kubernetes in upper-constraints.txtCédric Ollivier1-0/+2
It's needed by functest_kubernetes. Change-Id: I2ebd730a1d9f84a63026e8cf03cf27367d0bcfde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit aafe5a1be9b2d2cdf114477329b902767af23006)
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6d1302779501918acdbbd4047a67a010901814b1)
2020-07-15Update functest/ci/testcases.yamlCédric Ollivier1-1/+3
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f36cc92bb628b53ed3a58fa84a24f94f006d6f30)
2020-07-02Updates Kubernetes versionsCédric Ollivier1-0/+1
Kubernetes client selected by OpenStack is too old compared to K8s testing. Change-Id: I453b9518251ae3c907c17eef17a41ecc0e23dd2c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 15f8bc5f0f60f529cc9681a8c1eb8dbb699bf61c)
2020-06-14Stop leveraging on neutron plugins and extraCédric Ollivier1-2/+3
Neutron leverages on the upstream Rally task in Stein and newer. Leveraging on the upstream task may fix the side effects which sometimes occured on Vmtp and Shaker [1] and filled better the CNTT model. [1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/ Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-25Use ujson version asked by OpenStack requirementCédric Ollivier1-0/+1
It's newer than the former tag selected [1]. [1] https://github.com/openstack/requirements/blob/master/upper-constraints.txt Change-Id: Ie89136da364d7e972a1d7f49c71bdfbbdd9671d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 743235f280b675cab39adb15de8bcea215a1c038)
2020-04-03Fix upper-constraints in tempest-based containersCédric Ollivier1-1/+1
Change-Id: Id7f82b314af05c6b8ec47ef3685fcc806e72f1a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 749613f723ac25dc161b4311d20e3e691b7a8341)
2019-07-27Select the latest tempest versionCédric Ollivier1-1/+1
It selects the first release including our fixes. Change-Id: I553abc2df3c6adc727a24b9a27a7737f78fa3f5e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b231ceb959a486b934c421a4d439b11dc3ac6916)
2019-06-19Update tempest commit idCédric Ollivier1-1/+1
It includes "Fix region leaks after testing endpoints" [1]. [1] https://github.com/openstack/tempest/commit/e8088d1218eba0b8e4ed59fa5ca30ac9b664b7fb Change-Id: I063a9c4e2f09a27c79ea77ba0cf9307642950070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bf0b79d887851ebf36dca853328d388a727fd483)
2019-05-28Remove PyNacl contraints in FeaturesCédric Ollivier1-0/+1
It conforms with "Install PyNaCl via package" [1]. functest-feature may raise timeouts when cross-compiling PyNacl [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67956/ [2] https://travis-ci.org/collivier/functest/jobs/538119733 Change-Id: I986677b869f62caee6be219ee1de622b7bc20ca4 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 7a628f087403089d282cda14bcba858d8b0bc6c3)
2019-05-28Install PyNaCl via packageCédric Ollivier1-1/+1
Building functest-core container sometimes reaches travis-ci timeout [0]. It currently selects the right version in master and stable/hunter. [0] https://travis-ci.org/collivier/functest/jobs/531417730 Change-Id: Ie6c8e729f76c98c6f8c8e9ca01b2c998081f7ce8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6aad708727e41eaa8f61a104323386568a163dd3)
2019-05-18Update tempest to avoid resource leaks in EndPointGroupsTestCédric Ollivier1-1/+1
It includes "Fix resource leaks in EndPointGroupsTest" [1] which removes the 2 remaining tempest services. It's worth mentioning they raised side effects when trying to connect to Horizon. Change-Id: Ic85fa38a4690c5532d10d21d2eec64d99ab1e8cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 084ce7dd3976d65409f54d8ff5010e709ec76cd6)
2019-05-03Update to tempest 20.0.0Cédric Ollivier1-1/+1
test_dualnet_multi_prefix_slaac which is uncovered (marked as slow) by OpenStack gates [1] is failing on lf-virtual6 [2]. Updating to 20.0.0 is closer to the current OpenStack Neutron Rocky gates (tempest==20.0.1.dev42) [3]. It's worth mentioning that we cannot downgrade to 19.0.0 because the next commit is needed [4]. [1] http://logs.openstack.org/28/656428/1/check/tempest-multinode-full-py3/74d9cd7/testr_results.html.gz [2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-hunter-tempest_scenario-run-113/results/tempest_scenario/tempest-report.html [3] http://logs.openstack.org/57/654957/2/check/neutron-tempest-multinode-full/e5eda83/job-output.txt.gz [4] https://github.com/openstack/tempest/commit/3588bb3f5ef546a0ef4d4ad621fd1be381b5fdaf Change-Id: I496df1272f26ad73daf388070b762b736e4e5fd8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-21Update all OpenStack refs to opendev.orgCédric Ollivier1-5/+5
All gates are failing due wrong to redirections (see os-faults [1][2]). [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-tempest-latest-gate/96/console [2] https://travis-ci.org/collivier/functest/builds/522071220 Change-Id: I5a8ca67f0d95df24daa9bdca2f23eb13d896f9d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2ceebaa032f07c4162ed3701c6814dfe5cb683d4)
2019-04-14Speed up lxml buildCédric Ollivier1-0/+1
It allows cross-compiling it via travis-ci (benchmarking) [1][2] [1] https://lxml.de/installation.html [2] https://travis-ci.org/collivier/functest/jobs/519737041 Change-Id: I31609268d77405f036924a010cfb3dab520e9ea3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1d190eb4039194d049cfc97b456978853d0d77d1)
2019-02-15Harden upper-constraints.txt operationsCédric Ollivier1-5/+5
It takes into account the wget exit values and avoids manipulating a falsy empty file. It won't help fixing the network outages in LF network which have been highlighted by false failures in api_check (the wrong snaps package is installed [1]) [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-latest-api_check-run/100/console Change-Id: Ic9b75965b1ffb1f7bb342ff216bda9933ca75f0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fa8c50f4fd19576a2fde5b04077810d4ca91b330)
2019-02-12Set gnocchi as optional in Rally testcasesCédric Ollivier1-0/+6
ci/testcases.yaml was copied/pasted when moving the rally testcases. It completes "Set Gnocchi scenario as optional in rally tests" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66653/ Change-Id: Ia23ae9764750775fe8983660c56ced06f3de977a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 44db92e6135a573ed4bb23648ea1c73e8a70f91b)
2019-02-12Move rally_full in benchmarkingCédric Ollivier1-0/+11
It allows merging all benchmarking testcases in one tiers and saves lots of time as they could all run in parallel. Change-Id: I551179709d2ce862056c1f5fcc1e16ef0b776dd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cec721055631734d2d1d39bd09cfa1404ee1d32e)
2019-02-07Move testcases in the right tiersCédric Ollivier2-2/+19
Here are the moves: - tempest_smoke in healthcheck - tempest_full and tempest_scenario in smoke - rally_jobs in benchmarking It avoids conflicts between benchmarking tools and few functional tests (short timeouts). Then it should allow running in parallel all testcases in one tiers. It also allows cleaning the additional steps defined in releng. rally_full could move in benchmarking in a second step. Change-Id: I0bc657557a61c7d9bf7679b4f2dbda08c36728ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1d0f0bbf773aaaf7139b76442a9e59d13bd32830)
2018-09-13Fix OPENSTACK_TAG (stable/rocky)Cédric Ollivier1-1/+1
It completes the previous change. Change-Id: I3d65e15eba6a4ba812466a01cefe938002a9b177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-13Prepare hunter Docker tagsCédric Ollivier1-2/+2
Change-Id: I409975acd1493e2f5a6bdcb3a4bd6ff6e383e02e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Avoid cloning reposCédric Ollivier1-2/+4
It inits the repos and fetch the required tags/ids/branches. All tags are fetched to meet pbr requirements. Change-Id: I0accd8ad04b93d63857e301dea11af69e0edf957 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Move shaker and vmtp into functest-benchmarkingCédric Ollivier3-0/+65
It also updates all jobs and fixes Dockerhub hooks. Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>