Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: I0120e6a368b033f2fb47257ff9dcc3fd8a58d243
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9ebe47c8458c99066fd71a65007fff923004d209)
|
|
ONAP integration team asks to support all K8s versions.
A couple of OPNFV releases will allow testing 2 K8s versions.
Change-Id: Idb43cff0cc03cc9c17b290f7f1867e2c380c6319
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0163bb977604a32a0c46e10a97313ce0feea7b5f)
|
|
It also adds configs needed by resilience.
https://github.com/cncf/cnf-conformance/releases/tag/v0.9.19
Change-Id: I94b1efc47c5ceef96bc8879a6c71f92db1f63bd2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7385caf54c27b471bda8599d491aa3aee21b7b89)
|
|
pip 20.3 is disruptive and would lead to big changes in stable
branches.
Change-Id: Ic3770f4098c52b0d26bc62291c9e79e8ee81d107
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0c99749bb65cadd0142c90cd73e13802d48cb7f6)
|
|
It locally patches xrally_kubernetes before [1] is merged upstream.
It adds docker.io/appropriate/curl:edge in download_images.sh too.
[1] https://github.com/xrally/xrally-kubernetes/pull/51
Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com>
Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ea2715240015a482c5321d309257d801a412f02d)
|
|
It's considered as passed vs 95 out of 105 [1].
[1] http://artifacts.opnfv.org/functest-kubernetes/ACI2B7JDLFHI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-cnf_conformance-run-16/functest-kubernetes.log
Change-Id: Ib16927cf269784daba1085a3e97fb611e869928f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 53b16e8f00e5a60db2e6db7f375bd06f184a5cc8)
|
|
It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts
to the new cnf-conformance result output logic.
It runs all workload tests as it's now proposed (k8s conformance
is already part of smoke) and select the latest coredns
cnf-conformance.yml taking latest helm repo changes into account.
It sets criteria 95 as all steps are considered as passed and a
overall result 100/105.
[1] https://github.com/cncf/cnf-conformance/issues/388
Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 854f164998793000fcf8019214b259b7283f5194)
|
|
Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 30a5a084fa9e0c8677d70d8b1d7a696ea06b49b9)
|
|
Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for both test cases even if only k8s_conformance
reaches 1h (XtestingCI design).
Change-Id: Ieaef1cefb3dfc7f9ca47b1ce8ec082409fa52604
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f38caec124b925f8c633f9d8b4474bd1085638a2)
|
|
Change-Id: Iae0e61696987696fda3d9da05d75c5d87908b92a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ifb9a5ac2fac7286d5f3f5e677fc2a7ecda6ade25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 687723872c04c4b889cf4b529f6534776b16908d)
|
|
Change-Id: I3ea22a4050ff1eb609cffb61edc41c49fab44366
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3a3bd294ea8101c22896d8601fe2723861f73124)
|
|
Helm fails when detecting arch if qemu.
time="2020-09-17T16:25:15Z" level=error msg="failure getting variant" error="getCPUInfo for pattern: Cpu architecture: not found"
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-arm64-latest-helm_vims-run/1/console
Change-Id: Ida37062a780f9e2acf60035bf2d41fb8fbb61173
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit aed4dd8a97dbfcb9d0558f2df8f8ef8696f2c421)
|
|
https://github.com/cntt-n/CNTT/pull/2022
Change-Id: Icb4bdfa0c1ecca9d0c5b4d5beef7ff4c5edb289e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 63476e09e51c5c847df47b0855ee9d1b0ea1add1)
|
|
It leverages helm rather than kubectl as proposed by k8s_vims.
A new abstract class Vims is added to factorize code between both
testcases.
Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 32dfc10f56ead9abea8798e1ce16fe87652ca480)
|
|
It depends on bandwidth.
30 minutes should be enough in all scenarios
Change-Id: Ieaad053c8f8a270e5da08275de217b15fdf17f44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f6e86e451a0f5bf0e9775482c487d86249b935bd)
|
|
Change-Id: I52cb8303950269946774546cf8e413166c70a33c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4fa706f4b37d655f2239ad9381df8041e0701142)
|
|
The former deployment asked for all-in-one.
Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bced94b6fe24c7e939fb22834deb77477e4a9bb9)
|
|
Change-Id: I4f65a9eeb7eda471371668db9abfa49e2875c5b0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b866c73d70079fdb52e5fc999f49a32d2af82349)
|
|
It also fills self.details.
Change-Id: Ie73215ebcbd34de9d457fd364de4ab9cbdf64319
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 823b3a005ace9372a080421b2ae19152505201e4)
|
|
It fills self.details and checks if the test case passes according
to criteria (severity = high by default)
Change-Id: Ib20779b4b5dca078c65b546c8703bc99856c6f41
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4f197110710e9f148eae4533792e8e7e2d72f053)
|
|
Change-Id: Id7642e47ec2cc438c5fe3a0ec9447f72b358adab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3afa7d700eebf2bfcaabab7bdd3aa09198ba4fe0)
|
|
Change-Id: I0709e83f32261af232c20f94c1edef7423e05527
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 70d96ca61f1f11aafcf9e6975e61bce41febd371)
|
|
It now works on minikube in addition to Functest gates.
Change-Id: I314989516f81dcddb3e615fe23480135f1d8cf9a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 757fcb55867aa8c0545543a87ec9741827e9ab50)
|
|
Change-Id: I8132769ea23a376b2cae8b93beed27f5e66b9207
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d4af425da9a60c0eb8e80cb74972b99e3deadeb8)
|
|
Change-Id: I4b5da162dcb1efff810514498a20250c05afb3ba
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ef4ef77dfda94d02e2d933318c1b0072da224e43)
|
|
It runs the mandatory CNTT test cases [1].
[1] https://github.com/cntt-n/CNTT/commit/6af033c254727b7405fbfb2efbaa023e2b8ba876
Change-Id: I87d381c78049f7309c564791ed701cf446cc85d2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 463f233c0abb77f6758e7c39fa05b5c118fbaf1f)
|
|
It eases offline testing.
The default command leverages kind as in-use in Functest.
Change-Id: I66a20ede5e857f80cf49b9b708843034bc3b9904
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9913456884a19525bae18226ef0a6233f00993b2)
|
|
It allows offline testing via xrally_kubernetes, k8s_vims, kube_bench
and kube_hunter.
Change-Id: I3084abec19f06a894d0083ecb3ed61882eddd785
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8d748b9efc9ed4ed3edb4eaaf09909e41fe29577)
|
|
The Kubernetes default pull policy is IfNotPresent unless the image tag
is :latest in which case the default policy is Always. IfNotPresent
causes the Kubelet to skip pulling an image if it already exists [1]
[1] https://kind.sigs.k8s.io/docs/user/quick-start/
Change-Id: I83dac6165d2bbef165ca852dd03e5b76a5356f2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 44492e0da74473460ff6a9f1323c5df3a2af943e)
|
|
It forbids offline testing.
Change-Id: I6790f64fd1382671300374b339ae038ef015cfab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6371491ee2bc134c60abaa6a1deec18b9ffe22e2)
|
|
It follows the last stable version as expected by RA2 Baraque.
Change-Id: I962663516c38a2a879c3f263a8df2d1de949ca14
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/7/console
Change-Id: Ia6845525e62274f7792b4cb1909f36204fb51418
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e09c7eeab3a1bdc361769e469c0ec7a7b5718ebf)
|
|
conf-confirmance is beta.
Let's decrease criteria to allow gating [1].
[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/4/console
Change-Id: I77068fd027b2ae042e0ff9574ed608c8a3d77ade
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 12d6bc18b178d4a8a4f64574bd6549341268645a)
|
|
Change-Id: I51b013056bb5b88ef2e1de31e9171129e8ce4475
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0ec2aa15acbe7cd2b28d772165c22481b85bad79)
|
|
https://github.com/vmware-tanzu/sonobuoy
Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 711d9f1d875816386fd4afeb2e79f8d2de47b036)
|
|
https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43
Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit de3a7000a3173f0242cbf7bfcdd6a18d8678e0ae)
|
|
Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b198dcede7578b1c3bf688cd47cc0590dd8d6d14)
|
|
cnf-conformance doesn't support this architectures.
It also improve cleaning to publish artifacts [1].
[1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/2/console
Change-Id: Ie64e4a1b8b496a050a1798eaf4e5ef6397c011d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2cf6903c9a805b9c1b7702292bdf33b9485be319)
|
|
It selects cnf-conformance v0.7.2-beta1 (current latest release) and
the default CNF as proposed by [1].
The end user is free to override the default yml files on purpose (e.g.
docker volumes). Tag (default: all) could be modified too via
testcases.yaml
[1] https://hackmd.io/@vulk/SkY54QnsU
Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 120daffd8d6d4be727d2ba52a76dbd8eacfe2628)
|
|
Change-Id: I8664dcb579ae8df6dbccb6ad521df8da112b1482
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
homestead-prov sometimes fails reaching cassandra
30-08-2020 10:33:44.064 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code
30-08-2020 10:34:32.257 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code
Change-Id: I48566e39dca3dc9644733a76140a76300bbfd84e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e236b0f56f748c888df23eeaf65478967ad852f1)
|
|
It raises 413 Client Error: Request Entity Too Large for url [1]
[1] https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console
Change-Id: I165f7aec53d8ce1e567491a5b5559f00b1fe4a4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1f720b0fabbcf162366160a4fa9a46807e53f8bc)
|
|
https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console
Change-Id: I13685d74ce9e286520af6f1e5cd6ce9dafc3d5ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 42c2bbed87779218a8fe43c4c5c3012c64bec17b)
|
|
Change-Id: Ib2b7bb6de8cd6524fcc52baf48ebf5c4835c396b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8a8f6eafc3c6268a3663852f7de8f0cc4c39b817)
|
|
It iterates 10 times all operations run by xrally_kubernetes.
Now times, concurrenty and count can be set via testcases.yaml.
It creates a new containers functest-kubernetes-benchamrking as
Functest.
Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a0f76d884c1f13c27e906136d3418f12b5342fc4)
|
|
Change-Id: I63c6af9d0e20aab426e7f875cdb4f86d206f49aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3c7965bb37590eae9e968a530eaaa690ada903f2)
|
|
https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-healthcheck-arm-latest-k8s_smoke-run/2/console
Change-Id: I57f3ae0051fb55c8c80de81e79168e61c06d85bb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 64771ca4e6965c81aa2922c7efc44e4f7a38a610)
|
|
golang is now useless as we stop compiling kubernetes binaries.
Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1af6a5dc4ec8e087613275e912c819ea1d0aecbc)
|
|
Change-Id: I3d7d16ec7d8a7712a279258f817d811f0d59187f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit aa3d694b2c288521b6e3f96ea020a3ac485d4d14)
|