Age | Commit message (Collapse) | Author | Files | Lines |
|
It sets nodes=25 to run all tests in parallel.
It also beautifies all testcases.yml
Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4004d776b01a1b038df52ca45b18430da1b6b1f5)
|
|
“skeleton”: cluster is accessed via the Kubernetes API and nothing
else.
https://kubernetes.io/blog/2019/03/22/kubernetes-end-to-end-testing-for-everyone/
Change-Id: Iea8b65b2ac55d40572c0078b7a9a956d1c54d62a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 17929b0d015034bad2796fb733627fe5b23bbb2d)
|
|
Sometimes, tested Kubernetes doesn't have direct access to Internet but
access through repository mirrors.
This patch handles this case for e2e test case.
Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: Iaa2960ad03aae1fff859d41bcd6ddf3176658f8e
(cherry picked from commit 27dbb7c14bac45a9af8d18e1913a2be6815cea43)
|
|
It would speedup the testing.
Change-Id: I084bcf0d44a060f65eb9549eab8dcbbf5a4cc9d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 65d860c6ee36641ad7d248f7dc8a6f63f3173301)
|
|
Sometimes, tested Kubernetes doesn't have direct access to Internet but
access through repository mirrors.
This patch handles this case for ims test cases.
Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: I3b5e78fcf43ca7af6bcfd2d87fa4bb0705373697
(cherry picked from commit 9c95b5f46e57365c1f6e7e5c9073f7fe2ad48a66)
|
|
All remaining sig-scheduling tests are serial and for the time
Functest doesn't run serial test cases.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console
Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f28b4673a7b89f124d225e629f0c5267e6008c14)
|
|
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5c92fce62bb39c58d3ba9ffb1d9b6f23a06e8b4b)
|
|
Serial asks to split the testcases into 2 runs.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console
Change-Id: I58f9d9023f596141bbefae8339043f813a124854
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit db07029b8089c48d965e0ccefae7d87d69e3a46d)
|
|
Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 81c1353d02863e4b12038081cd0431a78a37100f)
|
|
Sometimes, tested Kubernetes doesn't have direct access to Internet but
access through repository mirrors.
This patch handles this case for security test cases.
Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: I699d065ee691596c4a5ccf06c22ea76ef00fe497
(cherry picked from commit af623f6b45c9357b0e33210f54db64b270d162bf)
|
|
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-leguer-sig_apps-run/2/console
Change-Id: I5cd41f2da49e59acd6bd06ded0c4e2178e7402b7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0b79c61af319c6f3beddf79e586e51e4675f3fc1)
|
|
It runs sig-node tests which are not included in K8s conformance.
It adds 38 single tests.
Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 56da8a0382889fa0558da48375d2319bfedd39a4)
|
|
It runs sig-cluster-lifecycle tests which are not included in K8s conformance.
It adds 4 single tests.
Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f3d390ddba5021ce45dd763e2bf953994a487337)
|
|
It runs sig-instrumentation tests which are not included in K8s conformance.
It adds 6 single tests.
Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 39511d8576f49b578882757fcc1e33a4bb2c9832)
|
|
It runs sig-scheduling tests which are not included in K8s conformance.
It adds 19 single tests.
Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8bfdc8569b9eaffb96562e7753423d3ded218ed4)
|
|
It runs sig-cli tests which are not included in K8s conformance.
It adds 34 single tests.
Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6eaf848638d7a1a7b4c4324837da9b8562ec7136)
|
|
It runs sig-apps tests which are not included in K8s conformance.
Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 985b7955d065065d191702f1355d7ca114f0c827)
|
|
It runs sig-auth tests which are not included in K8s conformance.
Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b5c7bc0107a443722004ecced91118042965f327)
|
|
It runs sig-api-machinery which are not included in K8s conformance.
It adds 97 single tests.
Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9c08bb471502b80df2470e577376f25400913939)
|
|
Sometimes, tested Kubernetes doesn't have direct access to Internet but
access through repository mirrors.
This patch handles this case for rally test case.
There's two ways for providing the repository mirrors:
- Give an environment variable (`MIRROR_REPO`) which gives a repository
mirro with all needed images.
- Gives an environment variable per needed repo:
- `DOCKERHUB_REPO` for DockerHub repository (`docker.io`)
- `GCR_REPO` for Google Cloud repository (`gcr.io`)
- `K8S_GCR_REPO` for Kubernetes repository (`k8s.gcr.io`)
Needed images list has also been extracted so Kubernetes administrator can
easily upload these images to the mirror if the mirror also doesn't have
access to Internet.
Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com>
Change-Id: I2ea6622b79f7e3c3c63c1441c4dab48e9bc4fb1a
(cherry picked from commit b26ac308d4d441195fcd804d4d0ff36356fa8a90)
|
|
Change-Id: Idbc520f1b196fd9d66dc57d32a543a6af7b73598
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also takes into account the last results (SCTP seems falky):
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console
Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 08558d2f47f7400176ad678ceaaff1b5be0b931c)
|
|
After all tests are based on e2e tests.
Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9e132759f6186672dd23dd31fac511bec128d386)
|
|
It runs the remaining sig-storage testing excluding the next labels:
Conformance (part of k8s_conformance), all features, all drivers and
Slow.
Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8e6f69afa84ae428a013debcc7329be26a475695)
|
|
It runs the remaining sig-network testing excluding the next labels:
Conformance (part of k8s_conformance), all features and load.balancer.
Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 80f0edf3194493620d1cfab79efbcdc8a136d799)
|
|
It verifies a couple of features by running a subset of e2e tests:
Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP
and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6,
IPv6DualStackAlphaFeature and Example. A couple of features may be
automatically skipped like NEG and kubemci.
Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e0d151ccaf4b267682feec0d38e8b7de3eb3d61c)
|
|
https://wiki.opnfv.org/pages/viewpage.action?pageId=20742412
Change-Id: I75a9303b2ee5b2df66e0169b37408bb9ad881d5a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 15f754678e4c8734c4600fea94fcbe66f2584515)
|
|
Change-Id: I0120e6a368b033f2fb47257ff9dcc3fd8a58d243
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9ebe47c8458c99066fd71a65007fff923004d209)
|
|
ONAP integration team asks to support all K8s versions.
A couple of OPNFV releases will allow testing 2 K8s versions.
Change-Id: Idb43cff0cc03cc9c17b290f7f1867e2c380c6319
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0163bb977604a32a0c46e10a97313ce0feea7b5f)
|
|
It also adds configs needed by resilience.
https://github.com/cncf/cnf-conformance/releases/tag/v0.9.19
Change-Id: I94b1efc47c5ceef96bc8879a6c71f92db1f63bd2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7385caf54c27b471bda8599d491aa3aee21b7b89)
|
|
latest-1.20 is the last rc.
Change-Id: I2587d1157c9274358f91e38f8991a349d4fc389a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Id2c05f8b425eeba1924bc2bc2688233beeb7457b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8f70187ec85781e141b40dce050dba24d8134fe2)
|
|
pip 20.3 is disruptive and would lead to big changes in stable
branches.
Change-Id: Ic3770f4098c52b0d26bc62291c9e79e8ee81d107
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0c99749bb65cadd0142c90cd73e13802d48cb7f6)
|
|
It locally patches xrally_kubernetes before [1] is merged upstream.
It adds docker.io/appropriate/curl:edge in download_images.sh too.
[1] https://github.com/xrally/xrally-kubernetes/pull/51
Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com>
Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ea2715240015a482c5321d309257d801a412f02d)
|
|
It's considered as passed vs 95 out of 105 [1].
[1] http://artifacts.opnfv.org/functest-kubernetes/ACI2B7JDLFHI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-cnf_conformance-run-16/functest-kubernetes.log
Change-Id: Ib16927cf269784daba1085a3e97fb611e869928f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 53b16e8f00e5a60db2e6db7f375bd06f184a5cc8)
|
|
It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts
to the new cnf-conformance result output logic.
It runs all workload tests as it's now proposed (k8s conformance
is already part of smoke) and select the latest coredns
cnf-conformance.yml taking latest helm repo changes into account.
It sets criteria 95 as all steps are considered as passed and a
overall result 100/105.
[1] https://github.com/cncf/cnf-conformance/issues/388
Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 854f164998793000fcf8019214b259b7283f5194)
|
|
Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 30a5a084fa9e0c8677d70d8b1d7a696ea06b49b9)
|
|
Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for both test cases even if only k8s_conformance
reaches 1h (XtestingCI design).
Change-Id: Ieaef1cefb3dfc7f9ca47b1ce8ec082409fa52604
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f38caec124b925f8c633f9d8b4474bd1085638a2)
|
|
Change-Id: I8b31468e8244e63feed163134f25461d019dbdea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes the new requirements just published into account.
Change-Id: Iea0ba4113b44d3056f2f8f1b1516271d33e84e32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I82797911296ac68701bbe1ced37c3c843360d92c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I91b31f2af0c2265cdda5715ae152558ffcbe003b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I834255837e15487bc6ae52b0c2dc805f84fb82b3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ifb9a5ac2fac7286d5f3f5e677fc2a7ecda6ade25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I3ea22a4050ff1eb609cffb61edc41c49fab44366
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Helm fails when detecting arch if qemu.
time="2020-09-17T16:25:15Z" level=error msg="failure getting variant" error="getCPUInfo for pattern: Cpu architecture: not found"
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-arm64-latest-helm_vims-run/1/console
Change-Id: Ida37062a780f9e2acf60035bf2d41fb8fbb61173
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
https://github.com/cntt-n/CNTT/pull/2022
Change-Id: Icb4bdfa0c1ecca9d0c5b4d5beef7ff4c5edb289e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It leverages helm rather than kubectl as proposed by k8s_vims.
A new abstract class Vims is added to factorize code between both
testcases.
Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It depends on bandwidth.
30 minutes should be enough in all scenarios
Change-Id: Ieaad053c8f8a270e5da08275de217b15fdf17f44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I52cb8303950269946774546cf8e413166c70a33c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|