Age | Commit message (Collapse) | Author | Files | Lines |
|
https://github.com/cncf/cnf-conformance
https://github.com/cncf/cnf-testsuite
Change-Id: I77983e0f04781a92b34afcf82f21366384782964
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 959da00d3e1c4d406bc59995c0ea93add1ec48d3)
|
|
There is no other test when NoExecuteTaintManager is skipped.
http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log
Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a6dda83e6d6da08f776010a7cdebff77c3c7c2c0)
|
|
Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c1ea4de55608b931462cd0a8d2a3a8325e5888e5)
|
|
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit adcbd42cabfa42a71410dd0c76ece0f367d338fd)
|
|
It hugely decreases the overall test duration.
(10 + 15 << 120)
Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a33e339a001d62352e15a3cc1546bb4d4d482e59)
|
|
Now multithreading is enabled at test case level.
Change-Id: I17a9bdb07216cd645483a0a893da502abee2ade0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bbc8501437c1112d2e5c53281622d3dbe25b0d61)
|
|
All remaining sig-scheduling tests are serial and for the time
Functest doesn't run serial test cases.
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console
Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f28b4673a7b89f124d225e629f0c5267e6008c14)
|
|
It runs sig-node tests which are not included in K8s conformance.
It adds 38 single tests.
Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 56da8a0382889fa0558da48375d2319bfedd39a4)
|
|
It runs sig-cluster-lifecycle tests which are not included in K8s conformance.
It adds 4 single tests.
Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f3d390ddba5021ce45dd763e2bf953994a487337)
|
|
It runs sig-instrumentation tests which are not included in K8s conformance.
It adds 6 single tests.
Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 39511d8576f49b578882757fcc1e33a4bb2c9832)
|
|
It runs sig-scheduling tests which are not included in K8s conformance.
It adds 19 single tests.
Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8bfdc8569b9eaffb96562e7753423d3ded218ed4)
|
|
It runs sig-cli tests which are not included in K8s conformance.
It adds 34 single tests.
Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6eaf848638d7a1a7b4c4324837da9b8562ec7136)
|
|
It runs sig-apps tests which are not included in K8s conformance.
Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 985b7955d065065d191702f1355d7ca114f0c827)
|
|
It runs sig-auth tests which are not included in K8s conformance.
Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b5c7bc0107a443722004ecced91118042965f327)
|
|
It runs sig-api-machinery which are not included in K8s conformance.
It adds 97 single tests.
Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9c08bb471502b80df2470e577376f25400913939)
|
|
It also takes into account the last results (SCTP seems falky):
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console
Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 08558d2f47f7400176ad678ceaaff1b5be0b931c)
(cherry picked from commit dcb442250783d97b2bbfc6e5671a18cc90106792)
|
|
It runs the remaining sig-network testing excluding the next labels:
Conformance (part of k8s_conformance), all features and load.balancer.
Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 80f0edf3194493620d1cfab79efbcdc8a136d799)
|
|
It verifies a couple of features by running a subset of e2e tests:
Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP
and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6,
IPv6DualStackAlphaFeature and Example. A couple of features may be
automatically skipped like NEG and kubemci.
Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e0d151ccaf4b267682feec0d38e8b7de3eb3d61c)
|
|
Gitlab CI/CD sets 1h as default timeout.
The timeout is valid for both test cases even if only k8s_conformance
reaches 1h (XtestingCI design).
Change-Id: Ieaef1cefb3dfc7f9ca47b1ce8ec082409fa52604
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f38caec124b925f8c633f9d8b4474bd1085638a2)
|
|
Change-Id: Iae0e61696987696fda3d9da05d75c5d87908b92a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ifb9a5ac2fac7286d5f3f5e677fc2a7ecda6ade25
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 687723872c04c4b889cf4b529f6534776b16908d)
|
|
https://github.com/cntt-n/CNTT/pull/2022
Change-Id: Icb4bdfa0c1ecca9d0c5b4d5beef7ff4c5edb289e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 63476e09e51c5c847df47b0855ee9d1b0ea1add1)
|
|
It leverages helm rather than kubectl as proposed by k8s_vims.
A new abstract class Vims is added to factorize code between both
testcases.
Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 32dfc10f56ead9abea8798e1ce16fe87652ca480)
|
|
The former deployment asked for all-in-one.
Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bced94b6fe24c7e939fb22834deb77477e4a9bb9)
|
|
It runs the mandatory CNTT test cases [1].
[1] https://github.com/cntt-n/CNTT/commit/6af033c254727b7405fbfb2efbaa023e2b8ba876
Change-Id: I87d381c78049f7309c564791ed701cf446cc85d2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 463f233c0abb77f6758e7c39fa05b5c118fbaf1f)
|
|
https://github.com/vmware-tanzu/sonobuoy
Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 711d9f1d875816386fd4afeb2e79f8d2de47b036)
|
|
It selects cnf-conformance v0.7.2-beta1 (current latest release) and
the default CNF as proposed by [1].
The end user is free to override the default yml files on purpose (e.g.
docker volumes). Tag (default: all) could be modified too via
testcases.yaml
[1] https://hackmd.io/@vulk/SkY54QnsU
Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 120daffd8d6d4be727d2ba52a76dbd8eacfe2628)
|
|
Change-Id: I8664dcb579ae8df6dbccb6ad521df8da112b1482
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It iterates 10 times all operations run by xrally_kubernetes.
Now times, concurrenty and count can be set via testcases.yaml.
It creates a new containers functest-kubernetes-benchamrking as
Functest.
Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a0f76d884c1f13c27e906136d3418f12b5342fc4)
|
|
golang is now useless as we stop compiling kubernetes binaries.
Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1af6a5dc4ec8e087613275e912c819ea1d0aecbc)
|
|
Change-Id: Ie5db13dda8dfcaa5bb26e39858448bddee8f6a2c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 07f59c24077e3d7906371eb2f8e2ec6458c2ff85)
|
|
Change-Id: Iaf8840167133917b50668edf8f6f36abaecbac62
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It adds k8s_vims, kube_bench and kube_hunter.
Change-Id: I13ead6e23c675a6ed2e70d95914cbf7cf9d54842
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also updates Python to 3.8 (default version).
https://alpinelinux.org/posts/Alpine-3.11.0-released.html
Change-Id: I3bbfdb76d2fb71f9a426e4fe7dacace0917e2070
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's asked by Kubernetes master [1]
[1] https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/90/console
Change-Id: I0fdd06944fea8ce328e16459e6cf4a9e2c6fa4f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Functest K8s container builds failed [1]
[1] https://build.opnfv.org/ci/view/functest%20(Installer%20gates)/job/functest-kubernetes-docker-master/94/
Change-Id: I3da0ebf05e1dd25b7fb609e0e851c07ed1722723
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Most the features are stopped and Functest shouldn't host dead code.
Functest is a framework (Docker and Python modules) which can be still
reused by any third-party (OPNFV Feature or anything else) in its tree
and CI
Change-Id: Ie2f5beddd21b09aabfbdf2bb2f3366e652d43b3a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It selects the generic way to set execution-type [1].
[1] https://github.com/collivier/ansible-role-xtesting/commit/292ab576fb8f0a13519bacc5ec46561a3ed8f838
Change-Id: I8b4d7dc3433cc210cd9eac180a1f247286ac1d7e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
pylint is updated to 2.3.1 (lastest py3.7 version)
Change-Id: I8b70e9764e2802aeb517969c265fbebfa03458ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It partially runs the all-in-one task for checking basic functionality
of Kubernetes cluster.
Change-Id: Iaf7a29d2c1a364073e4caaeef69d68ee79ea56bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
functest-kubernetes is defined as part of functest in OPNFV DB (see
testcases.yaml).
Change-Id: I09eadefd1f6b7bc9b58309fdbe92f8c23e7a5815
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It completes the previous commit updating Alpine.
Change-Id: I5f29bbe9d8c79f50d3270ad76eec687073351e43
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I246065e176eba9e8dbd31b8f54974b3b2a498f2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ic7db95470d510813949c059b2b573425446d2c34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
port is reserved in ansible.
Change-Id: I095396a94ac34ca6bded65033d1a7e2446eaeb8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Icfe4445c1405749698d2db42fa6001ad3d261e29
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It eases verifying OpenStack by deploying the full testing toolchain
via Ansible. As opposed to the Releng model, all tests can be executed
in parallel.
It leverages on Xtesting Ansible role which currently deploys
Jenkins, Minio, S3www, MongoDB, TestAPI and loads all jobs in Jenkins.
The dashboard will be deployed in the next update of the ansible role.
To deploy the testing toolchain:
$ ansible-galaxy install collivier.xtesting
$ ansible-playbook ansible/site.yml
Change-Id: Ie409653ae4f7f4d315449ee54ae0c504272f7899
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|