aboutsummaryrefslogtreecommitdiffstats
path: root/ansible
AgeCommit message (Collapse)AuthorFilesLines
2021-08-26Remove sig_network_serialCédric Ollivier2-2/+0
PerformanceDNS is now optional [1] and DNS configMap nameserver makes operations on coredns which would break an living deployment [2]. sig_network_serial is now enpty and then can be safely removed. [1] https://github.com/cntt-n/CNTT/pull/2580 [2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238 Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 775135dd1ef01ab50a22846067bfdd87903f836e)
2021-08-26Remove SIG CLI testingCédric Ollivier2-2/+16
It conforms to https://github.com/cntt-n/CNTT/pull/2579 Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0a68c0cb77c6d9967e5e33e59a737ef686b2e916)
2021-05-10Benchmark Kubernetes Networking PerformanceCédric Ollivier2-0/+2
https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3b5c1b115e234d636cb4f2a17d27ced872fee924)
2021-05-03Update cnf-conformance to cnf-testsuiteCédric Ollivier2-2/+2
https://github.com/cncf/cnf-conformance https://github.com/cncf/cnf-testsuite Change-Id: I77983e0f04781a92b34afcf82f21366384782964 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 959da00d3e1c4d406bc59995c0ea93add1ec48d3)
2021-04-14Remove sig_node_serial as it's fully disruptiveCédric Ollivier1-1/+0
There is no other test when NoExecuteTaintManager is skipped. http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a6dda83e6d6da08f776010a7cdebff77c3c7c2c0)
2021-04-04Update test case listCédric Ollivier1-0/+8
Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c1ea4de55608b931462cd0a8d2a3a8325e5888e5)
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier1-1/+0
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit adcbd42cabfa42a71410dd0c76ece0f367d338fd)
2021-04-03Spit conformance into 2 test casesCédric Ollivier1-0/+1
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a33e339a001d62352e15a3cc1546bb4d4d482e59)
2021-04-02Run opnfv/functest-kubernetes-smoke sequentiallyCédric Ollivier2-0/+4
Now multithreading is enabled at test case level. Change-Id: I17a9bdb07216cd645483a0a893da502abee2ade0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bbc8501437c1112d2e5c53281622d3dbe25b0d61)
2021-03-31Disable sig_scheduling as serialCédric Ollivier1-1/+0
All remaining sig-scheduling tests are serial and for the time Functest doesn't run serial test cases. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f28b4673a7b89f124d225e629f0c5267e6008c14)
2021-03-21Add sig_nodeCédric Ollivier1-0/+1
It runs sig-node tests which are not included in K8s conformance. It adds 38 single tests. Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 56da8a0382889fa0558da48375d2319bfedd39a4)
2021-03-21Add sig_cluster_lifecycleCédric Ollivier1-0/+1
It runs sig-cluster-lifecycle tests which are not included in K8s conformance. It adds 4 single tests. Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f3d390ddba5021ce45dd763e2bf953994a487337)
2021-03-21Add sig_instrumentationCédric Ollivier1-0/+1
It runs sig-instrumentation tests which are not included in K8s conformance. It adds 6 single tests. Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 39511d8576f49b578882757fcc1e33a4bb2c9832)
2021-03-21Add sig_schedulingCédric Ollivier1-0/+1
It runs sig-scheduling tests which are not included in K8s conformance. It adds 19 single tests. Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8bfdc8569b9eaffb96562e7753423d3ded218ed4)
2021-03-21Add sig_cliCédric Ollivier1-0/+1
It runs sig-cli tests which are not included in K8s conformance. It adds 34 single tests. Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6eaf848638d7a1a7b4c4324837da9b8562ec7136)
2021-03-21Add sig-appsCédric Ollivier1-0/+1
It runs sig-apps tests which are not included in K8s conformance. Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 985b7955d065065d191702f1355d7ca114f0c827)
2021-03-21Add sig-authCédric Ollivier1-0/+1
It runs sig-auth tests which are not included in K8s conformance. Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b5c7bc0107a443722004ecced91118042965f327)
2021-03-21Add sig-api-machineryCédric Ollivier1-0/+1
It runs sig-api-machinery which are not included in K8s conformance. It adds 97 single tests. Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9c08bb471502b80df2470e577376f25400913939)
2021-02-19Rename sig_network_feature -> sig_network_featuresCédric Ollivier1-1/+2
It also takes into account the last results (SCTP seems falky): https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 08558d2f47f7400176ad678ceaaff1b5be0b931c) (cherry picked from commit dcb442250783d97b2bbfc6e5671a18cc90106792)
2021-02-19Add sig_networkCédric Ollivier1-0/+1
It runs the remaining sig-network testing excluding the next labels: Conformance (part of k8s_conformance), all features and load.balancer. Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 80f0edf3194493620d1cfab79efbcdc8a136d799)
2021-02-19Add sig_network_featureCédric Ollivier1-0/+1
It verifies a couple of features by running a subset of e2e tests: Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature and Example. A couple of features may be automatically skipped like NEG and kubemci. Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0d151ccaf4b267682feec0d38e8b7de3eb3d61c)
2020-11-15Add timeout as needed by Gitlab CI/CDCédric Ollivier3-0/+3
Gitlab CI/CD sets 1h as default timeout. The timeout is valid for both test cases even if only k8s_conformance reaches 1h (XtestingCI design). Change-Id: Ieaef1cefb3dfc7f9ca47b1ce8ec082409fa52604 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f38caec124b925f8c633f9d8b4474bd1085638a2)
2020-11-15Split Gates in a dedicated site.ymlCédric Ollivier2-34/+65
Change-Id: Iae0e61696987696fda3d9da05d75c5d87908b92a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-23Split kube_bench_master and kube_bench_node in site.cntt.ymlCédric Ollivier1-1/+2
Change-Id: Ifb9a5ac2fac7286d5f3f5e677fc2a7ecda6ade25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 687723872c04c4b889cf4b529f6534776b16908d)
2020-09-16Add helm_vims in site.cntt.ymlCédric Ollivier1-0/+1
https://github.com/cntt-n/CNTT/pull/2022 Change-Id: Icb4bdfa0c1ecca9d0c5b4d5beef7ff4c5edb289e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 63476e09e51c5c847df47b0855ee9d1b0ea1add1)
2020-09-16Publish helm_vims also based on clearwater-dockerCédric Ollivier1-1/+2
It leverages helm rather than kubectl as proposed by k8s_vims. A new abstract class Vims is added to factorize code between both testcases. Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 32dfc10f56ead9abea8798e1ce16fe87652ca480)
2020-09-13Split kube-bench master and nodeCédric Ollivier1-1/+2
The former deployment asked for all-in-one. Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bced94b6fe24c7e939fb22834deb77477e4a9bb9)
2020-09-09Publish CNTT RC2 playbookCédric Ollivier1-0/+28
It runs the mandatory CNTT test cases [1]. [1] https://github.com/cntt-n/CNTT/commit/6af033c254727b7405fbfb2efbaa023e2b8ba876 Change-Id: I87d381c78049f7309c564791ed701cf446cc85d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 463f233c0abb77f6758e7c39fa05b5c118fbaf1f)
2020-09-06Publish k8s_quick as proposed by sonobuoyCédric Ollivier1-0/+1
https://github.com/vmware-tanzu/sonobuoy Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 711d9f1d875816386fd4afeb2e79f8d2de47b036)
2020-09-04Add cnf-conformance in functest-kubernetes-cnfCédric Ollivier1-0/+1
It selects cnf-conformance v0.7.2-beta1 (current latest release) and the default CNF as proposed by [1]. The end user is free to override the default yml files on purpose (e.g. docker volumes). Tag (default: all) could be modified too via testcases.yaml [1] https://hackmd.io/@vulk/SkY54QnsU Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 120daffd8d6d4be727d2ba52a76dbd8eacfe2628)
2020-09-02Fix docker_tag in ansible/site.ymlCédric Ollivier1-1/+1
Change-Id: I8664dcb579ae8df6dbccb6ad521df8da112b1482 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-22Add xrally_kubernetes_fullCédric Ollivier1-2/+10
It iterates 10 times all operations run by xrally_kubernetes. Now times, concurrenty and count can be set via testcases.yaml. It creates a new containers functest-kubernetes-benchamrking as Functest. Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a0f76d884c1f13c27e906136d3418f12b5342fc4)
2020-08-16Leverage alpine rather than golangCédric Ollivier1-2/+2
golang is now useless as we stop compiling kubernetes binaries. Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1af6a5dc4ec8e087613275e912c819ea1d0aecbc)
2020-08-11Remove useless repo in site.yamlCédric Ollivier1-12/+6
Change-Id: Ie5db13dda8dfcaa5bb26e39858448bddee8f6a2c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 07f59c24077e3d7906371eb2f8e2ec6458c2ff85)
2020-04-29Publish Functest K8s Kali dockersCédric Ollivier1-0/+3
Change-Id: Iaf8840167133917b50668edf8f6f36abaecbac62 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Take latest test cases into accountCédric Ollivier1-0/+15
It adds k8s_vims, kube_bench and kube_hunter. Change-Id: I13ead6e23c675a6ed2e70d95914cbf7cf9d54842 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11Cédric Ollivier1-1/+1
It also updates Python to 3.8 (default version). https://alpinelinux.org/posts/Alpine-3.11.0-released.html Change-Id: I3bbfdb76d2fb71f9a426e4fe7dacace0917e2070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-07Update to Go 1.13Cédric Ollivier1-1/+1
It's asked by Kubernetes master [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/90/console Change-Id: I0fdd06944fea8ce328e16459e6cf4a9e2c6fa4f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-20Select go 1.12 instead of 1.13 (rolling)Cédric Ollivier1-1/+1
Functest K8s container builds failed [1] [1] https://build.opnfv.org/ci/view/functest%20(Installer%20gates)/job/functest-kubernetes-docker-master/94/ Change-Id: I3da0ebf05e1dd25b7fb609e0e851c07ed1722723 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-31Remove Features containersCédric Ollivier1-8/+0
Most the features are stopped and Functest shouldn't host dead code. Functest is a framework (Docker and Python modules) which can be still reused by any third-party (OPNFV Feature or anything else) in its tree and CI Change-Id: Ie2f5beddd21b09aabfbdf2bb2f3366e652d43b3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-22Conforms with latest changes in Xtesting ansible role.Cédric Ollivier1-0/+2
It selects the generic way to set execution-type [1]. [1] https://github.com/collivier/ansible-role-xtesting/commit/292ab576fb8f0a13519bacc5ec46561a3ed8f838 Change-Id: I8b4d7dc3433cc210cd9eac180a1f247286ac1d7e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-1/+1
pylint is updated to 2.3.1 (lastest py3.7 version) Change-Id: I8b70e9764e2802aeb517969c265fbebfa03458ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Add a new testcase leveraging on xrally/kubernetesCédric Ollivier1-0/+1
It partially runs the all-in-one task for checking basic functionality of Kubernetes cluster. Change-Id: Iaf7a29d2c1a364073e4caaeef69d68ee79ea56bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-24Set db_project in ansible/site.ymlCédric Ollivier1-0/+1
functest-kubernetes is defined as part of functest in OPNFV DB (see testcases.yaml). Change-Id: I09eadefd1f6b7bc9b58309fdbe92f8c23e7a5815 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-23Update Alpine tag in build.sh and ansible/site.ymlCédric Ollivier1-1/+1
It completes the previous commit updating Alpine. Change-Id: I5f29bbe9d8c79f50d3270ad76eec687073351e43 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-21Fix container names in ansible/site.ymlCédric Ollivier1-3/+3
Change-Id: I246065e176eba9e8dbd31b8f54974b3b2a498f2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-17Fix BRANCH args in ansible.ymlCédric Ollivier1-3/+3
Change-Id: Ic7db95470d510813949c059b2b573425446d2c34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-15Switch from port to dportCédric Ollivier1-1/+1
port is reserved in ansible. Change-Id: I095396a94ac34ca6bded65033d1a7e2446eaeb8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-05Add Functest k8s gate jobsCédric Ollivier2-8/+31
Change-Id: Icfe4445c1405749698d2db42fa6001ad3d261e29 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-19Deploy Functest Kubernetes CI toolchainsCédric Ollivier1-0/+27
It eases verifying OpenStack by deploying the full testing toolchain via Ansible. As opposed to the Releng model, all tests can be executed in parallel. It leverages on Xtesting Ansible role which currently deploys Jenkins, Minio, S3www, MongoDB, TestAPI and loads all jobs in Jenkins. The dashboard will be deployed in the next update of the ansible role. To deploy the testing toolchain: $ ansible-galaxy install collivier.xtesting $ ansible-playbook ansible/site.yml Change-Id: Ie409653ae4f7f4d315449ee54ae0c504272f7899 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>