aboutsummaryrefslogtreecommitdiffstats
path: root/docker
AgeCommit message (Collapse)AuthorFilesLines
2021-03-21Add sig-appsCédric Ollivier1-2/+21
It runs sig-apps tests which are not included in K8s conformance. Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 985b7955d065065d191702f1355d7ca114f0c827)
2021-03-21Add sig-authCédric Ollivier1-0/+18
It runs sig-auth tests which are not included in K8s conformance. Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b5c7bc0107a443722004ecced91118042965f327)
2021-03-21Add sig-api-machineryCédric Ollivier1-4/+20
It runs sig-api-machinery which are not included in K8s conformance. It adds 97 single tests. Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9c08bb471502b80df2470e577376f25400913939)
2021-02-19Rename sig_network_feature -> sig_network_featuresCédric Ollivier1-10/+10
It also takes into account the last results (SCTP seems falky): https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 08558d2f47f7400176ad678ceaaff1b5be0b931c) (cherry picked from commit dcb442250783d97b2bbfc6e5671a18cc90106792)
2021-02-19Run rally firstCédric Ollivier1-12/+12
After all tests are based on e2e tests. Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9e132759f6186672dd23dd31fac511bec128d386)
2021-02-19Add sig-storageCédric Ollivier1-0/+18
It runs the remaining sig-storage testing excluding the next labels: Conformance (part of k8s_conformance), all features, all drivers and Slow. Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8e6f69afa84ae428a013debcc7329be26a475695)
2021-02-19Add sig_networkCédric Ollivier1-0/+17
It runs the remaining sig-network testing excluding the next labels: Conformance (part of k8s_conformance), all features and load.balancer. Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 80f0edf3194493620d1cfab79efbcdc8a136d799)
2021-02-19Add sig_network_featureCédric Ollivier1-0/+27
It verifies a couple of features by running a subset of e2e tests: Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature and Example. A couple of features may be automatically skipped like NEG and kubemci. Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0d151ccaf4b267682feec0d38e8b7de3eb3d61c)
2021-02-10Upgrade system firstCédric Ollivier1-1/+2
Change-Id: I0120e6a368b033f2fb47257ff9dcc3fd8a58d243 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9ebe47c8458c99066fd71a65007fff923004d209)
2021-02-04Allow parameterizing K8s versionsCédric Ollivier2-15/+18
ONAP integration team asks to support all K8s versions. A couple of OPNFV releases will allow testing 2 K8s versions. Change-Id: Idb43cff0cc03cc9c17b290f7f1867e2c380c6319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0163bb977604a32a0c46e10a97313ce0feea7b5f)
2021-01-10Update cnf-conformance to v0.9.19Cédric Ollivier1-7/+11
It also adds configs needed by resilience. https://github.com/cncf/cnf-conformance/releases/tag/v0.9.19 Change-Id: I94b1efc47c5ceef96bc8879a6c71f92db1f63bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7385caf54c27b471bda8599d491aa3aee21b7b89)
2020-11-22Allow offline testing via xrally_kubernetesCédric Ollivier2-2/+35
It locally patches xrally_kubernetes before [1] is merged upstream. It adds docker.io/appropriate/curl:edge in download_images.sh too. [1] https://github.com/xrally/xrally-kubernetes/pull/51 Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com> Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ea2715240015a482c5321d309257d801a412f02d)
2020-11-22Reduce cnf-conformance criteriaCédric Ollivier1-1/+1
It's considered as passed vs 95 out of 105 [1]. [1] http://artifacts.opnfv.org/functest-kubernetes/ACI2B7JDLFHI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-cnf_conformance-run-16/functest-kubernetes.log Change-Id: Ib16927cf269784daba1085a3e97fb611e869928f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 53b16e8f00e5a60db2e6db7f375bd06f184a5cc8)
2020-11-21Update cnf_conformance to v0.9.4Cédric Ollivier2-11/+13
It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts to the new cnf-conformance result output logic. It runs all workload tests as it's now proposed (k8s conformance is already part of smoke) and select the latest coredns cnf-conformance.yml taking latest helm repo changes into account. It sets criteria 95 as all steps are considered as passed and a overall result 100/105. [1] https://github.com/cncf/cnf-conformance/issues/388 Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 854f164998793000fcf8019214b259b7283f5194)
2020-11-20Skip cnf_conformance till helm repos are fixedCédric Ollivier1-0/+1
Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 30a5a084fa9e0c8677d70d8b1d7a696ea06b49b9)
2020-09-16Publish helm_vims also based on clearwater-dockerCédric Ollivier2-9/+29
It leverages helm rather than kubectl as proposed by k8s_vims. A new abstract class Vims is added to factorize code between both testcases. Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 32dfc10f56ead9abea8798e1ce16fe87652ca480)
2020-09-13Split kube-bench master and nodeCédric Ollivier1-6/+22
The former deployment asked for all-in-one. Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bced94b6fe24c7e939fb22834deb77477e4a9bb9)
2020-09-12Improve kube_bench outputCédric Ollivier1-0/+1
It also fills self.details. Change-Id: Ie73215ebcbd34de9d457fd364de4ab9cbdf64319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 823b3a005ace9372a080421b2ae19152505201e4)
2020-09-12Enhance kube-hunter result postprocessingCédric Ollivier1-0/+2
It fills self.details and checks if the test case passes according to criteria (severity = high by default) Change-Id: Ib20779b4b5dca078c65b546c8703bc99856c6f41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4f197110710e9f148eae4533792e8e7e2d72f053)
2020-09-07Update Kali to v1.19Cédric Ollivier1-1/+1
It follows the last stable version as expected by RA2 Baraque. Change-Id: I962663516c38a2a879c3f263a8df2d1de949ca14 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Decreate cnf-conformance criteriaCédric Ollivier1-1/+1
conf-confirmance is beta. Let's decrease criteria to allow gating [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/4/console Change-Id: I77068fd027b2ae042e0ff9574ed608c8a3d77ade Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 12d6bc18b178d4a8a4f64574bd6549341268645a)
2020-09-06Publish k8s_quick as proposed by sonobuoyCédric Ollivier1-1/+15
https://github.com/vmware-tanzu/sonobuoy Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 711d9f1d875816386fd4afeb2e79f8d2de47b036)
2020-09-06Conform with latest sonubuoy's non disruptive listCédric Ollivier1-1/+1
https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43 Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit de3a7000a3173f0242cbf7bfcdd6a18d8678e0ae)
2020-09-06Update Xtesting to 0.91.0Cédric Ollivier7-7/+2
Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b198dcede7578b1c3bf688cd47cc0590dd8d6d14)
2020-09-04Allow skipping arm and arm64 if cnf-conformanceCédric Ollivier1-3/+5
cnf-conformance doesn't support this architectures. It also improve cleaning to publish artifacts [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/2/console Change-Id: Ie64e4a1b8b496a050a1798eaf4e5ef6397c011d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2cf6903c9a805b9c1b7702292bdf33b9485be319)
2020-09-04Add cnf-conformance in functest-kubernetes-cnfCédric Ollivier2-0/+28
It selects cnf-conformance v0.7.2-beta1 (current latest release) and the default CNF as proposed by [1]. The end user is free to override the default yml files on purpose (e.g. docker volumes). Tag (default: all) could be modified too via testcases.yaml [1] https://hackmd.io/@vulk/SkY54QnsU Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 120daffd8d6d4be727d2ba52a76dbd8eacfe2628)
2020-08-22Add xrally_kubernetes_fullCédric Ollivier3-0/+35
It iterates 10 times all operations run by xrally_kubernetes. Now times, concurrenty and count can be set via testcases.yaml. It creates a new containers functest-kubernetes-benchamrking as Functest. Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a0f76d884c1f13c27e906136d3418f12b5342fc4)
2020-08-16Leverage alpine rather than golangCédric Ollivier1-1/+1
golang is now useless as we stop compiling kubernetes binaries. Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1af6a5dc4ec8e087613275e912c819ea1d0aecbc)
2020-08-16Fix arm -> arm64Cédric Ollivier1-1/+1
Change-Id: I3d7d16ec7d8a7712a279258f817d811f0d59187f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit aa3d694b2c288521b6e3f96ea020a3ac485d4d14)
2020-08-16Stop compiling K8s testing binariesCédric Ollivier1-16/+11
It reaches Travis CI timeouts and is quite useless. PyNaCl is now installed via Alpine packages to save CI. Change-Id: Ifdf3f46f162a811ed95e3ca07ea7c3d89bc77a91 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6801612e85c485e9885cfb41cbc84771475a134f)
2020-08-15Update K8S_TAG to v1.18.8Cédric Ollivier1-1/+1
Change-Id: Ie6fea9b39a9f58f2bfcaef2634cf1ba7aa70465b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Ease modifying the test list in E2E testingCédric Ollivier2-2/+7
It eases creating specific CNTT test cases based on K8s E2E testing. Change-Id: I304960fda760ffc47d763d53511898699f63e356 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a22553a65d6019350c215c9024c9dc54cf77dc7c)
2020-08-11Remove GOFLAGS in DockerfileCédric Ollivier1-2/+2
Change-Id: Ifc6c63641b9512b4b930c1d7032cae55d2afb811 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fac999583784f6e3b2c64294f2347fdf8a7a64f0)
2020-08-11Compile all Functest K8s containers for arm v7 and v8Cédric Ollivier1-2/+2
It removes sudo when useless and turns debug on when compiling K8s binaries. It avoids TravisCI timeouts (No output has been received)[1] [1] https://travis-ci.org/github/collivier/functest-kubernetes/jobs/716819529 Change-Id: I4719257596bf9a6510e2f772271b336847d1ccb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3c4543a8ef6f84a5f25483a6dfe50e0075a9cd0e)
2020-07-07Remove energy from logging configsCédric Ollivier2-12/+2
Change-Id: I35c15aa68fe1afadcdbf3d391febb166358c90be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 62b861884f55815e00b24f3aca6acb95e0f804b9)
2020-07-03v1.18.2 -> v1.18.5Cédric Ollivier1-1/+1
Change-Id: I9a9ce0cebef15eac35b1a01203063b695fba40be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-08Apply Rally patch (switch to threading for tasks)Cédric Ollivier2-2/+53
Change-Id: I8f4df2d4c220edc538c743cccce8050efe4a1140 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bfd0063c81f5d5d4fad2389832c8f1479a28f73d)
2020-05-05Try a quick fix vs the race conditions in xrallyCédric Ollivier2-0/+35
Change-Id: I57a4c317ba365586c10b13d425aac021dd030949 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 81139b1576981990f32df76719f179441e4d12ee)
2020-04-30Use OpenStack stable/ussuri requirementsCédric Ollivier1-1/+1
The branch was just created [1]. [1] https://github.com/openstack/requirements/tree/stable/ussuri Change-Id: Ib5d6a773f3ba20eaa1d54febbafae8b7bd1cde94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-29Merge "Set K8S_TAG=v1.18.2" into stable/kaliCedric Ollivier1-1/+1
2020-04-29Set K8S_TAG=v1.18.2Cédric Ollivier1-1/+1
Change-Id: I07dd3cc97921c15c7ad7cf1de7291b211d129c24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-29Publish Functest K8s Kali dockersCédric Ollivier5-6/+6
Change-Id: Iaf8840167133917b50668edf8f6f36abaecbac62 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-14Publish debug logging configCédric Ollivier2-0/+71
Change-Id: I6a42fdeb20e0d549819c327e92e138c28dc927e1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-14Fix project name in security's testcases.yamlCédric Ollivier1-2/+2
Change-Id: I7770873b2f7d61db05a9546631fdc2d4ddf3d20c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Add security docker for functest-kubernetesmrichomme2-0/+32
run kube-hunter and kube-bench cases dealing with security in kubernetes (check vulnerabilities) [1][2] It's the first step only printing the output. [1]: https://github.com/aquasecurity/kube-bench [2]: https://github.com/aquasecurity/kube-hunter Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I3bd9bda80046ef7a0c494d51dfb0b8cbfea02bb0 Signed-off-by: mrichomme <morgan.richomme@orange.com>
2020-03-13Deploy Clearwater IMS using KubernetesCédric Ollivier3-0/+30
The new testcase "k8s_vims" deploys and tests Clearwater IMS using Kubernetes. It follows the procedures proposed by clearwater-docker [1]. [1] https://github.com/Metaswitch/clearwater-docker Change-Id: I2fe3cd03a5dedfc61fbab294c53b4bc0b0fa70be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11Cédric Ollivier3-4/+4
It also updates Python to 3.8 (default version). https://alpinelinux.org/posts/Alpine-3.11.0-released.html Change-Id: I3bbfdb76d2fb71f9a426e4fe7dacace0917e2070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-16Add mailcap in dependenciesCédric Ollivier1-1/+1
It allows detecting mimetypes. Change-Id: Ieeae5e92142daab2ea724f1c332a71a8b0c63102 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-07Update to Go 1.13Cédric Ollivier1-1/+1
It's asked by Kubernetes master [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/90/console Change-Id: I0fdd06944fea8ce328e16459e6cf4a9e2c6fa4f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-20Select go 1.12 instead of 1.13 (rolling)Cédric Ollivier1-1/+1
Functest K8s container builds failed [1] [1] https://build.opnfv.org/ci/view/functest%20(Installer%20gates)/job/functest-kubernetes-docker-master/94/ Change-Id: I3da0ebf05e1dd25b7fb609e0e851c07ed1722723 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>