aboutsummaryrefslogtreecommitdiffstats
path: root/docker
AgeCommit message (Collapse)AuthorFilesLines
2021-02-04Allow parameterizing K8s versionsCédric Ollivier2-15/+18
ONAP integration team asks to support all K8s versions. A couple of OPNFV releases will allow testing 2 K8s versions. Change-Id: Idb43cff0cc03cc9c17b290f7f1867e2c380c6319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-26Rename sig_network_feature -> sig_network_featuresCédric Ollivier1-10/+10
It also takes into account the last results (SCTP seems falky): https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Run rally firstCédric Ollivier1-12/+12
After all tests are based on e2e tests. Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig-storageCédric Ollivier1-0/+18
It runs the remaining sig-storage testing excluding the next labels: Conformance (part of k8s_conformance), all features, all drivers and Slow. Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig_networkCédric Ollivier1-0/+17
It runs the remaining sig-network testing excluding the next labels: Conformance (part of k8s_conformance), all features and load.balancer. Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig_network_featureCédric Ollivier1-0/+27
It verifies a couple of features by running a subset of e2e tests: Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature and Example. A couple of features may be automatically skipped like NEG and kubemci. Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-10Update cnf-conformance to v0.9.19Cédric Ollivier1-7/+11
It also adds configs needed by resilience. https://github.com/cncf/cnf-conformance/releases/tag/v0.9.19 Change-Id: I94b1efc47c5ceef96bc8879a6c71f92db1f63bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-09Switch to latest (v1.21.0-alpha.0)Cédric Ollivier1-1/+1
Change-Id: I30d7e4c8861811bf405ae79eb6d6c7bf82226dd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-11Update to latest Kubernetes releaseCédric Ollivier1-1/+1
Change-Id: Id2c05f8b425eeba1924bc2bc2688233beeb7457b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Sync with xrally_kubernetesCédric Ollivier2-37/+2
As upstream is fixed [1][2], it can partially revert - Force Kubernetes 11.0 to please xrall_kubernetes - Allow offline testing via xrally_kubernetes [1] https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090 [2] https://github.com/xrally/xrally-kubernetes/commit/8caf16cd017d475360b2345b3091a9881cd884d0 Change-Id: I43ca1966dcf61e55c45f13adf27ba5b0035d8fda Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Allow offline testing via xrally_kubernetesCédric Ollivier2-2/+36
It locally patches xrally_kubernetes before [1] is merged upstream. It adds docker.io/appropriate/curl:edge in download_images.sh too. [1] https://github.com/xrally/xrally-kubernetes/pull/51 Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com> Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Reduce cnf-conformance criteriaCédric Ollivier1-1/+1
It's considered as passed vs 95 out of 105 [1]. [1] http://artifacts.opnfv.org/functest-kubernetes/ACI2B7JDLFHI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-cnf_conformance-run-16/functest-kubernetes.log Change-Id: Ib16927cf269784daba1085a3e97fb611e869928f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-21Update cnf_conformance to v0.9.4Cédric Ollivier2-11/+13
It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts to the new cnf-conformance result output logic. It runs all workload tests as it's now proposed (k8s conformance is already part of smoke) and select the latest coredns cnf-conformance.yml taking latest helm repo changes into account. It sets criteria 95 as all steps are considered as passed and a overall result 100/105. [1] https://github.com/cncf/cnf-conformance/issues/388 Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-20Skip cnf_conformance till helm repos are fixedCédric Ollivier1-0/+1
Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-20Force Kubernetes 11.0 to please xrall_kubernetesCédric Ollivier1-0/+1
It will be reverted once xrally_kubernetes is ready. Change-Id: If0ad5cd018ec4edeb8c150d789df051b3f55baed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-15Publish helm_vims also based on clearwater-dockerCédric Ollivier2-9/+29
It leverages helm rather than kubectl as proposed by k8s_vims. A new abstract class Vims is added to factorize code between both testcases. Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-13Split kube-bench master and nodeCédric Ollivier1-6/+22
The former deployment asked for all-in-one. Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-12Improve kube_bench outputCédric Ollivier1-0/+1
It also fills self.details. Change-Id: Ie73215ebcbd34de9d457fd364de4ab9cbdf64319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-12Enhance kube-hunter result postprocessingCédric Ollivier1-0/+2
It fills self.details and checks if the test case passes according to criteria (severity = high by default) Change-Id: Ib20779b4b5dca078c65b546c8703bc99856c6f41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Decreate cnf-conformance criteriaCédric Ollivier1-1/+1
conf-confirmance is beta. Let's decrease criteria to allow gating [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/4/console Change-Id: I77068fd027b2ae042e0ff9574ed608c8a3d77ade Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Publish k8s_quick as proposed by sonobuoyCédric Ollivier1-1/+15
https://github.com/vmware-tanzu/sonobuoy Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Conform with latest sonubuoy's non disruptive listCédric Ollivier1-1/+1
https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43 Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Xtesting to 0.91.0Cédric Ollivier7-7/+2
Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-04Allow skipping arm and arm64 if cnf-conformanceCédric Ollivier1-3/+5
cnf-conformance doesn't support this architectures. It also improve cleaning to publish artifacts [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/2/console Change-Id: Ie64e4a1b8b496a050a1798eaf4e5ef6397c011d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-04Add cnf-conformance in functest-kubernetes-cnfCédric Ollivier2-0/+28
It selects cnf-conformance v0.7.2-beta1 (current latest release) and the default CNF as proposed by [1]. The end user is free to override the default yml files on purpose (e.g. docker volumes). Tag (default: all) could be modified too via testcases.yaml [1] https://hackmd.io/@vulk/SkY54QnsU Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-22Add xrally_kubernetes_fullCédric Ollivier3-0/+35
It iterates 10 times all operations run by xrally_kubernetes. Now times, concurrenty and count can be set via testcases.yaml. It creates a new containers functest-kubernetes-benchamrking as Functest. Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Switch to latest K9S v1.19 rcCédric Ollivier1-1/+1
Change-Id: I3a8b45e8347b5a4eea3398cb2f84796b2893cace Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Fix arm -> arm64Cédric Ollivier1-1/+1
Change-Id: I3d7d16ec7d8a7712a279258f817d811f0d59187f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Leverage alpine rather than golangCédric Ollivier1-1/+1
golang is now useless as we stop compiling kubernetes binaries. Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Stop compiling K8s testing binariesCédric Ollivier2-18/+16
It reaches Travis CI timeouts and is quite useless. PyNaCl is now installed via Alpine packages to save CI. Change-Id: Ifdf3f46f162a811ed95e3ca07ea7c3d89bc77a91 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-14Update golang to 1.15Cédric Ollivier1-1/+1
As asked by Kubernetes [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-latest-gate/60/console Change-Id: Ic57fe67f6568d19615599f7762a18170158c6771 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Ease modifying the test list in E2E testingCédric Ollivier2-2/+7
It eases creating specific CNTT test cases based on K8s E2E testing. Change-Id: I304960fda760ffc47d763d53511898699f63e356 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Remove GOFLAGS in DockerfileCédric Ollivier1-2/+2
Change-Id: Ifc6c63641b9512b4b930c1d7032cae55d2afb811 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Compile all Functest K8s containers for arm v7 and v8Cédric Ollivier1-2/+2
It removes sudo when useless and turns debug on when compiling K8s binaries. It avoids TravisCI timeouts (No output has been received)[1] [1] https://travis-ci.org/github/collivier/functest-kubernetes/jobs/716819529 Change-Id: I4719257596bf9a6510e2f772271b336847d1ccb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Only upgrade py3-distlibCédric Ollivier1-1/+1
https://travis-ci.org/github/collivier/functest/jobs/715442363 Change-Id: Ib84615def124d38e29582b31af4229325fd3ab1a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Install py3-wheel in functest-kubernetes-coreCédric Ollivier1-1/+1
It fixes all deprecated warnings. Change-Id: Idd02668fac42a8e0c93d6df5a3e13b788716e873 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Install py3-distlib from Alpine EdgeCédric Ollivier1-1/+2
Alpine 3.12 doesn't offer a version compatible with latest OpenStack constraints [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-gate/68/console Change-Id: I70930f888d9612d44b73c5d87b9dc1663d02be1c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Update to go 1.14Cédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/116/console Change-Id: I8559ee71fe05682792728a62baa628c8199dfdd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Remove energy from logging configsCédric Ollivier2-12/+2
Change-Id: I35c15aa68fe1afadcdbf3d391febb166358c90be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Remove distlib from OpenStack constraintsCédric Ollivier1-2/+7
It raised side effects wih Alpine [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-core-docker-build-amd64-master/126/console Change-Id: If52bff670c7646e7cdc6703a6ed397a23a2be2b9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-08Apply Rally patch (switch to threading for tasks)Cédric Ollivier2-2/+53
Change-Id: I8f4df2d4c220edc538c743cccce8050efe4a1140 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Update to alpine3.12Cédric Ollivier1-2/+2
https://alpinelinux.org/posts/Alpine-3.12.0-released.html Change-Id: I3c95f0867c4364b93fd8ba14093710b7c0fdda8d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-05Try a quick fix vs the race conditions in xrallyCédric Ollivier2-0/+35
Change-Id: I57a4c317ba365586c10b13d425aac021dd030949 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-14Publish debug logging configCédric Ollivier2-0/+71
Change-Id: I6a42fdeb20e0d549819c327e92e138c28dc927e1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-14Fix project name in security's testcases.yamlCédric Ollivier1-2/+2
Change-Id: I7770873b2f7d61db05a9546631fdc2d4ddf3d20c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Add security docker for functest-kubernetesmrichomme2-0/+32
run kube-hunter and kube-bench cases dealing with security in kubernetes (check vulnerabilities) [1][2] It's the first step only printing the output. [1]: https://github.com/aquasecurity/kube-bench [2]: https://github.com/aquasecurity/kube-hunter Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I3bd9bda80046ef7a0c494d51dfb0b8cbfea02bb0 Signed-off-by: mrichomme <morgan.richomme@orange.com>
2020-03-13Deploy Clearwater IMS using KubernetesCédric Ollivier3-0/+30
The new testcase "k8s_vims" deploys and tests Clearwater IMS using Kubernetes. It follows the procedures proposed by clearwater-docker [1]. [1] https://github.com/Metaswitch/clearwater-docker Change-Id: I2fe3cd03a5dedfc61fbab294c53b4bc0b0fa70be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11Cédric Ollivier3-4/+4
It also updates Python to 3.8 (default version). https://alpinelinux.org/posts/Alpine-3.11.0-released.html Change-Id: I3bbfdb76d2fb71f9a426e4fe7dacace0917e2070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-16Add mailcap in dependenciesCédric Ollivier1-1/+1
It allows detecting mimetypes. Change-Id: Ieeae5e92142daab2ea724f1c332a71a8b0c63102 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-07Update to Go 1.13Cédric Ollivier1-1/+1
It's asked by Kubernetes master [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/90/console Change-Id: I0fdd06944fea8ce328e16459e6cf4a9e2c6fa4f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>