aboutsummaryrefslogtreecommitdiffstats
path: root/docker
AgeCommit message (Collapse)AuthorFilesLines
2020-11-22Allow offline testing via xrally_kubernetesCédric Ollivier2-2/+36
It locally patches xrally_kubernetes before [1] is merged upstream. It adds docker.io/appropriate/curl:edge in download_images.sh too. [1] https://github.com/xrally/xrally-kubernetes/pull/51 Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com> Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Reduce cnf-conformance criteriaCédric Ollivier1-1/+1
It's considered as passed vs 95 out of 105 [1]. [1] http://artifacts.opnfv.org/functest-kubernetes/ACI2B7JDLFHI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-cnf_conformance-run-16/functest-kubernetes.log Change-Id: Ib16927cf269784daba1085a3e97fb611e869928f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-21Update cnf_conformance to v0.9.4Cédric Ollivier2-11/+13
It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts to the new cnf-conformance result output logic. It runs all workload tests as it's now proposed (k8s conformance is already part of smoke) and select the latest coredns cnf-conformance.yml taking latest helm repo changes into account. It sets criteria 95 as all steps are considered as passed and a overall result 100/105. [1] https://github.com/cncf/cnf-conformance/issues/388 Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-20Skip cnf_conformance till helm repos are fixedCédric Ollivier1-0/+1
Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-20Force Kubernetes 11.0 to please xrall_kubernetesCédric Ollivier1-0/+1
It will be reverted once xrally_kubernetes is ready. Change-Id: If0ad5cd018ec4edeb8c150d789df051b3f55baed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-15Publish helm_vims also based on clearwater-dockerCédric Ollivier2-9/+29
It leverages helm rather than kubectl as proposed by k8s_vims. A new abstract class Vims is added to factorize code between both testcases. Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-13Split kube-bench master and nodeCédric Ollivier1-6/+22
The former deployment asked for all-in-one. Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-12Improve kube_bench outputCédric Ollivier1-0/+1
It also fills self.details. Change-Id: Ie73215ebcbd34de9d457fd364de4ab9cbdf64319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-12Enhance kube-hunter result postprocessingCédric Ollivier1-0/+2
It fills self.details and checks if the test case passes according to criteria (severity = high by default) Change-Id: Ib20779b4b5dca078c65b546c8703bc99856c6f41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Decreate cnf-conformance criteriaCédric Ollivier1-1/+1
conf-confirmance is beta. Let's decrease criteria to allow gating [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/4/console Change-Id: I77068fd027b2ae042e0ff9574ed608c8a3d77ade Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Publish k8s_quick as proposed by sonobuoyCédric Ollivier1-1/+15
https://github.com/vmware-tanzu/sonobuoy Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Conform with latest sonubuoy's non disruptive listCédric Ollivier1-1/+1
https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43 Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Xtesting to 0.91.0Cédric Ollivier7-7/+2
Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-04Allow skipping arm and arm64 if cnf-conformanceCédric Ollivier1-3/+5
cnf-conformance doesn't support this architectures. It also improve cleaning to publish artifacts [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/2/console Change-Id: Ie64e4a1b8b496a050a1798eaf4e5ef6397c011d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-04Add cnf-conformance in functest-kubernetes-cnfCédric Ollivier2-0/+28
It selects cnf-conformance v0.7.2-beta1 (current latest release) and the default CNF as proposed by [1]. The end user is free to override the default yml files on purpose (e.g. docker volumes). Tag (default: all) could be modified too via testcases.yaml [1] https://hackmd.io/@vulk/SkY54QnsU Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-22Add xrally_kubernetes_fullCédric Ollivier3-0/+35
It iterates 10 times all operations run by xrally_kubernetes. Now times, concurrenty and count can be set via testcases.yaml. It creates a new containers functest-kubernetes-benchamrking as Functest. Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Switch to latest K9S v1.19 rcCédric Ollivier1-1/+1
Change-Id: I3a8b45e8347b5a4eea3398cb2f84796b2893cace Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Fix arm -> arm64Cédric Ollivier1-1/+1
Change-Id: I3d7d16ec7d8a7712a279258f817d811f0d59187f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Leverage alpine rather than golangCédric Ollivier1-1/+1
golang is now useless as we stop compiling kubernetes binaries. Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Stop compiling K8s testing binariesCédric Ollivier2-18/+16
It reaches Travis CI timeouts and is quite useless. PyNaCl is now installed via Alpine packages to save CI. Change-Id: Ifdf3f46f162a811ed95e3ca07ea7c3d89bc77a91 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-14Update golang to 1.15Cédric Ollivier1-1/+1
As asked by Kubernetes [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-latest-gate/60/console Change-Id: Ic57fe67f6568d19615599f7762a18170158c6771 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Ease modifying the test list in E2E testingCédric Ollivier2-2/+7
It eases creating specific CNTT test cases based on K8s E2E testing. Change-Id: I304960fda760ffc47d763d53511898699f63e356 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Remove GOFLAGS in DockerfileCédric Ollivier1-2/+2
Change-Id: Ifc6c63641b9512b4b930c1d7032cae55d2afb811 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Compile all Functest K8s containers for arm v7 and v8Cédric Ollivier1-2/+2
It removes sudo when useless and turns debug on when compiling K8s binaries. It avoids TravisCI timeouts (No output has been received)[1] [1] https://travis-ci.org/github/collivier/functest-kubernetes/jobs/716819529 Change-Id: I4719257596bf9a6510e2f772271b336847d1ccb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Only upgrade py3-distlibCédric Ollivier1-1/+1
https://travis-ci.org/github/collivier/functest/jobs/715442363 Change-Id: Ib84615def124d38e29582b31af4229325fd3ab1a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Install py3-wheel in functest-kubernetes-coreCédric Ollivier1-1/+1
It fixes all deprecated warnings. Change-Id: Idd02668fac42a8e0c93d6df5a3e13b788716e873 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Install py3-distlib from Alpine EdgeCédric Ollivier1-1/+2
Alpine 3.12 doesn't offer a version compatible with latest OpenStack constraints [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-gate/68/console Change-Id: I70930f888d9612d44b73c5d87b9dc1663d02be1c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Update to go 1.14Cédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/116/console Change-Id: I8559ee71fe05682792728a62baa628c8199dfdd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Remove energy from logging configsCédric Ollivier2-12/+2
Change-Id: I35c15aa68fe1afadcdbf3d391febb166358c90be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Remove distlib from OpenStack constraintsCédric Ollivier1-2/+7
It raised side effects wih Alpine [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-core-docker-build-amd64-master/126/console Change-Id: If52bff670c7646e7cdc6703a6ed397a23a2be2b9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-08Apply Rally patch (switch to threading for tasks)Cédric Ollivier2-2/+53
Change-Id: I8f4df2d4c220edc538c743cccce8050efe4a1140 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Update to alpine3.12Cédric Ollivier1-2/+2
https://alpinelinux.org/posts/Alpine-3.12.0-released.html Change-Id: I3c95f0867c4364b93fd8ba14093710b7c0fdda8d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-05Try a quick fix vs the race conditions in xrallyCédric Ollivier2-0/+35
Change-Id: I57a4c317ba365586c10b13d425aac021dd030949 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-14Publish debug logging configCédric Ollivier2-0/+71
Change-Id: I6a42fdeb20e0d549819c327e92e138c28dc927e1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-14Fix project name in security's testcases.yamlCédric Ollivier1-2/+2
Change-Id: I7770873b2f7d61db05a9546631fdc2d4ddf3d20c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Add security docker for functest-kubernetesmrichomme2-0/+32
run kube-hunter and kube-bench cases dealing with security in kubernetes (check vulnerabilities) [1][2] It's the first step only printing the output. [1]: https://github.com/aquasecurity/kube-bench [2]: https://github.com/aquasecurity/kube-hunter Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I3bd9bda80046ef7a0c494d51dfb0b8cbfea02bb0 Signed-off-by: mrichomme <morgan.richomme@orange.com>
2020-03-13Deploy Clearwater IMS using KubernetesCédric Ollivier3-0/+30
The new testcase "k8s_vims" deploys and tests Clearwater IMS using Kubernetes. It follows the procedures proposed by clearwater-docker [1]. [1] https://github.com/Metaswitch/clearwater-docker Change-Id: I2fe3cd03a5dedfc61fbab294c53b4bc0b0fa70be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11Cédric Ollivier3-4/+4
It also updates Python to 3.8 (default version). https://alpinelinux.org/posts/Alpine-3.11.0-released.html Change-Id: I3bbfdb76d2fb71f9a426e4fe7dacace0917e2070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-16Add mailcap in dependenciesCédric Ollivier1-1/+1
It allows detecting mimetypes. Change-Id: Ieeae5e92142daab2ea724f1c332a71a8b0c63102 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-07Update to Go 1.13Cédric Ollivier1-1/+1
It's asked by Kubernetes master [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-healthcheck-docker-build-amd64-master/90/console Change-Id: I0fdd06944fea8ce328e16459e6cf4a9e2c6fa4f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-20Select go 1.12 instead of 1.13 (rolling)Cédric Ollivier1-1/+1
Functest K8s container builds failed [1] [1] https://build.opnfv.org/ci/view/functest%20(Installer%20gates)/job/functest-kubernetes-docker-master/94/ Change-Id: I3da0ebf05e1dd25b7fb609e0e851c07ed1722723 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-31Remove Features containersCédric Ollivier4-68/+0
Most the features are stopped and Functest shouldn't host dead code. Functest is a framework (Docker and Python modules) which can be still reused by any third-party (OPNFV Feature or anything else) in its tree and CI Change-Id: Ie2f5beddd21b09aabfbdf2bb2f3366e652d43b3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Switch to Python 3.7 and Alpine 3.10Cédric Ollivier4-5/+5
pylint is updated to 2.3.1 (lastest py3.7 version) Change-Id: I8b70e9764e2802aeb517969c265fbebfa03458ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Add a new testcase leveraging on xrally/kubernetesCédric Ollivier2-2/+17
It partially runs the all-in-one task for checking basic functionality of Kubernetes cluster. Change-Id: Iaf7a29d2c1a364073e4caaeef69d68ee79ea56bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-27Disable log dumpCédric Ollivier1-1/+1
It avoids dumping logs at the end which requires gcloud configured (CI). Then it partially reverts "Keep kubernetes sources" [1]. It now dumps e2e.test output in e2e.log as sonobuoy [2]. [1] https://gerrit.opnfv.org/gerrit/68106 [2] https://raw.githubusercontent.com/cncf/k8s-conformance/master/v1.15/kubeadm/e2e.log Change-Id: I400e1cf92a8540eba3d40db1ed4237628921efe6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-27Remove useless ci_loop in testcase descriptionsCédric Ollivier3-4/+0
Change-Id: I89f5a9172bed9d6861543250a971e09466d1307b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-25Keep kubernetes sourcesCédric Ollivier1-1/+1
It now only removes .git and _output Else they are missing files when dumping the logs in case of failures [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-iruya-k8s_conformance-run/107/console Change-Id: Ia8b45b8af48bc0005e75a174258e27f1f3edcaac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-12Update to Python3Cédric Ollivier4-12/+12
Functest containers leverage on Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html Change-Id: I4f148e91259377b4e3b9076621f192a6e00f6009 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-21Update all OpenStack refs to opendev.orgCédric Ollivier2-2/+2
Change-Id: I829c7798d21abb013db09d80cc509862fa5b9e2d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-19Update to Apine 3.9Cédric Ollivier3-3/+3
It updates to the latest Alpine release [1] [1] https://www.alpinelinux.org/posts/Alpine-3.9.0-released.html Change-Id: I4afbc1d4830647f11509a02df5820ce7d33541ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>