aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-09-12Enhance kube-hunter result postprocessingCédric Ollivier3-4/+66
It fills self.details and checks if the test case passes according to criteria (severity = high by default) Change-Id: Ib20779b4b5dca078c65b546c8703bc99856c6f41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-12Avoid running VNF testing if deployment failedCédric Ollivier1-3/+7
Change-Id: Id7642e47ec2cc438c5fe3a0ec9447f72b358adab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-12Add clusterIP: None in ims svc.yamlCédric Ollivier11-0/+11
Change-Id: I0709e83f32261af232c20f94c1edef7423e05527 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-10Remove clusterIP: None in ims svc.yamlCédric Ollivier11-11/+0
It now works on minikube in addition to Functest gates. Change-Id: I314989516f81dcddb3e615fe23480135f1d8cf9a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-10Allow setting e2e non blocking taints via env varsCédric Ollivier1-0/+3
Change-Id: I8132769ea23a376b2cae8b93beed27f5e66b9207 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-10Add quay.io/coreos/etcd:v2.2.5 in download_images.shCédric Ollivier1-0/+1
Change-Id: I4b5da162dcb1efff810514498a20250c05afb3ba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-09Publish CNTT RC2 playbookCédric Ollivier1-0/+25
It runs the mandatory CNTT test cases [1]. [1] https://github.com/cntt-n/CNTT/commit/6af033c254727b7405fbfb2efbaa023e2b8ba876 Change-Id: I87d381c78049f7309c564791ed701cf446cc85d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Add helper to download all imagesCédric Ollivier3-0/+68
It eases offline testing. The default command leverages kind as in-use in Functest. Change-Id: I66a20ede5e857f80cf49b9b708843034bc3b9904 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Set all image tagsCédric Ollivier14-37/+37
It allows offline testing via xrally_kubernetes, k8s_vims, kube_bench and kube_hunter. Change-Id: I3084abec19f06a894d0083ecb3ed61882eddd785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Remove latest in all imagesCédric Ollivier12-12/+12
The Kubernetes default pull policy is IfNotPresent unless the image tag is :latest in which case the default policy is Always. IfNotPresent causes the Kubelet to skip pulling an image if it already exists [1] [1] https://kind.sigs.k8s.io/docs/user/quick-start/ Change-Id: I83dac6165d2bbef165ca852dd03e5b76a5356f2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Remove all imagePullPolicy: Always in ims depl yamlCédric Ollivier10-10/+0
It forbids offline testing. Change-Id: I6790f64fd1382671300374b339ae038ef015cfab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Override default Xtesting logs in cnf-conformanceCédric Ollivier1-0/+5
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/7/console Change-Id: Ia6845525e62274f7792b4cb1909f36204fb51418 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Decreate cnf-conformance criteriaCédric Ollivier1-1/+1
conf-confirmance is beta. Let's decrease criteria to allow gating [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/4/console Change-Id: I77068fd027b2ae042e0ff9574ed608c8a3d77ade Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Slightly generalize ginkgo paramsCédric Ollivier1-4/+2
Change-Id: I51b013056bb5b88ef2e1de31e9171129e8ce4475 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Publish k8s_quick as proposed by sonobuoyCédric Ollivier2-1/+16
https://github.com/vmware-tanzu/sonobuoy Change-Id: I7b1777cf7bc0d6cd04ea5cccc08b7c29887ae874 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Conform with latest sonubuoy's non disruptive listCédric Ollivier1-1/+1
https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43 Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Xtesting to 0.91.0Cédric Ollivier7-7/+2
Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-04Allow skipping arm and arm64 if cnf-conformanceCédric Ollivier2-6/+21
cnf-conformance doesn't support this architectures. It also improve cleaning to publish artifacts [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/2/console Change-Id: Ie64e4a1b8b496a050a1798eaf4e5ef6397c011d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-04Add cnf-conformance in functest-kubernetes-cnfCédric Ollivier6-0/+134
It selects cnf-conformance v0.7.2-beta1 (current latest release) and the default CNF as proposed by [1]. The end user is free to override the default yml files on purpose (e.g. docker volumes). Tag (default: all) could be modified too via testcases.yaml [1] https://hackmd.io/@vulk/SkY54QnsU Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Increase cassandra timeoutsCédric Ollivier2-2/+2
homestead-prov sometimes fails reaching cassandra 30-08-2020 10:33:44.064 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code 30-08-2020 10:34:32.257 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code Change-Id: I48566e39dca3dc9644733a76140a76300bbfd84e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-23Stop pushing all details in Test DBCédric Ollivier1-1/+1
It raises 413 Client Error: Request Entity Too Large for url [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console Change-Id: I165f7aec53d8ce1e567491a5b5559f00b1fe4a4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-23Set output logs in Rally testcasesCédric Ollivier1-0/+3
https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console Change-Id: I13685d74ce9e286520af6f1e5cd6ce9dafc3d5ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-23Fix kube-hunter commandCédric Ollivier1-1/+1
https://github.com/aquasecurity/kube-hunter/commit/3e06647b4c09257cb994bbdd174ee621e2af5406 Change-Id: Idf470f0161aaeb7a326a3e2a4e680445d9f00eac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-22Fix last hardcoded concurrenciesCédric Ollivier1-8/+8
Change-Id: Ib2b7bb6de8cd6524fcc52baf48ebf5c4835c396b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-22Add xrally_kubernetes_fullCédric Ollivier10-64/+149
It iterates 10 times all operations run by xrally_kubernetes. Now times, concurrenty and count can be set via testcases.yaml. It creates a new containers functest-kubernetes-benchamrking as Functest. Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-18Merge "Add tempo waiting for ellis account"Cedric Ollivier1-0/+1
2020-08-17Add tempo waiting for ellis accountCédric Ollivier1-0/+1
Change-Id: I63c6af9d0e20aab426e7f875cdb4f86d206f49aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Safely decode e2e.test outputCédric Ollivier1-2/+4
https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-healthcheck-arm-latest-k8s_smoke-run/2/console Change-Id: I57f3ae0051fb55c8c80de81e79168e61c06d85bb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Switch to latest K9S v1.19 rcCédric Ollivier1-1/+1
Change-Id: I3a8b45e8347b5a4eea3398cb2f84796b2893cace Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Fix arm -> arm64Cédric Ollivier1-1/+1
Change-Id: I3d7d16ec7d8a7712a279258f817d811f0d59187f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Leverage alpine rather than golangCédric Ollivier3-8/+8
golang is now useless as we stop compiling kubernetes binaries. Change-Id: I7b9416281de069d1f454b13eff6e9e6107f7471e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-16Stop compiling K8s testing binariesCédric Ollivier3-20/+42
It reaches Travis CI timeouts and is quite useless. PyNaCl is now installed via Alpine packages to save CI. Change-Id: Ifdf3f46f162a811ed95e3ca07ea7c3d89bc77a91 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-14Update golang to 1.15 in site.yamlCédric Ollivier1-1/+1
Change-Id: I8891ab01dcbeee7711fcb704535ce1621d0dc7c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-14Update golang to 1.15Cédric Ollivier2-5/+5
As asked by Kubernetes [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-healthcheck-latest-gate/60/console Change-Id: Ic57fe67f6568d19615599f7762a18170158c6771 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Conform with Functest pylint configCédric Ollivier1-1/+3
Change-Id: Ie12d17a32fe8ee7ee212a6a4acf6aec107377390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Merge "Make K8s security tests namespace aware"Cedric Ollivier1-15/+28
2020-08-13Ease modifying the test list in E2E testingCédric Ollivier5-43/+22
It eases creating specific CNTT test cases based on K8s E2E testing. Change-Id: I304960fda760ffc47d763d53511898699f63e356 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Make K8s security tests namespace awareCédric Ollivier1-15/+28
It now creates a namespace to allow running the test cases twice in parallel. It also overprotects clean operations to force a full delete. Change-Id: Ie0becd8ea9126328e7280591bacc0d88e14dd031 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Make K8s_vims namespace awareCédric Ollivier1-6/+21
It now creates a namespace to allow running the test case twice in parallel (see DNS requests). Change-Id: Ib47b3fb2d753f8259d9224cb79168cde68d8e854 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Remove GOFLAGS in DockerfileCédric Ollivier1-2/+2
Change-Id: Ifc6c63641b9512b4b930c1d7032cae55d2afb811 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Remove useless repo in site.yamlCédric Ollivier1-12/+6
Change-Id: Ie5db13dda8dfcaa5bb26e39858448bddee8f6a2c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Stop building smoke if arm and arm64Cédric Ollivier1-13/+1
Change-Id: Ifef3eef410cdca58855bda471ef2be49bf3ba64f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Don't build arm containers on TravisCICédric Ollivier1-13/+1
From the time being, they are reaching timeouts. Change-Id: I5a2d6060f1f1042f630eeafa1876ed434e681e3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-11Compile all Functest K8s containers for arm v7 and v8Cédric Ollivier3-20/+106
It removes sudo when useless and turns debug on when compiling K8s binaries. It avoids TravisCI timeouts (No output has been received)[1] [1] https://travis-ci.org/github/collivier/functest-kubernetes/jobs/716819529 Change-Id: I4719257596bf9a6510e2f772271b336847d1ccb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Only upgrade py3-distlibCédric Ollivier1-1/+1
https://travis-ci.org/github/collivier/functest/jobs/715442363 Change-Id: Ib84615def124d38e29582b31af4229325fd3ab1a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Updated from global requirementsCédric Ollivier2-10/+1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I3a60f9916ff96b1820c72bb9b45b3c919baeade1
2020-08-06Install py3-wheel in functest-kubernetes-coreCédric Ollivier1-1/+1
It fixes all deprecated warnings. Change-Id: Idd02668fac42a8e0c93d6df5a3e13b788716e873 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Install py3-distlib from Alpine EdgeCédric Ollivier1-1/+2
Alpine 3.12 doesn't offer a version compatible with latest OpenStack constraints [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-gate/68/console Change-Id: I70930f888d9612d44b73c5d87b9dc1663d02be1c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-09Boot Ellis once homestead-depl is readyCédric Ollivier5-10/+22
Change-Id: If61a36020f3dfa5ba0a9858df769138257f9ec94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Improve vIMS service orderCédric Ollivier4-12/+6
It seems fixing the last side effects. Change-Id: Iee8506c2f0048f7c2619b772aea815288a40145e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>