aboutsummaryrefslogtreecommitdiffstats
path: root/docker
AgeCommit message (Collapse)AuthorFilesLines
2021-05-03Update cnf-conformance to cnf-testsuiteCédric Ollivier2-17/+17
https://github.com/cncf/cnf-conformance https://github.com/cncf/cnf-testsuite Change-Id: I77983e0f04781a92b34afcf82f21366384782964 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Reduce number of threadsCédric Ollivier1-10/+10
It passed successfully with 10 threads (more doesn't reduce the overall duration so much). Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-01Update master to next 1.22Cédric Ollivier2-2/+2
Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-20Install setuptools_scm before xrallyCédric Ollivier1-0/+4
Else upper-constraints basically fails. Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)
2021-04-15Skip Network.should.set.TCP.CLOSE_WAIT.timeoutCédric Ollivier1-1/+2
https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-14Remove sig_node_serial as it's fully disruptiveCédric Ollivier1-24/+0
There is no other test when NoExecuteTaintManager is skipped. http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeatureCédric Ollivier1-2/+0
kind master allows dualstack since [1] [1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551 Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Remove [k8s.io] testingCédric Ollivier1-18/+0
v1.21 enforces sig ownership of all e2e tests [1]. [1] https://github.com/kubernetes/kubernetes/issues/98326 Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-05Switch to latest-1.21Cédric Ollivier2-4/+4
Else it would consider v1.22.0-alpha.0 (N+2). Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Add k8s_io and serial test casesCédric Ollivier1-6/+161
It completes the first sig test cases. Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier1-27/+4
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-03Spit conformance into 2 test casesCédric Ollivier1-0/+17
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Properly manage e2e parallel testingCédric Ollivier5-362/+359
It sets nodes=25 to run all tests in parallel. It also beautifies all testcases.yml Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-31Disable sig_scheduling as serialCédric Ollivier1-18/+0
All remaining sig-scheduling tests are serial and for the time Functest doesn't run serial test cases. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Remove the useless Feature prefixCédric Ollivier1-1/+1
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Exlude Serial and Feature:Feature:StorageVersionAPICédric Ollivier1-12/+20
Serial asks to split the testcases into 2 runs. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console Change-Id: I58f9d9023f596141bbefae8339043f813a124854 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Blacklist all alpha testingCédric Ollivier1-11/+11
Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-22Add missing blackslashingCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-leguer-sig_apps-run/2/console Change-Id: I5cd41f2da49e59acd6bd06ded0c4e2178e7402b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_nodeCédric Ollivier1-0/+23
It runs sig-node tests which are not included in K8s conformance. It adds 38 single tests. Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_cluster_lifecycleCédric Ollivier1-0/+16
It runs sig-cluster-lifecycle tests which are not included in K8s conformance. It adds 4 single tests. Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_instrumentationCédric Ollivier1-0/+16
It runs sig-instrumentation tests which are not included in K8s conformance. It adds 6 single tests. Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_schedulingCédric Ollivier1-0/+17
It runs sig-scheduling tests which are not included in K8s conformance. It adds 19 single tests. Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_cliCédric Ollivier1-0/+16
It runs sig-cli tests which are not included in K8s conformance. It adds 34 single tests. Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-appsCédric Ollivier1-2/+21
It runs sig-apps tests which are not included in K8s conformance. Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-authCédric Ollivier1-0/+18
It runs sig-auth tests which are not included in K8s conformance. Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-api-machineryCédric Ollivier1-4/+20
It runs sig-api-machinery which are not included in K8s conformance. It adds 97 single tests. Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-11Add Cargo as build devCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/2/console Change-Id: Ic4ac415de09226d4ce2bb59a2790be5364efbf35 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-11Force legacy pip resolverCédric Ollivier1-1/+1
Change-Id: I6e3ad097333b529e4d80cbf52905e4e75cb96227 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-10Fix alpine versionCédric Ollivier1-2/+2
It also install rust as it's now a build dependency. Change-Id: I8fb11095b3fa29d40ec415c111015abd2dea2b34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-10Upgrade system firstCédric Ollivier1-1/+2
Change-Id: I0120e6a368b033f2fb47257ff9dcc3fd8a58d243 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-04Allow parameterizing K8s versionsCédric Ollivier2-15/+18
ONAP integration team asks to support all K8s versions. A couple of OPNFV releases will allow testing 2 K8s versions. Change-Id: Idb43cff0cc03cc9c17b290f7f1867e2c380c6319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-26Rename sig_network_feature -> sig_network_featuresCédric Ollivier1-10/+10
It also takes into account the last results (SCTP seems falky): https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Run rally firstCédric Ollivier1-12/+12
After all tests are based on e2e tests. Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig-storageCédric Ollivier1-0/+18
It runs the remaining sig-storage testing excluding the next labels: Conformance (part of k8s_conformance), all features, all drivers and Slow. Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig_networkCédric Ollivier1-0/+17
It runs the remaining sig-network testing excluding the next labels: Conformance (part of k8s_conformance), all features and load.balancer. Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig_network_featureCédric Ollivier1-0/+27
It verifies a couple of features by running a subset of e2e tests: Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature and Example. A couple of features may be automatically skipped like NEG and kubemci. Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-10Update cnf-conformance to v0.9.19Cédric Ollivier1-7/+11
It also adds configs needed by resilience. https://github.com/cncf/cnf-conformance/releases/tag/v0.9.19 Change-Id: I94b1efc47c5ceef96bc8879a6c71f92db1f63bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-09Switch to latest (v1.21.0-alpha.0)Cédric Ollivier1-1/+1
Change-Id: I30d7e4c8861811bf405ae79eb6d6c7bf82226dd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-11Update to latest Kubernetes releaseCédric Ollivier1-1/+1
Change-Id: Id2c05f8b425eeba1924bc2bc2688233beeb7457b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Sync with xrally_kubernetesCédric Ollivier2-37/+2
As upstream is fixed [1][2], it can partially revert - Force Kubernetes 11.0 to please xrall_kubernetes - Allow offline testing via xrally_kubernetes [1] https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090 [2] https://github.com/xrally/xrally-kubernetes/commit/8caf16cd017d475360b2345b3091a9881cd884d0 Change-Id: I43ca1966dcf61e55c45f13adf27ba5b0035d8fda Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Allow offline testing via xrally_kubernetesCédric Ollivier2-2/+36
It locally patches xrally_kubernetes before [1] is merged upstream. It adds docker.io/appropriate/curl:edge in download_images.sh too. [1] https://github.com/xrally/xrally-kubernetes/pull/51 Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com> Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Reduce cnf-conformance criteriaCédric Ollivier1-1/+1
It's considered as passed vs 95 out of 105 [1]. [1] http://artifacts.opnfv.org/functest-kubernetes/ACI2B7JDLFHI/functest-kubernetes-opnfv-functest-kubernetes-cnf-kali-cnf_conformance-run-16/functest-kubernetes.log Change-Id: Ib16927cf269784daba1085a3e97fb611e869928f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-21Update cnf_conformance to v0.9.4Cédric Ollivier2-11/+13
It removes all hacks bypassing a few former bugs (e.g. [1]) and adapts to the new cnf-conformance result output logic. It runs all workload tests as it's now proposed (k8s conformance is already part of smoke) and select the latest coredns cnf-conformance.yml taking latest helm repo changes into account. It sets criteria 95 as all steps are considered as passed and a overall result 100/105. [1] https://github.com/cncf/cnf-conformance/issues/388 Change-Id: I95b7889b21b86961e7a1d0c84b13e0ae367cae44 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-20Skip cnf_conformance till helm repos are fixedCédric Ollivier1-0/+1
Change-Id: Ie5b9aff6f56ca5cfd8501f142969f8a6246c4151 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-20Force Kubernetes 11.0 to please xrall_kubernetesCédric Ollivier1-0/+1
It will be reverted once xrally_kubernetes is ready. Change-Id: If0ad5cd018ec4edeb8c150d789df051b3f55baed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-15Publish helm_vims also based on clearwater-dockerCédric Ollivier2-9/+29
It leverages helm rather than kubectl as proposed by k8s_vims. A new abstract class Vims is added to factorize code between both testcases. Change-Id: Ie5de8d62e25e74f73f8e32167228a08e82989abd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-13Split kube-bench master and nodeCédric Ollivier1-6/+22
The former deployment asked for all-in-one. Change-Id: I12e470cec9e82b82c6f3ea5ff2431087f5deb9be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-12Improve kube_bench outputCédric Ollivier1-0/+1
It also fills self.details. Change-Id: Ie73215ebcbd34de9d457fd364de4ab9cbdf64319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-12Enhance kube-hunter result postprocessingCédric Ollivier1-0/+2
It fills self.details and checks if the test case passes according to criteria (severity = high by default) Change-Id: Ib20779b4b5dca078c65b546c8703bc99856c6f41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Decreate cnf-conformance criteriaCédric Ollivier1-1/+1
conf-confirmance is beta. Let's decrease criteria to allow gating [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/4/console Change-Id: I77068fd027b2ae042e0ff9574ed608c8a3d77ade Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>