aboutsummaryrefslogtreecommitdiffstats
path: root/docker
AgeCommit message (Collapse)AuthorFilesLines
2021-09-10Update CNF_TESTSUITE_TAG to v0.15.0Cédric Ollivier1-2/+1
Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fbd14c587ba477b7c9e3dcadabb295edbcc6ffbb)
2021-08-27Blacklist 2 features (out of Anuket)Cédric Ollivier1-0/+2
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_instrumentation-run/38/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_node-run/38/console Change-Id: Ieabfd42bdd98df9bf0c6fe3970045a07c2b9a38d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-27Skip Feature:CSIStorageCapacity in sig_storageCédric Ollivier1-0/+1
Change-Id: I701423895b3aabd51b95a8e7aff7dca15e1d5808 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c1bc5af679651f035401c32f161620763f80763e)
2021-08-26Remove sig_network_serialCédric Ollivier1-29/+2
PerformanceDNS is now optional [1] and DNS configMap nameserver makes operations on coredns which would break an living deployment [2]. sig_network_serial is now enpty and then can be safely removed. [1] https://github.com/cntt-n/CNTT/pull/2580 [2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238 Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 775135dd1ef01ab50a22846067bfdd87903f836e)
2021-08-26Remove SIG CLI testingCédric Ollivier1-33/+0
It conforms to https://github.com/cntt-n/CNTT/pull/2579 Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0a68c0cb77c6d9967e5e33e59a737ef686b2e916)
2021-07-09Skip git_repo testingCédric Ollivier1-2/+4
As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type. "we shouldn't expend resources on these volume types". [1] https://github.com/kubernetes-sigs/kind/issues/2356 [2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console Change-Id: I9951f49208376652e8d580b3086f72994424cf80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 89dfd5adb8a1e4ac8a1278e421ef7fd90847c65e)
2021-06-30Fix previous backportCédric Ollivier1-1/+1
It reverts IPv6DualStack to IPv6DualStackAlphaFeature Change-Id: If7795d6e7ec37087079b2b7b598cae607b2873bd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 573073379f57ca95a60ff6fa56ddef103810e803)
2021-06-20Make clear all skipped Features according to CNTT RA2 Chapter6Cédric Ollivier1-64/+92
Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9e025ffa82fad7a5b49663a30987dcf03bb44ca3)
2021-05-25Update cnf_testsuite to v0.11.2Cédric Ollivier1-10/+8
https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2 Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c35c6d443eb93db318c3436d995809dfe7e8389f)
2021-05-11Install libstdc++Cédric Ollivier1-1/+1
Error loading shared library libstdc++.so.6 Change-Id: Ica164f5fddabd5508200ad0017e81de041c40b22 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-11Install matplotlib as needed by netperfCédric Ollivier1-2/+8
Change-Id: I55d03dbc5a35adcbf9b88d873b3f2bb7851d0d86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-11Set --use-deprecated=legacy-resolver in pip callsCédric Ollivier1-2/+2
Change-Id: I3fbf72043b8c9145364eecfd091bba6553424b67 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-10Benchmark Kubernetes Networking PerformanceCédric Ollivier3-0/+69
https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3b5c1b115e234d636cb4f2a17d27ced872fee924)
2021-05-03Skip [Feature:Federation] in sig_network_serialCédric Ollivier1-0/+1
Change-Id: I005d6207311e661a0ce6695f24e3b91703926692 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Fix cnf-conformance results filenameCédric Ollivier2-2/+2
It also decreases criteria to 1 due to massive changes (dockerd). Change-Id: Ic420139e6355debae183a77d6b0c574801b05076 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Update cnf-conformance to cnf-testsuiteCédric Ollivier2-17/+17
https://github.com/cncf/cnf-conformance https://github.com/cncf/cnf-testsuite Change-Id: I77983e0f04781a92b34afcf82f21366384782964 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 959da00d3e1c4d406bc59995c0ea93add1ec48d3)
2021-05-03Reduce number of threadsCédric Ollivier1-11/+11
It passed successfully with 10 threads (more doesn't reduce the overall duration so much). Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-20Install setuptools_scm before xrallyCédric Ollivier1-0/+4
Else upper-constraints basically fails. Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)
2021-04-15Skip Network.should.set.TCP.CLOSE_WAIT.timeoutCédric Ollivier1-1/+2
https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 16f4a0c29fcfd1c6dc577394d9627845f559f177)
2021-04-14Remove sig_node_serial as it's fully disruptiveCédric Ollivier1-24/+0
There is no other test when NoExecuteTaintManager is skipped. http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a6dda83e6d6da08f776010a7cdebff77c3c7c2c0)
2021-04-14Skip SetHostnameAsFQDN in sig-nodeCédric Ollivier1-2/+3
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_node-run/14/console Change-Id: I55c9d3404f9bca64354a6276881a71624281a59b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-08Disable Feature:StackdriverLogging in sig_instrumentationCédric Ollivier1-2/+4
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_instrumentation-run/8/console Change-Id: I6634ec335b632ac6c7efb9b2078eb1c5f3d9be31 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-08Disable a few sig-auth featuresCédric Ollivier1-3/+5
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_auth-run/8/console Change-Id: I8a1523ba293f40dc8533428f9d75b29560a817cc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Add k8s_io and serial test casesCédric Ollivier1-6/+161
It completes the first sig test cases. Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier1-27/+4
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit adcbd42cabfa42a71410dd0c76ece0f367d338fd)
2021-04-03Spit conformance into 2 test casesCédric Ollivier1-0/+17
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a33e339a001d62352e15a3cc1546bb4d4d482e59)
2021-04-02Properly manage e2e parallel testingCédric Ollivier5-362/+359
It sets nodes=25 to run all tests in parallel. It also beautifies all testcases.yml Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4004d776b01a1b038df52ca45b18430da1b6b1f5)
2021-03-31Disable sig_scheduling as serialCédric Ollivier1-18/+0
All remaining sig-scheduling tests are serial and for the time Functest doesn't run serial test cases. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f28b4673a7b89f124d225e629f0c5267e6008c14)
2021-03-26Remove the useless Feature prefixCédric Ollivier1-1/+1
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-26Exlude Serial and Feature:Feature:StorageVersionAPICédric Ollivier1-12/+20
Serial asks to split the testcases into 2 runs. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console Change-Id: I58f9d9023f596141bbefae8339043f813a124854 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-26Blacklist all alpha testingCédric Ollivier1-11/+11
Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-26Leverage py3-setuptools_scm as proposed by AlpineCédric Ollivier1-1/+1
Last version setuptools-scm asks for very new setuptools. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-xrally_kubernetes-run/194/console Change-Id: Ib1f4b4b49c036e0018fd695b52013bccdaf4998f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-22Add missing blackslashingCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-leguer-sig_apps-run/2/console Change-Id: I5cd41f2da49e59acd6bd06ded0c4e2178e7402b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0b79c61af319c6f3beddf79e586e51e4675f3fc1)
2021-03-21Add sig_nodeCédric Ollivier1-0/+23
It runs sig-node tests which are not included in K8s conformance. It adds 38 single tests. Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 56da8a0382889fa0558da48375d2319bfedd39a4)
2021-03-21Add sig_cluster_lifecycleCédric Ollivier1-0/+16
It runs sig-cluster-lifecycle tests which are not included in K8s conformance. It adds 4 single tests. Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f3d390ddba5021ce45dd763e2bf953994a487337)
2021-03-21Add sig_instrumentationCédric Ollivier1-0/+16
It runs sig-instrumentation tests which are not included in K8s conformance. It adds 6 single tests. Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 39511d8576f49b578882757fcc1e33a4bb2c9832)
2021-03-21Add sig_schedulingCédric Ollivier1-0/+17
It runs sig-scheduling tests which are not included in K8s conformance. It adds 19 single tests. Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8bfdc8569b9eaffb96562e7753423d3ded218ed4)
2021-03-21Add sig_cliCédric Ollivier1-0/+16
It runs sig-cli tests which are not included in K8s conformance. It adds 34 single tests. Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6eaf848638d7a1a7b4c4324837da9b8562ec7136)
2021-03-21Add sig-appsCédric Ollivier1-2/+21
It runs sig-apps tests which are not included in K8s conformance. Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 985b7955d065065d191702f1355d7ca114f0c827)
2021-03-21Add sig-authCédric Ollivier1-0/+18
It runs sig-auth tests which are not included in K8s conformance. Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b5c7bc0107a443722004ecced91118042965f327)
2021-03-21Add sig-api-machineryCédric Ollivier1-4/+20
It runs sig-api-machinery which are not included in K8s conformance. It adds 97 single tests. Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9c08bb471502b80df2470e577376f25400913939)
2021-02-19Rename sig_network_feature -> sig_network_featuresCédric Ollivier1-10/+10
It also takes into account the last results (SCTP seems falky): https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 08558d2f47f7400176ad678ceaaff1b5be0b931c) (cherry picked from commit dcb442250783d97b2bbfc6e5671a18cc90106792)
2021-02-19Run rally firstCédric Ollivier1-12/+12
After all tests are based on e2e tests. Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9e132759f6186672dd23dd31fac511bec128d386)
2021-02-19Add sig-storageCédric Ollivier1-0/+18
It runs the remaining sig-storage testing excluding the next labels: Conformance (part of k8s_conformance), all features, all drivers and Slow. Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8e6f69afa84ae428a013debcc7329be26a475695)
2021-02-19Add sig_networkCédric Ollivier1-0/+17
It runs the remaining sig-network testing excluding the next labels: Conformance (part of k8s_conformance), all features and load.balancer. Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 80f0edf3194493620d1cfab79efbcdc8a136d799)
2021-02-19Add sig_network_featureCédric Ollivier1-0/+27
It verifies a couple of features by running a subset of e2e tests: Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature and Example. A couple of features may be automatically skipped like NEG and kubemci. Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0d151ccaf4b267682feec0d38e8b7de3eb3d61c)
2021-02-10Upgrade system firstCédric Ollivier1-1/+2
Change-Id: I0120e6a368b033f2fb47257ff9dcc3fd8a58d243 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9ebe47c8458c99066fd71a65007fff923004d209)
2021-02-04Allow parameterizing K8s versionsCédric Ollivier2-15/+18
ONAP integration team asks to support all K8s versions. A couple of OPNFV releases will allow testing 2 K8s versions. Change-Id: Idb43cff0cc03cc9c17b290f7f1867e2c380c6319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0163bb977604a32a0c46e10a97313ce0feea7b5f)
2021-01-10Update cnf-conformance to v0.9.19Cédric Ollivier1-7/+11
It also adds configs needed by resilience. https://github.com/cncf/cnf-conformance/releases/tag/v0.9.19 Change-Id: I94b1efc47c5ceef96bc8879a6c71f92db1f63bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7385caf54c27b471bda8599d491aa3aee21b7b89)
2020-11-22Allow offline testing via xrally_kubernetesCédric Ollivier2-2/+35
It locally patches xrally_kubernetes before [1] is merged upstream. It adds docker.io/appropriate/curl:edge in download_images.sh too. [1] https://github.com/xrally/xrally-kubernetes/pull/51 Co-Authored-By: Tamas Lendvay <tamas.lendvay@nokia.com> Change-Id: I82ea2c777cd4d8f24c38dbf32d66081846e3e9af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ea2715240015a482c5321d309257d801a412f02d)