aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-05-25Switch to focal in travis-ci gatesCédric Ollivier1-8/+1
Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Remove six from Openstack requirementsCédric Ollivier1-0/+1
Attempting uninstall: six Found existing installation: six 1.15.0 [91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall. https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445 Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Update cnf_testsuite to v0.11.2Cédric Ollivier3-33/+19
https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2 Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-10Easy creating next netperf branchesCédric Ollivier1-1/+5
Change-Id: If3de6a18b7edd811157cb093434a7128617475d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-09Publish patch for plotperfCédric Ollivier1-0/+42
Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-09Benchmark Kubernetes Networking PerformanceCédric Ollivier7-0/+92
https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-07Update test case results in READMECédric Ollivier1-14/+31
Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-07Disable cnf_testsuite in masterCédric Ollivier1-0/+1
cnf_testsuite asks for an official stable Kubernetes release during cnf setup. It doesn't work defacto for Functest K8s master (currently next v1.22). Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-05Update skip Feature listsCédric Ollivier1-1/+5
Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Fix cnf-conformance results filenameCédric Ollivier3-3/+3
It also decreases criteria to 1 due to massive changes (dockerd). Change-Id: Ic420139e6355debae183a77d6b0c574801b05076 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Update cnf-conformance to cnf-testsuiteCédric Ollivier6-30/+30
https://github.com/cncf/cnf-conformance https://github.com/cncf/cnf-testsuite Change-Id: I77983e0f04781a92b34afcf82f21366384782964 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Reduce number of threadsCédric Ollivier1-10/+10
It passed successfully with 10 threads (more doesn't reduce the overall duration so much). Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-01Update master to next 1.22Cédric Ollivier2-2/+2
Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-21Mock os.makedirsCédric Ollivier1-2/+7
Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-20Install setuptools_scm before xrallyCédric Ollivier1-0/+4
Else upper-constraints basically fails. Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)
2021-04-15Skip Network.should.set.TCP.CLOSE_WAIT.timeoutCédric Ollivier1-1/+2
https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-14Remove sig_node_serial as it's fully disruptiveCédric Ollivier2-25/+0
There is no other test when NoExecuteTaintManager is skipped. http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeatureCédric Ollivier1-2/+0
kind master allows dualstack since [1] [1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551 Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Remove [k8s.io] testingCédric Ollivier1-18/+0
v1.21 enforces sig ownership of all e2e tests [1]. [1] https://github.com/kubernetes/kubernetes/issues/98326 Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-05Switch to latest-1.21Cédric Ollivier2-4/+4
Else it would consider v1.22.0-alpha.0 (N+2). Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Update test case listCédric Ollivier1-0/+8
Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Add k8s_io and serial test casesCédric Ollivier1-6/+161
It completes the first sig test cases. Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier2-28/+4
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-03Spit conformance into 2 test casesCédric Ollivier2-0/+18
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-03Fix etcd image repository in etcd-depl.yamlCédric Ollivier1-1/+1
Change-Id: I4447b4030b141b691b3a2cdf05c97c79de9eb72a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Fix name in chronos-depl.yamlCédric Ollivier1-1/+1
Change-Id: Ia6972a216daaa9d807058b34b55615cab2c09b64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Run opnfv/functest-kubernetes-smoke sequentiallyCédric Ollivier2-0/+4
Now multithreading is enabled at test case level. Change-Id: I17a9bdb07216cd645483a0a893da502abee2ade0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Properly manage e2e parallel testingCédric Ollivier6-367/+366
It sets nodes=25 to run all tests in parallel. It also beautifies all testcases.yml Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Rather use skeleton instead of localCédric Ollivier1-1/+1
“skeleton”: cluster is accessed via the Kubernetes API and nothing else. https://kubernetes.io/blog/2019/03/22/kubernetes-end-to-end-testing-for-everyone/ Change-Id: Iea8b65b2ac55d40572c0078b7a9a956d1c54d62a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-31Disable sig_scheduling as serialCédric Ollivier2-19/+0
All remaining sig-scheduling tests are serial and for the time Functest doesn't run serial test cases. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Remove the useless Feature prefixCédric Ollivier1-1/+1
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Merge "Exlude Serial and Feature:Feature:StorageVersionAPI"Cedric Ollivier1-12/+20
2021-03-25Merge "Blacklist all alpha testing"Cedric Ollivier1-11/+11
2021-03-25Exlude Serial and Feature:Feature:StorageVersionAPICédric Ollivier1-12/+20
Serial asks to split the testcases into 2 runs. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console Change-Id: I58f9d9023f596141bbefae8339043f813a124854 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Blacklist all alpha testingCédric Ollivier1-11/+11
Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25 Provide support for air gapped env for e2eSylvain Desbureaux2-1/+42
Sometimes, tested Kubernetes doesn't have direct access to Internet but access through repository mirrors. This patch handles this case for e2e test case. Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com> Change-Id: Iaa2960ad03aae1fff859d41bcd6ddf3176658f8e
2021-03-25Provide support for air gapped env for imsSylvain Desbureaux25-66/+82
Sometimes, tested Kubernetes doesn't have direct access to Internet but access through repository mirrors. This patch handles this case for ims test cases. Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com> Change-Id: I3b5e78fcf43ca7af6bcfd2d87fa4bb0705373697
2021-03-24Provide support for air gapped env for securitySylvain Desbureaux5-5/+11
Sometimes, tested Kubernetes doesn't have direct access to Internet but access through repository mirrors. This patch handles this case for security test cases. Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com> Change-Id: I699d065ee691596c4a5ccf06c22ea76ef00fe497
2021-03-22Add missing blackslashingCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-leguer-sig_apps-run/2/console Change-Id: I5cd41f2da49e59acd6bd06ded0c4e2178e7402b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_nodeCédric Ollivier2-0/+24
It runs sig-node tests which are not included in K8s conformance. It adds 38 single tests. Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_cluster_lifecycleCédric Ollivier2-0/+17
It runs sig-cluster-lifecycle tests which are not included in K8s conformance. It adds 4 single tests. Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_instrumentationCédric Ollivier2-0/+17
It runs sig-instrumentation tests which are not included in K8s conformance. It adds 6 single tests. Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_schedulingCédric Ollivier2-0/+18
It runs sig-scheduling tests which are not included in K8s conformance. It adds 19 single tests. Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_cliCédric Ollivier2-0/+17
It runs sig-cli tests which are not included in K8s conformance. It adds 34 single tests. Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-appsCédric Ollivier2-2/+22
It runs sig-apps tests which are not included in K8s conformance. Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-authCédric Ollivier2-0/+19
It runs sig-auth tests which are not included in K8s conformance. Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-api-machineryCédric Ollivier2-4/+21
It runs sig-api-machinery which are not included in K8s conformance. It adds 97 single tests. Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-19Provide support for air gapped env for rallySylvain Desbureaux5-79/+102
Sometimes, tested Kubernetes doesn't have direct access to Internet but access through repository mirrors. This patch handles this case for rally test case. There's two ways for providing the repository mirrors: - Give an environment variable (`MIRROR_REPO`) which gives a repository mirro with all needed images. - Gives an environment variable per needed repo: - `DOCKERHUB_REPO` for DockerHub repository (`docker.io`) - `GCR_REPO` for Google Cloud repository (`gcr.io`) - `K8S_GCR_REPO` for Kubernetes repository (`k8s.gcr.io`) Needed images list has also been extracted so Kubernetes administrator can easily upload these images to the mirror if the mirror also doesn't have access to Internet. Signed-off-by: Sylvain Desbureaux <sylvain.desbureaux@orange.com> Change-Id: I2ea6622b79f7e3c3c63c1441c4dab48e9bc4fb1a
2021-03-15Fix k8s.gcr.io/etcd tag (3.4.13-0)Cédric Ollivier1-1/+1
Change-Id: Idbc520f1b196fd9d66dc57d32a543a6af7b73598 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-17nit: highlight the releaseCédric Ollivier1-8/+8
Change-Id: I09e3708d4afb477bdc767f124a778d0176f448a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>