aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-05-19Skip Feature:ProxyTerminatingEndpointsCédric Ollivier1-0/+1
It's a new v1.24 feature testing which must be set as mandatory in Anuket if relevant. Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-05-19Revert latest docker buildsCédric Ollivier6-8/+8
This reverts commit b2be1ff2852320940a1450ed5f2a6f4f4e91d7da. Change-Id: If2852d6e85e11872fd0f2839445de014427dc535 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-05-18Install libxml2 and libxsltCédric Ollivier1-3/+4
Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e755e4cad01074086d53893f40b57ed2cbf5dd14)
2022-05-18Prepare v1.24 docker buildsCédric Ollivier6-8/+8
Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-03-04Leverage Xtesting 0.96Cédric Ollivier6-7/+7
Change-Id: I6235342d4d53a688b960698b30332824cd372551 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-11Outdated need to install python2.7-dev in CircleCICédric Ollivier1-3/+0
Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-04Remove constraints on flake8Cédric Ollivier1-1/+1
Change-Id: I23142c207c50eca24ad075a838f44d00293989b5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-04Update active releases in README.mdCédric Ollivier1-4/+3
Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-03Skip new Feature testingCédric Ollivier1-0/+3
It skips new features which have not been selected yet by Anuket: - [Feature:CustomResourceValidationExpressions] - [Feature:StatefulSetAutoDeletePVC] - [Feature:GRPCContainerProbe] Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-15Update linters and fix all new issuesCédric Ollivier6-43/+35
It mostly adds encoding in open calls and leverages f-strings. It removes ansible-lint as it now asks for ansible, roles and collections. Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-10-05Set defaut provider to local backCédric Ollivier1-2/+3
It apply the same rules as sonuoboy. Any user is free to set skeleton or something else via testcases.yml. Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-09-11Set encoding utf-8 when opening fileCédric Ollivier5-9/+16
Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-09-10Fallback to item calculationCédric Ollivier1-0/+8
There is no final result if simple tag is called. Change-Id: If86c5115e917e5790799fac4308cf08d57e87905 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-09-10Update CNF_TESTSUITE_TAG to v0.15.0Cédric Ollivier1-2/+1
Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-26Remove sig_network_serialCédric Ollivier5-35/+2
PerformanceDNS is now optional [1] and DNS configMap nameserver makes operations on coredns which would break an living deployment [2]. sig_network_serial is now enpty and then can be safely removed. [1] https://github.com/cntt-n/CNTT/pull/2580 [2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238 Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-26Remove SIG CLI testingCédric Ollivier4-37/+16
It conforms to https://github.com/cntt-n/CNTT/pull/2579 Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-20Swith to v1.23 alphasCédric Ollivier2-5/+2
Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-19Fix py site-package pathCédric Ollivier1-1/+1
Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-18Update to Alpine 3.14Cédric Ollivier16-42/+44
It also disabled wrong order check as it fails vs kubernetes amongst others. [1] https://github.com/PyCQA/pylint/issues/2175 Change-Id: I3d641c213067428848212a148d25d78051c5674f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-07-09Skip git_repo testingCédric Ollivier1-2/+4
As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type. "we shouldn't expend resources on these volume types". [1] https://github.com/kubernetes-sigs/kind/issues/2356 [2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console Change-Id: I9951f49208376652e8d580b3086f72994424cf80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-07-07Print cnf_testsuite console on exceptionsCédric Ollivier1-0/+4
Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-25Remove k8s.io from ansible/site.ymlCédric Ollivier2-1/+17
It's now up-to-date. It also fixes ansible/site.cntt.yml Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-20Make clear all skipped Features according to CNTT RA2 Chapter6Cédric Ollivier1-61/+91
Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-20Allow passing extra opts to e2e.testCédric Ollivier1-0/+12
E2E_TEST_OPTS now allows setting runtime opts. For instance, Functest K8s gates ask for -container-runtime containerd Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-10Remove distlib from constraintsCédric Ollivier1-0/+1
Else it fails when uninstalling distlib. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-26Add enchant in travis-ciCédric Ollivier1-0/+1
Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Switch to focal in travis-ci gatesCédric Ollivier1-8/+1
Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Remove six from Openstack requirementsCédric Ollivier1-0/+1
Attempting uninstall: six Found existing installation: six 1.15.0 [91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall. https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445 Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Update cnf_testsuite to v0.11.2Cédric Ollivier3-33/+19
https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2 Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-10Easy creating next netperf branchesCédric Ollivier1-1/+5
Change-Id: If3de6a18b7edd811157cb093434a7128617475d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-09Publish patch for plotperfCédric Ollivier1-0/+42
Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-09Benchmark Kubernetes Networking PerformanceCédric Ollivier7-0/+92
https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-07Update test case results in READMECédric Ollivier1-14/+31
Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-07Disable cnf_testsuite in masterCédric Ollivier1-0/+1
cnf_testsuite asks for an official stable Kubernetes release during cnf setup. It doesn't work defacto for Functest K8s master (currently next v1.22). Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-05Update skip Feature listsCédric Ollivier1-1/+5
Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Fix cnf-conformance results filenameCédric Ollivier3-3/+3
It also decreases criteria to 1 due to massive changes (dockerd). Change-Id: Ic420139e6355debae183a77d6b0c574801b05076 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Update cnf-conformance to cnf-testsuiteCédric Ollivier6-30/+30
https://github.com/cncf/cnf-conformance https://github.com/cncf/cnf-testsuite Change-Id: I77983e0f04781a92b34afcf82f21366384782964 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Reduce number of threadsCédric Ollivier1-10/+10
It passed successfully with 10 threads (more doesn't reduce the overall duration so much). Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-01Update master to next 1.22Cédric Ollivier2-2/+2
Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-21Mock os.makedirsCédric Ollivier1-2/+7
Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-20Install setuptools_scm before xrallyCédric Ollivier1-0/+4
Else upper-constraints basically fails. Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)
2021-04-15Skip Network.should.set.TCP.CLOSE_WAIT.timeoutCédric Ollivier1-1/+2
https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-14Remove sig_node_serial as it's fully disruptiveCédric Ollivier2-25/+0
There is no other test when NoExecuteTaintManager is skipped. http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeatureCédric Ollivier1-2/+0
kind master allows dualstack since [1] [1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551 Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Remove [k8s.io] testingCédric Ollivier1-18/+0
v1.21 enforces sig ownership of all e2e tests [1]. [1] https://github.com/kubernetes/kubernetes/issues/98326 Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-05Switch to latest-1.21Cédric Ollivier2-4/+4
Else it would consider v1.22.0-alpha.0 (N+2). Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Update test case listCédric Ollivier1-0/+8
Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Add k8s_io and serial test casesCédric Ollivier1-6/+161
It completes the first sig test cases. Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier2-28/+4
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-03Spit conformance into 2 test casesCédric Ollivier2-0/+18
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>