aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-01-11Outdated need to install python2.7-dev in CircleCICédric Ollivier1-3/+0
Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bdc882d05a70ec60fa6a4c9f8122ec29cae3f407)
2021-10-05Set defaut provider to local backCédric Ollivier1-2/+3
It apply the same rules as sonuoboy. Any user is free to set skeleton or something else via testcases.yml. Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b100b1254e06719bf1c779b9d53d0ac2da67fca4)
2021-09-11Set encoding utf-8 when opening fileCédric Ollivier5-9/+16
Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5a565816e30dcb5aefb2feb33acce7ef7a457cc0)
2021-09-10Fallback to item calculationCédric Ollivier1-0/+8
There is no final result if simple tag is called. Change-Id: If86c5115e917e5790799fac4308cf08d57e87905 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e2f255aaaddeb0b7bebd7a158b535aa0ecdf55e0)
2021-09-10Update CNF_TESTSUITE_TAG to v0.15.0Cédric Ollivier1-2/+1
Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fbd14c587ba477b7c9e3dcadabb295edbcc6ffbb)
2021-08-26Remove sig_network_serialCédric Ollivier5-35/+2
PerformanceDNS is now optional [1] and DNS configMap nameserver makes operations on coredns which would break an living deployment [2]. sig_network_serial is now enpty and then can be safely removed. [1] https://github.com/cntt-n/CNTT/pull/2580 [2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238 Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 775135dd1ef01ab50a22846067bfdd87903f836e)
2021-08-26Remove SIG CLI testingCédric Ollivier4-37/+16
It conforms to https://github.com/cntt-n/CNTT/pull/2579 Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0a68c0cb77c6d9967e5e33e59a737ef686b2e916)
2021-08-20Update v1.22's READMECédric Ollivier1-5/+6
Change-Id: I512dcd8d641c9b6d63071fde1485fe9080f172bb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-20Take v1.22 into accountCédric Ollivier11-54/+60
Change-Id: Iec601131e41bf3e9c6c5b2e381dc9089d545bca8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-20Set defaultbranch in .gitreviewCédric Ollivier1-0/+1
Change-Id: Iddee2418b3bbc526f20891b810fdae20d6320851 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-19Fix py site-package pathCédric Ollivier1-1/+1
Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-18Update to Alpine 3.14Cédric Ollivier16-42/+44
It also disabled wrong order check as it fails vs kubernetes amongst others. [1] https://github.com/PyCQA/pylint/issues/2175 Change-Id: I3d641c213067428848212a148d25d78051c5674f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-07-09Skip git_repo testingCédric Ollivier1-2/+4
As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type. "we shouldn't expend resources on these volume types". [1] https://github.com/kubernetes-sigs/kind/issues/2356 [2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console Change-Id: I9951f49208376652e8d580b3086f72994424cf80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-07-07Print cnf_testsuite console on exceptionsCédric Ollivier1-0/+4
Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-25Remove k8s.io from ansible/site.ymlCédric Ollivier2-1/+17
It's now up-to-date. It also fixes ansible/site.cntt.yml Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-20Make clear all skipped Features according to CNTT RA2 Chapter6Cédric Ollivier1-61/+91
Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-20Allow passing extra opts to e2e.testCédric Ollivier1-0/+12
E2E_TEST_OPTS now allows setting runtime opts. For instance, Functest K8s gates ask for -container-runtime containerd Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-10Remove distlib from constraintsCédric Ollivier1-0/+1
Else it fails when uninstalling distlib. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-26Add enchant in travis-ciCédric Ollivier1-0/+1
Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Switch to focal in travis-ci gatesCédric Ollivier1-8/+1
Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Remove six from Openstack requirementsCédric Ollivier1-0/+1
Attempting uninstall: six Found existing installation: six 1.15.0 [91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall. https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445 Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Update cnf_testsuite to v0.11.2Cédric Ollivier3-33/+19
https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2 Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-10Easy creating next netperf branchesCédric Ollivier1-1/+5
Change-Id: If3de6a18b7edd811157cb093434a7128617475d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-09Publish patch for plotperfCédric Ollivier1-0/+42
Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-09Benchmark Kubernetes Networking PerformanceCédric Ollivier7-0/+92
https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-07Update test case results in READMECédric Ollivier1-14/+31
Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-07Disable cnf_testsuite in masterCédric Ollivier1-0/+1
cnf_testsuite asks for an official stable Kubernetes release during cnf setup. It doesn't work defacto for Functest K8s master (currently next v1.22). Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-05Update skip Feature listsCédric Ollivier1-1/+5
Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Fix cnf-conformance results filenameCédric Ollivier3-3/+3
It also decreases criteria to 1 due to massive changes (dockerd). Change-Id: Ic420139e6355debae183a77d6b0c574801b05076 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Update cnf-conformance to cnf-testsuiteCédric Ollivier6-30/+30
https://github.com/cncf/cnf-conformance https://github.com/cncf/cnf-testsuite Change-Id: I77983e0f04781a92b34afcf82f21366384782964 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Reduce number of threadsCédric Ollivier1-10/+10
It passed successfully with 10 threads (more doesn't reduce the overall duration so much). Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-01Update master to next 1.22Cédric Ollivier2-2/+2
Change-Id: I29a514bc1e510858f33b7babbc5ac64373517ab1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-21Mock os.makedirsCédric Ollivier1-2/+7
Change-Id: I5f9fd24421727cea474715f502670ae6f2c80b76 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-20Install setuptools_scm before xrallyCédric Ollivier1-0/+4
Else upper-constraints basically fails. Change-Id: I022f101e2ed44708afd0b88d47b77d2f7ca85458 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 75170fc0b528c7e182b8164d5905fcbaa6957faa)
2021-04-15Skip Network.should.set.TCP.CLOSE_WAIT.timeoutCédric Ollivier1-1/+2
https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-14Remove sig_node_serial as it's fully disruptiveCédric Ollivier2-25/+0
There is no other test when NoExecuteTaintManager is skipped. http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeatureCédric Ollivier1-2/+0
kind master allows dualstack since [1] [1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551 Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Remove [k8s.io] testingCédric Ollivier1-18/+0
v1.21 enforces sig ownership of all e2e tests [1]. [1] https://github.com/kubernetes/kubernetes/issues/98326 Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-05Switch to latest-1.21Cédric Ollivier2-4/+4
Else it would consider v1.22.0-alpha.0 (N+2). Change-Id: Ie98418fc7068beb338a057af8ce8e092150cb696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Update test case listCédric Ollivier1-0/+8
Change-Id: Ide5fdd5967ce11847f9672259b79b6068c228848 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Add k8s_io and serial test casesCédric Ollivier1-6/+161
It completes the first sig test cases. Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier2-28/+4
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-03Spit conformance into 2 test casesCédric Ollivier2-0/+18
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-03Fix etcd image repository in etcd-depl.yamlCédric Ollivier1-1/+1
Change-Id: I4447b4030b141b691b3a2cdf05c97c79de9eb72a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Fix name in chronos-depl.yamlCédric Ollivier1-1/+1
Change-Id: Ia6972a216daaa9d807058b34b55615cab2c09b64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Run opnfv/functest-kubernetes-smoke sequentiallyCédric Ollivier2-0/+4
Now multithreading is enabled at test case level. Change-Id: I17a9bdb07216cd645483a0a893da502abee2ade0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Properly manage e2e parallel testingCédric Ollivier6-367/+366
It sets nodes=25 to run all tests in parallel. It also beautifies all testcases.yml Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Rather use skeleton instead of localCédric Ollivier1-1/+1
“skeleton”: cluster is accessed via the Kubernetes API and nothing else. https://kubernetes.io/blog/2019/03/22/kubernetes-end-to-end-testing-for-everyone/ Change-Id: Iea8b65b2ac55d40572c0078b7a9a956d1c54d62a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-31Disable sig_scheduling as serialCédric Ollivier2-19/+0
All remaining sig-scheduling tests are serial and for the time Functest doesn't run serial test cases. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Remove the useless Feature prefixCédric Ollivier1-1/+1
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>