aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2022-10-17cnf conformance now returns non zero valuesCédric Ollivier1-10/+5
Change-Id: I61cb69ef48b113571f791c7ee2ef7387c7421f32 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f0ebad3e5b23350483929a2a881f89d0f2822f5e)
2022-10-17Use cnf certifaction criteriaCédric Ollivier2-5/+7
Change-Id: I7362827b600914ab032ba9657ac17e7bb157bdfc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-10-17Update cnf_testsuite v0.34.0Cédric Ollivier2-5/+6
It now runs cert (replacing workload) It downgrades msg to warning as cnf_testsuite now returns non 0 values. Change-Id: I0ce4f201065bf601111d7154cb4afa31e9a4666c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4338a2532600e659179335a5f5f71ab15f83f8d7)
2022-10-14By default just print all vulnerabilitiesCédric Ollivier2-12/+5
It's the behavior expected by RA2. Please change it via testcases.yaml if needed. Change-Id: I84b02fa273f63ea1930bd356739243756032533d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cf40e38be4d85c235a9d85a15f7fa326ebf356e6)
2022-10-10Uninstall falco and cri_tools after testingCédric Ollivier1-4/+6
Functest runs several clusters in the same server. It quickly failes if falco is still running (dkms tries to unload the module which is in-use). Change-Id: I13b596a78ac40064cbed1aead8c785cc1cfc8626 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 334cdea22b2c47c75523399ed3ebfa08f105e57c)
2022-10-06Pin netperf toolsCédric Ollivier1-2/+2
Change-Id: I36dde21d9af2cc7d96be4a8f0947d94491ae00c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-10-06Update kube bench test cases to latest devCédric Ollivier4-8/+121
Change-Id: I6edcfcced84d46a06933f4a5dc1702cfa90e3f9a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-10-06Update hube-hunterCédric Ollivier1-2/+2
Change-Id: I41e9a4a95a53bf51286951db2911475a8d2dd3a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 06eb071ee719c015f696ed6c0a685926a8a0ae62)
2022-09-30Complete Alpine 3.15 updateCédric Ollivier1-1/+1
Change-Id: I7cd5c8b22634af52d494b8a8d1eedb158f42d288 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9cb9e74a1bfd1a185ac72e409851e6d951c6ac82)
2022-09-30Fix tags in build.shCédric Ollivier1-33/+33
Change-Id: I06ae108a154560d8a2cc31c4a648a699606a634d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-09-30Don't Replace -noColor by --no-color in v1.24Cédric Ollivier1-1/+1
Change-Id: I565c6e6c2eb4ccc44dc374e9afd5375f0bceb9fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-09-30Replace -noColor by --no-colorCédric Ollivier1-1/+1
--noColor is deprecated, use --no-color instead Learn more at: https://onsi.github.io/ginkgo/MIGRATING_TO_V2#changed-command-line-flags Change-Id: I31d17fda3138a59bba65c1ad8155c07d6b05a828 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b56474a4e5e5c60eb318d9605c6042158535ef8d)
2022-09-30Get the right K8s e2e versionCédric Ollivier2-2/+4
Change-Id: I4eaba8b410061e4d401319a020770d78b6990a85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-05-19Skip Feature:ProxyTerminatingEndpointsCédric Ollivier1-0/+1
It's a new v1.24 feature testing which must be set as mandatory in Anuket if relevant. Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7d1b01dafdfcd65bea716b61a6036a972dcf395b)
2022-05-19Update gitreviewCédric Ollivier1-0/+1
Change-Id: Ie09d962d6b65e93289635ff48319c2af0157959a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-05-18Install libxml2 and libxsltCédric Ollivier1-3/+4
Change-Id: Ie827d9fbb3a6c20a30b921b197bcbcb6666ced4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e755e4cad01074086d53893f40b57ed2cbf5dd14)
2022-05-18Prepare v1.24 docker buildsCédric Ollivier6-8/+8
Change-Id: I8dc1e279eeb3b5c6045499b8b2fb3c1a5d62920d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-03-04Leverage Xtesting 0.96Cédric Ollivier6-7/+7
Change-Id: I6235342d4d53a688b960698b30332824cd372551 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-11Outdated need to install python2.7-dev in CircleCICédric Ollivier1-3/+0
Change-Id: I6e25c16659f4a5653afbf9ed66d809cb638bce65 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-04Remove constraints on flake8Cédric Ollivier1-1/+1
Change-Id: I23142c207c50eca24ad075a838f44d00293989b5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-04Update active releases in README.mdCédric Ollivier1-4/+3
Change-Id: I5fd9486f49ef8bbca568fd539ae2cbe39e33e7f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-03Skip new Feature testingCédric Ollivier1-0/+3
It skips new features which have not been selected yet by Anuket: - [Feature:CustomResourceValidationExpressions] - [Feature:StatefulSetAutoDeletePVC] - [Feature:GRPCContainerProbe] Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-15Update linters and fix all new issuesCédric Ollivier6-43/+35
It mostly adds encoding in open calls and leverages f-strings. It removes ansible-lint as it now asks for ansible, roles and collections. Change-Id: I3ef729f44b2c721b14d19df27805938298aa2c67 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-10-05Set defaut provider to local backCédric Ollivier1-2/+3
It apply the same rules as sonuoboy. Any user is free to set skeleton or something else via testcases.yml. Change-Id: Id999dfd5fbcf9bde9430e0f35c63c41e80c8044f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-09-11Set encoding utf-8 when opening fileCédric Ollivier5-9/+16
Change-Id: I4e756552173247499ba882bfee4fbe8738fbae3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-09-10Fallback to item calculationCédric Ollivier1-0/+8
There is no final result if simple tag is called. Change-Id: If86c5115e917e5790799fac4308cf08d57e87905 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-09-10Update CNF_TESTSUITE_TAG to v0.15.0Cédric Ollivier1-2/+1
Change-Id: Icf13d49ec3c4fd65b0d089714728d67813633e49 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-26Remove sig_network_serialCédric Ollivier5-35/+2
PerformanceDNS is now optional [1] and DNS configMap nameserver makes operations on coredns which would break an living deployment [2]. sig_network_serial is now enpty and then can be safely removed. [1] https://github.com/cntt-n/CNTT/pull/2580 [2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238 Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-26Remove SIG CLI testingCédric Ollivier4-37/+16
It conforms to https://github.com/cntt-n/CNTT/pull/2579 Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-20Swith to v1.23 alphasCédric Ollivier2-5/+2
Change-Id: I226ff09b0a4ca8082736f4d695e67154940ce249 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-19Fix py site-package pathCédric Ollivier1-1/+1
Change-Id: Iab3ece39fa8cf1c5e0f62100e14b9fa2f5e3298a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-18Update to Alpine 3.14Cédric Ollivier16-42/+44
It also disabled wrong order check as it fails vs kubernetes amongst others. [1] https://github.com/PyCQA/pylint/issues/2175 Change-Id: I3d641c213067428848212a148d25d78051c5674f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-07-09Skip git_repo testingCédric Ollivier1-2/+4
As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type. "we shouldn't expend resources on these volume types". [1] https://github.com/kubernetes-sigs/kind/issues/2356 [2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console Change-Id: I9951f49208376652e8d580b3086f72994424cf80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-07-07Print cnf_testsuite console on exceptionsCédric Ollivier1-0/+4
Change-Id: I3c20993e1cbb644546ac89a8b4b7d1cfd98b0a80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-25Remove k8s.io from ansible/site.ymlCédric Ollivier2-1/+17
It's now up-to-date. It also fixes ansible/site.cntt.yml Change-Id: I2e3ad76f4b0f0064b8ce75ed6718eff6466c649f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-20Make clear all skipped Features according to CNTT RA2 Chapter6Cédric Ollivier1-61/+91
Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-20Allow passing extra opts to e2e.testCédric Ollivier1-0/+12
E2E_TEST_OPTS now allows setting runtime opts. For instance, Functest K8s gates ask for -container-runtime containerd Change-Id: I4f6e1caf57590b16d0c01324dadb040f67f3cee4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-10Remove distlib from constraintsCédric Ollivier1-0/+1
Else it fails when uninstalling distlib. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-latest-build/48/console Change-Id: I2e3a3f91c74182e9567f691117ca8754ae2583b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-26Add enchant in travis-ciCédric Ollivier1-0/+1
Change-Id: I96c59f943ee58dec60b3a9376673c5a69c66747f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Switch to focal in travis-ci gatesCédric Ollivier1-8/+1
Change-Id: Ifcd3f1df7116dc665bf8d3316ce2bc03e2db8c5d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Remove six from Openstack requirementsCédric Ollivier1-0/+1
Attempting uninstall: six Found existing installation: six 1.15.0 [91mERROR: Cannot uninstall 'six'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall. https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L445 Change-Id: Iaefff9653ea9d3ac06b881328c545367a9a02244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-25Update cnf_testsuite to v0.11.2Cédric Ollivier3-33/+19
https://github.com/cncf/cnf-testsuite/releases/tag/v0.11.2 Change-Id: Id3a5ea98260859f7fe5aba6ecf02d09905610dda Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-10Easy creating next netperf branchesCédric Ollivier1-1/+5
Change-Id: If3de6a18b7edd811157cb093434a7128617475d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-09Publish patch for plotperfCédric Ollivier1-0/+42
Change-Id: I34ff9f121fa52667a62b33f596639d6f9bff1650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-09Benchmark Kubernetes Networking PerformanceCédric Ollivier7-0/+92
https://github.com/kubernetes/perf-tests/tree/master/network/benchmarks/netperf Change-Id: I6facd567f1c52c5949b53484a1fb107dcf34d622 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-07Update test case results in READMECédric Ollivier1-14/+31
Change-Id: Ifbcb56c690dde66d35ef772a2c680c60354a58ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-07Disable cnf_testsuite in masterCédric Ollivier1-0/+1
cnf_testsuite asks for an official stable Kubernetes release during cnf setup. It doesn't work defacto for Functest K8s master (currently next v1.22). Change-Id: I7d81e069f0a5539cd027ffed80fa3c9d3b32bd21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-05Update skip Feature listsCédric Ollivier1-1/+5
Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Fix cnf-conformance results filenameCédric Ollivier3-3/+3
It also decreases criteria to 1 due to massive changes (dockerd). Change-Id: Ic420139e6355debae183a77d6b0c574801b05076 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Update cnf-conformance to cnf-testsuiteCédric Ollivier6-30/+30
https://github.com/cncf/cnf-conformance https://github.com/cncf/cnf-testsuite Change-Id: I77983e0f04781a92b34afcf82f21366384782964 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>