aboutsummaryrefslogtreecommitdiffstats
path: root/docker/smoke/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2023-12-18Reduce regex < 80 charsCédric Ollivier1-2/+2
Change-Id: I3f28b02188aff54fffe19f3652d3881270a3eb4b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 052eaad0ec0395723a7f2d8fd2d59751785f2276)
2023-12-18Skip OpenAPIV3 [It] should contain OpenAPI V3 for Aggregated APIServerCédric Ollivier1-2/+4
https://github.com/kubernetes/kubernetes/commit/bf41b0462ccd9c0ecc97a9f64fd499e2d4284f85 Change-Id: I229288b3fe58ade2e089b3c443ef93289e8978f6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 75da28c8e451155761f3a7552e12cf9b62b1750d)
2023-12-18Disable [Feature:APISelfSubjectReview] testingCédric Ollivier1-1/+2
https://github.com/kubernetes/kubernetes/commit/7c5573d326d10e81f69da38c1238e22bb6d056c8 STEP: creating SSR authentication/v1alpha1 @ 12/17/23 23:46:55.031 Dec 17 23:46:55.034: INFO: Unexpected error: <*errors.StatusError | 0xc00581a140>: the server could not find the requested resource { ErrStatus: code: 404 details: {} message: the server could not find the requested resource metadata: {} reason: NotFound status: Failure, } [FAILED] in [It] - tes Change-Id: If70773712d1dababf2b07ed8aaca12bb43947c3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2023-12-18Skip should perform canary updates ...Cédric Ollivier1-2/+4
https://github.com/kubernetes/kubernetes/issues/119685 https://github.com/kubernetes/kubernetes/pull/120731/commits/00c21ced3abba18d93b38f7232a353b6b28d8eae Change-Id: I98dcbfbc5d4f0250c899cc6ee6b1f8d52a3240aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2023-12-15Skip RecoverVolumeExpansionFailure testsCédric Ollivier1-1/+4
RecoverVolumeExpansionFailure false Alpha 1.23 https://kubernetes.io/docs/reference/command-line-tools-reference/feature-gates/ Change-Id: I3d7786ff37929dc4ff6ddd82901571dbb873491a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cffe5d332db5d5dc6b1bdc6e628159eb809f5ff2)
2023-12-15Skip SELinux tests by defaultCédric Ollivier1-0/+1
https://github.com/kubernetes-csi/csi-release-tools/pull/208/commits/36e433e2aaaaf96b3257812cecd9bc55a1f71999 Change-Id: I80293c3a4456979970b88ab7cb8dca36f6a6b5fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f86bb8ff598b4838215e990a52a19d63ec3b317f)
2023-12-15Skip all In-place Resource Resize for Kubernetes Pods testsCédric Ollivier1-0/+1
It's alpha in v1.27. https://kubernetes.io/blog/2023/05/12/in-place-pod-resize-alpha/ Change-Id: Iee818623425100dfa40e2198082d29069520c80c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2023-12-15Skip all Feature:DynamicResourceAllocation testsCédric Ollivier1-0/+1
It's alpha in v1.26 and v1.27. https://kubernetes.io/docs/concepts/scheduling-eviction/dynamic-resource-allocation/ Change-Id: I0216241d3e08a828ca92f0c21ed4c1439d09a8c8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a084ca0dd8fe33f16c65f12fda5a5f6fd4683ee1)
2022-10-04Disable new testing Feature UserNamespacesStatelessPodsSupportCédric Ollivier1-0/+1
All new features are defacto optional until RA2 changes its status. Change-Id: I23456ec525c728719cd01533122d6c79c2617631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-05-19Skip Feature:ProxyTerminatingEndpointsCédric Ollivier1-0/+1
It's a new v1.24 feature testing which must be set as mandatory in Anuket if relevant. Change-Id: I6d8aff5ad35e1c08da300dd8b3de2ac9792d5068 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-01-03Skip new Feature testingCédric Ollivier1-0/+3
It skips new features which have not been selected yet by Anuket: - [Feature:CustomResourceValidationExpressions] - [Feature:StatefulSetAutoDeletePVC] - [Feature:GRPCContainerProbe] Change-Id: I36d4f29e3ee7046e08a20244d7bbe0f3271bfbdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-26Remove sig_network_serialCédric Ollivier1-29/+2
PerformanceDNS is now optional [1] and DNS configMap nameserver makes operations on coredns which would break an living deployment [2]. sig_network_serial is now enpty and then can be safely removed. [1] https://github.com/cntt-n/CNTT/pull/2580 [2] https://github.com/kubernetes/kubernetes/blob/c262d09bb7d22d62665aa215b5c6d1dd2a865007/test/e2e/network/dns_common.go#L238 Change-Id: I525cf894699a1d56f0b3cbb8e630d40ea3549b51 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-26Remove SIG CLI testingCédric Ollivier1-33/+0
It conforms to https://github.com/cntt-n/CNTT/pull/2579 Change-Id: Ic5d6e6914fc34e8a5de9403c1b72ad251d97d759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-07-09Skip git_repo testingCédric Ollivier1-2/+4
As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type. "we shouldn't expend resources on these volume types". [1] https://github.com/kubernetes-sigs/kind/issues/2356 [2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console Change-Id: I9951f49208376652e8d580b3086f72994424cf80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-20Make clear all skipped Features according to CNTT RA2 Chapter6Cédric Ollivier1-61/+91
Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-05Update skip Feature listsCédric Ollivier1-1/+5
Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Reduce number of threadsCédric Ollivier1-10/+10
It passed successfully with 10 threads (more doesn't reduce the overall duration so much). Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-15Skip Network.should.set.TCP.CLOSE_WAIT.timeoutCédric Ollivier1-1/+2
https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-14Remove sig_node_serial as it's fully disruptiveCédric Ollivier1-24/+0
There is no other test when NoExecuteTaintManager is skipped. http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeatureCédric Ollivier1-2/+0
kind master allows dualstack since [1] [1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551 Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Remove [k8s.io] testingCédric Ollivier1-18/+0
v1.21 enforces sig ownership of all e2e tests [1]. [1] https://github.com/kubernetes/kubernetes/issues/98326 Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Add k8s_io and serial test casesCédric Ollivier1-6/+161
It completes the first sig test cases. Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier1-27/+4
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-03Spit conformance into 2 test casesCédric Ollivier1-0/+17
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Properly manage e2e parallel testingCédric Ollivier1-225/+233
It sets nodes=25 to run all tests in parallel. It also beautifies all testcases.yml Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-31Disable sig_scheduling as serialCédric Ollivier1-18/+0
All remaining sig-scheduling tests are serial and for the time Functest doesn't run serial test cases. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Remove the useless Feature prefixCédric Ollivier1-1/+1
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Exlude Serial and Feature:Feature:StorageVersionAPICédric Ollivier1-12/+20
Serial asks to split the testcases into 2 runs. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console Change-Id: I58f9d9023f596141bbefae8339043f813a124854 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Blacklist all alpha testingCédric Ollivier1-11/+11
Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-22Add missing blackslashingCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-leguer-sig_apps-run/2/console Change-Id: I5cd41f2da49e59acd6bd06ded0c4e2178e7402b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_nodeCédric Ollivier1-0/+23
It runs sig-node tests which are not included in K8s conformance. It adds 38 single tests. Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_cluster_lifecycleCédric Ollivier1-0/+16
It runs sig-cluster-lifecycle tests which are not included in K8s conformance. It adds 4 single tests. Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_instrumentationCédric Ollivier1-0/+16
It runs sig-instrumentation tests which are not included in K8s conformance. It adds 6 single tests. Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_schedulingCédric Ollivier1-0/+17
It runs sig-scheduling tests which are not included in K8s conformance. It adds 19 single tests. Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_cliCédric Ollivier1-0/+16
It runs sig-cli tests which are not included in K8s conformance. It adds 34 single tests. Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-appsCédric Ollivier1-2/+21
It runs sig-apps tests which are not included in K8s conformance. Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-authCédric Ollivier1-0/+18
It runs sig-auth tests which are not included in K8s conformance. Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-api-machineryCédric Ollivier1-4/+20
It runs sig-api-machinery which are not included in K8s conformance. It adds 97 single tests. Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-26Rename sig_network_feature -> sig_network_featuresCédric Ollivier1-10/+10
It also takes into account the last results (SCTP seems falky): https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Run rally firstCédric Ollivier1-12/+12
After all tests are based on e2e tests. Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig-storageCédric Ollivier1-0/+18
It runs the remaining sig-storage testing excluding the next labels: Conformance (part of k8s_conformance), all features, all drivers and Slow. Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig_networkCédric Ollivier1-0/+17
It runs the remaining sig-network testing excluding the next labels: Conformance (part of k8s_conformance), all features and load.balancer. Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig_network_featureCédric Ollivier1-0/+27
It verifies a couple of features by running a subset of e2e tests: Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature and Example. A couple of features may be automatically skipped like NEG and kubemci. Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Conform with latest sonubuoy's non disruptive listCédric Ollivier1-1/+1
https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43 Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Ease modifying the test list in E2E testingCédric Ollivier1-1/+4
It eases creating specific CNTT test cases based on K8s E2E testing. Change-Id: I304960fda760ffc47d763d53511898699f63e356 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Add a new testcase leveraging on xrally/kubernetesCédric Ollivier1-0/+12
It partially runs the all-in-one task for checking basic functionality of Kubernetes cluster. Change-Id: Iaf7a29d2c1a364073e4caaeef69d68ee79ea56bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-27Remove useless ci_loop in testcase descriptionsCédric Ollivier1-1/+0
Change-Id: I89f5a9172bed9d6861543250a971e09466d1307b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Update Xtesting to 0.60Cédric Ollivier1-2/+1
Xtesting leverages on stevedore [1] which will bring much more flexibility (discovery, module or class renaming, etc). OPNFV Features have to be updated as well: - https://gerrit.opnfv.org/gerrit/61719 - https://gerrit.opnfv.org/gerrit/61723 [1] https://docs.openstack.org/stevedore/latest/ Change-Id: Ibe2a6ab3ddca92882aa4a26f140d2db28d77cb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-22Fix smoke/testcases.yamlCédric Ollivier1-2/+1
https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/265/console Change-Id: I83e98e678f931f8ac22f8dd5dfca8b2583874ff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>