aboutsummaryrefslogtreecommitdiffstats
path: root/docker/smoke/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier1-27/+4
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit adcbd42cabfa42a71410dd0c76ece0f367d338fd)
2021-04-03Spit conformance into 2 test casesCédric Ollivier1-0/+17
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a33e339a001d62352e15a3cc1546bb4d4d482e59)
2021-04-02Properly manage e2e parallel testingCédric Ollivier1-225/+233
It sets nodes=25 to run all tests in parallel. It also beautifies all testcases.yml Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4004d776b01a1b038df52ca45b18430da1b6b1f5)
2021-03-31Disable sig_scheduling as serialCédric Ollivier1-18/+0
All remaining sig-scheduling tests are serial and for the time Functest doesn't run serial test cases. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f28b4673a7b89f124d225e629f0c5267e6008c14)
2021-03-26Remove the useless Feature prefixCédric Ollivier1-1/+1
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-26Exlude Serial and Feature:Feature:StorageVersionAPICédric Ollivier1-12/+20
Serial asks to split the testcases into 2 runs. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console Change-Id: I58f9d9023f596141bbefae8339043f813a124854 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-26Blacklist all alpha testingCédric Ollivier1-11/+11
Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-22Add missing blackslashingCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-leguer-sig_apps-run/2/console Change-Id: I5cd41f2da49e59acd6bd06ded0c4e2178e7402b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0b79c61af319c6f3beddf79e586e51e4675f3fc1)
2021-03-21Add sig_nodeCédric Ollivier1-0/+23
It runs sig-node tests which are not included in K8s conformance. It adds 38 single tests. Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 56da8a0382889fa0558da48375d2319bfedd39a4)
2021-03-21Add sig_cluster_lifecycleCédric Ollivier1-0/+16
It runs sig-cluster-lifecycle tests which are not included in K8s conformance. It adds 4 single tests. Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f3d390ddba5021ce45dd763e2bf953994a487337)
2021-03-21Add sig_instrumentationCédric Ollivier1-0/+16
It runs sig-instrumentation tests which are not included in K8s conformance. It adds 6 single tests. Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 39511d8576f49b578882757fcc1e33a4bb2c9832)
2021-03-21Add sig_schedulingCédric Ollivier1-0/+17
It runs sig-scheduling tests which are not included in K8s conformance. It adds 19 single tests. Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8bfdc8569b9eaffb96562e7753423d3ded218ed4)
2021-03-21Add sig_cliCédric Ollivier1-0/+16
It runs sig-cli tests which are not included in K8s conformance. It adds 34 single tests. Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6eaf848638d7a1a7b4c4324837da9b8562ec7136)
2021-03-21Add sig-appsCédric Ollivier1-2/+21
It runs sig-apps tests which are not included in K8s conformance. Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 985b7955d065065d191702f1355d7ca114f0c827)
2021-03-21Add sig-authCédric Ollivier1-0/+18
It runs sig-auth tests which are not included in K8s conformance. Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b5c7bc0107a443722004ecced91118042965f327)
2021-03-21Add sig-api-machineryCédric Ollivier1-4/+20
It runs sig-api-machinery which are not included in K8s conformance. It adds 97 single tests. Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9c08bb471502b80df2470e577376f25400913939)
2021-02-19Rename sig_network_feature -> sig_network_featuresCédric Ollivier1-10/+10
It also takes into account the last results (SCTP seems falky): https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 08558d2f47f7400176ad678ceaaff1b5be0b931c) (cherry picked from commit dcb442250783d97b2bbfc6e5671a18cc90106792)
2021-02-19Run rally firstCédric Ollivier1-12/+12
After all tests are based on e2e tests. Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9e132759f6186672dd23dd31fac511bec128d386)
2021-02-19Add sig-storageCédric Ollivier1-0/+18
It runs the remaining sig-storage testing excluding the next labels: Conformance (part of k8s_conformance), all features, all drivers and Slow. Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8e6f69afa84ae428a013debcc7329be26a475695)
2021-02-19Add sig_networkCédric Ollivier1-0/+17
It runs the remaining sig-network testing excluding the next labels: Conformance (part of k8s_conformance), all features and load.balancer. Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 80f0edf3194493620d1cfab79efbcdc8a136d799)
2021-02-19Add sig_network_featureCédric Ollivier1-0/+27
It verifies a couple of features by running a subset of e2e tests: Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature and Example. A couple of features may be automatically skipped like NEG and kubemci. Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0d151ccaf4b267682feec0d38e8b7de3eb3d61c)
2020-09-06Conform with latest sonubuoy's non disruptive listCédric Ollivier1-1/+1
https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43 Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit de3a7000a3173f0242cbf7bfcdd6a18d8678e0ae)
2020-09-06Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b198dcede7578b1c3bf688cd47cc0590dd8d6d14)
2020-08-13Ease modifying the test list in E2E testingCédric Ollivier1-1/+4
It eases creating specific CNTT test cases based on K8s E2E testing. Change-Id: I304960fda760ffc47d763d53511898699f63e356 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a22553a65d6019350c215c9024c9dc54cf77dc7c)
2019-07-11Add a new testcase leveraging on xrally/kubernetesCédric Ollivier1-0/+12
It partially runs the all-in-one task for checking basic functionality of Kubernetes cluster. Change-Id: Iaf7a29d2c1a364073e4caaeef69d68ee79ea56bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-27Remove useless ci_loop in testcase descriptionsCédric Ollivier1-1/+0
Change-Id: I89f5a9172bed9d6861543250a971e09466d1307b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Update Xtesting to 0.60Cédric Ollivier1-2/+1
Xtesting leverages on stevedore [1] which will bring much more flexibility (discovery, module or class renaming, etc). OPNFV Features have to be updated as well: - https://gerrit.opnfv.org/gerrit/61719 - https://gerrit.opnfv.org/gerrit/61723 [1] https://docs.openstack.org/stevedore/latest/ Change-Id: Ibe2a6ab3ddca92882aa4a26f140d2db28d77cb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-22Fix smoke/testcases.yamlCédric Ollivier1-2/+1
https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/265/console Change-Id: I83e98e678f931f8ac22f8dd5dfca8b2583874ff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-22Remove installer dependenciesCédric Ollivier1-1/+1
They are useless as all scenarios are well defined. It will allow running k8s testcases without defining INSTALLER_TYPE as OpenStack and eases maintaining that files. Change-Id: I6f9b0b5a8162e9db3ccc9155a9f88a97eda56f20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-09Add testcase clover_k8sQiLiang1-2/+2
Clover testcase hook patch: https://gerrit.opnfv.org/gerrit/#/c/54541/ This patch is depend on patch: https://gerrit.opnfv.org/gerrit/#/c/54695/ Scenario k8-istio-clover run k8s_smoke and clover_k8s Change-Id: I2cd76ed9d882f94567fd721d250da13b19aaa37b Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-04-07Split opnfv/functest-kubernetesCédric Ollivier1-0/+24
4 containers are now proposed - opnfv/functest-kubernetes-core - opnfv/functest-kubernetes-healthcheck - opnfv/functest-kubernetes-smoke - opnfv/functest-kubernetes-features Change-Id: I7d6f1edc7e9ace185b2cf991592ebc841f5520b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>