aboutsummaryrefslogtreecommitdiffstats
path: root/docker/smoke
AgeCommit message (Collapse)AuthorFilesLines
2021-08-18Update to Alpine 3.14Cédric Ollivier1-1/+1
It also disabled wrong order check as it fails vs kubernetes amongst others. [1] https://github.com/PyCQA/pylint/issues/2175 Change-Id: I3d641c213067428848212a148d25d78051c5674f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-07-09Skip git_repo testingCédric Ollivier1-2/+4
As discussed in Kind [1], this test is for the deprecated in-tree GitRepo volume type. "we shouldn't expend resources on these volume types". [1] https://github.com/kubernetes-sigs/kind/issues/2356 [2] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage_serial-run/16/console Change-Id: I9951f49208376652e8d580b3086f72994424cf80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-06-20Make clear all skipped Features according to CNTT RA2 Chapter6Cédric Ollivier1-61/+91
Change-Id: I57d414902e973d7bcbb67ba12d10b727b2ec4785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-05Update skip Feature listsCédric Ollivier1-1/+5
Change-Id: I0959d04b95972e84cb2816c293b18b96b3bd607f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-03Reduce number of threadsCédric Ollivier1-10/+10
It passed successfully with 10 threads (more doesn't reduce the overall duration so much). Change-Id: I9013897883a40ebaf699c9a180f1bc8a6a34505c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-15Skip Network.should.set.TCP.CLOSE_WAIT.timeoutCédric Ollivier1-1/+2
https://github.com/kubernetes/test-infra/blob/master/config/jobs/kubernetes/sig-release/release-branch-jobs/1.21.yaml Change-Id: I9d8065fe84d3f6f5e74bf9b46bc8c85ad985c8b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-14Remove sig_node_serial as it's fully disruptiveCédric Ollivier1-24/+0
There is no other test when NoExecuteTaintManager is skipped. http://artifacts.opnfv.org/functest-kubernetes/T94WVHSMW8ZH/functest-kubernetes-opnfv-functest-kubernetes-smoke-kali-sig_scheduling_serial-run-6/sig_scheduling_serial/e2e.log Change-Id: I09a81ec973b26fc6de32df6788e73c7e529ecbf0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Run Feature:Networking-IPv6 Feature:IPv6DualStackAlphaFeatureCédric Ollivier1-2/+0
kind master allows dualstack since [1] [1] https://github.com/kubernetes-sigs/kind/commit/31e595678ed008ac657756d650729c8fac9b3551 Change-Id: Ia2caeee1380ee9c31d3c5717dfa9c13b0de0506c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-06Remove [k8s.io] testingCédric Ollivier1-18/+0
v1.21 enforces sig ownership of all e2e tests [1]. [1] https://github.com/kubernetes/kubernetes/issues/98326 Change-Id: Ibaac8ea38f54b08675a587afd9e138e65092997a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Add k8s_io and serial test casesCédric Ollivier1-6/+161
It completes the first sig test cases. Change-Id: I6b018177e93efe60f9de67f384e388d2a584536c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-04Merge sig_network_features in sig_networkCédric Ollivier1-27/+4
Change-Id: I33516a7b0f280355c40aa821738a0625e4fae93a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-03Spit conformance into 2 test casesCédric Ollivier1-0/+17
It hugely decreases the overall test duration. (10 + 15 << 120) Change-Id: I534f6d09956bb51c32ad35c5a1baff8ebbfabb3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-02Properly manage e2e parallel testingCédric Ollivier1-225/+233
It sets nodes=25 to run all tests in parallel. It also beautifies all testcases.yml Change-Id: I3ecd8899e957c0efbef34ab0409c2b4d557c9425 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-31Disable sig_scheduling as serialCédric Ollivier1-18/+0
All remaining sig-scheduling tests are serial and for the time Functest doesn't run serial test cases. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_scheduling-run/13/console Change-Id: I3f09077a1873b92120daa3a97cbb6f68558e2b4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Remove the useless Feature prefixCédric Ollivier1-1/+1
Change-Id: Ibec3e1cee170a91a4333b3c625ae39cd0c4bbe11 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Exlude Serial and Feature:Feature:StorageVersionAPICédric Ollivier1-12/+20
Serial asks to split the testcases into 2 runs. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_api_machinery-run/7/console Change-Id: I58f9d9023f596141bbefae8339043f813a124854 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-25Blacklist all alpha testingCédric Ollivier1-11/+11
Change-Id: Ifb9edb0d70f285825eb2cfee05a53590367b2650 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-22Add missing blackslashingCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-leguer-sig_apps-run/2/console Change-Id: I5cd41f2da49e59acd6bd06ded0c4e2178e7402b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_nodeCédric Ollivier1-0/+23
It runs sig-node tests which are not included in K8s conformance. It adds 38 single tests. Change-Id: Idbd172517e705402632a7fadb4d4639b5f1ee2d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_cluster_lifecycleCédric Ollivier1-0/+16
It runs sig-cluster-lifecycle tests which are not included in K8s conformance. It adds 4 single tests. Change-Id: I834523d753eec9bd570b8d4cc1cf3550b4a19bab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_instrumentationCédric Ollivier1-0/+16
It runs sig-instrumentation tests which are not included in K8s conformance. It adds 6 single tests. Change-Id: Ic320f3bc7daed0aa2846a7ea672f13f3bec45f12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_schedulingCédric Ollivier1-0/+17
It runs sig-scheduling tests which are not included in K8s conformance. It adds 19 single tests. Change-Id: I9b34c327cc1079e401771b1fa77a6baeef24251c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig_cliCédric Ollivier1-0/+16
It runs sig-cli tests which are not included in K8s conformance. It adds 34 single tests. Change-Id: I4beaf9d08d151d06fc3f3c05770c51dcc68f762a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-appsCédric Ollivier1-2/+21
It runs sig-apps tests which are not included in K8s conformance. Change-Id: Ic02e75b94e6cd923f05af16eb98706599fd26f59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-authCédric Ollivier1-0/+18
It runs sig-auth tests which are not included in K8s conformance. Change-Id: I5684dbcb5d61866f5ae1cb483f3a119b8d3c7807 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-03-21Add sig-api-machineryCédric Ollivier1-4/+20
It runs sig-api-machinery which are not included in K8s conformance. It adds 97 single tests. Change-Id: I76949b75e2d6c59d21f459f8fc358e806af6f23d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-26Rename sig_network_feature -> sig_network_featuresCédric Ollivier1-10/+10
It also takes into account the last results (SCTP seems falky): https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network-run/1/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_network_feature-run/3/console https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-sig_storage-run/1/console Change-Id: I7d4b11462da33d20fd5ed00d870f1099b70f437b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Run rally firstCédric Ollivier1-12/+12
After all tests are based on e2e tests. Change-Id: I727f40255ccc165f9a7da7fa7bdff1a629614d21 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig-storageCédric Ollivier1-0/+18
It runs the remaining sig-storage testing excluding the next labels: Conformance (part of k8s_conformance), all features, all drivers and Slow. Change-Id: I486d8ecdfc46287f4774ba8acaa64d47fb1da287 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig_networkCédric Ollivier1-0/+17
It runs the remaining sig-network testing excluding the next labels: Conformance (part of k8s_conformance), all features and load.balancer. Change-Id: I708ff4690205196e5f69382890a39ea4fd5b6942 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-25Add sig_network_featureCédric Ollivier1-0/+27
It verifies a couple of features by running a subset of e2e tests: Ingress, Networking-IPv4, Networking-Performance, PerformanceDNS, SCTP and NoSNAT. It excludes by default NetworkPolicy, Networking-IPv6, IPv6DualStackAlphaFeature and Example. A couple of features may be automatically skipped like NEG and kubemci. Change-Id: I6efac39bb99c1deb8efe8e82d976d69d6540a9d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Conform with latest sonubuoy's non disruptive listCédric Ollivier1-1/+1
https://github.com/vmware-tanzu/sonobuoy/blob/master/pkg/client/mode.go#L43 Change-Id: Ie6c331168e1186b33c4cabda6744e1bb2c6346a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: I384478ec9a0926b168f2372c8007b3eceeadb6da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-13Ease modifying the test list in E2E testingCédric Ollivier1-1/+4
It eases creating specific CNTT test cases based on K8s E2E testing. Change-Id: I304960fda760ffc47d763d53511898699f63e356 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11Cédric Ollivier1-1/+1
It also updates Python to 3.8 (default version). https://alpinelinux.org/posts/Alpine-3.11.0-released.html Change-Id: I3bbfdb76d2fb71f9a426e4fe7dacace0917e2070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-1/+1
pylint is updated to 2.3.1 (lastest py3.7 version) Change-Id: I8b70e9764e2802aeb517969c265fbebfa03458ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Add a new testcase leveraging on xrally/kubernetesCédric Ollivier1-0/+12
It partially runs the all-in-one task for checking basic functionality of Kubernetes cluster. Change-Id: Iaf7a29d2c1a364073e4caaeef69d68ee79ea56bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-27Remove useless ci_loop in testcase descriptionsCédric Ollivier1-1/+0
Change-Id: I89f5a9172bed9d6861543250a971e09466d1307b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-12Update to Python3Cédric Ollivier1-1/+1
Functest containers leverage on Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html Change-Id: I4f148e91259377b4e3b9076621f192a6e00f6009 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Update Xtesting to 0.60Cédric Ollivier1-2/+1
Xtesting leverages on stevedore [1] which will bring much more flexibility (discovery, module or class renaming, etc). OPNFV Features have to be updated as well: - https://gerrit.opnfv.org/gerrit/61719 - https://gerrit.opnfv.org/gerrit/61723 [1] https://docs.openstack.org/stevedore/latest/ Change-Id: Ibe2a6ab3ddca92882aa4a26f140d2db28d77cb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-22Fix smoke/testcases.yamlCédric Ollivier1-2/+1
https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/265/console Change-Id: I83e98e678f931f8ac22f8dd5dfca8b2583874ff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-22Remove installer dependenciesCédric Ollivier1-1/+1
They are useless as all scenarios are well defined. It will allow running k8s testcases without defining INSTALLER_TYPE as OpenStack and eases maintaining that files. Change-Id: I6f9b0b5a8162e9db3ccc9155a9f88a97eda56f20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-09Add testcase clover_k8sQiLiang1-2/+2
Clover testcase hook patch: https://gerrit.opnfv.org/gerrit/#/c/54541/ This patch is depend on patch: https://gerrit.opnfv.org/gerrit/#/c/54695/ Scenario k8-istio-clover run k8s_smoke and clover_k8s Change-Id: I2cd76ed9d882f94567fd721d250da13b19aaa37b Signed-off-by: QiLiang <liangqi1@huawei.com>
2018-04-07Split opnfv/functest-kubernetesCédric Ollivier3-0/+34
4 containers are now proposed - opnfv/functest-kubernetes-core - opnfv/functest-kubernetes-healthcheck - opnfv/functest-kubernetes-smoke - opnfv/functest-kubernetes-features Change-Id: I7d6f1edc7e9ace185b2cf991592ebc841f5520b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>