aboutsummaryrefslogtreecommitdiffstats
path: root/functest_kubernetes
AgeCommit message (Collapse)AuthorFilesLines
2020-09-06Slightly generalize ginkgo paramsCédric Ollivier1-4/+2
Change-Id: I51b013056bb5b88ef2e1de31e9171129e8ce4475 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0ec2aa15acbe7cd2b28d772165c22481b85bad79)
2020-09-04Allow skipping arm and arm64 if cnf-conformanceCédric Ollivier1-3/+16
cnf-conformance doesn't support this architectures. It also improve cleaning to publish artifacts [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-cnf_conformance-run/2/console Change-Id: Ie64e4a1b8b496a050a1798eaf4e5ef6397c011d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2cf6903c9a805b9c1b7702292bdf33b9485be319)
2020-09-04Add cnf-conformance in functest-kubernetes-cnfCédric Ollivier2-0/+104
It selects cnf-conformance v0.7.2-beta1 (current latest release) and the default CNF as proposed by [1]. The end user is free to override the default yml files on purpose (e.g. docker volumes). Tag (default: all) could be modified too via testcases.yaml [1] https://hackmd.io/@vulk/SkY54QnsU Change-Id: Iec2a830c441e523e067f6eb114ecb205c49c6b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 120daffd8d6d4be727d2ba52a76dbd8eacfe2628)
2020-08-30Increase cassandra timeoutsCédric Ollivier2-2/+2
homestead-prov sometimes fails reaching cassandra 30-08-2020 10:33:44.064 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code 30-08-2020 10:34:32.257 UTC ERROR base.py:327: Translating internal <class 'telephus.cassandra.ttypes.TimedOutException'> error into a 503 status code Change-Id: I48566e39dca3dc9644733a76140a76300bbfd84e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e236b0f56f748c888df23eeaf65478967ad852f1)
2020-08-23Stop pushing all details in Test DBCédric Ollivier1-1/+1
It raises 413 Client Error: Request Entity Too Large for url [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console Change-Id: I165f7aec53d8ce1e567491a5b5559f00b1fe4a4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1f720b0fabbcf162366160a4fa9a46807e53f8bc)
2020-08-23Set output logs in Rally testcasesCédric Ollivier1-0/+3
https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-benchmarking-latest-xrally_kubernetes_full-run/1/console Change-Id: I13685d74ce9e286520af6f1e5cd6ce9dafc3d5ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 42c2bbed87779218a8fe43c4c5c3012c64bec17b)
2020-08-22Fix last hardcoded concurrenciesCédric Ollivier1-8/+8
Change-Id: Ib2b7bb6de8cd6524fcc52baf48ebf5c4835c396b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8a8f6eafc3c6268a3663852f7de8f0cc4c39b817)
2020-08-22Add xrally_kubernetes_fullCédric Ollivier2-60/+70
It iterates 10 times all operations run by xrally_kubernetes. Now times, concurrenty and count can be set via testcases.yaml. It creates a new containers functest-kubernetes-benchamrking as Functest. Change-Id: Ibfd493b987a359a3f16c2d8db0aef6b8e90b7e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a0f76d884c1f13c27e906136d3418f12b5342fc4)
2020-08-17Add tempo waiting for ellis accountCédric Ollivier1-0/+1
Change-Id: I63c6af9d0e20aab426e7f875cdb4f86d206f49aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3c7965bb37590eae9e968a530eaaa690ada903f2)
2020-08-17Safely decode e2e.test outputCédric Ollivier1-2/+4
https://build.opnfv.org/ci/job/functest-kubernetes-pi-ollivier-functest-kubernetes-healthcheck-arm-latest-k8s_smoke-run/2/console Change-Id: I57f3ae0051fb55c8c80de81e79168e61c06d85bb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 64771ca4e6965c81aa2922c7efc44e4f7a38a610)
2020-08-14Pin latest versions from security toolsCédric Ollivier2-2/+3
It selects kube-bench and kube-hunter 0.3.1. Change-Id: Icb85f3d0d88056370500ec827ef77c215740e5e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6b8384b57a0bfc200c15ed9ded71544c33a27e81)
2020-08-13Merge "Make K8s_vims namespace aware" into stable/hunterCedric Ollivier1-6/+21
2020-08-13Merge "Ease modifying the test list in E2E testing" into stable/hunterCedric Ollivier2-39/+14
2020-08-13Ease modifying the test list in E2E testingCédric Ollivier2-39/+14
It eases creating specific CNTT test cases based on K8s E2E testing. Change-Id: I304960fda760ffc47d763d53511898699f63e356 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a22553a65d6019350c215c9024c9dc54cf77dc7c)
2020-08-13Make K8s security tests namespace awareCédric Ollivier1-15/+28
It now creates a namespace to allow running the test cases twice in parallel. It also overprotects clean operations to force a full delete. Change-Id: Ie0becd8ea9126328e7280591bacc0d88e14dd031 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8e2a7dbee8f134dbe9022683d40e2328e5e50fe6)
2020-08-13Make K8s_vims namespace awareCédric Ollivier1-6/+21
It now creates a namespace to allow running the test case twice in parallel (see DNS requests). Change-Id: Ib47b3fb2d753f8259d9224cb79168cde68d8e854 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 019101492b51aa74412265cd99ba1a9e27a3de8c)
2020-07-09Boot Ellis once homestead-depl is readyCédric Ollivier5-10/+22
Change-Id: If61a36020f3dfa5ba0a9858df769138257f9ec94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5bc18405d75e9d765cd707ff9a98c3553de4b0dd)
2020-07-07Fix phase conditionsCédric Ollivier1-3/+5
Else it waits 20 minutes for nothing [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-cnf-latest-k8s_vims-run/5/console Change-Id: I6427f28975b465ef503f9a3f2868b878fa92b55e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 83d3161c52c8cc8d9e4f52d7a693bbcc32508379)
2020-07-07Override the right log filesCédric Ollivier2-0/+5
Else Xtesting publishes the default xtesting.log [1] [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-security-latest-kube_hunter-run/2/console Change-Id: I0b9b9eda04762771d4e10f0d124b4d5f2975a4da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 36039d940f473d7385d918375390e804b626bad2)
2020-07-07Improve vIMS service orderCédric Ollivier4-12/+6
It seems fixing the last side effects. Change-Id: Iee8506c2f0048f7c2619b772aea815288a40145e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f7b45c10ef78a96f33568d2480ca79efbbd72505)
2020-07-06Manage Ims service dependenciesCédric Ollivier11-0/+48
Change-Id: I6647d9acfabd2ce2d12ff2f30393c2de8f6165ff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 68b2a9ac43003840ae0b88bf3b2cd6c1fc10db21)
2020-07-06Remove Kubernetes.create_check_and_delete_daemonsetCédric Ollivier1-13/+0
It seems incorrect as Rally tired waiting to become 3 pods [1] Here are the nodes: - control-plane - worker - worker [1] http://artifacts.opnfv.org/functest-kubernetes/0LMEWUMSA2U6/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-xrally_kubernetes-run-157/xrally_kubernetes/xrally_kubernetes.html Change-Id: I19bb19eb1e0f2ae66a64532d99d4a59f82651a8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit efee842caa2585c2174c9b780ea1d33f69c69f2e) (cherry picked from commit 90d2fe1fb88bbe963e7c242f2b6b74fb68ab0c67)
2020-07-06Correctly override dir_results and res_dir in rally_kubernetesCédric Ollivier1-2/+2
Both have to be modified else publishing artifacts fails [1]. https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-jerma-xrally_kubernetes-run/47/console Change-Id: If21334d7d1342737575f9a260a0ad647c4f382e2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 004d28383111d344aeb82ba9080c7c015970c9bb) (cherry picked from commit cad10e2f00034a283a318e4e0fdf271d0ff2e32a)
2020-07-06Add a new testcase leveraging on xrally/kubernetesCédric Ollivier3-0/+471
It partially runs the all-in-one task for checking basic functionality of Kubernetes cluster. Change-Id: Iaf7a29d2c1a364073e4caaeef69d68ee79ea56bc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 413b52a98a359094dbc251749c04d2789e0ab24c)
2020-07-05Use shallow copy - copy() is py3 onlyCédric Ollivier1-1/+1
Change-Id: Ib470c4ddd36f4b522915e6e131f1b16aee268d15 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Fix former pep8 issuesCédric Ollivier2-2/+6
It's allowed by the newer version Change-Id: Ief4cb2f0cce8da8af6e0bee275772f0940f56d5a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6493a5acf8a3724f7c00fc971542d25b42a36e4c)
2020-07-04Improve Ims codingCédric Ollivier1-1/+1
Change-Id: Id8b042fd38399f0cf1868f67b5a3f4f1b4f2ef0d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit dbe25c73b976a8a3d9b5c10dc92b8c9a17c68baa) (cherry picked from commit b1acb9c247f09b6c6e29442c4d8e067d6e4a3c10)
2020-07-04Deploy Clearwater IMS using KubernetesCédric Ollivier24-0/+887
The new testcase "k8s_vims" deploys and tests Clearwater IMS using Kubernetes. It follows the procedures proposed by clearwater-docker [1]. [1] https://github.com/Metaswitch/clearwater-docker Change-Id: I2fe3cd03a5dedfc61fbab294c53b4bc0b0fa70be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 080d2414682d5fecea8c01640e2e5971278fe19d) (cherry picked from commit d56ecab65904d9a190f378262ad9bff48358a40e)
2020-07-01Add security docker for functest-kubernetesmrichomme4-0/+186
run kube-hunter and kube-bench cases dealing with security in kubernetes (check vulnerabilities) [1][2] It's the first step only printing the output. [1]: https://github.com/aquasecurity/kube-bench [2]: https://github.com/aquasecurity/kube-hunter Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I3bd9bda80046ef7a0c494d51dfb0b8cbfea02bb0 Signed-off-by: mrichomme <morgan.richomme@orange.com> (cherry picked from commit 98d9f93337ab514fa9aafc1cd1e87473de68b364) (cherry picked from commit 0626f54b8686134515eab3b9014c5b538405d84f) (cherry picked from commit a7191389900b58f50e428af47e6819f30ba07d8f)
2019-11-16Correctly override dir_results and res_dirCédric Ollivier1-2/+2
Both have to be modified else publishing artifacts fails [1]. [1] https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-smoke-latest-xrally_kubernetes-run/139/console Change-Id: Ieefee6a9a61452bb4f23d40f75b60280803cd215 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 63ef7413921dcd06d4bd15ae59a20da811cfe7d3)
2019-11-10Update to Xtesting 0.82Cédric Ollivier1-0/+3
It overrides the default log files. Change-Id: I6a1f9951b47b761e4e1832140181a57dd886117c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 63b56cf0740fd5e2e0b7b022e287b27ddb898dee)
2019-07-27Enable py36 in gatesCédric Ollivier1-4/+4
It also updates pylint. Change-Id: Ifcc597bc4a6aabdb56588949af3b7cf4d52221af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4f7536dfb0f4d639d76de54e360e6ba47f51888a)
2019-06-28Rewrite kubernetes parsingCédric Ollivier2-69/+24
It now sets details and result thanks to 1 regex. It also prints the failure summary if needed. Change-Id: Ia89d6825134161cf6513924dac93281d677eada6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d22f950cae95350ae0b0518ceefb3bcfc4f17009)
2019-06-27Disable log dumpCédric Ollivier2-3/+8
It avoids dumping logs at the end which requires gcloud configured (CI). Then it partially reverts "Keep kubernetes sources" [1]. It now dumps e2e.test output in e2e.log as sonobuoy [2]. [1] https://gerrit.opnfv.org/gerrit/68106 [2] https://raw.githubusercontent.com/cncf/k8s-conformance/master/v1.15/kubeadm/e2e.log Change-Id: I400e1cf92a8540eba3d40db1ed4237628921efe6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d1d3feacdbf061cf4115ceeadcb71d2142971757)
2019-05-24Update to Python3Cédric Ollivier1-1/+1
Functest containers leverage on Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html Change-Id: I4f148e91259377b4e3b9076621f192a6e00f6009 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e38bb1ee4c2a5c2e03ad7af46631da37c5f189ba)
2019-03-10Publish Junit files and fix Conformance regexCédric Ollivier1-4/+8
It fixes Conformance to [Conformance] and add the skips test regex. It now conforms with Kubernetes Certification (see Sunobuoy) Change-Id: Ic25bb72c839810cf41668a3a8b86579a3fd59629 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fd130c880d4d185153efe3e3e0aa24c95052c320)
2018-10-11Set Ginkgo's reporter not to print out in colorJuha Kosonen1-6/+5
Change-Id: If0ef89ba521d02b5ea1a1fcb5bc3e546f93e2859 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 51fb9ee1ff83d90874bd24847df33739a7cf1b79)
2018-08-31Fully remove kubernetes working dirCédric Ollivier1-4/+2
It hugely decreases the size of our containers. Change-Id: I7bdc31645fb00c01e16855795bf99dd1b3b17dfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-31Remove useless env varsCédric Ollivier2-34/+6
In OPNFV context, provider is always local. Change-Id: Ieb51153bedfec34c0a3dfba9705b0b2afcebb8c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-21Fix functest-k8s logging to log all k8s testsKonrad Djimeli2-8/+16
JIRA: FUNCTEST-967 Change-Id: If4924a5c6d66dcbda48ac5ea80d67fcef11ba40a Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
2018-04-26Update logging to log Errors, when they occurKonrad Djimeli2-0/+16
Enable logging of errors which can occur due to incorrect configfile, wrong KUBE_MASTER_URL or KUBE_MASTER_IP etc. Change-Id: I352ed0ab0376e9392d205decdc569bac6304ba27 Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
2018-04-09Add unit tests for K8sTesting's run and run_kubetest methodsKonrad Djimeli1-0/+13
Change-Id: I0442614c609d0d6248c1896d0bc8f55c32e5152d Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
2018-04-09Add unit test for config file validationKonrad Djimeli2-1/+18
Change-Id: I170de36f9641fce253acdd169061476443b86f81 Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
2018-03-21Remove KUBECONFIG from env varsLinda Wang2-15/+12
Change-Id: I85f4c01ceaf9cdadff7fe3d0f284f28da5727658 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-13Refactor loggersCédric Ollivier1-16/+15
Only 1 logger is needed and it's updated to conform with logging.ini. Change-Id: I53465bbe9a81526ce1acaac90e47ffe4daaaa716 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01Switch from functest to XtestingCédric Ollivier1-1/+1
It also fixes logging.ini and tox.ini. Change-Id: I3001dd847d0cd4bcffb7e466ba1cf5a71705f636 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01Add unit tests for functest-kubernetesdjkonro1-0/+54
Change-Id: I4c9b5a56e891f4a63c86e0d7c4dd0d02de677610 Signed-off-by: djkonro <konraddjimeli@gmail.com>
2018-03-01Add Kubernetes conformance testsdjkonro1-11/+55
JIRA: FUNCTEST-905 Change-Id: I2f70884811431f21fe98bb6a989a9172f3612a64 Signed-off-by: djkonro <konraddjimeli@gmail.com>
2018-01-25Remove KUBE_MASTER which is not a require environment variabledjkonro1-1/+0
Change-Id: I948c3c843dcf625317be4be44e496c1e2da2a23c Signed-off-by: djkonro <konraddjimeli@gmail.com>
2018-01-24Add initial python class for kubernetes testingdjkonro2-0/+96
JIRA: FUNCTEST-904 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I9007e4e6f58118d1b09774d0acbb2a315437e09a Signed-off-by: djkonro <konraddjimeli@gmail.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>