From 0ac6463d7ddb79e0e3eda1aaf7388ca9ab700cd5 Mon Sep 17 00:00:00 2001 From: Cédric Ollivier Date: Sun, 23 Aug 2020 14:44:36 +0200 Subject: Update K8s test case results in doc MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60 Signed-off-by: Cédric Ollivier (cherry picked from commit 5b1a05cdea1d7e0a3c9e6bd8f81473f4be845b39) --- docs/release/release-notes/functest-release.rst | 8 +++ docs/spelling_wordlist.txt | 3 ++ docs/testing/user/configguide/configguide.rst | 68 ++++++++++++++++++++++--- docs/testing/user/userguide/test_results.rst | 36 +++++++++++-- 4 files changed, 103 insertions(+), 12 deletions(-) diff --git a/docs/release/release-notes/functest-release.rst b/docs/release/release-notes/functest-release.rst index 76ffad9b9..490ffbe18 100644 --- a/docs/release/release-notes/functest-release.rst +++ b/docs/release/release-notes/functest-release.rst @@ -69,6 +69,11 @@ The internal test cases are: * k8s_smoke * k8s_conformance + * xrally_kubernetes + * kube_hunter + * kube_bench + * xrally_kubernetes_full + * k8s_vims Release Data ============ @@ -98,6 +103,9 @@ Software * https://hub.docker.com/r/opnfv/functest-kubernetes-healthcheck * https://hub.docker.com/r/opnfv/functest-kubernetes-smoke + * https://hub.docker.com/r/opnfv/functest-kubernetes-security + * https://hub.docker.com/r/opnfv/functest-kubernetes-benchmarking + * https://hub.docker.com/r/opnfv/functest-kubernetes-cnf Docker tag for iruya: iruya diff --git a/docs/spelling_wordlist.txt b/docs/spelling_wordlist.txt index 5c24796cb..dfcd54633 100644 --- a/docs/spelling_wordlist.txt +++ b/docs/spelling_wordlist.txt @@ -14,6 +14,8 @@ ci Clearwater cloudify Cloudify +cnf +cntt conf config dashboarding @@ -130,6 +132,7 @@ vEPC verifier versioned vIMS +vims Virtualised Virtualized vm diff --git a/docs/testing/user/configguide/configguide.rst b/docs/testing/user/configguide/configguide.rst index 43db48588..74404a9af 100644 --- a/docs/testing/user/configguide/configguide.rst +++ b/docs/testing/user/configguide/configguide.rst @@ -13,7 +13,6 @@ Functest Dockers for OpenStack deployment ----------------------------------------- Docker images are available on the dockerhub: - * opnfv/functest-core * opnfv/functest-healthcheck * opnfv/functest-smoke * opnfv/functest-benchmarking @@ -175,9 +174,11 @@ Functest Dockers for Kubernetes deployment ------------------------------------------ Docker images are available on the dockerhub: - * opnfv/functest-kubernetes-core * opnfv/functest-kubernetes-healthcheck * opnfv/functest-kubernetes-smoke + * opnfv/functest-kubernetes-security + * opnfv/functest-kubernetes-benchmarking + * opnfv/functest-kubernetes-cnf Preparing your environment ^^^^^^^^^^^^^^^^^^^^^^^^^^ @@ -217,11 +218,64 @@ Run smoke suite:: Results shall be displayed as follows:: - +-------------------------+------------------+---------------+------------------+----------------+ - | TEST CASE | PROJECT | TIER | DURATION | RESULT | - +-------------------------+------------------+---------------+------------------+----------------+ - | k8s_conformance | functest | smoke | 135:54 | PASS | - +-------------------------+------------------+---------------+------------------+----------------+ + +---------------------------+------------------+---------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +---------------------------+------------------+---------------+------------------+----------------+ + | k8s_conformance | functest | smoke | 94:11 | PASS | + | xrally_kubernetes | functest | smoke | 13:39 | PASS | + +---------------------------+------------------+---------------+------------------+----------------+ + +Testing security suite +^^^^^^^^^^^^^^^^^^^^^^ + +Run smoke suite:: + + sudo docker run -it --env-file env \ + -v $(pwd)/config:/root/.kube/config \ + opnfv/functest-kubernetes-security:iruya + +Results shall be displayed as follows:: + + +---------------------+------------------+------------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +---------------------+------------------+------------------+------------------+----------------+ + | kube_hunter | functest | security | 00:17 | PASS | + | kube_bench | functest | security | 00:02 | PASS | + +---------------------+------------------+------------------+------------------+----------------+ + +Testing benchmarking suite +^^^^^^^^^^^^^^^^^^^^^^^^^^ + +Run benchmarking suite:: + + sudo docker run -it --env-file env \ + -v $(pwd)/config:/root/.kube/config \ + opnfv/functest-kubernetes-benchmarking:iruya + +Results shall be displayed as follows:: + + +--------------------------------+------------------+----------------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +--------------------------------+------------------+----------------------+------------------+----------------+ + | xrally_kubernetes_full | functest | benchmarking | 38:21 | PASS | + +--------------------------------+------------------+----------------------+------------------+----------------+ + +Testing cnf suite +^^^^^^^^^^^^^^^^^ + +Run cnf suite:: + + sudo docker run -it --env-file env \ + -v $(pwd)/config:/root/.kube/config \ + opnfv/functest-kubernetes-cnf:iruya + +Results shall be displayed as follows:: + + +-------------------+------------------+--------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +-------------------+------------------+--------------+------------------+----------------+ + | k8s_vims | functest | cnf | 18:14 | PASS | + +-------------------+------------------+--------------+------------------+----------------+ Environment variables ===================== diff --git a/docs/testing/user/userguide/test_results.rst b/docs/testing/user/userguide/test_results.rst index 59d3d0fba..7c82239e4 100644 --- a/docs/testing/user/userguide/test_results.rst +++ b/docs/testing/user/userguide/test_results.rst @@ -91,11 +91,37 @@ Kubernetes healthcheck suite:: Kubernetes smoke suite:: - +-------------------------+------------------+---------------+------------------+----------------+ - | TEST CASE | PROJECT | TIER | DURATION | RESULT | - +-------------------------+------------------+---------------+------------------+----------------+ - | k8s_conformance | functest | smoke | 135:54 | PASS | - +-------------------------+------------------+---------------+------------------+----------------+ + +---------------------------+------------------+---------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +---------------------------+------------------+---------------+------------------+----------------+ + | k8s_conformance | functest | smoke | 94:11 | PASS | + | xrally_kubernetes | functest | smoke | 13:39 | PASS | + +---------------------------+------------------+---------------+------------------+----------------+ + +Kubernetes security suite:: + + +---------------------+------------------+------------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +---------------------+------------------+------------------+------------------+----------------+ + | kube_hunter | functest | security | 00:17 | PASS | + | kube_bench | functest | security | 00:02 | PASS | + +---------------------+------------------+------------------+------------------+----------------+ + +Kubernetes benchmarking suite:: + + +--------------------------------+------------------+----------------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +--------------------------------+------------------+----------------------+------------------+----------------+ + | xrally_kubernetes_full | functest | benchmarking | 38:21 | PASS | + +--------------------------------+------------------+----------------------+------------------+----------------+ + +Kubernetes cnf suite:: + + +-------------------+------------------+--------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +-------------------+------------------+--------------+------------------+----------------+ + | k8s_vims | functest | cnf | 18:14 | PASS | + +-------------------+------------------+--------------+------------------+----------------+ Results are automatically pushed to the test results database, some additional result files are pushed to OPNFV artifact web sites. -- cgit 1.2.3-korg