diff options
Diffstat (limited to 'docs/release/release-notes/functest-release.rst')
| -rw-r--r-- | docs/release/release-notes/functest-release.rst | 120 |
1 files changed, 48 insertions, 72 deletions
diff --git a/docs/release/release-notes/functest-release.rst b/docs/release/release-notes/functest-release.rst index ee1e8e89f..b5e228caa 100644 --- a/docs/release/release-notes/functest-release.rst +++ b/docs/release/release-notes/functest-release.rst @@ -32,50 +32,53 @@ The internal test cases are: * vping_ssh * vping_userdata * cinder_test - * api_check - * snaps_health_check - * odl * tempest_smoke - * neutron-tempest-plugin-api + * tempest_horizon + * odl + * tempest_neutron + * tempest_cinder + * tempest_keystone + * tempest_heat + * tempest_telemetry * rally_sanity - * refstack_defcore - * patrole - * snaps_smoke - * neutron_trunk - * networking-bgpvpn - * networking-sfc - * barbican + * refstack_compute + * refstack_object + * refstack_platform * tempest_full * tempest_scenario + * tempest_slow + * patrole_admin + * patrole_user + * patrole_reader + * tempest_barbican + * tempest_octavia + * tempest_cyborg * rally_full + * rally_jobs + * vmtp + * shaker * cloudify * cloudify_ims * heat_ims * vyos_vrouter * juju_epc - * vgpu - -The OPNFV projects integrated into Functest framework for automation are: - - * doctor - * bgpvpn - * odl-sfc - * barometer - * fds - * stor4nfv_os Kubernetes ---------- The internal test cases are: + * k8s_quick * k8s_smoke * k8s_conformance - -The OPNFV projects integrated into Functest framework for automation are: - - * stor4nfv - * clover + * xrally_kubernetes + * kube_hunter + * kube_bench_master + * kube_bench_node + * xrally_kubernetes_full + * k8s_vims + * helm_vims + * cnf_conformance Release Data ============ @@ -97,63 +100,34 @@ Software * https://hub.docker.com/r/opnfv/functest-healthcheck * https://hub.docker.com/r/opnfv/functest-smoke * https://hub.docker.com/r/opnfv/functest-benchmarking - * https://hub.docker.com/r/opnfv/functest-features - * https://hub.docker.com/r/opnfv/functest-components * https://hub.docker.com/r/opnfv/functest-vnf + * https://hub.docker.com/r/opnfv/functest-smoke-cntt + * https://hub.docker.com/r/opnfv/functest-benchmarking-cntt Functest Docker images (Kubernetes): * https://hub.docker.com/r/opnfv/functest-kubernetes-healthcheck * https://hub.docker.com/r/opnfv/functest-kubernetes-smoke - * https://hub.docker.com/r/opnfv/functest-kubernetes-features + * https://hub.docker.com/r/opnfv/functest-kubernetes-security + * https://hub.docker.com/r/opnfv/functest-kubernetes-benchmarking + * https://hub.docker.com/r/opnfv/functest-kubernetes-cnf Docker tag for master: latest Documents --------- - * Functests Guides: https://functest.readthedocs.io/en/latest/ + * Functest Guides: https://functest.readthedocs.io/en/latest/ * API Docs: https://functest-api.readthedocs.io/en/latest/ Version change ============== -New test cases --------------- - - * tenantnetwork1 - * tenantnetwork2 - * vmready1 - * vmready2 - * singlevm1 - * singlevm2 - * cinder_test - * neutron-tempest-plugin-api - * rally_jobs - * networking-bgpvpn - * networking-sfc - * barbican - * vmtp - * shaker - * tempest_scenario - * cloudify - * heat_ims - * vgpu - Key changes ----------- - * update test cases and containers to `OpenStack master`_ and to + * update testcases and containers to `OpenStack master`_ and to `Kubernetes master`_ - * define new scenarios to ease writing testcases vs OpenStack - * isolate all resources created in different tenants - * fully remove all OPNFV logics - * publish new Jenkins jobs - * support VIO (VMware Integrated OpenStack) and arm64 for Kubernetes - * reduce Functest Kubernetes image sizes - * add tempest_full and tempest_scenario in all daily jobs - * include benchmarking tools such as Vmtp ans Shaker - * increase functional scope by adding bgpvpn and sfc tempest plugins .. _`OpenStack master`: https://github.com/openstack/requirements/blob/master/upper-constraints.txt .. _`Kubernetes master`: https://github.com/kubernetes/kubernetes @@ -161,24 +135,26 @@ Key changes Key benefits ------------ - * the enduser can easily build its own toolchains by loading our Jenkins jobs - * all developpers can easily verify their changes before merge - * our testcases may be run vs VIM in production - * all testcases can run in parallel to decrease the overall duration - * Functest includes most of the OpenStack gate jobs + * the enduser can easily deploy its own `Functest toolchains`_ in few commands + * everyone can pick stable Functest rolling releases (latest included) + * Functest can verify VIM in production even on `Raspberry PI`_ + * all testcases can run in parallel (tested with 4 executors in our gates) + * no remaining resources detected in our gates after multiple runs + +.. _`Functest toolchains`: https://github.com/collivier/ansible-role-xtesting +.. _`Raspberry PI`: https://github.com/opnfv/functest/blob/master/PI.md Code quality ------------ - * pylint: ~9.5/10 - * code coverage: ~70% + * pylint: 10.00/10 + * code coverage: 70% Useful links ============ - * wiki project page: https://wiki.opnfv.org/display/functest/Opnfv+Functional+Testing - * Functest git repository: https://git.opnfv.org/cgit/functest - * Functest CI dashboard: https://build.opnfv.org/ci/view/functest/ + * Functest git repository: https://github.com/opnfv/functest + * Functest CI dashboard: http://104.154.71.112:8080/view/functest/ * JIRA dashboard: https://jira.opnfv.org/secure/Dashboard.jspa?selectPageId=10611 * Functest IRC channel: #opnfv-functest * Reporting page: http://testresults.opnfv.org/reporting/master/functest/functest.html |