From 99d75d87e31d4f9e078c899bd643da5474963aba Mon Sep 17 00:00:00 2001 From: Cédric Ollivier Date: Sat, 24 Mar 2018 17:17:16 +0100 Subject: Add "Gambia Challenges" presentation MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Change-Id: I16350b90f8bd8c5db7cad4aa28704b9bc908996c Signed-off-by: Cédric Ollivier --- docs/com/pres/gambiachallenges/gambia.md | 77 +++++++++++++++++++++++++++++++ docs/com/pres/gambiachallenges/index.html | 52 +++++++++++++++++++++ 2 files changed, 129 insertions(+) create mode 100644 docs/com/pres/gambiachallenges/gambia.md create mode 100644 docs/com/pres/gambiachallenges/index.html diff --git a/docs/com/pres/gambiachallenges/gambia.md b/docs/com/pres/gambiachallenges/gambia.md new file mode 100644 index 000000000..d041a3fc2 --- /dev/null +++ b/docs/com/pres/gambiachallenges/gambia.md @@ -0,0 +1,77 @@ +# Functest Gambia, new challenges + +[Cédric Ollivier](mailto:cedric.ollivier@orange.com) + +2018/03/22 + + + +## Gating + + +### Our gating is very simple + +- today all test suites are run sequentially +- all resources are not necessarily cleant until the next OpenStack deployment + +**It's fine for gating installers but not for verifying a production +environment (e.g. multi users running the same testcase)** + + +### Parallel and Live testing + +- all resources should be allocated in their own OpenStack projects (already + mostly the case) +- no testcase should create singletons on resource attributes (name, ip, etc.) +- all resources have to be cleant at the end + +**According to [Orange testing results](https://wiki.opnfv.org/pages/viewpage.action?pageId=13211751), +Functest is already in a good shape to meet this goal** + + + +## Quality Assurance + +**Gambia release will match the OpenStack Quality Golden rules** + + +### Pylint and coverage (started from E release) +- need to refactor several vnf testcases and to remove duplicated code +- document well and cover Functest utils: they are reused by +OPNFV third-parties (SFC, SDNVPN) + +** Functest will be rated 10/10** + + +### releasing + +- Functest could be also released as a classical Python package ( +[PyPI](https://pypi.python.org/pypi)) +- its API docs could be published in [Read the Docs](https://readthedocs.org/) + + +### Current technical debt +- former python modules (e.g. cli) or containers (e.g. restapi) have to be +removed +- functest shouldn't contain any OPNFV Installer logic. **All Jenkins Jobs +must set the right env vars as all endusers** +- vnf descriptors should be hosted by Functest instead of using external github +repositories + + + +## other challenges + + +### proposals + +- ease integrating tempest plugins with a minimum effort (new tempest driver in Functest Framework and new opnfv/functest-tempest container) +- why not leveraging on OpenStack middlewares such as + [oslo.config](https://docs.openstack.org/oslo.config/latest/) or + [stevedore](https://docs.openstack.org/stevedore/latest/)? + +**Any new testcase is more than welcome!** + + + +## Thank you diff --git a/docs/com/pres/gambiachallenges/index.html b/docs/com/pres/gambiachallenges/index.html new file mode 100644 index 000000000..592ccf2f5 --- /dev/null +++ b/docs/com/pres/gambiachallenges/index.html @@ -0,0 +1,52 @@ + + +Gambia challenges + + + + + + + + +
+
+
+
+
+ + + + + -- cgit 1.2.3-korg