diff options
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 207 |
1 files changed, 207 insertions, 0 deletions
diff --git a/README.md b/README.md new file mode 100644 index 000000000..a4b8d9f82 --- /dev/null +++ b/README.md @@ -0,0 +1,207 @@ +# Functest + +Network virtualization has dramatically modified our architectures which asks +for more automation and powerful testing tools like Functest, a collection of +state-of-the-art virtual infrastructure test suites, including automatic VNF +testing (cf. +[[1]](https://www.linuxfoundation.org/press-release/2019/05/opnfv-hunter-delivers-test-tools-ci-cd-framework-to-enable-common-nfvi-for-verifying-vnfs/)). + +In context of OPNFV, Functest verifies any kind of OpenStack and Kubernetes +deployments including production environments. It conforms to upstream rules +and integrates smoothly lots of the test cases available in the opensource +market. It includes about 3000+ functional tests and 3 hours upstream API and +dataplane benchmarks. It’s completed by Virtual Network Function deployments +and testing (vIMS, vRouter and vEPC) to ensure that the platforms meet Network +Functions Virtualization requirements. Raspberry PI is also supported to verify +datacenters as the lowest cost (50 euros hardware and software included). + +| Functest releases | OpenStack releases | +|-------------------|--------------------| +| **Hunter** | **Rocky** | +| Iruya | Stein | +| Jerma | Train | +| Kali | Ussuri | +| Leguer | Victoria | +| Master | next Wallaby | + +## Prepare your environment + +cat env +``` +DEPLOY_SCENARIO=XXX # if not os-nosdn-nofeature-noha scenario +NAMESERVER=XXX # if not 8.8.8.8 +EXTERNAL_NETWORK=XXX # if not first network with router:external=True +DASHBOARD_URL=XXX # else tempest_horizon will be skipped +NEW_USER_ROLE=XXX # if not member +SDN_CONTROLLER_IP=XXX # if odl scenario +VOLUME_DEVICE_NAME=XXX # if not vdb +FLAVOR_EXTRA_SPECS=hw:mem_page_size:large # if fdio scenarios +``` + +cat openstack.creds +``` +export OS_AUTH_URL=XXX +export OS_USER_DOMAIN_NAME=XXX +export OS_PROJECT_DOMAIN_NAME=XXX +export OS_USERNAME=XXX +export OS_PROJECT_NAME=XXX +export OS_PASSWORD=XXX +export OS_IDENTITY_API_VERSION=3 +export OS_REGION_NAME=XXX +``` + +mkdir -p images && wget -q -O- https://git.opnfv.org/functest/plain/functest/ci/download_images.sh?h=stable/hunter | bash -s -- images && ls -1 images/* +``` +images/cirros-0.4.0-aarch64-disk.img +images/cirros-0.4.0-x86_64-disk.img +images/cloudify-docker-manager-community-19.01.24.tar +images/Fedora-Cloud-Base-30-1.2.x86_64.qcow2 +images/shaker-image-1.3.0+stretch.qcow2 +images/ubuntu-14.04-server-cloudimg-amd64-disk1.img +images/ubuntu-14.04-server-cloudimg-arm64-uefi1.img +images/ubuntu-16.04-server-cloudimg-amd64-disk1.img +images/vyos-1.1.8-amd64.qcow2 +``` + +## Run healthcheck suite + +```bash +sudo docker run --env-file env \ + -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \ + -v $(pwd)/images:/home/opnfv/functest/images \ + opnfv/functest-healthcheck:hunter +``` + +``` ++--------------------------+------------------+---------------------+------------------+----------------+ +| TEST CASE | PROJECT | TIER | DURATION | RESULT | ++--------------------------+------------------+---------------------+------------------+----------------+ +| connection_check | functest | healthcheck | 00:03 | PASS | +| tenantnetwork1 | functest | healthcheck | 00:08 | PASS | +| tenantnetwork2 | functest | healthcheck | 00:16 | PASS | +| vmready1 | functest | healthcheck | 00:09 | PASS | +| vmready2 | functest | healthcheck | 00:10 | PASS | +| singlevm1 | functest | healthcheck | 00:51 | PASS | +| singlevm2 | functest | healthcheck | 00:41 | PASS | +| vping_ssh | functest | healthcheck | 00:56 | PASS | +| vping_userdata | functest | healthcheck | 00:42 | PASS | +| cinder_test | functest | healthcheck | 02:19 | PASS | +| tempest_smoke | functest | healthcheck | 07:02 | PASS | +| tempest_horizon | functest | healthcheck | 00:52 | PASS | +| odl | functest | healthcheck | 00:00 | SKIP | ++--------------------------+------------------+---------------------+------------------+----------------+ +``` + +## Run smoke suite + +```bash +sudo docker run --env-file env \ + -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \ + -v $(pwd)/images:/home/opnfv/functest/images \ + opnfv/functest-smoke:hunter +``` + +``` ++---------------------------+------------------+---------------+------------------+----------------+ +| TEST CASE | PROJECT | TIER | DURATION | RESULT | ++---------------------------+------------------+---------------+------------------+----------------+ +| tempest_neutron | functest | smoke | 16:49 | PASS | +| tempest_cinder | functest | smoke | 01:39 | PASS | +| tempest_keystone | functest | smoke | 00:57 | PASS | +| tempest_heat | functest | smoke | 24:33 | PASS | +| rally_sanity | functest | smoke | 18:41 | PASS | +| refstack_defcore | functest | smoke | 10:38 | PASS | +| tempest_full | functest | smoke | 55:19 | PASS | +| tempest_scenario | functest | smoke | 11:06 | PASS | +| tempest_slow | functest | smoke | 61:39 | PASS | +| patrole | functest | smoke | 02:46 | PASS | +| networking-bgpvpn | functest | smoke | 00:00 | SKIP | +| networking-sfc | functest | smoke | 00:00 | SKIP | +| tempest_barbican | functest | smoke | 02:30 | PASS | ++---------------------------+------------------+---------------+------------------+----------------+ +``` + +## Run smoke CNTT suite + +```bash +sudo docker run --env-file env \ + -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \ + -v $(pwd)/images:/home/opnfv/functest/images \ + opnfv/functest-smoke-cntt:hunter +``` + +``` ++-------------------------------+------------------+---------------+------------------+----------------+ +| TEST CASE | PROJECT | TIER | DURATION | RESULT | ++-------------------------------+------------------+---------------+------------------+----------------+ +| tempest_neutron_cntt | functest | smoke | 13:54 | PASS | +| tempest_cinder_cntt | functest | smoke | 01:46 | PASS | +| tempest_keystone_cntt | functest | smoke | 00:58 | PASS | +| tempest_heat_cntt | functest | smoke | 25:31 | PASS | +| rally_sanity_cntt | functest | smoke | 18:50 | PASS | +| tempest_full_cntt | functest | smoke | 44:32 | PASS | +| tempest_scenario_cntt | functest | smoke | 11:14 | PASS | +| tempest_slow_cntt | functest | smoke | 43:55 | PASS | ++-------------------------------+------------------+---------------+------------------+----------------+ +``` + +## Run benchmarking suite + +```bash +sudo docker run --env-file env \ + -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \ + -v $(pwd)/images:/home/opnfv/functest/images \ + opnfv/functest-benchmarking:hunter +``` + +``` ++--------------------+------------------+----------------------+------------------+----------------+ +| TEST CASE | PROJECT | TIER | DURATION | RESULT | ++--------------------+------------------+----------------------+------------------+----------------+ +| rally_full | functest | benchmarking | 108:34 | PASS | +| rally_jobs | functest | benchmarking | 22:07 | PASS | +| vmtp | functest | benchmarking | 15:38 | PASS | +| shaker | functest | benchmarking | 25:12 | PASS | ++--------------------+------------------+----------------------+------------------+----------------+ +``` + +## Run benchmarking CNTT suite + +```bash +sudo docker run --env-file env \ + -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \ + -v $(pwd)/images:/home/opnfv/functest/images \ + opnfv/functest-benchmarking-cntt:hunter +``` + +``` ++-------------------------+------------------+----------------------+------------------+----------------+ +| TEST CASE | PROJECT | TIER | DURATION | RESULT | ++-------------------------+------------------+----------------------+------------------+----------------+ +| rally_full_cntt | functest | benchmarking | 106:60 | PASS | +| rally_jobs_cntt | functest | benchmarking | 21:16 | PASS | +| vmtp | functest | benchmarking | 16:15 | PASS | +| shaker | functest | benchmarking | 25:09 | PASS | ++-------------------------+------------------+----------------------+------------------+----------------+ +``` + +## Run vnf suite + +```bash +sudo docker run --env-file env \ + -v $(pwd)/openstack.creds:/home/opnfv/functest/conf/env_file \ + -v $(pwd)/images:/home/opnfv/functest/images \ + opnfv/functest-vnf:hunter +``` + +``` ++----------------------+------------------+--------------+------------------+----------------+ +| TEST CASE | PROJECT | TIER | DURATION | RESULT | ++----------------------+------------------+--------------+------------------+----------------+ +| cloudify | functest | vnf | 04:35 | PASS | +| cloudify_ims | functest | vnf | 24:16 | PASS | +| heat_ims | functest | vnf | 30:36 | PASS | +| vyos_vrouter | functest | vnf | 15:37 | PASS | +| juju_epc | functest | vnf | 34:39 | PASS | ++----------------------+------------------+--------------+------------------+----------------+ +``` |