summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-05-04Functest fail to parse refstack resultsxudan1-3/+6
1. The regular expression can't work well for refstack results 2. Refer to http://testresults.opnfv.org/test/api/v1/results?project=functest&case_name=refstack_defcore&last=1 3. There are 88 success test cases but the list of success is empty 4. Refstack test case name is not always begin with {0}, it maybe any number 5. The test case whose name has the keyword 'fail' will also be list in 'failures' Change-Id: I5187aaaabdca762256be9162cc85ba42263169bc Signed-off-by: xudan <xudan16@huawei.com>
2018-04-30Rewrite TempestResourcesManagerCédric Ollivier5-232/+144
It now leverages on OpenStack Shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky) requires to change only one line. It stops dedicating the network to the user possibly created because the support is incomplete (the users have to be registed in tempest.conf and the multiprocessing has to be enforced). It also writes the second image and the second flavor in tempest.conf. Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-29Rewrite vping_ssh and vping_userdataCédric Ollivier5-482/+202
They now leverage on shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (openstacksdk) requires to change only one line. It deletes the related unit tests as they have to be fully rewritten. They will be added in another change. Change-Id: I0c60681d6e1c0944960770429ef972947dd85321 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-27Set image_url as filenameCédric Ollivier1-2/+1
It will be reused as soon as vping switches to openstacksdk. Change-Id: Ib84f4b35b22ead1741579ec9140d3626f9102469 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-24Merge "Add debug logs in cloudify_ims"valentin boucher2-15/+21
2018-04-24Merge "Switch from deploy utils to the right objects"Cedric Ollivier4-35/+49
2018-04-24Merge "Add Rally GnocchiResource scenarios"Juha Kosonen2-0/+27
2018-04-24Add Rally GnocchiResource scenariosJuha Kosonen2-0/+27
New scenarios: GnocchiResource.create_resource (rally_full) GnocchiResource.create_delete_resource (rally_sanity, rally_full) Change-Id: Ica03bdd60224d97ef0ec0d45c2cd25c295723ffc Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-23Check shell scripts via bashateCédric Ollivier5-20/+34
It also removes functest/cli/functest-complete.sh. Change-Id: I5d9313be6a155b4adf1b82ce2b111ec06823cd8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Switch from deploy utils to the right objectsCédric Ollivier4-35/+49
It also prints the full exceptions and removes useless casts. Change-Id: I19ff1ae90670833f998c0d17592da82207235229 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Add debug logs in cloudify_imsCédric Ollivier2-15/+21
Change-Id: I47c6d598ce52f292bf2abdd2e9ecbadff6250712 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Merge "Update graphs in userguide"Cedric Ollivier4-2/+2
2018-04-23Merge "Fix tier/testcases list"Juha Kosonen1-1/+1
2018-04-22Bypass NoneType errors when creating router in rallyCédric Ollivier1-1/+1
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: Ia728415207f8ecb5b5ac55982f82337c45671c4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-21Bypass NoneType errors when creating routerCédric Ollivier1-2/+2
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: I849944fa9d4d2be21fe1a37b76c4cfd231b6d56f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-21Add timeouts in juju_epcCédric Ollivier1-11/+19
juju_epc still hangs if OpenStack isn't well deployed [1]. As releng doesn't publish logs if the job is aborted, timeout has to be added mostly everywhere. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/31/console Change-Id: I0296cd811bda0234aab98f184b3ab247a5b32017 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-21Update graphs in userguideLinda Wang4-2/+2
1. Functest structural concept 2. Clearwater architecture Change-Id: I88e39d6d08f1eb28a389d2b8a7a1669295f6aa49 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-04-21Fix tier/testcases listLinda Wang1-1/+1
Change-Id: I15da2df4905efbca4415739fd7c6391b51168c82 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-04-20Merge "Update version in setup.cfg (Gambia)"Cedric Ollivier1-1/+1
2018-04-20Merge "Last Release updates before tag (master)"Cedric Ollivier3-54/+54
2018-04-20Update version in setup.cfg (Gambia)Cédric Ollivier1-1/+1
Change-Id: I81ad97a441a050ed9469e178dac8e9dc57c5e72d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-20Update configguideLinda Wang1-202/+94
JIRA: FUNCTEST-959 Change-Id: Id75689154a63b7258d753f26bb5ff01c0b06012e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-04-20Last Release updates before tag (master)Cédric Ollivier3-54/+54
Change-Id: Icbe6943d574ab5878833fb0cfbc8cd05c65756d6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-20Merge "Update test results in userguide"Cedric Ollivier2-65/+106
2018-04-20Merge "Update log config for Restapi"Cedric Ollivier1-2/+2
2018-04-20Merge "Fix image paths in cloudify_ims_perf.yaml"Juha Kosonen1-2/+2
2018-04-20Merge "Add Kubernetes test details to functest userguide"Juha Kosonen1-0/+28
2018-04-20Merge "Add Kubernetes test results to functest userguide"Juha Kosonen1-0/+36
2018-04-20Fix image paths in cloudify_ims_perf.yamlCédric Ollivier1-2/+2
Change-Id: If58b5f2021df8a0de672a30459b5b0b12f3fcef2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-20Update log config for RestapiLinda Wang1-2/+2
Change-Id: I3117489d489fe7e948c81f62ccfd04a13351780a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-04-20Update test results in userguideLinda Wang2-65/+106
JIRA: FUNCTEST-958 Change-Id: I45fcdac6c645e52db9d664b7bd96319bbac49a63 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-04-19Add Kubernetes test details to functest userguideKonrad Djimeli1-0/+28
Change-Id: I032bfe5f079c185d6217800b4a4d16e94c29b05c Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
2018-04-19Merge "Introduce Rally scenarios for Gnocchi"Cedric Ollivier4-1/+278
2018-04-19Use timeout to wrap juju-waitCédric Ollivier1-2/+4
It allows getting logs as releng doesn't push them if global timeout. Change-Id: I4bbb3818feff37d29b4ccd586f3e940380feef2e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-19Add Kubernetes test results to functest userguideKonrad Djimeli1-0/+36
Change-Id: I8b9d7a449ea3b123993c6619b368a4afb0dd2e3e Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
2018-04-19Introduce Rally scenarios for GnocchiJuha Kosonen4-1/+278
Added scenarios for testing: - capabilities - status - archive policy - archive policy rule - resource - resource type - metric Change-Id: I79f4f0b2bd4d206588ea3edbce8037d1cb993646 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-19Add "Functest Gates presentation"Cédric Ollivier2-0/+134
It should be presented during next "Weekly Technical Community Discussion". Change-Id: Id275aeb8e93bd4bd0b2d91be67a63d1763723451 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-18Clone rally-openstack in functest-smokeCédric Ollivier2-9/+4
It allows getting latest changes verifying Gnocchi. Former neutron tempest tests are also removed. Change-Id: I5910ca012b72b1c5bfb9b0f52591cc9e03051f47 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-18Check app workload in juju_epcCédric Ollivier1-16/+16
It avoids interpreting rsync errors in case of deployment failures. Mysql is still unchecked. Change-Id: I01b4470b86637d0fc322c422f05240a928305158 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Get debug data before cleaning juju_epcCédric Ollivier1-0/+6
It could help us to detect the issue when testing Apex (nosdn). It should be only printed on exceptions instead but this proposal is safer and straightforward. Change-Id: I2cccc737e3b3572af72c2653bf32bc02f9ab9077 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Set scp debug flag in juju_epcCédric Ollivier1-3/+3
Change-Id: Ic57d05416ac7c8bc459363ea479237101c22f27e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Update Xtesting to 0.41Cédric Ollivier1-1/+1
It includes an enhancement about logger (needed by sdnvpn). Change-Id: I05173d2f5b86e12f6badc83e9ee71ecd5898ecee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Enable sdnvpn (Gambia Release)Cédric Ollivier3-3/+1
sdnvpn has been synced to OpenStack Queens [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/55531/ Change-Id: I468752394da12023083d83f92c91b09ecf964a26 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Merge "Add Kubernetes tests to userguide"Linda Wang1-1/+17
2018-04-17Add Kubernetes tests to userguideKonrad Djimeli1-1/+17
Change-Id: Iaa278269650449b2be19de6382e4e35896001984 Signed-off-by: Konrad Djimeli <konraddjimeli@gmail.com>
2018-04-15Fix emails and copyrights in all conf.pyCédric Ollivier9-27/+27
Change-Id: Idbd735443ec106f14e088c1469701507c28d7545 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Upates Installer results (master jobs)Cédric Ollivier6-83/+95
Change-Id: I3bf93c2c76b1c0f624d605be2c9534ac23558ee7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Update configguide (latest results)Cédric Ollivier1-27/+23
Change-Id: I5eb2f3b0096e57c9f72c07a8adea3bbe4aae3ec7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Remove odl_netvirt testcaseCédric Ollivier7-56/+2
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Filter only on scenarios if possibleCédric Ollivier2-6/+6
If a scenario is defined, setting installers as dependencies makes the maintenance more difficult. Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>