summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-11-21Clean Functest images for CI jobs on ARMLinda Wang1-4/+0
Change-Id: I3e9d8122bf67296d6270583efeda34ac64e21e68 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15[Functest] Switch ARM jobs to Alpine containersJose Lausuch5-139/+5
Change-Id: I2de88bcf0407b89579447159ed0ed233fbd62553 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-10-17[Functest] Add TESTCASE_OPTIONS env variable to the Alpine containersJose Lausuch1-3/+3
This patch also removes the --report flag when running a single test case (functest-suite type of jobs) Change-Id: Ic94fba53ced7c6f908905c02577e1b104f15afb7 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-10-17[Functest] Cleanup daily Jenkins jobJose Lausuch1-86/+1
There is a former job template which was used for testing Alpine containers at the beginning on 2 alpine-pods. That is not needed any longer since we are running Alpine everywhere. Also, this patch re-orders the builders. Change-Id: Iabb41552f513773ebae1170232b8db1aeceb9a59 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-10-16Get daisy installer IPAlex Yang1-0/+18
Now the job functest-daisy-baremetal-daily-master runs on zte-pod3, but the INSTALLER_IP in [1] belongs to zte-pod2. Use virsh and arp commands to get the real INSTALLER_IP. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/151/console Change-Id: I9e297b8f7a240437f81b4c3e2eab5949ac9d5e51 Signed-off-by: Alex Yang <yangyang1@zte.com.cn>
2017-10-03Fix Yamllint violations for jjb/functestTrevor Bramwell3-616/+638
JIRA: RELENG-254 Change-Id: I89043a1149360d587588e8c887f88cc5192c1692 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-10-02[Functest] Continue the job execution if healhcheck failsJose Lausuch1-1/+1
This will allow the push-test-logs.sh script to be executed in any case instead of exiting directly Change-Id: I03c40e2f368485389a21313f98745217ae634eca Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-29[Functest] Remove former way to execute run_testsJose Lausuch2-10/+2
It was used in Danube and there are no more Functest jobs that are runnign stable/danube branch. Change-Id: If297487767e8e8ead39aa4a10f58c6554be197b0 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-29[Functest] Remove former way to execute prepare_envJose Lausuch1-7/+1
It was used in Danube and there are no more Functest jobs that are runnign stable/danube branch. Change-Id: I8e8b1f769b76ad511af6086b7a21dd9ae94404f0 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-28Merge "[Functest] Add DOCKER_TAG in Alpine images"Jose Lausuch1-7/+8
2017-09-28[Functest] Add DOCKER_TAG in Alpine imagesJose Lausuch1-7/+8
Change-Id: I8a8d46798ea73364cf0f2b66464d3628d6d572d3 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-28Merge "[Functest] Block daily job if healthcheck fails"Morgan Richomme1-1/+5
2017-09-28[Functest] Block daily job if healthcheck failsLinda Wang1-1/+5
Change-Id: I3ec48bd337f8dc9100ff82f53067954925245dfa Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-28[Functest] Add argument in function run_tiers()Jose Lausuch1-5/+6
Replace single by double quotes, variables should be within double quotes. Change-Id: I5dae42178f5638689a8c46e03a01c12bd42b65e1 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-26[Functest] Avoid reporting results for suite jobLinda Wang1-0/+2
Change-Id: I182962570fc88e181f312ad432daf774b79e44f1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-26[Functest] Fix syntax error in alpine jobLinda Wang1-6/+7
Change-Id: I1bb751e1df37bb00347f5597c95066041b37ead2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-25Merge "Enable daisy euphrates jobs of daily and functest"Morgan Richomme1-3/+15
2017-09-25[Functest] Fix unicode issueJose Lausuch1-1/+1
Change-Id: I40e00a1abfc383bb5f13a8ec140294d3a67e5cbf Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-25[Functest] Fix nits in alpine jobsJose Lausuch2-2/+4
And add debug information for the suite jobs Change-Id: I478a09c689b54f82246a72c19726576ff5aeaffd Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-25Restrict functest running with k8 deploymentLinda Wang2-32/+18
Also, improve suite job with alpine images. Change-Id: I1367dea6b09361641c38ef91652acec5be4fbebb Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-22Enable daisy euphrates jobs of daily and functestAlex Yang1-3/+15
Change-Id: I8c0c088c5b6879033e1d369488b589271e741a68 Signed-off-by: Alex Yang <yangyang1@zte.com.cn>
2017-09-21[Functest] Support functest-suite with Alpine containersJose Lausuch2-22/+92
Updated all the jobs that use functest-suite. For single test cases, we need to know to which docker image the test belongs to. Change-Id: If7db231ccc891233423f2f2bc3aa5b95d048b30a Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-09-20Add functest return status in AlpinesMorgan Richomme2-0/+7
So far we had 2 approaches: * return Functest CI status: can be OK even if tests are FAIL * return Functest Test status: can be FAIL even if all Functest tests are OK (Fail in onboaraded tests) A 3rd way is possible thanks to [1]. We consider only Functest status and Functest tests for the return statement the return will be FAIL only if * error in the framework * error in Functest Tests So concretely, if promise, Doctor can be FAIL, if Functest tests are OK, the return will be PASS [1]: https://gerrit.opnfv.org/gerrit/#/c/42245/ Change-Id: I6c7fbe99d888e43700ddb2dfc9bfd6cc9bfbaed6 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-19functest: Enable euphrates jobsFatih Degirmenci2-2/+2
Change-Id: I536d3182ef7f4b598f734502cc0880201487d968 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-09-19functest: Create jobs for EuphratesFatih Degirmenci3-21/+21
This change switches jobs to euphrates and removes danube jobs. Change-Id: I9e53c595886b6214927c10c380a898e3c7510c7b Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-09-19Merge "Integrate functest with ARM Architecture with alpine images"Morgan Richomme1-1/+8
2017-09-16Enable parser projectshangxdy1-1/+1
Enable parser project since it has tested successfully in multiple installers. Change-Id: I7f6f22910cf2b44975c511d3ff20b822181c18fe Signed-off-by: shangxdy <shang.xiaodong@zte.com.cn>
2017-09-15Merge "[Functest] Exclude vnf tests for virtual deployments"Jose Lausuch1-1/+5
2017-09-14[Functest] Exclude vnf tests for virtual deploymentsJoseLausuch1-1/+5
VNF test cases take long time when executed in virtual deployments, mainly due to the resources assigned to the virtual hosts. Change-Id: Id0591e6217515b04fe163488a89667ac66c06cdd Signed-off-by: JoseLausuch <lausso@Joses-iMac.local>
2017-09-14Apply docker config adaptations to alpinesMorgan Richomme2-3/+5
regression reported by barometer project 1) --privileged=true no more set in docker run 2) wrong INSTALLER_IP -e INSTALLER_IP=192.168.122.169 3) ssh_key no more mounted -v /root/.ssh/id_rsa:/root/.ssh/id_rsa Change-Id: Iccda9d57b7ea4c346ff26e9b2f74320bfe7eec95 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-14Integrate functest with ARM Architecture with alpine imagesDelia Popescu1-1/+8
Read compute architecture form salt master and send it as environment variable. JIRA: ARMBAND-310 Change-Id: I5c44697d1856f4d09df6fbbbf23ec94478e08f21 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2017-09-14[fuel] Handle os cacert for alpine as wellMichael Polenchuk1-7/+7
Change-Id: Ie7e8228dc4316a70c8cd800415108180148f5f31 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-09-13Add reporting for Functest Alpine in RelengMorgan Richomme1-2/+4
Change-Id: I1e72cb5b7ce9441900a239bb593d89275fe7b675 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-12Use old functest container for armband CI runsMorgan Richomme1-11/+37
Functest Alpine not supported yet for aarch64 architecture. Task for Armband project but until support could be done, the traditionnal docker shall be used for armband tests usage of alpine leads to errors [1] [1]: https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/214/console Change-Id: I48e05a0c7cd97989784fd97348bd331425c4877e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-11functest: Fix missing brackets in conditionAlexandru Avadanii1-1/+1
Change-Id: If6d4f6b2ac0266af35b150159a752b8b6f48ad83 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-09-11fuel, armband: Remove SALT_MASTER_IP paramAlexandru Avadanii1-5/+6
Fuel@OPNFV mcpcontrol network (equiv to old admin/PXE net) has been configured to use 192.168.10.0/24 during E release cycle. However, due to overlapping with Ericsson-pod1 networks, we decided to re-use the old CIDR Fuel used before E release (10.20.0.0/24). This allows reusing the INSTALLER_IP param instead of recently added SALT_MASTER_IP param. Current change refactors all usage of SALT_MASTER_IP in favor of old INSTALLER_IP, thus reducing complexity and providing a familiar env to leagcy Fuel users. JIRA: FUEL-285 Change-Id: I1e89cca08ce4cb9bf3a82a06043c91ee26aa0794 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-09-11Switch daily job to Alpine containersMorgan Richomme1-3/+10
The following alpine containers will be launched one after the others: - healthcheck - smoke - features - vnf Old container is kept for suite (which could be refactored later) Jenkins exit condition (return_value) and push_test_logs to be checkeded. Regarding the return condition, I did not reapply the mechanism that returns false when one of the test suite is FAIL. This was misleading for lots of people as for them, red means functest is FAIL.The argument was, if functest jenkins status is blue, people believe that tests are PASS and do not consider the results, which may be FAIL, which may be also misleading... Due to the refactoring I think we can be more Functest Centric and consider that if we succeeded in running the test, our CI status shall be PASS (same behavior than other test projects..HA test FAIL in yardstick do not prevent blue status). Scenario owner must have a look at the reportign page to get more details. Functest PASS means that tests have been succesfully launched, so they know that there are available results To summarize previously Functest OK but 1 or more tests FAIL => red status in Jenkins currently Functest OK but 1 or more tests FAIL => blue status in Jenkins Regarding the push to artifacts, it should be transparent (volume) but the last log links listed on huawei-virtual5 are broken [1] [1]: https://build.opnfv.org/ci/view/functest/job/functest-alpine-compass-huawei-virtual5-daily-master/27/consoleFull Change-Id: I4ed036dda3daae3d46726e5946f9d04897bab9bb Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-08Merge "Add functest-healthcheck alpine to xci-verify-healthcheck-macro"Morgan Richomme1-1/+6
2017-09-07Move back to opnfv/functest-* for alpine containersMorgan Richomme1-1/+1
Temporary solutions relied on ollivier/functest-* but now opnfv/functest-* are well produced and can be used as official reference for CI Change-Id: I02b5a03929d5b31df0db2a6c4722edf62b920df9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-06functest: verify job should be multijobAlexandru Avadanii1-0/+2
Change-Id: I3b62e855be9205326fee1fa8b2b56cb2276c689c Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-09-06functest: verify: build-timeout, ssh-agent-wrapperAlexandru Avadanii1-0/+5
Change-Id: I2754c7d5502a05ef0fa1dec9dbd14b4c97b70f11 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-09-06functest: Move verify back to opnfv-build-ubuntuAlexandru Avadanii1-1/+1
Recent rework changed the label for the verify jobs from "opnfv-build-ubuntu" to just "opnfv-build", trying to make it more OS-agnostic. Since verify jobs fail after the rework, try reverting the label change, hopefully it will fix the failure as well. Change-Id: I15d139d8dc2d2f940a1af2c1b5fb218d6be19f82 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-09-06functest: Fix verify job triggerAlexandru Avadanii1-2/+6
Commit 27f5d5c refactored the functest verify jobs, but also introduced an issue triggering said job by not passing project and branch parameters to the new trigger macros. Change-Id: I7a61a1f85df345c090813b5060959fa79d294f9b Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-09-05Add functest-healthcheck alpine to xci-verify-healthcheck-macroMorgan Richomme1-2/+7
- add the rc file retrieval in fetch_os.sh - adapt alpine to split healtcheck from daily (healthcheck + smoke + features) - adapt the xci builder Change-Id: I38836814240a1d769d379a10c9ef14def7e6df97 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-05multiarch: Add functest x86_64, aarch64 verify jobsCatalina Focsa1-46/+150
Add a verify job for each architecture. JIRA: https://jira.opnfv.org/browse/ARMBAND-233 Change-Id: Ia99292504ac54d6b2870bd2a490e9d5f09c3f49a Signed-off-by: Catalina Focsa <catalina.focsa@enea.com>
2017-08-31cleanup of obsolete non-CI arm PODsCharalampos Kominos1-32/+0
Change-Id: I134feba421d12c4ca428b098aaa2bf52b3dec0ca
2017-08-29Merge "[fuel] Handle os cacert for baremetal deployments"Trevor Bramwell1-7/+8
2017-08-29Do not redirect errors in ${redirect}Cédric Ollivier1-1/+1
${redirect} can be equal to /dev/null. Change-Id: Ie66ee7ca2da92270de8619399a7f362acff8873a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-28[fuel] Handle os cacert for baremetal deploymentsMichael Polenchuk1-7/+8
Change-Id: I02503772dc5ed59562c2e0aba96280e2cae1da50 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-08-26Avoid exiting the script if an error happensLinda Wang2-0/+2
1. Avoid exiting the script if an tier fails 2. Push logs to artifacts Change-Id: Ia258994e4694bb71615f7adc18967afcc237813f Signed-off-by: Linda Wang <wangwulin@huawei.com>