Age | Commit message (Collapse) | Author | Files | Lines |
|
|
|
|
|
|
|
We should reload the XCI environment before running functest in order to
ensure that playbooks have the correct information from the XCI
deployment.
Change-Id: Ieadeca61d3ea3e504e21aa96945ad067f20d1489
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
This change enables Functest for kubernetes scenarios but any change
that impacts kubernetes scenarios will fail and block the change from
merging until the prepare-functest playbook and role are fixed in
releng-xci.
Change-Id: I046e3a0fb9a211cf9d629899017922288d466b0c
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Commands may exit with non-zero exit code but this could be normal (for
example grep does than when it doesn't match anything). As such, lets
not fail on everything but rather capture such failures and handle them
appropriately.
Change-Id: Icc16d0ccd09fd6f262600ae514161bfdf0c593f1
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
The bifrost jobs are using some scripts from the releng-xci repository
so we need to set the XCI_PATH variable appropriately.
Change-Id: Ibfd139d2401029b2ea577c4797b68f29362356ec
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
Previously, the code was already setting the default scenario if we had
changes outside the xci/scenario directory. However, this is somewhat
problematic since scenarios may touch other files which do not necessary
affect other scenarios such as anything in xci/playbooks etc. As such,
lets only set a default scenario if no scenario was set up to that
point. However, since installers and scenarios need to match, we also
need to consider installer changes because we fallback to the default
scenario. Finally, since we are filtering results with 'uniq' we can
simply drop the bash regexps prior to adding the scenario to the array.
Change-Id: Ie961071b3e93d04a860bb6655513654208b1a9d4
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
There is not reason to grep the logs for failures because we can simply
preserve the functest exit code and use that to determine whether the
job passed or not.
Change-Id: I9f027960fd3d9d452d417b95e9dac66bbb314a47
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
The list of supported scenarios is hardcoded and this makes it difficult
to test new scenarios. As such, lets determine the scenario and the
installer based on the actual files that have been changed on every
patchset.
Change-Id: I4868a1da08d58cd6ff37347a0c0bc5c5e28b15bb
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
Change-Id: I609b796c629c68df214634ced5e9e6bda8ac2607
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: I20eb3c89c199b09ce839ae4ef6dfdcdd34dc58cf
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
|
|
Change-Id: Id6ea4f8124bdfe8c4233400d216d503fa101b0cb
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
|
|
We need the variables CI_LOOP, BUILD_TAG, and NODE_NAME
passed to the deployment to display during functest execution.
Change-Id: Ib6709678d760d43927d3cd9f606d2c7e74e724d0
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: I16eed2ec0ca1fa659fc449799813c02b19b08174
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
It would be good to point to the link of the job that promoted
certain scenario and display promotion date/time so we know when
was the last time the scenario has successfully been promoted.
Change-Id: I8099cf48f0ba5000cbf7622aa084f863f123eb15
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: I55e5042fda4bf5662a90f0065fa427a50bc76bfa
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
Change-Id: Ieab479d257fb1922136eb343d1dd25f2006c2ac2
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: I981b115bc37f034db991667a29f0ce66b239cbdf
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
These variables are needed for displaying details of functest run.
Apart from that and more importantly, FUNCTEST_SUITE_NAME will be
important for adjusting the criteria for verifying and promoting
scenarios.
Change-Id: I7a3c82c6babc4d5e057b26fda697e9fc969c8526
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
|
|
verify-centos jobs do not vote for patch verification since
things on centos are still shaky. Make merge-centos jobs
non-voting for promotion as well by not allowing them to
fail the entire promotion job or by stopping the promotion.
Change-Id: Idf7b3c7586d94454ff94cd0bccf42f02954c722c
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: Iacbd6515de08e77e3874354fc8e23a6cf8f7bf61
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
|
|
envInject doesn't play well with variable expansion so it is fixed. [1]
Scenario support check is not necessary for promotion since the
promotion job is common for all scenarios/distros and check is done
as part of earlier distro jobs accordingly. [2]
gsutil upload is also made quiet.
Fixed version can be seen from [3].
[1] https://build.opnfv.org/ci/job/xci-merge-promote-virtual-master/2/console
[2] https://build.opnfv.org/ci/job/xci-merge-promote-virtual-master/4/console
[3] https://build.opnfv.org/ci/job/xci-merge-promote-virtual-master/5/console
Change-Id: Ie36394cab631826209dda4cea6daa456aca3c276
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: I61fdcf11cc8008bde1c4e26e7b4fd6f16b6e5a78
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: I1048be7e7a41c56d25c7689678d3811f0a5eae44
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
It is difficuly to have post-merge jobs per scenario since we set
the scenario during job runtime and having jobs per scenario makes
things unnecessarily complicated. Apart from that, there is no
reason to have scenario specific merge jobs either since this is
some kind of verify job and everything is same except the scenario
name itself which we extract via set-scenario script.
Daily and further jobs will be scenario specific since they will
be run on timer and we will have ability to specify the scenario.
Change-Id: I3bf6d5ce0fbc48b2d2b2b9695e198bad229ce08d
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
PROJECT_NAME is added into scenario metadata to use for promotion and xci dashboard.
Also, the metadata collected is aligned across different type of patches including
the skipped ones.
Change-Id: I3751884b48f5d9306d0cae35c757b976484b26a3
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
|
|
We need to enter the $HOME/releng-xci/xci directory instead of
/root/relneg-xci/xci since we are ssh'ing as 'devuser'.
Change-Id: Id05d5012d58443c7f415a58f9f3d1ae16fd25b55
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
Change-Id: Ic9801a2f1282b695025a6dce70e662765ce4296b
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: Id1ac133782e6b90929ddc055efbc6997ff63adc2
Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
|
|
|
|
|
|
Changes coming to these do not impact the framework so there is
no need to run full verification for these.
Change-Id: Ia9f8f4772a94cb0761c49ff27933798265831fa4
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Change-Id: Ide49917687ed583497ca089969fd2c7e7e00e548
Signed-off-by: Periyasamy Palanisamy <periyasamy.palanisamy@ericsson.com>
|
|
Change-Id: Ic914bc5bf11e2246f214990353c804688d6e43d9
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
This change lays down the basic job structure for post merge promotion
jobs. The job structure will be
- a top level multijob job that is scenario specific and can not run
concurrently. This job runs distro deploy and test jobs for all the
distros in the first phase concurrently, followed by a common promote job.
- the deploy and test jobs are same as the xci-verify jobs except the
trigger. They are triggered by top level multijob.
- the promote job is run once all the deploy & test phase jobs successfully
completed, uploading promotion metadata to artifacts.opnfv.org.
The builders except set-scenario are left empty in order to try the basic
job setup first. Followup changes will get real things in.
Once the basics are in place, the first promotion will be done using functest
healthcheck and then we will start working on gating scenarios for promotion
using functest smoke and perhaps feature test cases.
Change-Id: Ib91ffe0f3003b86841a62537c52fde176cafa70f
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
When functest fails, the job exits directly without us logging the
functest output to console. [1] Grepping functest log for FAIL for
determining the result helps us to cat the log before exiting with
right exit code.
[1] https://build.opnfv.org/ci/job/xci-verify-ubuntu-healthcheck-virtual-master/509/console
Change-Id: I01e3dcc51321e935b1722b749e8caf7ec5ad755b
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
|
|
It is not always practical to try determining scenario and installer
to run jobs programmatically. This change adds possibility to do that
by parsing commit message and skipping the automatic scenario and
installer extraction.
Change-Id: I10c9620fe8bb69a2d69fceb31d08084265aa1d75
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
Fixes the following problem
[description-setter] Description set: Scenario: os-nosdn-nofeature | Node: intel-virtual14
[xci-verify-ubuntu-healthcheck-virtual-master] $ /bin/bash /tmp/jenkins7521920744845291696.sh
/tmp/jenkins7521920744845291696.sh: line 21: GERRIT_TOPIC: unbound variable
Build step 'Execute shell' marked build as failure
Change-Id: Iddf82e6ae6c6c433d941c461953c11935bc45269
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
Sometimes we make global changes that affect multiple components at
once and splitting that is not possible because it needs to be shipped
as an atomic change. As such, allow topics with 'force-verify' to run
the CI using the default installer and scenario.
Change-Id: Ie4753822111b20c4f479886a55fe569c9b91ccd0
Signed-off-by: Markos Chandras <mchandras@suse.de>
|
|
Change-Id: I5312ac784b1621ce968bbdfb1532859dada0e790
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
|
|
Variables injected by envInject are set after the job variables
which results in not setting the variable correctly. The Jenkins
test script now uses the variable injected by envInject to set
the INSTALLER_TYPE to XCI_INSTALLER.
Change-Id: Id79281a2ee22d407ffb1bd7c4be1471f6f329803
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
We need to work on functest healthcheck for Kubernetes scenarios.
Until we get it working, healthcheck is disabled.
Change-Id: If470dbe956c5859825f0829d1f8d022bdafcc242
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|