summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-01-21Uplift Armband to Fuel NewtonAlexandru Avadanii60-2423/+1983
[ Dan Andresan ] - puppet: database: Fix Percona XtraBackup sync [ Alexandru Avadanii ] - disable all plugins; - re-enable remote tracking; - remove "Revert: Point to specific snapshot ..."; - patch context adjustments; - obsolete "kernel-bump", linux-image-lts-xenial is now the default; - network-checker iface state check now fixed upstream [1]; - fuel-nailgun-agent hugepage size should also check /proc/meminfo; - fuel-nailgun-agent CPU detection for AArch64; - nova AArch64 hugepage support is now upstream; - obsolete Cirros Test VM direct kernel boot (by switch to AAVMF): * f-l/0001-upload_cirros-Add-direct-kernel-boot-support.patch * f-w/0001-direct-kernel-boot-for-cirros.patch - rework m1.micro RAM size patch after puppet manifest split upstream; - re-enable arch-agnostic plugins which were rebased in Fuel@OPNFV: * f_yardstick-pluginbuild * f_congress-pluginbuild - do NOT retire MySQL SST provider patch series (nack: ARMBAND-186), rebase (and keep for now) MySQL SST provider patches, as trying to use xtrabackup-v2 revelead a regression since Colorado.3.0, and these patches simplify troubleshooting a lot; - AArch64: nova: libvirt: Use host-model cpu (ARMBAND-193); - AArch64: nova: libvirt: Use pointer_model instead of use_usb_tablet; - m1.micro RAM size insufficient for TestVM with AAVMF (s/128/256/) - switch Cirros TestVM to AAVMF from direct kernel boot; - backport nova libvirt driver fix for deleting instances booted with AAVMF firmware from [2]; TODO (later): - Include ISO build time fixes for cirros_testvm in Armband package; TODO (ODL, later): - test & revise leveldb patching; - bring back Qugga patching for arm64; - configure systemd service to automatically respawn; [1] https://review.openstack.org/#/c/417373/ [2] https://review.openstack.org/#/c/357190/ JIRA: ARMBAND-29 JIRA: ARMBAND-32 JIRA: ARMBAND-63 JIRA: ARMBAND-88 JIRA: ARMBAND-116 JIRA: ARMBAND-118 JIRA: ARMBAND-186 JIRA: ARMBAND-193 JIRA: ARMBAND-194 JIRA: ARMBAND-195 JIRA: ARMBAND-196 JIRA: ARMBAND-197 Change-Id: Ia99022e364e61245d109cabab9d0ed7157b4d2f5 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com> Signed-off-by: Dan Andresan <dan.andresan@enea.com>
2016-12-21deploy-cache: Fix home dir expansion in .ssh pathAlexandru Avadanii1-1/+1
JIRA: ARMBAND-184 Change-Id: I26a79ac6c4ec4314fb21fc55b43985488c1b5fde Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-20deploy-cache: Fix one more time id_rsa injectAlexandru Avadanii1-1/+1
JIRA: ARMBAND-184 Change-Id: Ie88d1d2a16cbce6987ac12f226e48acc1fc81d9b Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-20build: select_ubuntu_repo: break on errAlexandru Avadanii1-0/+70
Backport urgent fix [1] from Fuel@OPNFV to unbreak all CI verify/build jobs in Armband. [1] https://gerrit.opnfv.org/gerrit/#/c/26269/ Change-Id: Icf5a84b62eb39edd922ab98a45b2c26c478466f6 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-19patches: fuel-mirror: Remove obsolete patchesAlexandru Avadanii3-117/+0
fuel-mirror has been replaced by packetary and all its patches we held in Armband are now obsolote as well. JIRA: ARMBAND-185 Change-Id: I1b83501965394ea8080305428bad17c826c5cf42 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-18deploy-cache: Fix bootstrap id_rsa injectAlexandru Avadanii1-1/+1
JIRA: ARMBAND-184 Change-Id: Ibcc70205f0688ce43e27d6d1361d513f15b4576b Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-17sub: packetary: remove, patches upstreamAlexandru Avadanii7-291/+313
Backported from [1] and adapted for Trusty, since Armband did not switch to Ubuntu Xenial / Openstack Newton yet. [1] https://gerrit.opnfv.org/gerrit/#/c/23999/7/ JIRA: ARMBAND-185 Change-Id: I1dd2cec09aa1077a5779573bc54c01db93339ac9 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-17ci/build.sh: improve robustnessAnders Roxell1-1/+1
Change-Id: I6324439f887c5d286052128ed1b627f5fec42b31 Signed-off-by: Anders Roxell <anders.roxell@enea.com>
2016-12-15fuel-main: Restart sshd service instead of reloadAlexandru Avadanii1-0/+26
Backported from [1] until we switch to Newton and sync again with Fuel@OPNFV master. [1] https://gerrit.opnfv.org/gerrit/#/c/25867/ Change-Id: I0972218eaf7aeb9cb435f6408e140b502fc1c0ed Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-14fuel-library: pp: cobbler: Fix CentOS ver detectAlexandru Avadanii2-2/+41
Upstream fuel-library bug report: [1]. Recently, CentOS released version 7.3.1611, which triggered a latent bug in fuel-library puppet scripts related to differentiating between 6.x and 7.x major versions: 7.3.1611 is wrongly detected as 6.x, leading to the wrong packages being attempted to be installed, leaving nailgun server service broken on the Fuel Master node. This change forces the match at the beggining of the version string (e.g. "/^6.+/: {" instead of "/6.+/: {"), so the new CentOS 7.3.1611 no longer matches the condition for 6.x). This patch will soon be obsoleted by the Netwon switch. However, until that happens, we need to ensure CentOS 7.3 is not breaking the deploy. [1] https://bugs.launchpad.net/fuel/+bug/1649895 JIRA: FUEL-238 Change-Id: Iebda7e13d66191614c3552dacb6c80091215baf5 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-12deploy-cache: Fix bootstrap cache locationAlexandru Avadanii1-1/+1
We recently changed the location of the deploy cache artifacts on Fuel Master, which failed to also update the bootstrap_admin_node.sh harcodes. JIRA: ARMBAND-172 Change-Id: I1244beca0b5f386efb7ae255fadb0ef69eb559de Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-09deploy-cache: Fix opnfv-bootstraps-cache contentsAlexandru Avadanii1-15/+12
fuel-bootstrap import expects all artifacts to be placed in the archive root dir, so adapt our scripts accordingly. Change-Id: I18ba5cb0f81b1193bc75067ec7c83367f45c0375 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-08deploy-cache: Misc fixes and improvementsAlexandru Avadanii1-36/+49
- move cache dir on Fuel Master to /var/cache/opnfv, since /var/lib/opnfv is deleted during env config; - allow target image collection on environment deploy failure too; - create cache directory if missing for bootstrap extraction; JIRA: ARMBAND-172 Change-Id: Icca650e560913345303ca0430a4d8b38183aa0c9 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-07Merge "Fix failed deploys on virtual pod (noha scenarios)"Cristina Pauna1-53/+627
2016-12-07fuel-plugins: Enable yardstick plugin buildAlexandru Avadanii1-1/+1
JIRA: ARMBAND-174 Change-Id: I6a7c76e31b26aa13c82bc755c8985526b5083ecc Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-07Fix failed deploys on virtual pod (noha scenarios)cristinapauna1-53/+627
JIRA: ARMBAND-173 Currently only ha scenarios were successfully deployed on virtual pods The default configuration is for ha scenarios and those have 5 target nodes while on the noha scenarios there are 4. The noha scenarios failed because it was trying to parse one extra node. This patch modifies the dea and dha files for each noha scenario so that the nodes are properly configured. Change-Id: I360aeaf8dc92e0ff614367d47d74f6fa61ef2268 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-06deploy-cache: Fix typos in bootstrap collectAlexandru Avadanii1-3/+3
Change-Id: I2d30e72cf218251e1b823619501454a65006dd9d Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-05Update docs for Colorado 3.0 releasecristinapauna3-23/+16
Change-Id: I93156463e63d71e8b32446b3dfbfe61a7929bf38 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-02Merge "Update documentation for Colorado 3.0 release"Alexandru Avadanii3-36/+27
2016-12-02Update documentation for Colorado 3.0 releasecristinapauna3-36/+27
This is the first update on documentation for C3 release Mostly updated the links and Jira filters Change-Id: Idd4d6dd92b1ff3972bbcfb1f8b49e547160b6ed9 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-01Merge "fuel-plugin-opendaylight: Upstart service: Respawn"Alexandru Avadanii1-0/+38
2016-12-01fuel-plugin-opendaylight: Upstart service: RespawnAlexandru Avadanii1-0/+38
On arm64, JVM sometimes (~10%) crashes at the very start, due to JIT issues in our openjdk8 package. We can't really solve the JVM on arm64 issues in the near future, so we will try to work around the issue by configuring the ODL service as respawn-able (see [1] for more details). Note: This is specific to Ubuntu Trusty (14.04), which uses upstart, for Ubuntu Xenial (or anything else >14.x), which uses systemd, a different, equivalent mechanism should be used. [1] http://upstart.ubuntu.com/cookbook/#respawn JIRA: ARMBAND-134 Change-Id: I0dc82e4a6d0cc485e981477e6a25dbad95db930b Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-01deploy-cache: Fixup targetimages extract typoAlexandru Avadanii1-1/+1
JIRA: ARMBAND-172 Change-Id: I9f549e0161d39d8f72fff698cfc26c164b0f10ae Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-30CI: deploy-cache: Store and reuse deploy artifactsAlexandru Avadanii1-0/+738
Add support for caching deploy artifacts, like bootstraps and target images, which take a lot of time at each deploy to be built, considering it requires a cross-debootstrap via qemu-user-static and binfmt. For OPNFV CI, the cache will piggy back on the <iso_mount> mechanism, and be located at: /iso_mount/opnfv_ci/<branch>/deploy-cache TODO: Use dea interface adapter in target images fingerprinting. TODO: remote fingerprinting TODO: differentiate between bootstraps and targetimages, so we don't end up trying to use one cache artifact type as the other. FIXME: This is still a bit hacky in some areas, but we need it ASAP. JIRA: ARMBAND-172 Change-Id: Iecd293db98c061325643cc61863a48f092bfd491 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-27Correct previous patch on fuel reworkcristinapauna1-20/+28
Some leftover chars in https://gerrit.opnfv.org/gerrit/#/c/24901/ were keeping the deploy to work. Also, the empty folder networks was added. This folder should contain templates for virtual network config for the targets. For arm we don't need those so we leave it empty for consistency with other projects and for avoiding changing the deploy logic JIRA: ARMBAND-122 Change-Id: Id33e2efacc3ff8d3754c8b29d4bebefd0b385c41 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-11-25Fuel rework for multiple libvirtcristinapauna1-0/+938
The current fuel arhitecture assumes that all the VMs (Jenkins slave, Fuel master and Target nodes) are all on the same server. There is code that allows the Fuel master to be on a different machine, but nothing for the Target nodes. In Enea-Arm lab we have a different server for each. This commit also adds specific templates for a virtual pod in the Enea-Arm lab. Therefore, the following changes are done: - The default libvirt URI is the machine on which the Target nodes are - The parameter libvirtUri was added in the dha.yaml file for fuel master - All virsh calls have "-c" option to explicitly specify the uri; this parameter is set only when libvirtUri is explicitly set in the yaml file - The scenarios dha override now point to the arm template files - The network templates are not needed for ARM, as the network infra is provided by the server on which the Target node VMs reside; the folder is added here just for consistency - The target nodes are created with virsh rather than quemu when the nodes are not on the same machine as Jenkins slave (similar logic to what is done for remote Fuel master) JIRA: ARMBAND-122 FIXME: remove hardcodes for - Network bridges from templates - Default pool - libvirtUri from scenario overwrite Change-Id: Ibf4744e5593f5201550115397024fd8311696074 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-11-21Merge "fuel-plugin-opendaylight: Prebuilt leveldbjni DEB"Alexandru Avadanii3-254/+52
2016-11-21local mirror: Add missing vgabios for arm64Alexandru Avadanii1-1/+3
JIRA: ARMBAND-169 Change-Id: I4dbcd044c6c146f541e8c005282a4e60af2c3c8a Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-20fuel-plugin-opendaylight: Prebuilt leveldbjni DEBAlexandru Avadanii3-254/+52
Switch from deploy time building of leveldb + leveldbjni to using a prebuilt artifact, shipped as a DEB package from Armband repos. JIRA: ARMBAND-114 Change-Id: Ic7a52c78e803c1a6ebda1f127774959a0880a5a3 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-20f_repobuild: Fixup missing OPNFV plugin depsAlexandru Avadanii1-21/+22
Packetary solves "libasound2" with "liboss4-salsa-asound2" from universe, leading to openjdk failing to install. Work around this by altering recently introduced packetary-driven local mirror build to include OPNFV plugin deps into the "main" package list. JIRA: ARMBAND-167 JIRA: ARMBAND-35 Change-Id: I040a7117c7ae809933a400ae00937ab8fcc1ea0e Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-19f_odlpluginbuild: Armband prereq in packages.yamlAlexandru Avadanii1-0/+40
We need to explicitily add our Armband leveldb patching prereq tools, like maven, git, make etc. to the ODL plugin's packages.yaml, so they are included in the offline Ubuntu mirror. While at it, also add openjdk-8-jre amos version additional dep: - libasound2 JIRA: ARMBAND-167 Change-Id: I17fa7a4727b8a553f5a46ab13267380a8864c728 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-19fuel-plugin-ovs: FIXME: Pin to pre-Newton upstreamAlexandru Avadanii1-1/+2
Upstream Fuel@OPNFV made the switch to Newton, while in Armband this will happen later. Until then, pin the latest Mitaka compatible version, i.e. use the Fuel@OPNFV reference from the Colorado branch. While at it, add missing change var for upstream fuel-plugin-ovs git repo, to prevent issues like ARMBAND-166 from happening on Armband master later. JIRA: ARMBAND-166 JIRA: ARMBAND-118 Change-Id: I0630c2349befa3bdfbbb01b4ad401660d8cfd5fe Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build: fixtures: Fix local Ubuntu mirror URIsAlexandru Avadanii1-2/+2
Previous commit (bcdc1eaa74d5efd5f8c80600fb30d722bae9a421) confused the URL of the local Ubuntu mirror with the local MOS mirror. JIRA: ARMBAND-35 Change-Id: Icfb68e88e61c238cf650b84b269d16f9a52f9f26 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build: Add local Ubuntu mirror to target imageAlexandru Avadanii1-1/+13
When deploying via Jenkins CI, the repos used for target image building are overridden to use the local Ubuntu mirror on Fuel Master instead of fetching packages from internet. However, when deploying manually, only bootstrap image building benefits from the local Ubuntu mirror. While keeping the internet mirrors, add the local Ubuntu mirror to target image build repo list. JIRA: ARMBAND-35 Change-Id: Ibd58067703ce6370781a6b54fd01ce52e29686ac Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build/install: Fix missing arch list from ReleaseAlexandru Avadanii1-1/+2
During the previous attempt to fix the local mirror rebuild by reworking `atp-ftparchive` configuration, we removed the arch list from the main configuration, which led to the local Release file missing "Architectures" entries. This led to "/etc/fuel_openstack_arch" not being populated, binfmt not starting on the first boot, and bootstrap build failing. Bring back the "Architecture" config line to restore the old behavior. JIRA: ARMBAND-163 Change-Id: Ica64fcd60ed4e0185d2cab5457603b42d3d55af8 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16FIXME: build: Temp pin to pre-Newton Fuel@OPNFVAlexandru Avadanii5-1/+1
Until we populate Armband repos with Fuel Newton packages, we cannot build the Newton version of Fuel@OPNFV in Armband. Therefore, temporarily pin the upstream repos to pre-Newton commits. JIRA: ARMBAND-118 Change-Id: I34d44c4fabe59c32a7f2c45424dd80e9ae3e04bc Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-15Merge "AArch64: Ubuntu local partial mirror: Add arm64"Alexandru Avadanii8-48/+800
2016-11-15AArch64: Ubuntu local partial mirror: Add arm64Alexandru Avadanii8-48/+800
NOTE: Temporarily patch "packetary" in Armband until we upstream two small fixes. Bootstrap build, deploy target image build: - Switch from public Ubuntu mirrors to 10.20.0.2. JIRA: ARMBAND-35 Change-Id: I14645cfeebb486063e7b8198de273f68285b11cd Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-15build/docker: Import Enea Armband keysAlexandru Avadanii2-3/+24
JIRA: ARMBAND-96 Change-Id: I28ab3030d3f31c5734508838985412a33334570a Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-11build/install: Fix paths in apt-ftparchive confAlexandru Avadanii1-34/+53
JIRA: ARMBAND-163 Change-Id: I3fd5a8a826372afc323665abe229c7e67991e31a Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-03fuel-plugin-ovs: Bind to stable/9.0 branchAnders Roxell3-1/+78
Previously, fuel-plugin-ovs did not have a stable branch for Fuel 9, but now it does, and since fuel-plugin-ovs/master was reworked for Fuel 10, we need to switch to it. v1 -> v2: Backported one patch that was not cherry-picked on stable. Change-Id: I58467e441763b35e5296cb29433eb941e65eec3f Signed-off-by: Anders Roxell <anders.roxell@enea.com> Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-28Merge "build: Rebase after cirros bump / GPG addition"Alexandru Avadanii2-12/+8
2016-10-28patches/fuel-plugin-ovs: fix version bump of libxenstore3.0Anders Roxell1-1/+5
Change-Id: I4c232fec4f35add7b04faf305cdf53dde70d7e92 Signed-off-by: Anders Roxell <anders.roxell@enea.com> Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-28build: Rebase after cirros bump / GPG additionAlexandru Avadanii2-12/+8
Slightly edit patch context to match upstream changes [1, 2]. [1] https://gerrit.opnfv.org/gerrit/#/c/22559/ [2] https://gerrit.opnfv.org/gerrit/#/c/21823/ Change-Id: Ibdb3b557f3e482f74d345a1e0e1eedda26879179 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-18build: Add <debug> make targetAlexandru Avadanii1-3/+5
Pass `make debug` to Fuel@OPNFV build system. debug requires Fuel@OPNFV submodules to be initialized, since `f_repobuild` relies on fuel-mirror submodule. Change-Id: Ia64a7d79143c00fc09076472ad346f0cdc20c2b5 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-18FIXME: build: Revert using mirror snapshotsAlexandru Avadanii1-0/+43
Armband does not yet have DEB/RPM repo snapshots, so revert upstream Fuel@OPNFV change enabling them. JIRA: ARMBAND-155 Change-Id: Ib08c36bf28a66ef38d8b33031dcbf363fb34123c Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-17Merge "Revert "FIXME: Temporary: Use archive.ubuntu.com only""Alexandru Avadanii1-152/+0
2016-10-17Revert "FIXME: Temporary: Use archive.ubuntu.com only"Alexandru Avadanii1-152/+0
Now that [1] has been merged, we should stick to upstream behavior. [1] https://gerrit.opnfv.org/gerrit/#/c/22975/ This reverts commit f653f97dd2591f4cd5bcb4e76eb2134a93f6d460. Change-Id: I5f23dd6e1b113e8a7d06995e479287ff196410dd
2016-10-13Merge "ci/{build,deploy}.sh: Move `export TERM` to releng"Alexandru Avadanii2-4/+0
2016-10-12Upstream: Fuel@OPNFV: Fuel Master VM templatesAlexandru Avadanii2-183/+0
While at it, also upstream: "build: Use OPNFV_GIT_SHA for ISO preparer ID" JIRA: ARMBAND-146 Change-Id: Ifcd7b3041d172aa492e26477c0872cd96efd90ba Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>