summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-02-03Rebase: Adjust patch context for deploy configAlexandru Avadanii1-1/+6
Change-Id: I3d1b15cbfd70d726ae8b24514d2106e7e52e2524 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-02-01Upstream: packetary multiarch mirrorAlexandru Avadanii1-1223/+0
Packetary-based rework was merged in Fuel@OPNFV in [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/23999/ JIRA: ARMBAND-185 Change-Id: I19958467acd62c7b3469a1172a5b93b544782b09 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-02-01docker: fpb: Obsolete src overrideAlexandru Avadanii3-55/+2
Fuel@OPNFV recently applied a better fix for using the latest version of fpb, so obsolete our patch. Change-Id: I088fc31177e5c56ce09712b65a3dbd18eb013ce5 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-31f_bgpvpn-pluginbuild: Enable after Newton rebaseAlexandru Avadanii1-2/+2
Fuel@OPNFV rebased and bumped the BGPVPN Fuel plugin for Newton, so enable building it for Armband ISO too. JIRA: ARMBAND-202 Change-Id: Ifd59f060f828855d85a9621fcfed7a43f33d48fd Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-30Fuel-plugin-odl: fix ODL cache corruptionDan Andresan1-7/+20
Modify Puppet recipe to restart Opendaylight service after leveldbjni This avoids a cache corruption described in ARMBAND-211 JIRA: ARMBAND-211 Change-Id: Iab126c7058032044c1789ea41c17ba15ced73b77 Signed-off-by: Dan Andresan <dan.andresan@enea.com>
2017-01-25fuel-plugin-odl: Patch leveldb before jetty.xmlAlexandru Avadanii1-24/+20
With systemd, leveldb patching happens too late, and the cache (/opt/opendaylight/data/cache) gets corrupted. Try moving the leveldbjni puppet class before jetty.xml patching, and also transform notification arrow into simple ordering arrow. While at it, simplify patch by removing obsolete fragments. JIRA: ARMBAND-202 Change-Id: I168b13266f2b4eeac4b8c8008d248f1884858b67 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-25fuel-plugin-odl: Uplift OpenDaylight to Fuel10Alexandru Avadanii2-4/+32
JIRA: ARMBAND-202 Change-Id: Ife5a5a34f272cb77dc88c2f927d4129e025a3846 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-25deploy-cache: Fix typo in nailgun settings sedAlexandru Avadanii1-1/+1
Previous commit missed adding the "-i" flag to a sed call, rendering the whole effort useless. JIRA: ARMBAND-190 Change-Id: If0724cb99c94530e5eeb140e93759c4a19503908 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-24deploy-cache: Relax repo fingerprintingAlexandru Avadanii1-22/+13
JIRA: ARMBAND-206 Change-Id: I054a287593a327fa16941f6c9fec802e9ce2fac8 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-24deploy-cache: Sync nailgun settings explicitlyAlexandru Avadanii1-5/+7
/etc/nailgun/settings.yaml AUTHORIZED_KEYS is populated before the bootstrap image (and cached keypair) are injected, so it needs to be synced explicitly. JIRA: ARMBAND-188 JIRA: ARMBAND-190 Change-Id: I8e4004e1ec62ace1dd127ee19127190bc295b0e2 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-23deploy-cache: refresh authorized_keys from id_rsaAlexandru Avadanii1-33/+36
When bootstrap cache is present, the cached id_rsa keypair is copied to Fuel Master node after the initial packages are installed (cobbler pp copies id_rsa.pub as /etc/cobbler/authorized_keys). This leaves behind out-of-sync cobbler configuration, generated from the fresh id_rsa.pub instead of the cached one. While at it, also fix Fuel Master authorized_keys from ~/.ssh, which is transferred via /etc/nailgun/settings.yaml to deployed nodes, leading to nodes rejecting subsequent key-based ssh logins. JIRA: ARMBAND-188 JIRA: ARMBAND-190 Change-Id: I58b45c9522b16c7d05dafcd1acaff4b8cc30013e Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-22patch-packages: Disable for ArmbandAlexandru Avadanii2-28/+88
Now Armband also patches test-vm with an updated x86 image in the upstream repo, so we can disable patch-packages for cirros-testvm during ISO build. Since Armband can patch packages at the upstream repo level, disable patch-packages completely. JIRA: ARMBAND-200 Change-Id: I5531460c1dd18d94b680d40971713d090be8c353 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-21f_repobuild: Pull packetary patch from upstreamAlexandru Avadanii1-63/+65
Sync sensitive packetary change with upstream [1]. Once validated in Armband, we should be able to also push [2]. [1] https://review.openstack.org/#/c/420815 [2] https://gerrit.opnfv.org/gerrit/#/c/23999/ JIRA: ARMBAND-185 Change-Id: I2aa28daf217e01a5cd905a77141903758d085de7 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-01-21Merge "Uplift Armband to Fuel Newton"Alexandru Avadanii60-2423/+1983
2017-01-21Uplift Armband to Fuel NewtonAlexandru Avadanii60-2423/+1983
[ Dan Andresan ] - puppet: database: Fix Percona XtraBackup sync [ Alexandru Avadanii ] - disable all plugins; - re-enable remote tracking; - remove "Revert: Point to specific snapshot ..."; - patch context adjustments; - obsolete "kernel-bump", linux-image-lts-xenial is now the default; - network-checker iface state check now fixed upstream [1]; - fuel-nailgun-agent hugepage size should also check /proc/meminfo; - fuel-nailgun-agent CPU detection for AArch64; - nova AArch64 hugepage support is now upstream; - obsolete Cirros Test VM direct kernel boot (by switch to AAVMF): * f-l/0001-upload_cirros-Add-direct-kernel-boot-support.patch * f-w/0001-direct-kernel-boot-for-cirros.patch - rework m1.micro RAM size patch after puppet manifest split upstream; - re-enable arch-agnostic plugins which were rebased in Fuel@OPNFV: * f_yardstick-pluginbuild * f_congress-pluginbuild - do NOT retire MySQL SST provider patch series (nack: ARMBAND-186), rebase (and keep for now) MySQL SST provider patches, as trying to use xtrabackup-v2 revelead a regression since Colorado.3.0, and these patches simplify troubleshooting a lot; - AArch64: nova: libvirt: Use host-model cpu (ARMBAND-193); - AArch64: nova: libvirt: Use pointer_model instead of use_usb_tablet; - m1.micro RAM size insufficient for TestVM with AAVMF (s/128/256/) - switch Cirros TestVM to AAVMF from direct kernel boot; - backport nova libvirt driver fix for deleting instances booted with AAVMF firmware from [2]; TODO (later): - Include ISO build time fixes for cirros_testvm in Armband package; TODO (ODL, later): - test & revise leveldb patching; - bring back Qugga patching for arm64; - configure systemd service to automatically respawn; [1] https://review.openstack.org/#/c/417373/ [2] https://review.openstack.org/#/c/357190/ JIRA: ARMBAND-29 JIRA: ARMBAND-32 JIRA: ARMBAND-63 JIRA: ARMBAND-88 JIRA: ARMBAND-116 JIRA: ARMBAND-118 JIRA: ARMBAND-186 JIRA: ARMBAND-193 JIRA: ARMBAND-194 JIRA: ARMBAND-195 JIRA: ARMBAND-196 JIRA: ARMBAND-197 Change-Id: Ia99022e364e61245d109cabab9d0ed7157b4d2f5 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com> Signed-off-by: Dan Andresan <dan.andresan@enea.com>
2017-01-18patches/fuel-plugin-ovs: fix version bump of libxenstore3.0Anders Roxell1-1/+3
JIRA: ARMBAND-192 Change-Id: Ia99fab2dc38e7e5f8372dedfadf9c807586e7080 Signed-off-by: Anders Roxell <anders.roxell@enea.com>
2016-12-21deploy-cache: Fix home dir expansion in .ssh pathAlexandru Avadanii1-1/+1
JIRA: ARMBAND-184 Change-Id: I26a79ac6c4ec4314fb21fc55b43985488c1b5fde Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-20deploy-cache: Fix one more time id_rsa injectAlexandru Avadanii1-1/+1
JIRA: ARMBAND-184 Change-Id: Ie88d1d2a16cbce6987ac12f226e48acc1fc81d9b Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-20build: select_ubuntu_repo: break on errAlexandru Avadanii1-0/+70
Backport urgent fix [1] from Fuel@OPNFV to unbreak all CI verify/build jobs in Armband. [1] https://gerrit.opnfv.org/gerrit/#/c/26269/ Change-Id: Icf5a84b62eb39edd922ab98a45b2c26c478466f6 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-19patches: fuel-mirror: Remove obsolete patchesAlexandru Avadanii3-117/+0
fuel-mirror has been replaced by packetary and all its patches we held in Armband are now obsolote as well. JIRA: ARMBAND-185 Change-Id: I1b83501965394ea8080305428bad17c826c5cf42 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-18deploy-cache: Fix bootstrap id_rsa injectAlexandru Avadanii1-1/+1
JIRA: ARMBAND-184 Change-Id: Ibcc70205f0688ce43e27d6d1361d513f15b4576b Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-17sub: packetary: remove, patches upstreamAlexandru Avadanii7-291/+313
Backported from [1] and adapted for Trusty, since Armband did not switch to Ubuntu Xenial / Openstack Newton yet. [1] https://gerrit.opnfv.org/gerrit/#/c/23999/7/ JIRA: ARMBAND-185 Change-Id: I1dd2cec09aa1077a5779573bc54c01db93339ac9 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-17ci/build.sh: improve robustnessAnders Roxell1-1/+1
Change-Id: I6324439f887c5d286052128ed1b627f5fec42b31 Signed-off-by: Anders Roxell <anders.roxell@enea.com>
2016-12-15fuel-main: Restart sshd service instead of reloadAlexandru Avadanii1-0/+26
Backported from [1] until we switch to Newton and sync again with Fuel@OPNFV master. [1] https://gerrit.opnfv.org/gerrit/#/c/25867/ Change-Id: I0972218eaf7aeb9cb435f6408e140b502fc1c0ed Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-14fuel-library: pp: cobbler: Fix CentOS ver detectAlexandru Avadanii2-2/+41
Upstream fuel-library bug report: [1]. Recently, CentOS released version 7.3.1611, which triggered a latent bug in fuel-library puppet scripts related to differentiating between 6.x and 7.x major versions: 7.3.1611 is wrongly detected as 6.x, leading to the wrong packages being attempted to be installed, leaving nailgun server service broken on the Fuel Master node. This change forces the match at the beggining of the version string (e.g. "/^6.+/: {" instead of "/6.+/: {"), so the new CentOS 7.3.1611 no longer matches the condition for 6.x). This patch will soon be obsoleted by the Netwon switch. However, until that happens, we need to ensure CentOS 7.3 is not breaking the deploy. [1] https://bugs.launchpad.net/fuel/+bug/1649895 JIRA: FUEL-238 Change-Id: Iebda7e13d66191614c3552dacb6c80091215baf5 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-12deploy-cache: Fix bootstrap cache locationAlexandru Avadanii1-1/+1
We recently changed the location of the deploy cache artifacts on Fuel Master, which failed to also update the bootstrap_admin_node.sh harcodes. JIRA: ARMBAND-172 Change-Id: I1244beca0b5f386efb7ae255fadb0ef69eb559de Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-09deploy-cache: Fix opnfv-bootstraps-cache contentsAlexandru Avadanii1-15/+12
fuel-bootstrap import expects all artifacts to be placed in the archive root dir, so adapt our scripts accordingly. Change-Id: I18ba5cb0f81b1193bc75067ec7c83367f45c0375 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-08deploy-cache: Misc fixes and improvementsAlexandru Avadanii1-36/+49
- move cache dir on Fuel Master to /var/cache/opnfv, since /var/lib/opnfv is deleted during env config; - allow target image collection on environment deploy failure too; - create cache directory if missing for bootstrap extraction; JIRA: ARMBAND-172 Change-Id: Icca650e560913345303ca0430a4d8b38183aa0c9 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-07Merge "Fix failed deploys on virtual pod (noha scenarios)"Cristina Pauna1-53/+627
2016-12-07fuel-plugins: Enable yardstick plugin buildAlexandru Avadanii1-1/+1
JIRA: ARMBAND-174 Change-Id: I6a7c76e31b26aa13c82bc755c8985526b5083ecc Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-07Fix failed deploys on virtual pod (noha scenarios)cristinapauna1-53/+627
JIRA: ARMBAND-173 Currently only ha scenarios were successfully deployed on virtual pods The default configuration is for ha scenarios and those have 5 target nodes while on the noha scenarios there are 4. The noha scenarios failed because it was trying to parse one extra node. This patch modifies the dea and dha files for each noha scenario so that the nodes are properly configured. Change-Id: I360aeaf8dc92e0ff614367d47d74f6fa61ef2268 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-06deploy-cache: Fix typos in bootstrap collectAlexandru Avadanii1-3/+3
Change-Id: I2d30e72cf218251e1b823619501454a65006dd9d Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-05Update docs for Colorado 3.0 releasecristinapauna3-23/+16
Change-Id: I93156463e63d71e8b32446b3dfbfe61a7929bf38 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-02Merge "Update documentation for Colorado 3.0 release"Alexandru Avadanii3-36/+27
2016-12-02Update documentation for Colorado 3.0 releasecristinapauna3-36/+27
This is the first update on documentation for C3 release Mostly updated the links and Jira filters Change-Id: Idd4d6dd92b1ff3972bbcfb1f8b49e547160b6ed9 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-01Merge "fuel-plugin-opendaylight: Upstart service: Respawn"Alexandru Avadanii1-0/+38
2016-12-01fuel-plugin-opendaylight: Upstart service: RespawnAlexandru Avadanii1-0/+38
On arm64, JVM sometimes (~10%) crashes at the very start, due to JIT issues in our openjdk8 package. We can't really solve the JVM on arm64 issues in the near future, so we will try to work around the issue by configuring the ODL service as respawn-able (see [1] for more details). Note: This is specific to Ubuntu Trusty (14.04), which uses upstart, for Ubuntu Xenial (or anything else >14.x), which uses systemd, a different, equivalent mechanism should be used. [1] http://upstart.ubuntu.com/cookbook/#respawn JIRA: ARMBAND-134 Change-Id: I0dc82e4a6d0cc485e981477e6a25dbad95db930b Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-01deploy-cache: Fixup targetimages extract typoAlexandru Avadanii1-1/+1
JIRA: ARMBAND-172 Change-Id: I9f549e0161d39d8f72fff698cfc26c164b0f10ae Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-30CI: deploy-cache: Store and reuse deploy artifactsAlexandru Avadanii1-0/+738
Add support for caching deploy artifacts, like bootstraps and target images, which take a lot of time at each deploy to be built, considering it requires a cross-debootstrap via qemu-user-static and binfmt. For OPNFV CI, the cache will piggy back on the <iso_mount> mechanism, and be located at: /iso_mount/opnfv_ci/<branch>/deploy-cache TODO: Use dea interface adapter in target images fingerprinting. TODO: remote fingerprinting TODO: differentiate between bootstraps and targetimages, so we don't end up trying to use one cache artifact type as the other. FIXME: This is still a bit hacky in some areas, but we need it ASAP. JIRA: ARMBAND-172 Change-Id: Iecd293db98c061325643cc61863a48f092bfd491 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-27Correct previous patch on fuel reworkcristinapauna1-20/+28
Some leftover chars in https://gerrit.opnfv.org/gerrit/#/c/24901/ were keeping the deploy to work. Also, the empty folder networks was added. This folder should contain templates for virtual network config for the targets. For arm we don't need those so we leave it empty for consistency with other projects and for avoiding changing the deploy logic JIRA: ARMBAND-122 Change-Id: Id33e2efacc3ff8d3754c8b29d4bebefd0b385c41 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-11-25Fuel rework for multiple libvirtcristinapauna1-0/+938
The current fuel arhitecture assumes that all the VMs (Jenkins slave, Fuel master and Target nodes) are all on the same server. There is code that allows the Fuel master to be on a different machine, but nothing for the Target nodes. In Enea-Arm lab we have a different server for each. This commit also adds specific templates for a virtual pod in the Enea-Arm lab. Therefore, the following changes are done: - The default libvirt URI is the machine on which the Target nodes are - The parameter libvirtUri was added in the dha.yaml file for fuel master - All virsh calls have "-c" option to explicitly specify the uri; this parameter is set only when libvirtUri is explicitly set in the yaml file - The scenarios dha override now point to the arm template files - The network templates are not needed for ARM, as the network infra is provided by the server on which the Target node VMs reside; the folder is added here just for consistency - The target nodes are created with virsh rather than quemu when the nodes are not on the same machine as Jenkins slave (similar logic to what is done for remote Fuel master) JIRA: ARMBAND-122 FIXME: remove hardcodes for - Network bridges from templates - Default pool - libvirtUri from scenario overwrite Change-Id: Ibf4744e5593f5201550115397024fd8311696074 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-11-21Merge "fuel-plugin-opendaylight: Prebuilt leveldbjni DEB"Alexandru Avadanii3-254/+52
2016-11-21local mirror: Add missing vgabios for arm64Alexandru Avadanii1-1/+3
JIRA: ARMBAND-169 Change-Id: I4dbcd044c6c146f541e8c005282a4e60af2c3c8a Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-20fuel-plugin-opendaylight: Prebuilt leveldbjni DEBAlexandru Avadanii3-254/+52
Switch from deploy time building of leveldb + leveldbjni to using a prebuilt artifact, shipped as a DEB package from Armband repos. JIRA: ARMBAND-114 Change-Id: Ic7a52c78e803c1a6ebda1f127774959a0880a5a3 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-20f_repobuild: Fixup missing OPNFV plugin depsAlexandru Avadanii1-21/+22
Packetary solves "libasound2" with "liboss4-salsa-asound2" from universe, leading to openjdk failing to install. Work around this by altering recently introduced packetary-driven local mirror build to include OPNFV plugin deps into the "main" package list. JIRA: ARMBAND-167 JIRA: ARMBAND-35 Change-Id: I040a7117c7ae809933a400ae00937ab8fcc1ea0e Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-19f_odlpluginbuild: Armband prereq in packages.yamlAlexandru Avadanii1-0/+40
We need to explicitily add our Armband leveldb patching prereq tools, like maven, git, make etc. to the ODL plugin's packages.yaml, so they are included in the offline Ubuntu mirror. While at it, also add openjdk-8-jre amos version additional dep: - libasound2 JIRA: ARMBAND-167 Change-Id: I17fa7a4727b8a553f5a46ab13267380a8864c728 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-19fuel-plugin-ovs: FIXME: Pin to pre-Newton upstreamAlexandru Avadanii1-1/+2
Upstream Fuel@OPNFV made the switch to Newton, while in Armband this will happen later. Until then, pin the latest Mitaka compatible version, i.e. use the Fuel@OPNFV reference from the Colorado branch. While at it, add missing change var for upstream fuel-plugin-ovs git repo, to prevent issues like ARMBAND-166 from happening on Armband master later. JIRA: ARMBAND-166 JIRA: ARMBAND-118 Change-Id: I0630c2349befa3bdfbbb01b4ad401660d8cfd5fe Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build: fixtures: Fix local Ubuntu mirror URIsAlexandru Avadanii1-2/+2
Previous commit (bcdc1eaa74d5efd5f8c80600fb30d722bae9a421) confused the URL of the local Ubuntu mirror with the local MOS mirror. JIRA: ARMBAND-35 Change-Id: Icfb68e88e61c238cf650b84b269d16f9a52f9f26 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build: Add local Ubuntu mirror to target imageAlexandru Avadanii1-1/+13
When deploying via Jenkins CI, the repos used for target image building are overridden to use the local Ubuntu mirror on Fuel Master instead of fetching packages from internet. However, when deploying manually, only bootstrap image building benefits from the local Ubuntu mirror. While keeping the internet mirrors, add the local Ubuntu mirror to target image build repo list. JIRA: ARMBAND-35 Change-Id: Ibd58067703ce6370781a6b54fd01ce52e29686ac Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build/install: Fix missing arch list from ReleaseAlexandru Avadanii1-1/+2
During the previous attempt to fix the local mirror rebuild by reworking `atp-ftparchive` configuration, we removed the arch list from the main configuration, which led to the local Release file missing "Architectures" entries. This led to "/etc/fuel_openstack_arch" not being populated, binfmt not starting on the first boot, and bootstrap build failing. Bring back the "Architecture" config line to restore the old behavior. JIRA: ARMBAND-163 Change-Id: Ica64fcd60ed4e0185d2cab5457603b42d3d55af8 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>