aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-12-17ci/build.sh: improve robustnessAnders Roxell1-1/+1
Change-Id: I6324439f887c5d286052128ed1b627f5fec42b31 Signed-off-by: Anders Roxell <anders.roxell@enea.com>
2016-12-15fuel-main: Restart sshd service instead of reloadAlexandru Avadanii1-0/+26
Backported from [1] until we switch to Newton and sync again with Fuel@OPNFV master. [1] https://gerrit.opnfv.org/gerrit/#/c/25867/ Change-Id: I0972218eaf7aeb9cb435f6408e140b502fc1c0ed Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-14fuel-library: pp: cobbler: Fix CentOS ver detectAlexandru Avadanii2-2/+41
Upstream fuel-library bug report: [1]. Recently, CentOS released version 7.3.1611, which triggered a latent bug in fuel-library puppet scripts related to differentiating between 6.x and 7.x major versions: 7.3.1611 is wrongly detected as 6.x, leading to the wrong packages being attempted to be installed, leaving nailgun server service broken on the Fuel Master node. This change forces the match at the beggining of the version string (e.g. "/^6.+/: {" instead of "/6.+/: {"), so the new CentOS 7.3.1611 no longer matches the condition for 6.x). This patch will soon be obsoleted by the Netwon switch. However, until that happens, we need to ensure CentOS 7.3 is not breaking the deploy. [1] https://bugs.launchpad.net/fuel/+bug/1649895 JIRA: FUEL-238 Change-Id: Iebda7e13d66191614c3552dacb6c80091215baf5 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-12deploy-cache: Fix bootstrap cache locationAlexandru Avadanii1-1/+1
We recently changed the location of the deploy cache artifacts on Fuel Master, which failed to also update the bootstrap_admin_node.sh harcodes. JIRA: ARMBAND-172 Change-Id: I1244beca0b5f386efb7ae255fadb0ef69eb559de Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-09deploy-cache: Fix opnfv-bootstraps-cache contentsAlexandru Avadanii1-15/+12
fuel-bootstrap import expects all artifacts to be placed in the archive root dir, so adapt our scripts accordingly. Change-Id: I18ba5cb0f81b1193bc75067ec7c83367f45c0375 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-08deploy-cache: Misc fixes and improvementsAlexandru Avadanii1-36/+49
- move cache dir on Fuel Master to /var/cache/opnfv, since /var/lib/opnfv is deleted during env config; - allow target image collection on environment deploy failure too; - create cache directory if missing for bootstrap extraction; JIRA: ARMBAND-172 Change-Id: Icca650e560913345303ca0430a4d8b38183aa0c9 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-07Merge "Fix failed deploys on virtual pod (noha scenarios)"Cristina Pauna1-53/+627
2016-12-07fuel-plugins: Enable yardstick plugin buildAlexandru Avadanii1-1/+1
JIRA: ARMBAND-174 Change-Id: I6a7c76e31b26aa13c82bc755c8985526b5083ecc Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-07Fix failed deploys on virtual pod (noha scenarios)cristinapauna1-53/+627
JIRA: ARMBAND-173 Currently only ha scenarios were successfully deployed on virtual pods The default configuration is for ha scenarios and those have 5 target nodes while on the noha scenarios there are 4. The noha scenarios failed because it was trying to parse one extra node. This patch modifies the dea and dha files for each noha scenario so that the nodes are properly configured. Change-Id: I360aeaf8dc92e0ff614367d47d74f6fa61ef2268 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-06deploy-cache: Fix typos in bootstrap collectAlexandru Avadanii1-3/+3
Change-Id: I2d30e72cf218251e1b823619501454a65006dd9d Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-05Update docs for Colorado 3.0 releasecristinapauna3-23/+16
Change-Id: I93156463e63d71e8b32446b3dfbfe61a7929bf38 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-02Merge "Update documentation for Colorado 3.0 release"Alexandru Avadanii3-36/+27
2016-12-02Update documentation for Colorado 3.0 releasecristinapauna3-36/+27
This is the first update on documentation for C3 release Mostly updated the links and Jira filters Change-Id: Idd4d6dd92b1ff3972bbcfb1f8b49e547160b6ed9 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-12-01Merge "fuel-plugin-opendaylight: Upstart service: Respawn"Alexandru Avadanii1-0/+38
2016-12-01fuel-plugin-opendaylight: Upstart service: RespawnAlexandru Avadanii1-0/+38
On arm64, JVM sometimes (~10%) crashes at the very start, due to JIT issues in our openjdk8 package. We can't really solve the JVM on arm64 issues in the near future, so we will try to work around the issue by configuring the ODL service as respawn-able (see [1] for more details). Note: This is specific to Ubuntu Trusty (14.04), which uses upstart, for Ubuntu Xenial (or anything else >14.x), which uses systemd, a different, equivalent mechanism should be used. [1] http://upstart.ubuntu.com/cookbook/#respawn JIRA: ARMBAND-134 Change-Id: I0dc82e4a6d0cc485e981477e6a25dbad95db930b Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-12-01deploy-cache: Fixup targetimages extract typoAlexandru Avadanii1-1/+1
JIRA: ARMBAND-172 Change-Id: I9f549e0161d39d8f72fff698cfc26c164b0f10ae Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-30CI: deploy-cache: Store and reuse deploy artifactsAlexandru Avadanii1-0/+738
Add support for caching deploy artifacts, like bootstraps and target images, which take a lot of time at each deploy to be built, considering it requires a cross-debootstrap via qemu-user-static and binfmt. For OPNFV CI, the cache will piggy back on the <iso_mount> mechanism, and be located at: /iso_mount/opnfv_ci/<branch>/deploy-cache TODO: Use dea interface adapter in target images fingerprinting. TODO: remote fingerprinting TODO: differentiate between bootstraps and targetimages, so we don't end up trying to use one cache artifact type as the other. FIXME: This is still a bit hacky in some areas, but we need it ASAP. JIRA: ARMBAND-172 Change-Id: Iecd293db98c061325643cc61863a48f092bfd491 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-27Correct previous patch on fuel reworkcristinapauna1-20/+28
Some leftover chars in https://gerrit.opnfv.org/gerrit/#/c/24901/ were keeping the deploy to work. Also, the empty folder networks was added. This folder should contain templates for virtual network config for the targets. For arm we don't need those so we leave it empty for consistency with other projects and for avoiding changing the deploy logic JIRA: ARMBAND-122 Change-Id: Id33e2efacc3ff8d3754c8b29d4bebefd0b385c41 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-11-25Fuel rework for multiple libvirtcristinapauna1-0/+938
The current fuel arhitecture assumes that all the VMs (Jenkins slave, Fuel master and Target nodes) are all on the same server. There is code that allows the Fuel master to be on a different machine, but nothing for the Target nodes. In Enea-Arm lab we have a different server for each. This commit also adds specific templates for a virtual pod in the Enea-Arm lab. Therefore, the following changes are done: - The default libvirt URI is the machine on which the Target nodes are - The parameter libvirtUri was added in the dha.yaml file for fuel master - All virsh calls have "-c" option to explicitly specify the uri; this parameter is set only when libvirtUri is explicitly set in the yaml file - The scenarios dha override now point to the arm template files - The network templates are not needed for ARM, as the network infra is provided by the server on which the Target node VMs reside; the folder is added here just for consistency - The target nodes are created with virsh rather than quemu when the nodes are not on the same machine as Jenkins slave (similar logic to what is done for remote Fuel master) JIRA: ARMBAND-122 FIXME: remove hardcodes for - Network bridges from templates - Default pool - libvirtUri from scenario overwrite Change-Id: Ibf4744e5593f5201550115397024fd8311696074 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-11-21Merge "fuel-plugin-opendaylight: Prebuilt leveldbjni DEB"Alexandru Avadanii3-254/+52
2016-11-21local mirror: Add missing vgabios for arm64Alexandru Avadanii1-1/+3
JIRA: ARMBAND-169 Change-Id: I4dbcd044c6c146f541e8c005282a4e60af2c3c8a Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-20fuel-plugin-opendaylight: Prebuilt leveldbjni DEBAlexandru Avadanii3-254/+52
Switch from deploy time building of leveldb + leveldbjni to using a prebuilt artifact, shipped as a DEB package from Armband repos. JIRA: ARMBAND-114 Change-Id: Ic7a52c78e803c1a6ebda1f127774959a0880a5a3 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-20f_repobuild: Fixup missing OPNFV plugin depsAlexandru Avadanii1-21/+22
Packetary solves "libasound2" with "liboss4-salsa-asound2" from universe, leading to openjdk failing to install. Work around this by altering recently introduced packetary-driven local mirror build to include OPNFV plugin deps into the "main" package list. JIRA: ARMBAND-167 JIRA: ARMBAND-35 Change-Id: I040a7117c7ae809933a400ae00937ab8fcc1ea0e Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-19f_odlpluginbuild: Armband prereq in packages.yamlAlexandru Avadanii1-0/+40
We need to explicitily add our Armband leveldb patching prereq tools, like maven, git, make etc. to the ODL plugin's packages.yaml, so they are included in the offline Ubuntu mirror. While at it, also add openjdk-8-jre amos version additional dep: - libasound2 JIRA: ARMBAND-167 Change-Id: I17fa7a4727b8a553f5a46ab13267380a8864c728 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-19fuel-plugin-ovs: FIXME: Pin to pre-Newton upstreamAlexandru Avadanii1-1/+2
Upstream Fuel@OPNFV made the switch to Newton, while in Armband this will happen later. Until then, pin the latest Mitaka compatible version, i.e. use the Fuel@OPNFV reference from the Colorado branch. While at it, add missing change var for upstream fuel-plugin-ovs git repo, to prevent issues like ARMBAND-166 from happening on Armband master later. JIRA: ARMBAND-166 JIRA: ARMBAND-118 Change-Id: I0630c2349befa3bdfbbb01b4ad401660d8cfd5fe Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build: fixtures: Fix local Ubuntu mirror URIsAlexandru Avadanii1-2/+2
Previous commit (bcdc1eaa74d5efd5f8c80600fb30d722bae9a421) confused the URL of the local Ubuntu mirror with the local MOS mirror. JIRA: ARMBAND-35 Change-Id: Icfb68e88e61c238cf650b84b269d16f9a52f9f26 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build: Add local Ubuntu mirror to target imageAlexandru Avadanii1-1/+13
When deploying via Jenkins CI, the repos used for target image building are overridden to use the local Ubuntu mirror on Fuel Master instead of fetching packages from internet. However, when deploying manually, only bootstrap image building benefits from the local Ubuntu mirror. While keeping the internet mirrors, add the local Ubuntu mirror to target image build repo list. JIRA: ARMBAND-35 Change-Id: Ibd58067703ce6370781a6b54fd01ce52e29686ac Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16build/install: Fix missing arch list from ReleaseAlexandru Avadanii1-1/+2
During the previous attempt to fix the local mirror rebuild by reworking `atp-ftparchive` configuration, we removed the arch list from the main configuration, which led to the local Release file missing "Architectures" entries. This led to "/etc/fuel_openstack_arch" not being populated, binfmt not starting on the first boot, and bootstrap build failing. Bring back the "Architecture" config line to restore the old behavior. JIRA: ARMBAND-163 Change-Id: Ica64fcd60ed4e0185d2cab5457603b42d3d55af8 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-16FIXME: build: Temp pin to pre-Newton Fuel@OPNFVAlexandru Avadanii5-1/+1
Until we populate Armband repos with Fuel Newton packages, we cannot build the Newton version of Fuel@OPNFV in Armband. Therefore, temporarily pin the upstream repos to pre-Newton commits. JIRA: ARMBAND-118 Change-Id: I34d44c4fabe59c32a7f2c45424dd80e9ae3e04bc Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-15Merge "AArch64: Ubuntu local partial mirror: Add arm64"Alexandru Avadanii8-48/+800
2016-11-15AArch64: Ubuntu local partial mirror: Add arm64Alexandru Avadanii8-48/+800
NOTE: Temporarily patch "packetary" in Armband until we upstream two small fixes. Bootstrap build, deploy target image build: - Switch from public Ubuntu mirrors to 10.20.0.2. JIRA: ARMBAND-35 Change-Id: I14645cfeebb486063e7b8198de273f68285b11cd Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-15build/docker: Import Enea Armband keysAlexandru Avadanii2-3/+24
JIRA: ARMBAND-96 Change-Id: I28ab3030d3f31c5734508838985412a33334570a Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-11build/install: Fix paths in apt-ftparchive confAlexandru Avadanii1-34/+53
JIRA: ARMBAND-163 Change-Id: I3fd5a8a826372afc323665abe229c7e67991e31a Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-11-03fuel-plugin-ovs: Bind to stable/9.0 branchAnders Roxell3-1/+78
Previously, fuel-plugin-ovs did not have a stable branch for Fuel 9, but now it does, and since fuel-plugin-ovs/master was reworked for Fuel 10, we need to switch to it. v1 -> v2: Backported one patch that was not cherry-picked on stable. Change-Id: I58467e441763b35e5296cb29433eb941e65eec3f Signed-off-by: Anders Roxell <anders.roxell@enea.com> Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-28Merge "build: Rebase after cirros bump / GPG addition"Alexandru Avadanii2-12/+8
2016-10-28patches/fuel-plugin-ovs: fix version bump of libxenstore3.0Anders Roxell1-1/+5
Change-Id: I4c232fec4f35add7b04faf305cdf53dde70d7e92 Signed-off-by: Anders Roxell <anders.roxell@enea.com> Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-28build: Rebase after cirros bump / GPG additionAlexandru Avadanii2-12/+8
Slightly edit patch context to match upstream changes [1, 2]. [1] https://gerrit.opnfv.org/gerrit/#/c/22559/ [2] https://gerrit.opnfv.org/gerrit/#/c/21823/ Change-Id: Ibdb3b557f3e482f74d345a1e0e1eedda26879179 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-18build: Add <debug> make targetAlexandru Avadanii1-3/+5
Pass `make debug` to Fuel@OPNFV build system. debug requires Fuel@OPNFV submodules to be initialized, since `f_repobuild` relies on fuel-mirror submodule. Change-Id: Ia64a7d79143c00fc09076472ad346f0cdc20c2b5 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-18FIXME: build: Revert using mirror snapshotsAlexandru Avadanii1-0/+43
Armband does not yet have DEB/RPM repo snapshots, so revert upstream Fuel@OPNFV change enabling them. JIRA: ARMBAND-155 Change-Id: Ib08c36bf28a66ef38d8b33031dcbf363fb34123c Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-17Merge "Revert "FIXME: Temporary: Use archive.ubuntu.com only""Alexandru Avadanii1-152/+0
2016-10-17Revert "FIXME: Temporary: Use archive.ubuntu.com only"Alexandru Avadanii1-152/+0
Now that [1] has been merged, we should stick to upstream behavior. [1] https://gerrit.opnfv.org/gerrit/#/c/22975/ This reverts commit f653f97dd2591f4cd5bcb4e76eb2134a93f6d460. Change-Id: I5f23dd6e1b113e8a7d06995e479287ff196410dd
2016-10-13Merge "ci/{build,deploy}.sh: Move `export TERM` to releng"Alexandru Avadanii2-4/+0
2016-10-12Upstream: Fuel@OPNFV: Fuel Master VM templatesAlexandru Avadanii2-183/+0
While at it, also upstream: "build: Use OPNFV_GIT_SHA for ISO preparer ID" JIRA: ARMBAND-146 Change-Id: Ifcd7b3041d172aa492e26477c0872cd96efd90ba Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-12fuel-plugin-tacker: Enable build for ArmbandAlexandru Avadanii1-1/+1
JIRA: ARMBAND-143 Change-Id: I388e324b39aa2cec015bc65559f4c363bc37abdd Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-10ci/{build,deploy}.sh: Move `export TERM` to relengAlexandru Avadanii2-4/+0
TERM is now only set for CI runs, not when calling CI scripts by hand, outside Jenkins CI. Releng: 'fuel, armband: build, deploy: export TERM="vt220"' [1] [1] https://gerrit.opnfv.org/gerrit/#/c/22933/ Change-Id: I756505c6c395a2cbf7902b49db689abb956fbf5d
2016-10-10deploy: Reduce Fuel Master VCPU countAlexandru Avadanii1-1/+1
Fuel Master VM template has been updated to use: - 4 VCPUs (was 8 VPCUs); Related-bug: ARMBAND-98 Change-Id: I1a587f0efa06850885ff8cf938ebb9775af8f7a8 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-09FIXME: Temporary: Use archive.ubuntu.com onlyAlexandru Avadanii1-0/+152
We recently removed blacklists for a few mirrors, on account of upstream Fuel@OPNFV fixing mirror selection in [1]. Although the mechanism will be polished a little, it works very nicely; pointing us to [2], where we seem to trigger some flood protection at sync, leading to dropped connections and failed builds. Keep using the official Ubuntu Archive mirror [3] until we sort this out. Fixes: ARMBAND-136 [1] https://gerrit.opnfv.org/gerrit/#/c/22195 [2] http://mirrors.se.eu.kernel.org/ubuntu/ [3] http://archive.ubuntu.com/ubuntu/ Change-Id: If9247f829ee314d4c71dafa84b6cd13b384484f0 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-09ci/{build,deploy}.sh: Use /bin/sh, vt220Alexandru Avadanii3-0/+6
This should fix Jenkins build log warns like: <tput: unknown terminal "unknown">, and also NOT print color chars. Fixes: ARMBAND-136 Change-Id: If65f6bf3df5323374aefba56d0c9b7ca4f91e5ca Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-09build: Fix missing git config for applying patchesAlexandru Avadanii1-0/+4
After decoupling Fuel@OPNFV's `build/config.mk`, which exports GIT_COMMITER_* info, we need to configure it in Armband too, so git can apply patches for Fuel plugins / Fuel@OPNFV itself. Fixes: ARMBAND-136 Change-Id: I9404d742e89d7a54e4763f8248f16405f4685881 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2016-10-09build: Rework patch mechanism for Fuel submodulesAlexandru Avadanii94-839/+868
While refactoring the patching mechanism, take care of: - Sync submodule handling with Fuel@OPFNV; - build: Investigate/prepare for moving patches to Fuel@OPNFV; - build: Investigate divergent fuel-mirror; - ISO build: cacheid for Fuel comps should not depend on Armband git commit; CHANGE: Rename/shuffle patches while grouping them in "features", preparing for upstreaming them to Fuel@OPNFV and beyond. CHANGE: Allow linking patches for better representing the dependency between one patch and different features. e.g. 0001-Add-arch-to-nailgun-release-and-target-image.patch: - part of `multiarch-fuel`, because it extends Fuel; - part of `direct-kernel-boot`, as arch is required for that; - part of `cross-bootstrap`, target image is arch-dependent; NOTE: Patch links are not staged to Fuel@OPNFV, they only serve as markers that a specific patch is part of a feature. CHANGE: Kill all Fuel component submodules, now handled in Fuel@OPNFV: - fuel-agent - fuel-astute - fuel-library - fuel-mirror - fuel-nailgun-agent - fuel-web CHANGE: Move armband-fuel-config.mk to armband git root. FIXME: m1.micro-Increase-profile-RAM-size-to-128MB.patch is NOT part of `cross-bootstrap` feature, but patch context says so ... FIXME: 0001-Add-arm64-deb-repositories-setup.patch is broken at `make patches-export` by removing spaces at EOL. v2 -> v3: * Phony patch support (links to show a patch belongs to a feature); * Updated README.md v3 -> v7: * Re-export Fuel submodules & plugins patches (update patch context); * Update Cavium mail addresses (s/caviumnetworks.com/cavium.com/); * Ignore submodule changes; * Add armband git repo info to gitinfo_fuel.txt at build time; Implements: ARMBAND-136 Closes-bug: ARMBAND-95 Closes-bug: ARMBAND-93 Closes-bug: ARMBAND-92 Change-Id: I1a236d9f43b2e6dca22055911f696b43c22b5973 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>