summaryrefslogtreecommitdiffstats
path: root/fuel/build
AgeCommit message (Collapse)AuthorFilesLines
2015-09-26Build Fuel ODL pluginMichal Skalski2-1/+39
Build Fuel OpenDaylight plugin and make it accessible on Fuel Master inside /opt/opnfv directory. JIRA: FUEL-30 Change-Id: I5297c0fa70207c3631a0cdf205559fcb55d13554 Signed-off-by: Michal Skalski <mskalski@mirantis.com> (cherry picked from commit a73a2551cd0986a94402ed98e1608d861e22d709)
2015-09-26Try to choose close ubuntu mirrorMichal Skalski1-0/+10
As described in this bug https://bugs.launchpad.net/fuel/+bug/1459252 slow connection to ubuntu mirror can lead to errors. Lets try choose mirror which is near build server. Change-Id: I7a367cbb6edbcf30dceb52934a9adf35cbd7ce5a Signed-off-by: Michal Skalski <mskalski@mirantis.com> (cherry picked from commit f2752258649dc714a3c0adc8fa6aa4cfab405a45)
2015-09-26Correction of Fuel cache buildingStefan K. Berg1-14/+10
The cache was previously not fully populated. Change-Id: I77885bc1fa0e9cbc7499e2dc4ceee47ff3b2e14c Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com> (cherry picked from commit d8d4303b2cea8dca0ce67407b6a60145dbfe111c)
2015-09-25Fuel patch to enable virtual deploymentStefan K. Berg2-0/+45
Disable ext4 journalling during Fuel master image creation, otherwise the provisioning process times out on many virtual setups after 3600 sec. All credit to Michal Skalski of Mirantis for providing the information to patch this up: https://docs.mirantis.com/openstack/fuel/fuel-6.1/release-notes.html#issues-with-image-based-provisioning https://review.openstack.org/#/c/197943/ Change-Id: I90f68a351b3afe1273440846bc5d56da8f6d3507 Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>
2015-09-25Update of READMEs and build instructions for Arno SR1Jonas Bjurel1-1/+0
Change-Id: Ib4204a591a8623b47848968b9ee0252a772bbafe Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-09-25Removed obsolete Fuel patchesStefan K. Berg5-169/+0
The patch files were modifying behavior already addressed by changes in the Fuel config in terms of boot arguments. Change-Id: Icb5af0e3a75a71e8c26fb646fc734189bf16b7c8 Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com> (cherry picked from commit 19353295cc1e3bf5dff72ab48d794087767c62d7)
2015-09-24Ubuntu package repositories added to Fuel ISOStefan K. Berg3-1/+70
Starting with Fuel 6.1, the Ubuntu repositories are no longer stored on the Fuel ISO, but by default fetched from the Internet during installation (the exact URI can be modified in the Fuel configuration). In order to being able to handle a deployment scenario where the Fuel node has no Internet connectivity, the OPNFV Fuel ISO is adding the necessary repositories into /var/www/nailgun by fetching them during the generation of the ISO. The actual fetching is done by a Fuel provided package, fuel-createmirror.deb, which can be found in /opt of the Fuel master (but which is run outside Fuel in the context of the build process when generating the OPNFV ISO). An additional OPNFV post installation script is added as /opt/opnfv/bootstrap/post.d/03_install_repo.sh which will populate /var/www/nailgun with these repositories in the late stage of the bootstrap_admin_node process. Important! In order to use these repositories For deployment, the default Fuel repo configuration must be changed as below: Repository "mos-updates" URI="deb http://10.20.0.2:8080/mos-ubuntu mos6.1-updates main restricted" Repository "mos-security" URI="deb http://10.20.0.2:8080/mos-ubuntu mos6.1-security main restricted" Repository "mos-holdback" URI="deb http://10.20.0.2:8080/mos-ubuntu mos6.1-holdback main restricted" Repository "ubuntu" URI="deb http://10.20.0.2:8080/ubuntu-part trusty main" Repository "ubuntu-security" URI="deb http://10.20.0.2:8080/ubuntu-part trusty main" Repository "ubuntu-updates" URI="deb http://10.20.0.2:8080/ubuntu-part trusty main" Change-Id: I25211bd3f277b560808fd838180aa52e278af404 Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>
2015-09-20Merge "Missed a reference to prepare target which was earlier used by odl" ↵Jonas Bjurel1-2/+2
into stable/arno
2015-09-18Missed a reference to prepare target which was earlier used by odlJonas Bjurel1-2/+2
Change-Id: Ief101627e2af51c4b565dcb5d230922c5f113c8d Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com> (cherry picked from commit 0011674c45680df6c1fe9491c974eb3e57a4a0fe)
2015-09-18Tidied up the last references to ODLJonas Bjurel3-17/+3
Change-Id: I715f47461622f2d26a492eb61d68b20ca84825aa Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com> (cherry picked from commit 4d23d9a0079735322c88e53a8ebb1c4d2c0b1566)
2015-09-18Fixed cache logicJonas Bjurel1-6/+4
Change-Id: I904a4b8ebcab5aedefef287ff8bb5357dae8e3ff Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-09-14Refactoring build system to support Fuel 6.1Stefan K. Berg55-2273/+440
As Fuel 6.1 has changed both Debian package handling (fetching repositories from Internet) as well as Puppet packaging, the support for patching these has been disabled. The pre-deploy logic of Fuel has been removed together with a number of patches applied on top of a Fuel build, among them fixes for NTP, DNS and /etc/hosts injection. Instead, when changed default behavior is required, this will be introduced as Fuel plugins which more cleanly integrates into the Fuel system, and also decouples additional functionality from the ISO build stage. Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>
2015-08-25Removed ODL_DOCKER implementation (DEPRECATED FOR PLUGIN ARCH IN FUEL ↵Daniel Smith16-1250/+0
6.1/SR1 OF ARNO) Change-Id: I8643d268c5d5e3395725667deb50b5f9df7c3f09 JIRA:0 Signed-off-by: Daniel Smith <daniel.smith@ericsson.com>
2015-08-25Removed opendaylight build capabilities as a preparation toward Arno SR1Jonas Bjurel12-685/+1
Note: The local branch name "removedocker" is missleading! Change-Id: I4086bb3f47f720407a6356796a9724367cca2898 Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-08-12Needed rebase after fuel dev-ops changesJonas Bjurel5-4/+46
Patch needed after updated fuel devops repo key change Reference: https://github.com/stackforge/fuel-main/commit/82e77c7f476a23220f44b74c7f32fc04a7189a4e#diff-9d30c16c74e663e5cdb1dc7d9189ed2d Patch needed after updated fuel devops python package versions Reference: https://github.com/stackforge/fuel-main/commit/a765460d3fd69089e3b4d2b3a6b55e28e6fb53eb Rebased site.pp Change-Id: I138b383b0d57091a81f98acae3b6e7af6a189632 Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-06-26Revert "Adding in support for Lithium container."Jonas Bjurel19-1341/+0
since it doesnt deploy This reverts commit eb887812da568cfb4908f6ae14449b2ceaeb5bc0. Change-Id: Ia7490d86c1d91abca1f50d90f43bdf3e4917f23a
2015-06-18Fix typo: conatiner => containerSzilard Cserey4-6/+6
Change-Id: If7a29b0c88a7009ef7587a460ecfeff4ba3f3661 Signed-off-by: Szilard Cserey <szilard.cserey@ericsson.com>
2015-06-12Adding in support for Lithium container.Dan Smith19-0/+1341
Both will be present on the controller nodes and can be started/switches on and off at will. Networking scripts are not updated - will be deprecated in favour of plugin method of enabling / setting up VXLAN / OVSDB integration pulling from the latest nightly artifact at time of commit - will work on automated pulling each night to see if that makes sense. Change-Id: Ie911cdf61cd97a99b975c30c55c664daf70eb3ee JIRA: 0 Signed-off-by: Dan Smith <daniel.smith@ericsson.com>
2015-06-02Adding fix to ensure S3 is built and deployed.Dan Smith2-0/+224
Adding change.sh (for automation of ODL after deployemt) and updates odl_docker.pp file Change-Id: I7868f8e7381d726f1ce7fd9600ba048ee3119ab7 JIRA: 0 Signed-off-by: Dan Smith <daniel.smith@ericsson.com>
2015-06-01Updated scripts for ODL enablement on FUELDan Smith3-23/+56
Change-Id: Ia8c82a664056e8fd0c40ffd061e2945a9fd1f8ce JIRA:0 Signed-off-by: Dan Smith <daniel.smith@ericsson.com>
2015-06-01ODL scripts bugfixesjose.lausuch1-6/+6
JIRA: 0 Change-Id: I00f0cca283f7334dcf6ce98b3867af9aa6054c37 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2015-05-27Fixed typo in previous commit in odl_docker.pp (so that its used the correct ↵Dan Smith1-1/+1
filename) Change-Id: Idd74bbe3bc270a93db5a9325c36a0f3439077452 JIRA: 0 Signed-off-by: Dan Smith <daniel.smith@ericsson.com>
2015-05-26Merge "Delivering script for use with ODL automation to start ODL in daemon ↵Dan Radez5-0/+390
mode only."
2015-05-26Delivering script for use with ODL automation to start ODL in daemon mode only.Dan Smith5-0/+390
To start ODL after a fuel deployment simply run "/opt/opnfv/odl/stage_odl.sh" and the DLUX GUI will be listening at http://<br-ex ip>:8181/dlux/index.html Usage / Order: - after you have deployed login to controller and run config_net.sh - do the same for your compute nodes - login to controller and run stage_odl.sh note: Ensure that you are able to reach the internet / and resolv.conf is set to a valid DNS - create neutron networks and look in gui that your Nodes show up. Change-Id: Iba3d99152052e9e31a6f709b510a30c8b080aa26 JIRA: 0 Signed-off-by: Dan Smith <daniel.smith@ericsson.com>
2015-05-25Updated Neutron quota settings for FuelStefan K. Berg3-1/+87
Updated the following Neutron quotas in the Fuel defaults of neutron.conf: security_groups 10 to 50 floating ip 50 to 100 network 10 to 50 router 10 to 50 subnet 10 to 50 JIRA: BGS-51 Change-Id: I133625187ee95fc0d81fa874b20e293a4de3102c Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>
2015-05-21FIXED broken Softlink pointing to "nowhere" that is causing issues with ↵Dan Smith1-1/+0
Git/Bash (non-linux intrepreters) Change-Id: I8f2cc270ce4f91b69d86b7db26ccf6f980146b01 JIRA: 0 Signed-off-by: Dan Smith <daniel.smith@ericsson.com>
2015-05-18Merge "Update for SR3 Helium for ODL and refactoring other files."Dan Radez4-6/+7
2015-05-18Patch novnc ubuntu packageMichal Skalski4-2/+33
Patch novnc ubuntu package by adding missing files. Related bug: https://bugs.launchpad.net/fuel/+bug/1433894 Change-Id: Iba413c664bb93dea26245c9ed4471fff30e43968 Jira: - Signed-off-by: Michal Skalski <mskalski@mirantis.com>
2015-05-15Update for SR3 Helium for ODL and refactoring other files.Dan Smith4-6/+7
Change-Id: I5e616652f1084211bab4f8054dbf700112a89774 JIRA: 0 Signed-off-by: Dan Smith <daniel.smith@ericsson.com>
2015-05-13JIRA: -Jonas Bjurel3-58/+1
Removed an old console-log patch wich disabled console logging and deemed not needed any longer. Change-Id: Iafb35f9a0a0060c5c7280b3319f48a6a003380c8 Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-04-27Fix CentOS HA deploymentMichal Skalski1-6/+0
Do not run docker daemon during deployment. It can lead to haproxy resource timeout and rabbitmq connectivity issues. Change-Id: I49abc9d9c3b7ac954fe308f113f36c64d236ceb5 JIRA: BGS-36 Signed-off-by: Michal Skalski <mskalski@mirantis.com>
2015-04-21Allow deployment on Centos 6.5 environmentMichal Skalski3-46/+78
Modify Fuel@OPNFV puppet manifest to allow deployment on CentOS 6.5 environment. Add installation of docker-io centos package on controller nodes. Change-Id: I76cdd086607f279f46d827558c878b7be0d8314f JIRA: BGS-36 Signed-off-by: Michal Skalski <mskalski@mirantis.com>
2015-04-16Fix debootstrap packageMichal Skalski8-2/+182
This commit provide scripts to patch debootstrap package. This should fix problems that can occur during ubuntu 12.04 installation. More detail can be found here: * https://bugs.launchpad.net/ubuntu/+source/debootstrap/+bug/1001131 * https://wiki.debian.org/DebianInstaller/Modify/CD#Workaround_bug_in_deboostrap Change-Id: I881191a37ba22d336c61623ae506f7e75dcc7540 JIRA: Signed-off-by: Michal Skalski <mskalski@mirantis.com>
2015-04-16Fuel@OPNFV rebase due to upstrem changesJonas Bjurel2-30/+0
JIRA: Change-Id: I9864f16d2be725f7d48f4268a3886aa65410293a Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-04-14Initial rearrangements for the OPNFV/opnfvdoc documentation structure ↵Jonas Bjurel6-314/+0
including LOW level READMEs, LICENCEs, and TODOs. JIRA: Change-Id: Ifd2baa5b1db3ae0fb354e39548eb7f9547639581 Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-04-02Fix problems during build/deployment processMichal Skalski4-93/+25
If we used 'make all' for build iso, only release section from f_odl_docker Makefile was executed, so odl docker image and docker binary were not created. This patch also try resolve problems which appeared during execution of start_odl_container.sh on controller node: * install and run cgroup-lite to mitigate 'failed to find the cgroup root' error * use proper path to docker image and binary * prevent import of docker image before daemon is not fully initialized * because docker binary is delivered by puppet, we should execute commands against it, not try use system binary which is probably not present on controller node * stop use daemon mode('-d') of 'docker run' if user want to have access to container shell * fix name of start script which is run inside container when daemon mode is used It looks like file 'fuel/build/f_odl_docker/scripts/start_odl_container.sh' is not used and duplicate: 'fuel/build/f_odl_docker/puppet/modules/opnfv/scripts/start_odl_container.sh' JIRA: Change-Id: Ia6064dbacf30902bda557e5d0b631b5f5f207b5e Signed-off-by: Michal Skalski <mskalski@mirantis.com>
2015-03-27--- Fuel build system bug fix ---Jonas Bjurel2-4/+4
- Adding force remove of docker images to avoid non zero returns to CI and disk usage growth - Fixed another bug with caching, disabled cache for odl build from source since we're not currently building ODL from source! READY TO MERGE JIRA: Change-Id: I1478002cbe1574814d2597ffa5ec64b6ed9580b7 Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-03-26Fuel build cache handlingJonas Bjurel15-65/+143
- Cache invalidation supported in case cache is outdated compared to upstream. - Fully automated build.sh integration tests added (build.sh -t or build.sh -T) - Rebased to Daniel Smiths's patch-set: genesis refs/changes/71/171/4 - Yet untested, will perform automated integration tests over night! - Updated based on Stefan's comments (no more revs.) - Fixed a bug in f_odl_docker/Makefile - validate-cache target added in f_odl_docker/Makefile JIRA: BGS-1 Change-Id: I9f8f30c2a85fd7bf04dab1b566065e5739d4fcb1 Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-03-24TOPIC: ODL DOCKERDaniel Smith45-834/+666
AUTHOR: DANIEL SMITH *** PLEASE MERGE ** UPDATED TO REFLECT INPUT FRMO J. BJUREL - fixed whitespaces - fixed location of .erb file (they should have been in templates - the directory was there just int he wrong spot) - removed opcheck.pp from common opnfv class - Removed Debug from fuel/build/Makefile :) UPDATE: Input from S. Berg and F. Bockners incorporated. Merge required before we can refactor to common puppet manifest directory This patchset delivers the folowing functionality: - implementation of the common/opnfv-puppet structure / move of .pp files and update of f_odl_docker to build / source from there - creation of f_odl_doc subclass - fetch of latest stable release of ODL - fetch of latest docker binary release (TODO: this will be changed in next patchset push) - build of docker container with all needed libs and port exposure for DLUX and OVSDB/ODL with Openstack Integration (OVS Manager) - deployment of both the target odl docker image as well as the docker runtime binary to the control nodes via puppet script. GENERATES: - docker-latest - binary of docker for use on control node - odl_docker_image.tar - a docker container with a ODL controller running DLUX and OVSDB ENABLE / DISABLE: - Comment/Un-comment "SUBDIRS += f_odl_doc in base (fuel/build/) Makefile Breakdown of Update / Edits per File: ===================================== fuel/build/Makefile - Modified include to capture the newly created f_odl_doc directory fuel/build/f_odl_docker/Makefile - Fetches libraries and produces two outputs: docker-latest - binary of docker (actually lxc-docker cause ODL Container is running 12.04 (precise) libraries - i.e java7, tz 12.04, etc) odl_docker_image.tar - this is a docker image defined in ./dockefile/Dockerfile and contains the ODL distro + setup and deployment scripts for runtime on the target control node. fuel/build/f_odl_docker/dockerfile/Dockerfile - This Dockerfile defined the packages for use in the Docker Container that will run ODL with DLUX and OVSDB submodules. It also defines the ports to be exposed to the HOST OS (and thus as well through docker the ODL Controller exists in a private, but routable via but the fuel (10.20.0.0/16) and the tenants public network since docker handles the mapping (see the docker run command in the start_odl_docker.sh script) fuel/build/f_odl_docker/dockerfile/check_feature.sh - Simple expect script that starts up a client and checks that the features are installed (used during visual demo only) TODO - Replace with API call to ODL KARAF to install features (LOOKUP - Dont know how to address Karaf programatically - LOOKUP) fuel/build/f_odl_docker/dockerfile/speak.sh - Expect script called by odl_start_docker.sh once karaf is up to install the features that we need (runtime inside container script) called via ENTRYPOINT in Dockerfile at runtime on control node. fuel/build/f_odl_docker/dockerfile/start_odl_docker.sh - This is the CMD/ENTRYPOINT defined in docker and is what is called from the controller when you start the container (note: This runs inside the conatiner), not to be confused with staring the actual container on the control node). This script fires up Karaf first time, loads DLUX and OVSDB modules and monitors that the container is up. The container itself is started on the control node via /opt/opnfv/start_odl_container.sh which includes the syntax for the port mapping (RANDOM or 1:1). TODO - integrate into controller monitor script to ensure better handling (stop, start, monitor) of docker processes remove expect helper scripts and replace with API/JSON or some other appropriate method to KARAF fuel/build/f_odl_docker/puppet/modules/opnfv/manifests/odl_doc.pp - This puppet manifest defined where the docker binary and docker image should be placed on the target control node. /opt/opnfv/start_odl_container.sh will install docker binary package (if necessary) and load ODL docker image into docker, start the image. This file just ensures placement in /opt/opnfv/odl_docker fuel/build/f_opnfv_puppet/puppet/modules/opnfv/manifests/init.pp (MODIFICATION): - Removed previous includes and updated to have only f_odl_doc added fuel/build/f_odl_doc/scripts/start_odl_container.sh - this is the control script that will start the docker container (to be run on the control node), this is deployed this is deployed to /opt/opnfv on the control node via odl_doc puppet manifest file. JIRA: DEPRECATED: Deleted files are no longer needed due to new implementation of ODL. Change-Id: I26c13cc468a2aba18af78b7a3c78a719033f03e0 Signed-off-by: Daniel Smith <daniel.smith@ericsson.com>
2015-03-17*** FIRST VERSION OF CI BUILD SCRIPT ***Jonas Bjurel10-186/+187
- Provides build cache management to a remote location - Provides automatic cashe repopulation - See /fuel/ci/README - Rebased to master - Bug around cache handling fixed - New option -r introduced to invoke external script/program instead of standard http(s)/fttp get and put, eg. scripts or programs to integrate with dropbox, or similar. The script needs to anheaer to curl argument list. - Stefan Berg's comments implemented - Fatih Degirmenci's comments implemented with one exemption: the revision state .iso naming convention still remains the same - we need to discuss this. With the implementation of Fatih's comments the build.sh argument structure is slightly changed, please see ./build.sh -h TODO: - Further testing - Finalize cache invalidation logic - Make refactoring JIRA: Change-Id: I4efdbdd10f726c0a3229849a63040b6d2702db5c Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>
2015-03-11Rebase due to Fuel upstream changeStefan K. Berg2-0/+4
An update of the Fuel upstream code requires us to perform the corresponding change in the same file as we are modifying it in the OPNFV context. JIRA: #BGS-16 Change-Id: If3d5a0f1f2e97524f9e4a603cff89bc433226b92 Signed-off-by: Stefan K. Berg <stefan.k.berg@ericsson.com>
2015-03-09Starting point for ODL IntegrationJonas Bjurel133-0/+7030
***CAN BE MERGED*** - ODL build and installation (puppet manifests) including needed dependencies - Modified in accordance with Randy Levensalors comments - Added chmod 4755 /bin/fusermount due to that lately some systems dont install fuseiso withe SUID set for fusermount. Investing ongoing on why and why not consistent. - Rebased with master - ODL disabled in top Make (enable it by uncommenting the odl dirs - Removed white spaces - Hopefully fixed an issue with the docker ubuntu repos, added --no-cache=true to the fuel/docker/Make file. TODO: - Refactor collecting ODL and Java dependencies to one common place - Refactoring top Makefile - Adding CI hooks for build and deploy - Finishing integration plumbing wit Neutron/ML2 and OVS/OVSDB Change-Id: I13dd4d3a72d099316dfaa9f7cd9140781be2397b Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com>