Dev tool build dellcloudedge/crowbar Wiki

https://github.com/dellcloudedge/crowbar/wiki/Dev-tool-build

Explore

Gist

Blog

Help

spinemjay

BLIC

dellcloudedge / crowbar
forked from crowbar/crowbar

Watch

Star

Fork

219

Code

Network

Pull Requests

Wiki

Graphs

Home

Pages

Wiki History

Git Access

New Page

Edit Page

Page History

Changes effective 9/14/2012: Applies to Crowbar 1.5+ & Crowbar 2.x Deployment The Crowbar Dev Tool is a git overlay that helps manage Crowbar releases, barclamp integration, and gated checkins to the Crowbar source base. This page documents how to use the dev tool to build the Crowbar ISO. For more detailed documentation specifically on how to use the tool for regular development, see README.dev-and-workflow in the main crowbar git repository. If you are planning to write code for Crowbar core or develop a barclamp, we highly recommend you follow the following steps to create your build server. If you are NOT planning to edit Crowbar then include the nogithub flag or follow the read-only Build-Crowbar.ISO instructions. Tip: Want to watch it on video? http://youtu.be/vIQLK4MXcqg

Pre-requisites:
A GitHub account (https://github.com/). They are free for personal open source use. A 40GB Ubuntu 12.04 server (VM is ok) is recommended for this process! It is important to use the dev tool for managing branches & releases because it: takes care of synchronization with all the barclamps builds nested tags with the release information A copy of CentOS 6.2 install DVD from bittorrent or your favortie CentOS mirror. This install DVD will need to go in $ISO_LIBRARY (usually $HOME/.crowbar-build-cache/iso) or can be accessed using a host share A copy of your target Crowbar OS. This page uses Ubuntu 12.04 server x64 iso as the example
sudosedie"s/%adminALL=(ALL)ALL/%adminALL=(ALL)NOPASSWD:ALL/g"/etc/sudoers

note: this will allow passwordless sudo for users in the admin group. The build process performs some high level kung-fu, some of which requires root access. if running as non-root, you'll be prompted for password unless you setup Passwordless SUDO permissions for your user. if the above does not work, using your username instead of 'crowbar', try
echo'crowbarALL=(ALL)NOPASSWD:ALL'>/etc/sudoers.d/crowbar;chmod400/etc/sudoers.d/crowbar

Alternatively run the build as root.

Build Steps:

1 of 3

6/8/2013 6:51 AM

Dev tool build dellcloudedge/crowbar Wiki

https://github.com/dellcloudedge/crowbar/wiki/Dev-tool-build

note: use sudo as instructed. Do not use the Dev tool as root! 1. If you don't want to use HTTPS, then make sure that your build server's public key is registered with your Github account 2. 3. 4. 5. 6. 7.
sudoaptgetupdate sudoaptgetinstallgitrpmrubyrubygems1.8curlbuildessentialdebootstrapmkisofsbinutils sudogeminstalljsonnethttpdigest_auth gitclonehttps://github.com/crowbar/crowbar.git cd~/crowbar ./devsetup

directory

1. You can ignore warnings: "ulimit: open files: cannot modify limit: Invalid argument" 2. this will create personal github forks for you of all the Crowbar modules. If you don't have a Github login, or you don't care about pushing changes back upstream, you can run ./devsetupnogithub 8. optional, if this is a new system, set your user information as directed 1. git config --global user.name "Your Name" 2. git config --global user.email you@example.com 9. 10.
./devfetch ./build_sledgehammer.sh

1. this builds the "discovery image" called Sledgehammer. 2. this step take a long time. It helps if you've pre-fetched the CentOS ISO (see Build-Crowbar.ISO) 3. It does not change often and does not need to be repeated once it has been built. 11. sudo ln -s /usr/share/debootstrap/scripts/gutsy /usr/share/debootstrap/scripts/precise 1. note: This is required only if: You're building for 12.04 on a 11.04 or 11.10 machine, since those versions don't know how to build Precise 12. Make sure you have the right ISOs in ~/.crowbarbuildcache/iso directory 1. For Ubuntu, you should have http://releases.ubuntu.com/12.04/ubuntu-12.04.1-server-amd64.iso 1. 2. 13.
cd~/.crowbarbuildcache/iso wgethttp://releases.ubuntu.com/12.04/ubuntu12.04.1serveramd64.iso

./devswitchdevelopment

1. you can see all the releases with ./dev releases 2. choices trunk (default, trunk), 1.2 = fledermaus, 1.3 Cloudera = elefante 14.
./devcheckoutmaster

1. you can see all the branches with git branch -a 2. choices are master (default, trunk), openstackosbuild (OpenStack), clouderaosbuild (Hadoop) 3. different branches represent different "distros" which combine different sets of barclamps (e.g. openstack, hadoop) 15.
./devbuildosubuntu12.04updatecache

1. The parameter --update-cache will create your Build Cache at this time, thus the first run will download from the internet what it needs. This takes time and can be skipped for later builds. Dev Tool will tell you if your cache is need to be updated 2. you can add --release development --branch master if you did not switch or checkout

Special Notes for Using a Build VM

If you are using VMware Worktation (or similar) then these extra tips will help you improve your build experience Tips: VMware tools are not working on Ubuntu 12.04 at this time (5.5.2012) so use 11.10 To save space on your VM, you can use ISOs that are local to your host create a shared file location (e.g.: c:\isos) mounted to "isos"
vi~/.buildcrowbar.conf

add a reference to ISO_LIBRARY=/mnt/hgfs/isos To make it easier to build VMs from the build ISO, have the build save it directory to your host's drive

2 of 3

6/8/2013 6:51 AM

Dev tool build dellcloudedge/crowbar Wiki

https://github.com/dellcloudedge/crowbar/wiki/Dev-tool-build

create a shared file location (e.g.: c:\temp\crowbar) mounted to "crowbar"

vi~/.buildcrowbar.conf

add a reference to ISO_DEST=/mnt/hgfs/crowbar

Building Barclamp TARs only

If you only want barclamps for import (Utils\Import) then you should use the "--no-iso" flag with the build command. Note that you must still provide an operating system! You can find the tars in ~/.crowbar-build-cache/ubuntu-12.04/build/dell/barclamps where the OS will match the one that you choose to target. See Packaging-Barclamps about building individual barclamps.

Coding Steps
We recommend you consult the ./dev command line help, and also README.dev-and-workflow in the crowbar repository. 1. ./dev backup 1. makes a copy into your personal forks (if you did not have any, you do now!) 2. ./dev fetch 1. fetches changes from remote repositories, but does not make any local changes. 3. ./dev sync 1. Merges changes fetched with ./dev fetch into your local branches. 4. commit your code 1. git add 2. git commit 5. ./dev is_clean 6. ./dev pull-requests-prep 1. it will give you instructions on next steps to automatically submit a push request on ALL impacted barclamps

Build your cache

A Crowbar build contains the packages (e.g. deb,rpm,gem etc) that will be used to install your cloud. To avoid having to download the Internet on every build, the Crowbar build system maintains a local cache in ~/.crowbar-build-cache by default. Additionally, Crowbar utilizes a customized LiveCD image, SledgeHammer. You can build that too (sources on github), but it changes very infrequently - so you're better of snatching it from somewhere.
Last edited by cloudedge, 5 months ago

GitHub About us Blog Contact & support GitHub Enterprise Site status

Applications GitHub for Mac GitHub for Windows GitHub for Eclipse GitHub mobile apps

Services Gauges: Web analytics Speaker Deck: Presentations Gist: Code snippets Job board

Documentation GitHub Help Developer API GitHub Flavored Markdown GitHub Pages

More Training Students & teachers The Shop Plans & pricing The Octodex

Terms of Service

Privacy

Security

2013 GitHub, Inc. All rights reserved.

3 of 3

6/8/2013 6:51 AM