nuxeo/nuxeo-ansible-jenkins

Name: nuxeo-ansible-jenkins

Owner: Nuxeo

Description: Ansible scripts for building Jenkins slaves

Created: 2016-09-20 15:40:59.0

Updated: 2018-05-21 13:52:28.0

Pushed: 2018-05-21 13:52:30.0

Homepage: null

Size: 213

Language: Shell

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

Ansible playbook for Jenkins slave image generation

Generate an Ubuntu image for use by Jenkins as a slave.

Requirements

• ansible 2.0 or later,

• a S3 bucket for the resources cache, and the credentials to access it in your environment.

• existing nexus user and group with ID 1003

• existing hudson user and group with ID 1005

• current user must have SSH access to host target as ubuntu

• current user must be sudoer

• current user must be member of the hudson group

• gargantua:/volume1/Build mounted to /opt/build

Generate/update image

Prod:

ansible-playbook -i inventory/production/hosts slave.yml [-v]

Testing:

ansible-playbook -i inventory/stage/hosts slave.yml -v -c local [--ask-sudo-pass]
ansible-playbook -i inventory/stage/hosts slave.yml [-K]
ansible-playbook playbook.yml --list-hosts

Complete procedure with Jenkins

Log on https://console.aws.amazon.com/ec2/home?region=eu-west-1#s=Instances

Jenkins slave template generation

Technical details:

• based on ami-89fa71fe (from http://alestic.com/ or http://cloud-images.ubuntu.com/locator/ec2/) (trusty 14.04 LTS amd64 ebs-ssd 20150209.1 ami-89fa71fe aki-52a34525)

Launch an instance:

• from community AMI: ami-89fa71fe
• with m1.small type
• set “Jenkins slave template ” as name
• associate the key pair
• set 'default' security group (it's preconfigured to fit requirements)

Copy its public hostname into nuxeo-tools-cloud/ansible/jenkins/inventory/production/hosts under [aws_ondemand].

Issue from nuxeo-tools-cloud/ansible/jenkins/:

 ansible-playbook -i inventory/production/hosts --limit aws_ondemand slave.yml -v

Jenkins slave AMI generation

Select the “Jenkins slave template ” instance on AWS interface and click “Action / Create Image (EBS AMI)“.

Set “Jenkins_AMI_<DATE>_slave” as name. Set “Size (GiB)” to 50.

Browse https://console.aws.amazon.com/ec2/v2/home?region=eu-west-1#Images

Copy the AMI ID (for instance ami-a3b1a7d7).

Repeat the operation to generate an identical AMI with name: “Jenkins_AMI_<DATE>_ondemand”

Jenkins configuration

Browse https://qa.nuxeo.org/jenkins/configure#section147

In the “Cloud / Amazon EC2 / AMIs” section, set the AMI ID and check its availability (“Check AMI” button).

Instance Type: C3Xlarge.

Label “SLAVE”.

Jobs must set “SLAVE” as slave restriction to use that EC2 image.

Same for the “ondemand” label with the second AMI.

You can ask for an image from https://qa.nuxeo.org/jenkins/computer/ with “Provision via EC2” button.

AWS cleanup

Delete unused old AMIs. Delete unused associated “snapshot” volumes.

Docker image generation

First build the nuxeo/jenkins-base image: Add your id_rsa.pub in docker/files/id_rsa.pub (so ansible can connect later) then:

docker build -t nuxeo/jenkins-base docker

You should update that base image now and then to get package updates, that will make the ansible build faster.

Run a container from that image, exporting the SSH port locally:

docker run -d -t -i -p 127.0.0.1:2222:22 --name=slave-common nuxeo/jenkins-base

Make an inventory file for ansible to access this container:

[multidb:children]
docker
[docker:children]
slaves
[slaves]
slavecommon ansible_ssh_port=2222 ansible_ssh_host=127.0.0.1

Run ansible normally on this container:

ansible-playbook -i inventory/slave-common/hosts slave-common.yml -v

Commit this container:

docker commit slave-common nuxeo/jenkins-common

Run pub/priv containers from that image:

docker run -d -t -i -p 127.0.0.1:2223:22 --name=slave-pub nuxeo/jenkins-common
docker run -d -t -i -p 127.0.0.1:2224:22 --name=slave-priv nuxeo/jenkins-common

Make inventory files to access those containers:

[multidb:children]
docker
[docker:children]
slaves
[slaves]
slavepub ansible_ssh_port=2223 ansible_ssh_host=127.0.0.1

[multidb:children]
docker
[docker:children]
slaves
[slaves]
slavepriv ansible_ssh_port=2224 ansible_ssh_host=127.0.0.1

Run ansible on those containers:

ansible-playbook -i inventory/slave-pub/hosts slave-pub.yml -v
ansible-playbook -i inventory/slave-priv/hosts slave-priv.yml -v

Commit those containers:

docker commit slave-pub nuxeo/jenkins-pub
docker commit slave-priv nuxeo/jenkins-priv

Tag the image for the remote registry:

docker tag nuxeo/jenkins-pub dockerpriv.nuxeo.com:443/nuxeo/jenkins-slave
docker tag nuxeo/jenkins-pub dockerpriv.nuxeo.com:443/nuxeo/jenkins-ondemand
docker tag nuxeo/jenkins-pub dockerpriv.nuxeo.com:443/nuxeo/jenkins-check
docker tag nuxeo/jenkins-priv dockerpriv.nuxeo.com:443/nuxeo/jenkins-slavepriv

Push the image:

docker push dockerpriv.nuxeo.com:443/nuxeo/jenkins-slave
docker push dockerpriv.nuxeo.com:443/nuxeo/jenkins-ondemand
docker push dockerpriv.nuxeo.com:443/nuxeo/jenkins-check
docker push dockerpriv.nuxeo.com:443/nuxeo/jenkins-slavepriv

You can then pull the image on the slaves hosts and restart the slaves containers with the new image.