starkandwayne/concourse-deployment-pipeline

Name: concourse-deployment-pipeline

Owner: Stark & Wayne

Description: null

Created: 2015-05-08 15:05:19.0

Updated: 2018-05-13 03:59:20.0

Pushed: 2015-05-08 16:49:53.0

Homepage: null

Size: 140

Language: Shell

GitHub Committers

UserMost Recent Commit# Commits

Other Committers

UserEmailMost Recent Commit# Commits

README

Pipeline to deploy Logstash Docker

This project is an example http://concourse.ci pipeline for deploying the https://github.com/cloudfoundry-community/concourse-boshrelease/ BOSH release.

There are several pipeline*.yml to choose from:

try-anything

try-anything-production

pre-prod

The example pipelines all assume the deployments are via the same BOSH - as such only the entry deployment try-anything is responsible for uploading releases & stemcells. Other deployments assume that releases & stemcells are uploaded, and benefit from packages being pre-compiled.

Usage

The example pipelines above are designed to be deployed in sequence to grow out your pipeline.

The templates in try-anything, pre-production and production are for bosh-lite; so bootup bosh-lite. It is convenient to deployment http://concourse.ci into that bosh-lite too. Due to the amount of Docker images and BOSH assets being downloaded, deploying bosh-lite to AWS might be a good idea.

Next, create a credentials.yml based on credentials.yml.example.

Next, deploy the try-anything pipeline:

n-pipeline.sh concourse pipeline-try-anything.yml credentials.yml

Once it is working, you can expand your pipeline to feed into a production deployment:

n-pipeline.sh concourse pipeline-try-first-then-production.yml credentials.yml

The deploy-production job should trigger immediately because the deploy-try-anything job has already previously succeeded.

Finally, to add further deployment protection to production you might want to pre-deploy all changes through a pre-production deployment.

n-pipeline.sh concourse pipeline-try-pre-prod-prod.yml credentials.yml
Building/updating the base Docker image for tasks

Each task within all job build plans uses the same base Docker image for all dependencies. Using the same Docker image is a convenience. This section explains how to re-build and push it to Docker Hub.

All the resources used in the pipeline are shipped as independent Docker images and are outside the scope of this section.

n-pipeline.sh concourse-image ci_image/pipeline.yml credentials.yml job-build-task-image

This will ask your targeted Concourse to pull down this project repository, and build the task_docker_image/Dockerfile, and push it to a Docker image on Docker Hub.


This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.