zapier/docker-airflow

Name: docker-airflow

Owner: Zapier

Description: Simple Airbnb Airflow container

Forked from: puckel/docker-airflow

Created: 2016-02-05 17:11:00.0

Updated: 2016-02-05 17:11:01.0

Pushed: 2016-01-28 12:22:09.0

Homepage: null

Size: 31

Language: Shell

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

Airflow Dockerfile

Circle CI :

ImageLayers :

This repository contains Dockerfile of airflow for Docker's automated build published to the public Docker Hub Registry.

Informations

• Based on Debian Jessie official Image debian:jessie
• Install Docker
• Install Docker Compose
• Following the Airflow release from Python Package Index

Installation

    docker pull puckel/docker-airflow

Build

For example, if you need to install Extra Packages, edit the Dockerfile and than build-it.

    docker build --rm -t puckel/docker-airflow .

Usage

Start the stack (mysql, rabbitmq, airflow-webserver, airflow-scheduler airflow-flower & airflow-worker) :

    docker-compose up -d

If you want to use Ad hoc query, make sure you've configured connections : Go to Admin -> Connections and Edit “mysql_default” set this values (equivalent to values in airflow.cfg/docker-compose.yml) :

• Host : mysql
• Schema : airflow
• Login : airflow
• Password : airflow

Check Airflow Documentation

UI Links

• Airflow: localhost:8080
• Flower: localhost:5555
• RabbitMQ: localhost:15672

(with boot2docker, use: open http://$(boot2docker ip):8080)

Run the test “tutorial”

    docker exec dockerairflow_webserver_1 airflow backfill tutorial -s 2015-05-01 -e 2015-06-01

Wanna help?

Fork, improve and PR. ;-)