hybris/rsyslog-kafka-boshrelease

Name: rsyslog-kafka-boshrelease

Owner: hybris GmbH

Description: null

Created: 2016-05-04 12:59:07.0

Updated: 2016-11-16 20:15:35.0

Pushed: 2017-06-30 10:23:35.0

Homepage: null

Size: 84

Language: Shell

GitHub Committers

UserMost Recent Commit# Commits

Other Committers

UserEmailMost Recent Commit# Commits

README

BOSH release to run rsyslog-kafka

Background
What is rsyslog-kafka?

This release integrates the omkafka module from rsyslog to forward your logs to a kafka cluster.

Usage

To use this bosh release, first upload it to your bosh:

 upload release https://github.com/hybris/rsyslog-kafka-boshrelease

For bosh-lite, you can quickly create a deployment manifest & deploy a cluster:

lates/make_manifest warden
 -n deploy

For AWS EC2, create a single VM:

lates/make_manifest aws-ec2
 -n deploy
Override security groups

For AWS & Openstack, the default deployment assumes there is a default security group. If you wish to use a different security group(s) then you can pass in additional configuration when running make_manifest above.

Create a file my-networking.yml:


orks:
name: rsyslog-kafka1
type: dynamic
cloud_properties:
  security_groups:
    - rsyslog-kafka

Where - rsyslog-kafka means you wish to use an existing security group called rsyslog-kafka.

You now suffix this file path to the make_manifest command:

lates/make_manifest openstack-nova my-networking.yml
 -n deploy
Properties

erties:
yslog_kafka:
brokers:
  - localhost:9092  # required - Array of kafka servers
topic: kafka_topic  # required - Kafka topic
org: myorg          # required
space: myspace      # default to bosh deployment name
service: myservice  # default to bosh job name

This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.