elodina/collectd-framework

Name: collectd-framework

Owner: Elodina

Description: CollectD Plugin to Apache Kafka

Created: 2015-10-16 18:31:37.0

Updated: 2017-09-18 08:26:15.0

Pushed: 2016-01-18 11:15:05.0

Homepage: http://www.elodina.net

Size: 43

Language: Java

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

collectd-framework

Build

clone git@github.com:elodina/collectd-framework.git
ollectd-framework
ild-collectd-api.sh

You will have collectd-api.jar file containing all stuff you need to collect data and produce it to kafka.

Configure

All collectd configuration options are in collectd.conf. At first, load java plugin by:

Plugin java

Then configure it:

gin java>
JVMArg "-verbose:jni"
JVMArg "-Djava.class.path=/usr/share/collectd/java/collectd-api.jar"

LoadPlugin "net.elodina.collectd.Kafka"
<Plugin "Kafka">
    BrokerList "localhost:9092"
    BatchSize 1000
</Plugin>
ugin>

As you see, with java plugin here we have to load and configure Kafka plugin. Options:

• BrokerList: list of kafka brokers separated with comma. Default: "localhost:9292"
• BatchSize: kafka producer batch size. Default: 1000
• Topic: kafka topic. Default: "collectd"
• Namespace: namespace to report for. Defaults to no namespace.

Run

Without Docker

Prerequisites:

• JVM
• Collectd precompiled with java plugin (in rpm-based systems: yum install collectd-java.x86_64)

Launching:

1. You should put collectd-api.jar file to /usr/share/collectd/java/ or you can replace option from configuration step with your custom path.
2. Launch collectd deamon:

   ectd -C collecd.conf
   

Alternative way (for centos):

1. Put deploy.sh, collectd-api.jar, collectd.conf somewhere on server
2. Run ./deploy.sh

With Docker

At first, build docker image:

er build -t collectd .

It will contain all dependencies, including JVM, collectd-java and Kafka plugin.

Then run it:

er run collectd