RADAR-base/RADAR-HDFS-Sink-Connector

Name: RADAR-HDFS-Sink-Connector

Owner: RADAR-CNS

Owner: RADAR-CNS

Description: Contains Kafka-connectors of RADAR-CNS platform

Created: 2017-02-28 16:05:05.0

Updated: 2017-08-03 18:18:11.0

Pushed: 2018-01-15 12:35:05.0

Homepage:

Size: 119

Language: Java

GitHub Committers

UserMost Recent Commit# Commits

Other Committers

UserEmailMost Recent Commit# Commits

README

RADAR-Connectors

Contains HDFS-Sink-Connector of RADAR-CNS platform

To Run Radar-HDFS-Connector

  1. In addition to Zookeeper, Kafka-broker(s), Schema-registry and Rest-proxy, HDFS should be running

  2. Load the radar-hdfs-sink-connector-*.jar to CLASSPATH

    rt CLASSPATH=/path/to/radar-hdfs-sink-connector-*.jar
    
  3. Configure HDFS Connector properties.

    =radar-hdfs-sink
    ector.class=io.confluent.connect.hdfs.HdfsSinkConnector
    s.max=1
    cs=mock_empatica_e4_battery_level,mock_empatica_e4_blood_volume_pulse
    h.size=1200
    .url=hdfs://localhost:9000
    at.class=org.radarcns.sink.hdfs.AvroFormatRadar
    itioner.class=org.radarcns.sink.hdfs.AvroTopicPartitioner
    
  4. Run the connector. To run the connector in standalone mode (on an enviornment confluent platform is installed)

    ect-standalone /etc/schema-registry/connect-avro-standalone.properties path-to-your-hdfs-connector.properties
    

Contributing

Code should be formatted using the Google Java Code Style Guide. If you want to contribute a feature or fix browse our issues, and please make a pull request.


This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.