Clever/postgres-to-redshift

Name: postgres-to-redshift

Owner: Clever

Description: Copy data from a postgres db into redshift

Created: 2015-01-30 02:52:28.0

Updated: 2018-05-04 18:09:24.0

Pushed: 2018-05-18 23:04:23.0

Homepage:

Size: 320

Language: Go

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

postgres-to-redshift

postgres-to-redshift copies postgres data to redshift via S3. This repository is golang adaptation of the original script by Donors Choose at https://github.com/DonorsChoose/open-data-science/tree/master/postgres2redshift.

Running

REGION='us-east-1' \
p go run main.go \
shifthost=<host> \
shiftport=<port> \
shiftuser=<user> \
shiftpassword=<password> \
shiftdatabase=<database> \
shiftschema=<schema> \
tgreshost=<host> \
tgresdatabase=<database> \
tgresuser=<user> \
tgresport=<port> \
tgrespassword=<password> \
refix=<prefix> \
les=<tables_csv>

In production, the binary is run on gearman using a standalone worker run as a cron job.

Vendoring

Please view the dev-handbook for instructions.