Name: goblob
Owner: Pivotal Cloud Foundry
Description: Move Cloud Foundry blobs from NFS to S3
Created: 2016-12-08 17:41:34.0
Updated: 2018-05-13 04:00:19.0
Pushed: 2018-02-16 20:24:32.0
Size: 84271
Language: Go
GitHub Committers
User | Most Recent Commit | # Commits |
---|
Other Committers
User | Most Recent Commit | # Commits |
---|
goblob
is a tool for migrating Cloud Foundry blobs from one blobstore to
another. Presently it only supports migrating from an NFS blobstore to an
S3-compatible one.
Download the latest release.
Requirements:
r -p $GOPATH/src/github.com/pivotal-cf/goblob
clone git@github.com:pivotal-cf/goblob.git $GOPATH/src/github.com/pivotal-cf/goblob
GOPATH/src/github.com/pivotal-cf/goblob
e install
CH=amd64 GOOS=linux go install github.com/pivotal-cf/goblob/cmd/goblob
The tool is a Golang binary, which must be executed on the NFS VM that you intend to migrate. The only command of the tool is this:
goblob migrate [OPTIONS]
For each option you use, add --
before the option name in the command you want to execute.
concurrent-uploads
: Number of concurrent uploads (default: 20)exclude
: Directory to exclude (may be given more than once)blobstore-path
: The path to the root of the NFS blobstore, e.g. /var/vcap/store/shareds3-endpoint
: The endpoint of the S3-compatible blobstores3-accesskey
: The access key to use with the S3-compatible blobstores3-secretkey
: The secret key to use with the S3-compatible blobstoreregion
: The region to use with the S3-compatible blobstorebuildpacks-bucket-name
: The bucket containing buildpacksdroplets-bucket-name
: The bucket containing dropletspackages-bucket-name
: The bucket containing packagesresources-bucket-name
: The bucket containing resourcesuse-multipart-uploads
: Whether to use multi-part uploadsdisable-ssl
: Whether to disable SSL when uploading blobsinsecure-skip-verify
: Skip server SSL certificate verificationApply Changes
in Ops Managergoblob
to migrate any files which were created after the initial migrationbosh vm resurrection off
)bosh cck
the cf deployment to check for any errors with the bosh state. It should ask you if you want to delete references to the missing CC/NFS jobs, which you want to do.Apply Changes
in Ops Manager. After this deploy is finished, your CF API service availibility will resume.bosh vm resurrection on
).docker pull minio/minio
To run all of the tests in a Docker container:
./testrunner
To continually run the tests during development:
docker run -p 9000:9000 -e "MINIO_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE" -e "MINIO_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" minio/minio server /tmp
MINIO_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE MINIO_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY ginkgo watch -r