bbc/colly

Name: colly

Owner: BBC

Description: Another serverless framework for AWS Lambda and API Gateway

Forked from: tmaslen/colly

Created: 2017-07-13 14:27:37.0

Updated: 2017-07-13 14:27:38.0

Pushed: 2017-07-13 06:49:04.0

Homepage: null

Size: 166

Language: JavaScript

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

Colly

Another serverless framework for AWS Lambda and API Gateway.

Instructions

Init a new Lambda

y init-lambda --lambda_name <NAME_OF_LAMBDA>

Run a lambda locally

y run-lambda --name <NAME_OF_LAMBDA> --local

You can pass the Lambda an event object (use a JSON file in your project directory) and a context object (use a JS file in your project directory):

y run-lambda --name <NAME_OF_LAMBDA> --local --event <RELATIVE_PATH_TO_JSON_FILE> --context <RELATIVE_PATH_TO_JS_FILE>

Note the context object will need to export an object literal.

Deploy a lambda

y deploy-lambda --name <NAME_OF_LAMBDA> --aws_profile <AWS_PROFILE_NAME>

When deploying a lambda for the first time, a role will be created for it. This role will be similarly named as the lambda and will be given the AWSLambdaBasicExecutionRole action.

If you want your lambda to access other AWS features and services beyond simple Lambda execution, you can create a custom policy and tell colly to assign this to the lambda's role at creation time. Add your custom policy ARN to the colly.json file using a property called customRolePolicyArn.

Run a deployed lambda from the CLI

y run-lambda --name <NAME_OF_LAMBDA> --aws_profile <AWS_PROFILE_NAME>

You can pass the deployed Lambda an event object (use a JSON file in your project directory):

y run-lambda --name <NAME_OF_LAMBDA> --event <RELATIVE_PATH_TO_JSON_FILE> --aws_profile <AWS_PROFILE_NAME>

Get logs from AWS

Creating a log output for NodeJS running on AWS Lambda is very simple. Lambda will log any console.log (or even console.trace ) to AWS Cloudwatch logs. There is no setup required.

However AWS Cloudwatch Logs batches all logs up into collections based on time. Scanning through these can be cumbersome as each batch has its own page in the AWS console.

A better way to view the logs for your Lambda is to use the command colly log-watch. This will take all of your logs and display them in one place.

Get the logs for the lambda:

y watch-log --name myLambda --aws_profile colly_tester

Search the logs for a key word of phrase:

y watch-log --name myLambda --aws_profile colly_tester --search error
y watch-log --name myLambda --aws_profile colly_tester --search "foo bar"

Tail logs:

y watch-log --name myLambda --aws_profile colly_tester --search error --tail

Search from a moment in time:

y watch-log --name myLambda --aws_profile colly_tester --search error --tail --start_time 2017-09-01

Encrypting environment variables

While its possible to encrypt environment variables when they are uploaded to AWS Lambda, using encrypted environment variables will mean your code will need to behave differently when running it locally compared to when its deployed. If you have data that you want to encrypt, then if its to be part of your repo you don't want it to be lying around unencrypted.

With this feature you can encrypt a value (for example an API key) and store it in your project config (the colly.json file) immediately without the unencrypted value ever being written into a file.

To enable this functionality you need to create a AWS KMS key and store it in your colly.json file.

y encrypt-var --name <NAME_OF_ENV_VAR> --value <VALUE_OF_ENV_VAR> --aws_profile <AWS_PROFILE_NAME>

You can also get the encrypted values decrypted using this command:

y decrypt-var --name <NAME_OF_ENV_VAR> --aws_profile <AWS_PROFILE_NAME>

Use the --env flag to set which environment colly file you want to edit. For example:

y encrypt-var --name <NAME_OF_ENV_VAR> --value <VALUE_OF_ENV_VAR> --env test

Config file

You can define configuration for colly using config files. By default colly will look for a colly.json file in the root of your project. You can also define a colly file for each work pipeline you want to setup.

For example you can have a test as well as a live pipeline. Example colly config files:

• colly.json will be used by default.
• colly.live.json will also be used by default.
• colly.test.json will be used if you add the param --env test onto any colly task command.

Here's an example with all the options you can define:

"region": "eu-west-1", // AWS Region you are working from
"awsProfile": "<PROFILE_NAME>" // The name of the AWS profile you want to authenticate your AWS session with.
"useBastion": true // set to true if you want to authenticate your AWS session via a bastion service.
"bastionService": {
    "endpoint": "<URL_TO_BASTION_SERVICE>",
    "certPath": "<ABSOLUTE_PATH_TO_CERT>",
    "cloudServicesRoot": "<ABSOLUTE_PATH_TO_ROOT_FILE>"
},
"vpcConfig": {
    "SubnetIds": [ "<SUBNET_ID_1>", "<SUBNET_ID_2>" ], // Minimum of 2 subnets must be provided
    "SecurityGroupIds": [ "SECURITY_GROUP_ID" ]
},
"kmsKeyArn": "<KMS_KEY_ARN>",
"customRolePolicyArn": "<POLICY_ARN>"

Developing

Configuration is done with environment variables. To run a node module directly (rather than via the commands in the bin) you need to set environment variables. Use this pattern:

<VAR_NAME>="<VAR_VALUE>" node lib/<MODULE_NAME>

For example…

COLLY__PROJECT_DIR="./test/fixtures/deploy-lambda" ENV="live" node lib/deploy-lambda

Testing

There are unit tests that can be ran with this command…

test

Some of the tasks need to be manually tested. Here are command examples of running these…

COLLY__PROJECT_DIR="/<LOCAL_PATH_TO_PROJECT_DIR>/colly/test/fixtures/deploy-lambda" npm run colly deploy-lambda -- --name myLambda --aws_profile colly_tester