Unicon/mdq-server-lambda

Name: mdq-server-lambda

Owner: Unicon, Inc.

Description: An AWS Lambda-based metadata query (mdq) server implementation

Created: 2016-09-12 18:29:33.0

Updated: 2017-09-02 20:19:45.0

Pushed: 2017-07-17 17:45:19.0

Homepage: null

Size: 146

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

mdq-server-lambda

An AWS Lambda-based metadata query (mdq) server implementation

This is a very alpha/POC version. Use at your own risk!

Building

Lambda is particular about the version of .so files installed by pip. This requires that the project be build in an AWS AMI. While you can build on OS X, that archive will not execute after being pushed to AWS. You'll have an easier time starting an EC2 isntance with the appropriate AMI. See https://docs.aws.amazon.com/lambda/latest/dg/current-supported-versions.html for supported AMI versions.

From the project directory, run ./build, then upon seeting Updating AWS Lambda service, hit Ctrl+C.

Then run (be sure to change the <account-id>):

lambda create-function \
nction-name reloadMetdata \
ntime python2.7 \
le arn:aws:iam::<account-id>:role/lambda_basic_execution \
ndler importInc.handler_name \
p-file fileb://dist/mdq-server.zip

Upon sequent builds, ./build can be used exclusively to push updates.

Preping an AMI

On a clean AMI, run:

 pip install --upgrade pip
 yum install -y gcc libffi-devel libxml2-devel libxslt-devel openssl-devel 

Just to get this documented, seperate Lambda function for query:

 __future__ import print_function

rt boto3
rt json
rt urllib

t('Loading function')

lambda_handler(event, context):
'''Provide an event that contains the following keys:

  - params.path.entityId: the entityId of the requested entity.
  - params.header.If-None-Match: a previously provided ETag to take advantage of caching.
'''

if 'params' in event and 'path' in event['params'] and 'entityId' in event['params']['path']:
    entityId = event['params']['path']['entityId']
    entityId = urllib.unquote(entityId)
    print(entityId)

    inboundETag = ''
    if 'header' in event['params'] and 'If-None-Match' in event['params']['header']:
        #Striping single quotes until API Gateway Header JSON decoding issue fixed
        inboundETag = event['params']['header']['If-None-Match'].replace('W/','').replace('"','').replace("'",'')
        print(inboundETag)

    dynamo = boto3.client('dynamodb')

    response = dynamo.get_item(
        TableName='metadata',
        Key={'entityID': {'S': entityId}},
        AttributesToGet=['metadata','etag']
        )
    if 'Item' not in response:
        raise Exception('404')

    ETag = response['Item']['etag']['S']
    print(ETag)
    if inboundETag == ETag:
        print("ETag matched")
        raise Exception('304')

    metadata = response['Item']['metadata']['S']
    #print(metadata)

    return { 'metadata' : metadata, 'headers' : { 'etag': 'W/"{0}"'.format(ETag)}, 'status': '200'}
    #Using single quotes until API Gateway Header JSON decoding issue fixed
    #return { 'metadata' : metadata, 'headers' : { 'etag': "W/'{0}'".format(ETag)}, 'status': '200'}

else:
    raise Exception('404')