awslabs/amazon-kinesis-data-visualization-sample

Name: amazon-kinesis-data-visualization-sample

Owner: Amazon Web Services - Labs

Owner: AWS Samples

Description: Amazon Kinesis Data Visualization Sample Application

Created: 2014-04-15 19:55:16.0

Updated: 2017-12-28 13:45:05.0

Pushed: 2017-09-26 13:02:58.0

Homepage: http://aws.amazon.com/kinesis/

Size: 1065

Language: JavaScript

GitHub Committers

UserMost Recent Commit# Commits

Other Committers

UserEmailMost Recent Commit# Commits

README

Amazon Kinesis Data Visualization Sample Application

The Amazon Kinesis Data Visualization Sample Application demonstrates how to interact with Amazon Kinesis to generate meaningful statistics from a stream of data and visualize those results in real time.

Features

The Amazon Kinesis Data Visualization Sample Application contains three components:

  1. A record publisher to send data to Amazon Kinesis.
  2. An Amazon Kinesis Client application to compute the number of HTTP requests a resource received, and the HTTP referrer that sent them, over a sliding window.
  3. An embedded web server and real time chart to display counts as they are computed.

The application will create one Amazon Kinesis stream with two shards and two Amazon DynamoDB tables in your AWS account.

Important: These resources will incur charges on your AWS bill. It is your responsibility to delete these resources. A utility for deleting them is provided as part of this application. See Deleting Sample Application Resources for more information.

This application also includes a CloudFormation template to demonstrate how to launch an Amazon Kinesis Client application on EC2.

Getting Started
  1. Sign up for AWS — Before you begin, you need an AWS account. For more information about creating an AWS account and retrieving your AWS credentials, see AWS Account and Credentials in the AWS SDK for Java Developer Guide.
  2. Sign up for Amazon Kinesis — Go to the Amazon Kinesis console to sign up for the service.
  3. Minimum requirements — To use the sample application, you'll need Java 1.7+ and Maven 3. For more information about the requirements, see the Getting Started section of the Amazon Kinesis Developer Guide.
  4. Using the Amazon Kinesis Data Visualization Sample Application — The best way to familiarize yourself with the sample application is to read the Getting Started section of the Amazon Kinesis Developer Guide.
Building from Source

You can build the sample application using Maven:

clean package

The application and all its dependencies are packaged into `target/amazon-kinesis-data-visualization-sample-1.0.0-assembly.zip`. The CloudFormation template relies on this archive and its structure to start the application on the EC2 host.

Running the Application

You can execute all the sample application components directly from the command line using Maven.

Stream Writer

HttpReferrerStreamWriter.java sends randomly generated records to the Amazon Kinesis stream. You can start it locally by executing:

Counting Kinesis Client Application

pReferrerCounterApplication.java](src/main/java/com/amazonaws/services/kinesis/samples/datavis/HttpReferrerCounterApplication.java) starts a Kinesis Client application that counts the number of HTTP requests to a resource over a sliding window. The application then persists the counts to DynamoDB for retrieval by the web application. You can start it locally by executing:
Real Time Chart (Web Server)

WebServer.java starts a web server on port 8080 to view the results of the Counting Kinesis Client Application in real time. You can start it locally by executing:

r you have started all the components, navigate to http://localhost:8080 to view the running application. Note that you must execute both the Stream Writer and the Counting Kinesis Client Application to see any data on the chart.

CloudFormation Template

mple CloudFormation template is included to demonstrate how to launch the application on EC2. The template provisions an EC2 t1.micro instance and starts all three applications on it. See [EC2 Instance Types][ec2-instance-types] for more information on instance types.

CloudFormation stack creates an [IAM Role][iam-role] to allow the application to authenticate your account without the need for you to provide explicit credentials. See [Using IAM Roles for EC2 Instances with the SDK for Java][iam-roles-java-sdk] for more information.

template can be found at ```src/main/static-content/cloudformation/kinesis-data-vis-sample-app.template```.

t the [AWS CloudFormation][cloudformation] page for more information on what CloudFormation is and how you can leverage it to create and manage AWS resources.

eleting Sample Application Resources

sample application creates one Amazon Kinesis Stream and two Amazon DynamoDB tables, which will bill to your account. You can delete these resources by executing the following command:

This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.