Name: event-gateway-example
Owner: Serverless
Description: null
Created: 2017-08-08 18:17:02.0
Updated: 2018-04-10 20:37:40.0
Pushed: 2018-02-14 12:43:22.0
Homepage: null
Size: 277
Language: JavaScript
GitHub Committers
| User | Most Recent Commit | # Commits |
|---|
Other Committers
| User | Most Recent Commit | # Commits |
|---|
This example showcases how to develop and deploy Serverless applications using the Event Gateway as the central hub and broker, orchestrating event flows across decoupled services.
The Event Gateway allows you to provide HTTP endpoints as well as Pub/Sub functionality into a single event-driven experience. This example uses the serverless run command by the Serverless Framework providing developers with a seamless development experience.
This example contains multiple services. Each of them can be run separately to develop an individual service, but also together at the same time to test the integration between multiple services.
npm install -g serverless and you are logged into the Serverless Platform by running serverless login.npm install in the root directory. This command runs npm install in the frontend app and each backend service.To get started cd into the users service at services/users and run
erless run
This will emulate the function register locally. In addition it downloads, runs and configures the Event Gateway to invoke the function every time a request to HTTP endpoint /users is triggered with the method POST. You can test the endpoint by sending an HTTP request to register a user and receive a valid session:
-X POST -d '{ "email": "test@example.com" }' --header "Content-Type: application/json" http://localhost:4000/users
In the serverless run terminal session you will see that the user-registered function triggers the user.registered event which we will use in the next step.
t Gateway Event 'http' received
erless Function 'users-register' triggered by event 'http'
t Gateway Event 'user.registered' received
erless Function 'users-register' finished
Next up open another terminal and cd into the directory of the emails service at services/emails. There also run
erless run
This will register the function sendWelcomeEmail and subscribe it to the custom event user.registered. Details can be found in your serverless-run process of the users service. By now you have have two services running connected to one Event Gateway.
If you register another user now by running
-X POST -d '{ "email": "test2@example.com" }' --header "Content-Type: application/json" http://localhost:4000/users
This time the workflow is extended by
erless Function 'emails-sendWelcomeEmail' triggered by event 'user.registered'
t Gateway Event 'email.sent' received
erless Function 'emails-sendWelcomeEmail' finished
This event driven architecture allowed us to extend the existing functionality with very little effort.
While this demonstrated how to test the integration between multiple service you can also run and test the emails service alone. For a better experience testing custom events the Serverless Framework supports the emit command. Give it a try by running:
erless emit -n=user.registered -d='{ "id": 42, "session": "xxxxx", "email": "test3@example.com" }'
The Event Gateway provides the system event gateway.info.functionError which is triggered every time a functions fails.
In order to spin up a function that throws an error you can spin up the crm service at services/crm using:
erless run
It registers the function addUserToCrm and subscribes it to user.registered. After emitting the event the workflow should include:
t Gateway Event 'user.registered' received
erless Function 'crm-addUserToCrm' triggered by event 'user.registered'
erless Function failed due to an error
t Gateway Event 'gateway.info.functionError' received
You can subscribe and act on such system events. The errors service at services/errors subscribes to gateway.info.functionError. Once again initialize it with serverless run and emit the user.registered event to see how the alertAdmin is invoked
t Gateway Event 'gateway.info.functionError' received
erless Function 'errors-alertAdmin' triggered by event 'gateway.info.functionError'
erless Function 'errors-alertAdmin' finished:
The Event Gateway itself is designed in a way to operate across multiple cloud providers. In our application we leverage this opportunity to deploy two service running Google Cloud Functions using Google's Vision API as well as Google's BigQuery.
First you need to get an API and project key from a project that has the Cloud Vision API enabled.
Go to the Cloud Vision API section of the GCP console. Hit “Enable” to enable Cloud Vision for your project.
Go to the Credentials view in the GCP Console. Hit “Create credentials” and choose “API key”. Copy and paste the key into services/vision/config.json.
Retrieve the project id and set PROJECT_ID in the config.json file.
Next up open a new terminal and go to services/vision/ and run:
erless run
It registers the function annotateUser and subscribes it to user.registered. After emitting the event this function will fetch the user's Gravatar based on the email address and analyze it with the Vision API.
Once completed the function will emit the event user.annotated. The event can be used by any function subscribing to it from any cloud provider.
Our application emits user.clicked events directly from the front-end. To test this run the front-end, log in and click one of the buttons. Once up and running the analytics service listens to these events and sends them to BigQuery for further analysis.
In the next steps you need to retrieve a JSON credentials file with access to BigQuery.
Go to the Google APIs Credentials console. Select your project.
Go to the Google APIs Library page, and click on the BiqQuery API link to make sure the API is enabled for your project.
Click Create Credentials and choose Service account key.
In the Service Account dropdown, choose New service account. Give it a name. In the Role box, go to BigQuery and select BigQuery Admin.
Use a JSON key type and hit 'Create'. It will download a JSON file to your computer. Move it to the directory services/analytics/ as the file name credentials.json.
Update the project name in the config.json file in the services/analytics/ directory with your project name.
Next up open a new terminal and go to services/analytics/ and run:
setup.js # setup the BigQuery table
erless run
Then open another terminal, cd into frontend/ and run:
start
This will open your browser and visit http://localhost:3000. Register with an email and click one of the buttons.
In the terminal running the Event Gateway you will recognize a user.clicked event was received. This is the case, because the event was directly emitted from the browser using the Serverless Development Kit (aka FDK).
Go to the BigQuery Console. Make sure you're in the right project.
Useful queries:
Show the 1000 most recent events with event name, timestamp, email (if it exists in data), and full data object:
CT
ent,
ceivedAt,
ON_EXTRACT(data, '$.email') AS email,
ta
erverless-emit:emit_demo.test_events]
R BY receivedAt DESC
T
00
Congratulations! You explored the whole example application.
Please reach out to us in the issues or via email in case you have questions or suggestions for improvement.
A list of all the events used in this application:
Currently work in progress and you can expect this section to be completed soon. Production ready deployment is one of the highest priorities of the Serverless team. Please reach out to us if you are interested to run the Event Gateway on-premise or use a hosted solution.