CD2H gitForager

berkmancenter/im_centinel_integration

Name: im_centinel_integration

Owner: Berkman Klein Center for Internet & Society

Description: Connect ICLab's Centinel nodes to the Berkman Klein Center's Internet Monitor platform

Created: 2017-11-30 20:28:47.0

Updated: 2018-05-02 18:38:48.0

Pushed: 2018-05-24 15:04:53.0

Homepage:

Size: 118

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

Internet Monitor + Centinel Integration

Description

This is a small program whose purpose is to connect ICLab's Centinel nodes to the Berkman Klein Center's Internet Monitor platform.

Code Repository

The code for this program can be found at: https://github.com/berkmancenter/im_centinel_integration

Requirements

To get this running, you'll need the following:

Python 2.7
A clone of the centinel repo in your PYTHON_PATH
The required libraries, which can be installed with pip install -r requirements.txt

Setup

After fulfulling the requirements, you'll want to setup your credentials to connect to an AMQP server (like RabbitMQ). To do so, cp amqp_creds.json.example amqp_creds.json and edit amqp_creds.json to include the correct information.

After that, it should be enough to run: python watch_for_experiments.py

To Do

Update Centinel dependency to a package instead of a checked-out repo.
Clean out the code used to manipulate scheduler.info. We don't have to do that.
Remove the elasticsearch_dsl dependency. This is just an artifact of using scripts I already had lying around instead of rewriting the code to turn Centinel's data format into a HAR.
Move testing to separate thread. See here as example.

Notes

Because we're being lazy and using a single-threaded blocking connection to RabbitMQ, our result parsing and submission can cause missed heartbeats. See here and here for details.
http://www.andy-pearce.com/blog/posts/2013/Mar/file-capabilities-in-linux/

License

See LICENSE

Copyright

This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.