LLNL/OMSClient

Name: OMSClient

Owner: Lawrence Livermore National Laboratory

Description: Tool to read network traffic data output by OpenSM Monitoring Service

Created: 2016-03-09 04:44:43.0

Updated: 2016-03-09 06:31:15.0

Pushed: 2016-07-01 07:40:40.0

Homepage:

Size: 37173

Language: Java

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

OMS History Parser

This moves information from OMS history files (.his) and stores it in HBase. The process in done in two steps:

• reads OSM data from OMS files and stores them in JSON or comma delimited files.
• reads data from JSON/comma delimited files and stores it in HBase (WIP)

Usage

1. Compiling OSMHBase

c -extdirs ../../lib -encoding ISO-8859-1 OSMHBase.java

On LC machines, you can select Java 1.7.0 like this:

rt JAVA_HOME=/usr/lib/jvm/java-1.7.0-oracle-1.7.0.101.x86_64
rt PATH=$JAVA_HOME/bin:$PATH

2. Reading '.his'

OSMHBase : IB Performance Processor

Base <operation> [<args>...] [json/del]

Usage:

base help                            - Shows this help/usage message.
base parseHis /path/to/his/dir       - Extract data from OMS '.his' files located in a given path.
base parseHis /path/to/hisFile       - Extract data from a single '.his'
base parseHis <path> json            - Writes data in JSON format.
base parseHis <path> del             - Writes data in delimited format.

On LC machines, you might have to add some arguments:

 -classpath .:../../lib/* OSMHBase parseHis <path> <json/del>

OMSHbase should be renamed to ibperfp in a future commit.

3. Writing to HBase

The hbaseLoader will read JSON text and write to HBase - (WIP)