vega/datalib-sketch

Name: datalib-sketch

Owner: Vega

Description: Probabilistic data structures for large or streaming data sets.

Created: 2015-05-22 16:39:45.0

Updated: 2017-10-27 21:40:05.0

Pushed: 2017-05-13 15:50:29.0

Homepage:

Size: 187

Language: JavaScript

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

datalib-sketch

Probabilistic data structures for large or streaming data sets.

This module exports the following sketches:

• Bloom - Bloom filters test for (approximate) set membership.
• CountMin - Count-min sketches estimate frequency counts for streaming values.
• CountMinMean - Count-min-mean sketches modify the estimates of count-min sketches to account for bias.
• NGram - The N-Gram sketch simply counts all n-character strings (default 2) in text data.
• StreamSummary - The StreamSummary sketch tracks top-k frequent values.
• TDigest - The T-digest estimates a variable-width histogram for quantile and cdf estimation.

Build Process

To use datalib-sketch in the browser, you need to build the datalib-sketch.js and datalib-sketch.min.js files. We assume that you have npm installed.

1. Run npm install in the datalib-sketch folder to install dependencies.
2. Run npm run build. This will invoke browserify to bundle the source files into datalib-sketch.js, and then uglify-js to create the minified datalib-sketch.min.js.