Name: elephant-twin-lzo
Owner: Twitter, Inc.
Owner: Twitter Archive
Description: Elephant Twin LZO uses Elephant Twin to create LZO block indexes
Created: 2012-06-12 21:37:56.0
Updated: 2018-03-31 00:51:02.0
Pushed: 2012-06-13 16:56:03.0
Size: 128
Language: Java
GitHub Committers
| User | Most Recent Commit | # Commits |
|---|
Other Committers
| User | Most Recent Commit | # Commits |
|---|
Elephant Twin is a framework for creating indexes in Hadoop.
Elephant Twin LZO uses ElephantTwin to create LZO block indexes. The resulting indexes can be used by Elephant Twin's BlockIndexedFileInputFormat to avoid scanning LZO blocks that do not contain the sought values of indexed columns. It can also be used by Elephant Twin's IndexedPigLoader to automatically apply filters found in Pig scripts, reducing the number of scanned data when reading LZO-compressed files.
This project is separate from Elephant Twin due to licensing restrictions due to the GPL.
LZO files are expected to be indexed using the indexing tools found in the Hadoop-LZO package.
First, ensure that native LZO libraries are installed.
Use the instructions at https://github.com/twitter/hadoop-lzo for getting this done.
After that, it should be a regular `mvn install`.
ssues
a bug? Please create an issue here on GitHub!
s://github.com/twitter/elephant-twin-lzo/issues
ersioning
transparency and insight into our release cycle, releases will be numbered with the follow format:
jor>.<minor>.<patch>`
constructed with the following guidelines:
eaking backwards compatibility bumps the major
w additions without breaking backwards compatibility bumps the minor
g fixes and misc changes bump the patch
more information on semantic versioning, please visit http://semver.org/.
uthors
r contributions from
Xu
mmy Lin
itriy Ryaboy
r contributors can be found via git history (many thanks to all of them).
icense
right 2012 Twitter, Inc.
nsed under the GNU General Public License. See https://github.com/twitter/elephant-twin-lzo/blob/master/LICENSE