Name: s3-time-stream
Owner: npm
Description: binary search to and stream an exact time range from logs stored in s3.
Created: 2017-05-01 22:12:37.0
Updated: 2018-04-27 08:27:16.0
Pushed: 2018-03-30 19:24:36.0
Homepage: null
Size: 15
Language: JavaScript
GitHub Committers
| User | Most Recent Commit | # Commits |
|---|
Other Committers
| User | Most Recent Commit | # Commits |
|---|
cli tool. stream an exact time range from logs stored in s3. find the time segment with binary search so you download the minimum data possible.
ime-stream --bucket log-bucket --start 2017-04-27T16:08:00.212Z --end 2017-04-27T16:08:02.212Z
expects that logs are stored in s3 with date+hour prefix.
s3://bucket/2017-04-19T20
expects log lines to start with date in this format right now.
<134>2017-04-27T16:08:00Z
there can be many logs per hour they will be streamed in time order even if they overlap.
both of these things should be configurable later. e_notime