Name: UnifyCR
Owner: Lawrence Livermore National Laboratory
Description: UnifyCR: A file system for burst buffers
Created: 2017-10-16 19:36:31.0
Updated: 2018-03-29 01:15:15.0
Pushed: 2018-03-29 20:02:02.0
Homepage: null
Size: 3175
Language: C
GitHub Committers
| User | Most Recent Commit | # Commits |
|---|
Other Committers
| User | Most Recent Commit | # Commits |
|---|
Node-local burst buffers are becoming an indispensable hardware resource on large-scale supercomputers to buffer the bursty I/O from scientific applications. However, there is a lack of software support for burst buffers to be efficiently shared by applications within a batch-submitted job and recycled across different batch jobs. In addition, burst buffers need to cope with a variety of challenging I/O patterns from data-intensive scientific applications.
UnifyCR is a user-level burst buffer file system under active development. UnifyCR supports scalable and efficient aggregation of I/O bandwidth from burst buffers while having the same life cycle as a batch-submitted job. While UnifyCR is designed for N-N write/read, UnifyCR compliments its functionality with the support for N-1 write/read. It efficiently accelerates scientific I/O based on scalable metadata indexing, co-located I/O delegation, and server-side read clustering and pipelining.
Full UnifyCR documentation is contained here.
Use Build & I/O Interception for instructions on how to build and install UnifyCR.
The current status of the UnifyCR dev branch is:
We have a separate document with contribution guidelines.