FredHutch/fs-cleaner

Name: fs-cleaner

Owner: Fred Hutchinson Cancer Research Center

Description: delete or archive files based on last access time

Created: 2014-09-03 23:57:00.0

Updated: 2017-10-13 20:21:32.0

Pushed: 2017-10-22 14:33:20.0

Homepage: null

Size: 23

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

fs-cleaner

fs-cleaner deletes or archives files based on last access or modification time. The most common use case is managing persistent scratch file systems, for example in high performance computing environments. Scratch file systems contain temporary, machine generated data that can be deleted after use.

user@box1:~/py$ ./fs-cleaner.py --help
usage: fs-cleaner [-h] [--debug] [--email-notify EMAIL] [--warn-days WARNDAYS]
              [--days DAYS] [--archive-root AROOT]
              [--archive-prefix APREFIX] [--archive-tenant]
              [--bwlimit BWLIMIT] [--remove-appledoubles]
              [--folder FOLDER]

clean out old files on a scratch file system and notify file owners.
Optionally archive files to destination archive-root/+archive-tenant/+archive-
prefix/project-yyyy-mm-dd

optional arguments:
-h, --help            show this help message and exit
--debug, -g           show the actual shell commands that are executed (git,
                      chmod, cd)
--email-notify EMAIL, -e EMAIL
                      notify this email address of any error
--warn-days WARNDAYS, -w WARNDAYS
                      warn user x days before removal of file (default: 0
                      days = deactivated)
--days DAYS, -d DAYS  remove files older than x days (default: 1461 days or
                      4 years)
--archive-root AROOT, -r AROOT
                      the root folder of the destination archive file system
--archive-prefix APREFIX, -p APREFIX
                      fixed string to be added to prefix the target archive
                      project folder with this sub directory
--archive-tenant, -t  If true treat the first folder level below --folder as
                      group or tenant. In that case the archive target root
                      directory will be aroot+tenant+aprefix
--bwlimit BWLIMIT, -b BWLIMIT
                      maximum bandwidth limit (KB/s) of all parallel rsync
                      sessions combined
--remove-appledoubles, -a
                      immediately remove AppleDoubles at the source.
--folder FOLDER, -f FOLDER
                      search this folder and below for files to remove