archivesunleashed/aut

Name: aut

Owner: Archives Unleashed

Description: The Archives Unleashed Toolkit is an open-source platform for analyzing web archives.

Created: 2017-07-06 10:13:44.0

Updated: 2018-01-16 16:56:21.0

Pushed: 2018-01-11 22:16:51.0

Homepage: http://archivesunleashed.org/

Size: 6257

Language: Scala

GitHub Committers

UserMost Recent Commit# Commits

Other Committers

UserEmailMost Recent Commit# Commits

README

The Archives Unleashed Toolkit

Build Status codecov Maven Central LICENSE Contribution Guidelines

The Archives Unleashed Toolkit is an open-source platform for analyzing web archives. Tight integration with Hadoop provides powerful tools for analytics and data processing via Apache Spark. Our full documentation can be found at http://archivesunleashed.org/aut/.

The Archives Unleashed Toolkit is part of the Archives Unleashed Project.

Getting Started

You can download the latest release here, build it yourself as per the instructions below, or use Docker.

Clone the repo:

t clone http://github.com/archivesunleashed/aut.git

You can then build The Archives Unleashed Toolkit.

n clean install

For the impatient, to skip tests:

n clean install -DskipTests

Once built or downloaded, you can follow the basic set of tutorials here.

License

Licensed under the Apache License, Version 2.0.

Acknowledgments

This work is primarily supported by the Andrew W. Mellon Foundation. Additional funding for the Toolkit has come from the U.S. National Science Foundation, Columbia University Library's Mellon-funded Web Archiving Incentive Award, the Natural Sciences and Engineering Research Council of Canada, the Social Sciences and Humanities Research Council of Canada, and the Ontario Ministry of Research and Innovation's Early Researcher Award program. Any opinions, findings, and conclusions or recommendations expressed are those of the researchers and do not necessarily reflect the views of the sponsors.


This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.