unitedstates/domains

Name: domains

Owner: @unitedstates

Description: Organizing and publishing the web domains of the US federal government

Created: 2016-12-07 03:12:15.0

Updated: 2017-10-30 18:35:15.0

Pushed: 2016-12-07 21:41:57.0

Homepage: null

Size: 4

Language: null

GitHub Committers

UserMost Recent Commit# Commits

Other Committers

UserEmailMost Recent Commit# Commits

README

domains

Organizing and publishing the web domains of the US federal government

Background

The federal government expresses itself through its web presence. Much of an agency's mission can be seen through the information it publishes and the functionality it offers.

Goals

The goal of this project is to inventory and account for the full web presence of the US federal government.

Primary Resources
.gov Registry Export

The .gov Registry offers a recurring export of .gov second level domains. These include federal, state, tribal, and local .gov websites. Not included are .mil and .fed.us websites, as well as .com, .org, etc. websites that are used by government agencies.

Secondary Resources
Subdomains

While an agency may register second level domain (e.g. state.gov), its web presence may expand well beyond the content located at the second level domains' homepage (e.g. www.state.gov) to other sections and subsections located at subdomains (e.g. americanenglish.state.gov, blogs.state.gov, and adoption.state.gov). A truly comprehensive analysis of a domain must extend past the initial second level domain to the subdomains as well.

At the moment, though, there is not a published directory of .gov subdomains. Therefore, it is necessary to derive such lists by open source means. The following represent some initial efforts. Anyone is welcome to improve upon them or suggest new efforts.

Participants in the Digital Analytics Program
Exports from Censys.io
Crawling the .gov List with Wget

This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.