newsdev/nyt-nj-campfin

Name: nyt-nj-campfin

Owner: NYT Newsroom Developers

Description: Scrapers for NJ campaign finance data

Created: 2017-02-21 20:08:19.0

Updated: 2018-02-28 16:18:09.0

Pushed: 2017-08-10 22:28:25.0

Homepage: null

Size: 55

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

nyt-nj-campfin

Scrapers for NJ campaign finance data

Currently just listing filings by candidates who have filed for governor in 2017.

ACTUALLY everything is broken right now because they changed the site and I haven't had time to fix it.

Usage

Dump JSON with info about governor's election filings:

filing_list > filings.json

This command produces JSON of the following format:

ame" : candidate_name,
ate" : filing_date,
orm" : form_type,
eriod" : filing_period,
mendment" : amendment_number,
oc_id" : document_id_from_download_url

.]

For example:

{"date": "01/18/2017",
"period": "0",
"form": "D-1",
"amendment": "1",
"doc_id": "lRTrsnVg6%2b4%3d",
"name": "LESNIAK, RAYMOND J"},
{"date": "01/06/2017",
"period": "0",
"form": "D-1",
"amendment": "0",
"doc_id": "a9HjeNwNbRQ%3d",
"name": "LESNIAK, RAYMOND J"},
{"date": "01/12/2017",
"period": "0",
"form": "D-1",
"amendment": "0",
"doc_id": "plBeOeEX704%3d",
"name": "GUADAGNO, KIMBERLY"},
{"date": "01/12/2017",
"period": "0",
"form": "DX",
"amendment": "0",
"doc_id": "%2bna3eeIdDWs%3d",
"name": "GUADAGNO, KIMBERLY"}

Heads up

The website does not do well under load, I recommend against running this script frequently.