hasadna/knesset-data-datapackage

Name: knesset-data-datapackage

Owner: The Public Knowledge Workshop

Description: Provides downloadable Knesset (Israeli parliament) data

Created: 2017-02-07 20:46:11.0

Updated: 2018-02-10 18:42:11.0

Pushed: 2017-08-29 08:35:31.0

Homepage: null

Size: 63

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

knesset-data-datapackage

Provides Knesset data in easy to download and read formats (mostly CSV files).

Datapackages

Data Packages are a lightweight containerization format for data. They provide the foundation for frictionless data transport. You can read more about the concept and format of Friction less data specs and datapackage tooling and other related code

Downloading a prepared datapackage zip

We have a travis job that creates a datapackage for the last 120 days every week and a smaller package for last 5 days every day

Getting the latest zip:

• check the travis build log for “master” branch - https://travis-ci.org/hasadna/knesset-data-datapackage/branches
• pick one of the last successful builds
• scroll to the bottom of the build log
• look for the url, it looks something like this: https://s3.amazonaws.com/knesset-data/datapackage_last_5_days_2017-02-28.zip

Once you downloaded the zip, you can extract and it should be self-explanatory, it contains csv files and other resources.

Creating a datapackage zip from scratch

If you have more advanced requirements or would like to get a datapackage for a longer time-range you can create the datapackage zip file yourself

Warning Knesset APIs are known to be problematic, and sometimes block access for unknown reasons.

Creating a datapackage using the CLI tool:

• Prerequisites
• you are inside an activated python 2.7 virtualenv
  • virtualenv knesset-datapackage
  • cd knesset-datapackage
  • . bin/activate
• Prepare the environment
• pip install https://github.com/hasadna/knesset-data-python/archive/master.zip
• pip install https://github.com/hasadna/knesset-data-datapackage/archive/master.zip
• Run the CLI tool
• make_knesset_datapackage –help
• by default the CLI tool creates the output and zip files inside data directory (e.g. knesset-data-datapackage/data)
• you should delete existing files before creating a new datapackage