spotify/pythonflow

Name: pythonflow

Owner: Spotify

Description: :snake: Dataflow programming for python.

Created: 2017-09-05 17:52:33.0

Updated: 2018-05-21 11:41:34.0

Pushed: 2018-04-30 16:28:38.0

Homepage: http://pythonflow.readthedocs.io/en/latest/

Size: 125

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

Pythonflow: Dataflow programming for python.

Pythonflow is a simple implementation of dataflow programming for python. Users of Tensorflow will immediately be familiar with the syntax.

At Spotify, we use Pythonflow in data preprocessing pipelines for machine learning models because

• it automatically caches computationally expensive operations,
• any part of the computational graph can be easily evaluated for debugging purposes,
• it allows us to distribute data preprocessing across multiple machines.

See the documentation for details.