dask/dask-yarn

Name: dask-yarn

Owner: dask

Description: Deploy Dask on YARN clusters

Created: 2016-12-29 02:46:42.0

Updated: 2018-02-13 12:46:02.0

Pushed: 2017-07-21 15:52:12.0

Homepage: null

Size: 33

Language: Python

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

Please find this functionality in https://github.com/dask/knit/blob/master/knit/dask_yarn.py

Example

from dask_yarn import YARNCluster
cluster = YARNCluster()

from dask.distributed import Client
client = Client(cluster)
cluster.start(2, cpus=1, memory=500)

future = client.submit(lambda x: x + 1, 10)
future.result()