intel-analytics/BigDL-Tutorials

Name: BigDL-Tutorials

Owner: intel-analytics

Description: Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL

Created: 2017-05-16 05:02:31.0

Updated: 2018-05-13 23:46:55.0

Pushed: 2018-05-13 23:46:52.0

Homepage:

Size: 13160

Language: Jupyter Notebook

GitHub Committers

User	Most Recent Commit	# Commits

Other Committers

User	Email	Most Recent Commit	# Commits

README

Deep Learning Tutorials on Apache Spark using BigDL

Step-by-step Deep Learning Tutorials on Apache Spark using BigDL. The tutorials are inspired by Apache Spark examples, the Theano Tutorials and the Tensorflow tutorials.

Topics

1. RDD
2. DataFrame
3. SparkSQL
4. StructureStreaming
5. Forward and backward
6. Linear Regression
7. Introduction to MNIST
8. Logistic Regression
9. Feedforward Neural Network
10. Convolutional Neural Network
11. Recurrent Neural Network
12. LSTM
13. Bi-directional RNN
14. Auto-encoder
15. Visualizing Learning

Environment

• Python 2.7
• JDK 8
• Apache Spark 2.2.0
• Jupyter Notebook 4.1
• BigDL 0.5.0
• Setup env on Mac OS / Setup env on Linux

Start Jupyter Server

• Run `pip install BigDL==0.5.0`
• Run `jupyter notebook --notebook-dir=./ --ip=* --no-browser`

Start Toree Kernel to Run Scala Notebooks

• Run `pip install BigDL==0.5.0`
• Run `pip install https://dist.apache.org/repos/dist/dev/incubator/toree/0.2.0/snapshots/dev1/toree-pip/toree-0.2.0.dev1.tar.gz`
• Run `./toree_install.sh`
• Run `jupyter notebook --notebook-dir=./ --ip=* --no-browser`

Run Demo

• Open a browser - Suggest Chrome or Firefox or Safari
• Access notebook client at address http://localhost:8888, open the example ipynb files and execute.