NOTES
- Pip install support mac and linux platform but only Spark1.6.x for now.
- Pip install only support run in local. Might support cluster mode in the future.
- We've tested this package with python 2.7 and python 3.5
Install BigDL-0.2.1-SNAPSHOT
1.Download Spark1.6.3:
wget https://d3kbcqa49mib13.cloudfront.net/spark-1.6.3-bin-hadoop2.6.tgz
2.Extract the tar ball and set SPARK_HOME
tar -zxvf spark-1.6.3-bin-hadoop2.6.tgz
export SPARK_HOME=path to spark-1.6.3-bin-hadoop2.6
3.Install BigDL release via pip (we tested this on pip 9.0.1)
- NOTE: you might need to sudo
if without permission for the installation
pip install --upgrade pip
pip install BigDL==0.2.0 # for Python 2.7
pip3 install BigDL==0.2.0 # for Python 3.5