Wednesday, June 4, 2014

Step 1: Instalation

Installing everything proved harder than I expected. I found 4 very good resources (links at the bottom) that I'm going to go through in order to find the best installation procedure. The point of this exercise is to have a fully functioning EC2 GPU-optimized instance that can run Theano with good CPU and GPU acceleration. Many little issues along the way slowed me down: cuda wants gcc 4.6 or older; the blas library from ubuntu is not well optimized; people are skipping some of their own steps when posting their solution; using the nvidia ppa for ubuntu seems to always complain about some unmet dependencies; nvidia ppa for ubuntu always wants to install cuda-6; cuda 6 didn't work so far for me with theano - this might change in the future.

Step 1 will be done when I can just launch an EC2 instance, run a script, then compare the logistic regression from deeplearning theano tutorial on CPU and GPU and I should have significantly faster training than the times listed in the tutorial. Also I aim for 80-100% CPU usage at least when running on CPU.

An interesting thing I found out: EC2 spot instances currently cost $0.082/hour. That's peanuts. In my opinion, it's a lot more effective than buying your own nvidia card, at least for the purpose of learning to use theano.

Until next time, keep your fingers crossed!




The links relevant to installation are:

http://www.deeplearning.net/software/theano/install_ubuntu.html#install-ubuntu
http://www.kurtsp.com/deep-learning-in-python-with-pylearn2-and-amazon-ec2.html
http://blog.sbos.in/post/37828521741/setting-up-gpu-cluster-instance-on-amazon-ec2-for-a
https://theano.readthedocs.org/en/rel-0.6rc3/install.html#gpu-linux

No comments:

Post a Comment