Accelerating Machine Learning / Deep Learning in the Cloud: Architecture and Benchmark

Tags: , , , , , , , ,

This whitepaper introduces how to speed up end-to-end  distributed training in the cloud using Alluxio to accelerate data access. With the help of Alluxio, loading data from cloud storage, training and caching data can be done in a transparent and distributed way as a part of the training process. This whitepaper also demonstrates how to set up and benchmark the end-to-end performance of the training process, along with a comparison of other popular approaches.