Accelerating Machine Learning / Deep Learning in the Cloud: Architecture and Benchmark
This whitepaper introduces how to speed up end-to-end distributed training in the cloud using Alluxio to accelerate data access. With the help of Alluxio, loading data from cloud storage, training and caching data can be done in a transparent and distributed way as a part of the training process. This whitepaper also demonstrates how to set up and benchmark the end-to-end performance of the training process, along with a comparison of other popular approaches.
Tags: benchmark, cache, cloud, data orchestration, deep learning, distributed training, machine learning, performance, storage