Speeding up TensorFlow and PyTorch with Alluxio
The Alluxio core engineering team re-designed things to come up with a more efficient and transparent way for users to leverage data orchestration through the POSIX interface. This enables much better performance for ML workloads where data is accessed via the POSIX interface.
Tags: data orchestration, fuse, ml, performance, POSIX, pytorch, tensorflow