Speed up large scale ML/DL offline inference job with Alluxio at Microsoft [Chinese]
Speakers:
Tags: alluxio day, microsoft
Tag: microsoft
Speed up large-scale ML/DL offline inference job with Alluxio
We adopt alluxio which acts as an intermediate storage tier between the compute tier and cloud storage to optimize IO throughput of deep learning inference job.
For the production workload, the performance improves 18% and we seldom see job failure because of storage issue.
Tags: alluxio day, cloud storage, deep learning, machine learning, microsoft, performance
Deep Learning in the Cloud at Scale: A Data Orchestration Story
This is an open source community conference focused on the key data engineering challenges and solutions around building cloud-native data and AI platforms using latest technologies such as Alluxio, Apache Spark, Apache Airflow, Presto, Tensorflow, and Kubernetes.
Tags: cloud, data orchestration, data orchestration summit, deep learning, microsoft