ALLUXIO DAY V 2021 August 27, 2021 Speakers: Binyang Li (Software Engineer from Bing, focus on AI infrastructure) Qianxi Zhang (Research Software Engineer from MSRA, focus on next generation storage system)
Tags: alluxio day, microsoft
We adopt alluxio which acts as an intermediate storage tier between the compute tier and cloud storage to optimize IO throughput of deep learning inference job.
For the production workload, the performance improves 18% and we seldom see job failure because of storage issue.
Tags: alluxio day, cloud storage, deep learning, machine learning, microsoft, performance
This is an open source community conference focused on the key data engineering challenges and solutions around building cloud-native data and AI platforms using latest technologies such as Alluxio, Apache Spark, Apache Airflow, Presto, Tensorflow, and Kubernetes.
Tags: cloud, data orchestration, data orchestration summit, deep learning, microsoft