Learn the data access challenges in AI and why commonly used NAS/NFS may not be a good option for you.
See how Alluxio Fuse can help you gain significant performance improvement for accessing remote data in S3 compared to S3FS Fuse.
We have new videos releasing every 2 weeks. Subscribe to our channel and stay tuned!
Consistent hashing is a special technique that allows hash rings to be expanded or shrunk dynamically with minimal disruption. In this engineering blog, Jiaming introduces different consistent hash algorithms and compares them with experiment results.
Join us at the upcoming PrestoCon 2023 where Beinan Wang, Senior Staff Engineer at Alluxio, and Hope Wang, Developer Advocate at Alluxio, will be sharing insights into the challenges of data locality and query latency in Presto powered data lakes. Don’t miss out on this opportunity to secure your spot!
When training models on large datasets, one of the biggest challenges is low GPU utilization. Join this session, where Lu Qiu, machine learning engineer at Alluxio will discuss strategies for maximizing GPU utilization by using the open-source stack of PyTorch+Alluxio+S3.
As data lakes scale in complexity and size, companies face challenges with slow and inconsistent data access, rapidly growing storage costs, and high operation costs when migrating to the cloud. In this talk, Beinan Wang, senior staff engineer at Alluixo, will discuss an open-source caching framework designed to improve performance by 1.5x and reduce storage costs by millions per year.
Past events on-demand
Watch this latest lightning talk at CloudNativeCon 2023 by Shawn Sun, Software Engineer at Alluxio. This presentation discusses how a decentralized virtual file system can overcome data management and security challenges when scaling AI/ML training jobs on traditional centralized file systems
Alluxio’s Lu Qiu (Machine Learning Engineer) and Shawn Sun (Software Engineer) explored the crucial role of data locality in modern Kubernetes clusters and how it impacts the overall efficiency of large-scale Analytical and AI applications at the recent KubeCon in Chicago!
Got a tech question for the Alluxio Community? Chat with us on Slack!
Be our stargazers on GitHub ⭐
If you like our product, please give it a star on GitHub, and share the goodness!
We currently have 30+ opportunities across the globe! Learn more about our job openings in Customer Success, Sales, Product, and Engineering teams. Are you awesome or know of anyone to refer? Check out the full list of opportunities and apply here.