Alluxio Day X featured open source contributors and Presto users from bilibili, Uber, plus Alluxio core maintainers. Learn how Uber improves Presto performance with Alluxio, how bilibili increases AI training efficiency, and take a deep dive into Alluxio’s own journal evolution. Session replays now available on-demand.
Alluxio is excited to announce its partnership with NetApp! The Alluxio + NetApp StorageGRID joint solution provides a reliable platform that enables a wide range of enterprise-grade, geo-distributed analytics and AI across hybrid cloud and multicloud environments. On March 24, we hosted a joint talk that covered use case and architecture info from a variety of enterprises and some of the high-level technical details of how these business solutions are constructed. If you missed the live event, check out the webinar replay.
Alluxio founding member and VP of Open Source, Bin Fan, describes a new approach for more efficient data pipelines for end-to-end machine learning with ML frameworks such as TensorFlow and PyTorch in Kubernetes environments. Check out the latest approaches and best practices.
Got a tech question for the Alluxio Community? Chat with us on Slack!
cache Presto SQL
With the collaboration between Meta (Facebook), Princeton University, and Alluxio, our community users have developed “Shadow Cache” – a lightweight Alluxio component to track the working set size and infinite cache hit ratio. Shadow cache is deployed in Meta (Facebook) Presto and is being leveraged to understand the system bottlenecks and help with routing design decisions. Learn more about this solution.
autonomous driving AI
WeRide, an autonomous driving technology company, introduced the practice of using Alluxio and Spark to accelerate the auto data-tagging system, which resulted in 7x faster performance. Learn more about this user story.
With Alluxio and Spark together, you can modernize your data platform in a cost-effective, agile, and scalable way. In this blog, we provide an overview of the Spark & Alluxio stack, explain the architecture with real-world examples, describe deployment models, and present performance and cost benchmarking guidance.
By introducing Prometheus and Grafana, Tencent has built a more flexible, agile and easy-to-use monitoring system for Alluxio. This blog introduces how Tencent uses Prometheus and Grafana to set up a monitoring system for Alluxio in 10 minutes.
Kevin Xiaohua Cai is a software engineer at Ant Group (affiliated with Alibaba Group). He is the tech lead of the Ant Group storage team, expertizing in distributed storage and helping Ant Group’s business team to build robust service on top of scalable storage in variant scenarios. Kevin has also contributed significantly to the Alluxio community by raising high-quality issues and supporting the evolution of Alluxio in ML scenarios. The core Alluxio tech team highly appreciates his contribution!
Be our stargazers on GitHub ⭐
If you like our product, please give it a star on GitHub, and keep our open source community more popular!
With the recent complete Series C investment, Alluxio will continue fueling its rapid growth by investing in expanded product capabilities as well as scaling go-to-market and engineering operations across the globe. Check out over 20 job opportunities here.