Chuanying Chen, Senior Software Engineer at Ant Group, provides a deep dive into the practices of optimizing Alluxio for reliable, scalable, and high-performance large-scale training on billions of files. 1. Background Ant Group, formerly known as Ant Financial, is an affiliate company of the Chinese conglomerate Alibaba Group. The group owns the world’s largest mobile … Continued
Welcome to the Alluxio Community!
Alluxio (originally called Tachyon) started as an open source project from UC Berkeley’s AMPLab in 2014 by founder Haoyuan Li with the mission to orchestrate data for all data driven applications. We have now grown into a large and vibrant open source community! With over 1,200 contributors on Github and over 10,000 Slack community members, we were recognized as part of the Top 10 Most Critical Java Based Open Source Projects and named as one of the Top 100 Most Valuable Repositories on Github.
We invite you to read about, try out, use, and contribute to Alluxio, as well as to share your experience, feedback, suggestions and ideas!
New to Alluxio?
Welcome to a 3-part series to an introduction to Alluxio! This is a great starting resource for new developers and users of Alluxio, with short 2-3 minute videos. Alluxio’s Community Evangelist ChanChan Mao introduces the existing data problems that Alluxio was created to address, where Alluxio sits in the big data ecosystem, and how you can contribute to the Alluxio Open Source Project!
Alluxio Slack Community
We’ve reach 10,000+ Slack members! Join our vibrant and fast-growing Slack community to connect with users and developers of Alluxio. If you need help running or using Alluxio, get your technical questions answered by our global Alluxio community in #troubleshooting. Stay up to date with Alluxio news and events in #announcements. If you are a developer looking to contribute to Alluxio, check out #dev.
Alluxio CONTRIBUTORS
The Alluxio Open Source Contributors and Project Management Committee Members come from a diverse and experienced background. The project members includes committers with decades of experience from Tencent, Google, Palantir, UC Berkeley, Carnegie Mellon, IBM, Intel and JD.com. We invite you take a look at our Github repository and learn how you can contribute to the project!
Slack
Ask questions, get answers.
GitHub
Become a contributor.
MAILING LIST
Join the Google group.
Join our channel.
Shopee is the leading e-commerce platform in Southeast Asia. In this blog, Tianbao Ding and Haoning Sun from Shopee’s data infrastructure team share their project on query acceleration and “Data Access as a Service.” They describe how Shopee leverages Alluxio to improve Trino query performance by ~55% and how Alluxio enhances developer experience by providing … Continued
This blog post discusses the synergy between Trino and Alluxio, and how to deploy Alluxio as the caching layer for Trino. You will learn Why should you choose Alluxio as a cache for Trino How do Trino and Alluxio work together How to configure Alluxio to point to S3 storage like MinIO How to query … Continued
As we close out the Year of Tiger and welcome the Year of Rabbit, we are filled with gratitude for the support and contributions of the members of Alluxio Open Source Community. Thanks to your dedication and trust, the Alluxio Open Source project and community has continued to thrive and grow in ways we never … Continued
Big Data Bellevue & Cloudy With a Chance of Data Meetup October 20, 2022 Distributed systems are made up of many components such as … Continued
This whitepaper introduces how to speed up end-to-end distributed training in the cloud using Alluxio to accelerate data access. With the help of Alluxio, … Continued
join the community
4,000+
Stars
1,000+
Contributors
1 Million+
Downloads
apache 2.0 licensed
Join an Alluxio community event Near You
Don’t see an event in your area? Want to start a local Alluxio meetup? Drop us a note!
ACADEMIC PAPERS
Tachyon: Reliable, Memory Speed Storage for Cluster Computing Frameworks
ACM Symposium on Cloud Computing 2014
Alluxio: A Virtual Distributed File System
Berkeley EECS Ph.D. Dissertation
Tachyon: Reliable, Memory Speed Storage for Cluster Computing Frameworks
ACM Digital Library
alluxio uses open source
