Blog

MLPerf Storage v3.0: Alluxio's Distributed Cache Delivers 147 GiB/s Llama 3 Checkpoint Writes

Alluxio’s MLPerf Storage v3.0 results demonstrate that organizations can keep persistent AI data in Amazon S3 while delivering high-performance training and checkpointing through a distributed cache close to compute. Alluxio achieved 147.03 GiB/s checkpoint write bandwidth for Llama 3 405B and near-linear scaling from one to 32 workers.

‍

Diagnose & Fix Slow Distributed Training

Got periodic drops in GPU utilization? GPU Stalls? Training capacity grinding to a halt? Learn how checkpoint writes could be the cause of your suddent, yet periodic drops in training performance.

20x Faster Training Data Reads with Alluxio and Ray on Anyscale: A Cross-Region Benchmark

Alluxio and Anyscale benchmark achieves 20x faster cross-region data reads for AI training workloads on GCS.

Filters
Clear all
Use Cases
Use Cases
Technologies
Technologies
tag
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Announcing Our First AI PMC Member -- CacheGPT
No items found.
Alipay: Optimizing Alluxio for Efficient Large-Scale Training on Billions of Files
Model Training Acceleration
GPU Acceleration
Cross Cluster Synchronization in Alluxio: Part 2 - Mechanism

This is part 2 of the blog series talking about the design and implementation of the Cross Cluster Synchronization mechanism in Alluxio. In the previous blog, we discussed the scenario, background and how metadata sync is done with a single Alluxio cluster. This blog will describe how metadata sync is built upon to provide metadata consistency in a multi-cluster scenario.

‍

No items found.
Cross Cluster Synchronization in Alluxio: Part 3 - Discussions and Conclusion

Following part 1 and part 2, this final blog of the series discusses some design decisions and details, as well as certain future work.

No items found.
Cross Cluster Synchronization in Alluxio: Part 1 - Scenarios and Background

This is a blog series talking about the design and implementation of the Cross Cluster Synchronization mechanism in Alluxio. This mechanism ensures that the metadata is consistent when running multiple Alluxio clusters. Part 1 of this blog series discusses the scenario and background.

No items found.
Data Access as a Service at Shopee: Using Alluxio to Accelerate Interactive Queries and Enhance Developer Experience with Flexible APIs
Large Scale Analytics Acceleration
Get Started with Trino and Alluxio in 5 Minutes
Large Scale Analytics Acceleration
Hopping into the Year of Rabbit with Alluxio Community
No items found.
Whats Next for Data Analytics AI and Cloud in 2023
Cloud Cost Savings
Integrate Alluxio With Your Existing Data Stack Without Redefining Hive Tables
Large Scale Analytics Acceleration
Architecting Data Orchestration: Four Use Cases

Modern analytics projects rely on a hodgepodge of compute clusters, data stores, and pipelines, flung across countries and continents. Enterprises struggle to meet performance SLAs without replicating lots of data or moving and re-coding applications.

‍

Hybrid Multi-Cloud
Large Scale Analytics Acceleration
Model Training Acceleration
Whats New in Alluxio 2.9: Multi-Alluxio Synchronization, Kubernetes Operator and Flexible S3 Access Control
No items found.
FSDP
Huggingface
Safetensors
Cloud Storage
Object Storage
S3
Multi-tenant
Unified Namespace
Caching
MapReduce
Hadoop
HPC
Ray
Tensorflow
Kubernetes
Hive
Analytics
HDFS
Presto
Trino
Spark
Azure
GCP
AWS
AI-ML
Pytorch
Your selections don't match any items.

Sign-up for a Live Demo or Book a Meeting with a Solutions Engineer

Request a demo
Products
Alluxio AIAlluxio DAEditions ComparisonPricing
Use Cases
GPU AccelerationCloud Cost OptimizationsHybrid & Multi-cloud ArchitectureLarge Scale Analytics AccelerationData Platform Modernization
Learn
Resource HubDocumentationBlogEventsCommunityCase StudiesWhite PapersEbooksSolution BriefsVideosLearning Center
Company
AboutContactCareersNews & PressAwardsNewsletter