alluxio architecture overview

Learn more about the Alluxio internals, including its memory-centric architecture that abstracts files and objects in underlying persistent storage systems and provides a shared data access layer for compute applications.

Meet Alluxio

Alluxio enables data orchestration for compute in any cloud. It unifies data silos on-premise and across any cloud to give you the data locality, accessibility, and elasticity needed to reduce the complexities associated with orchestrating data for today’s big data and AI/ML workloads.

Scalable to over a billion files in a single cluster, Alluxio’s distributed architecture is built on three core components:

  • Alluxio Master, which manages file and object metadata
  • Alluxio Worker, which manages the node’s local space, as well as manages file and object blocks and interfaces with the storage systems underneath
  • Alluxio Client, which allows analytics and AI/ML applications to interface with Alluxio

Data caching for faster compute

Text goes here to describe this component

intelligent tiering for resource efficiency

Text goes here to describe this component

policy-driven data management

Text goes here to describe this component