raft Archives | Alluxio

Zookeeper vs Raft: Stateful Distributed Coordination with HA and Fault Tolerance

October 21, 2022

Big Data Bellevue & Cloudy With a Chance of Data Meetup October 20, 2022 Distributed systems are made up of many components such as authentication, a persistence layer, stateless services, load balancers, and stateful coordination services. These coordination services are central to the operation of the system, performing tasks such as maintaining system configuration state, … Continued

Tags: big data, distributed systems, fault tolerance, high availability, meetup, raft, zookeeper

Zookeeper vs Raft: Stateful distributed coordination with HA and Fault Tolerance

Alluxio Meetup * October 20, 2022

This talk will go over a generic example of stateful coordination service moving from Zookeeper to Raft.

From Zookeeper to Raft: How Alluxio Stores File System State with High Availability and Fault Tolerance

April 13, 2022 By Tyler Crain

Raft is an algorithm for state machine replication as a way to ensure high availability (HA) and fault tolerance. This blog shares how Alluxio has moved to a Zookeeper-less, built-in Raft-based journal system as a HA implementation.

Alluxio Journal Evolution – Towards high availability and fault tolerance

March 4, 2022

This talk will introduce and compare the two available implementations of this journal in Alluxio, the first using Zookeeper and the more recent version using Raft.

Tags: alluxio day, metadata management, raft, zookeeper

Scalable and Highly-available Distributed File System Metadata Service Using gRPC, RocksDB and RAFT

April 7, 2020

Alluxio (alluxio.io) is an open-source data orchestration system that provides a single namespace federating multiple external distributed storage systems. It is critical for Alluxio to be able to store and serve the metadata of all files and directories from all mounted external storage both at scale and at speed.
This talk shares our design, implementation, and optimization of Alluxio metadata service (master node) to address the scalability challenges.

Tags: alluxio engineering, distributed systems, grpc, metadata service, office hour, raft, rocksdb

Scalable and Highly-available Distributed File System Metadata Service Using gRPC, RocksDB and RAFT

Community Online Office Hour * April 7, 2020

It is critical for Alluxio to be able to store and serve the metadata of all files and directories from all mounted external storage both at scale and at speed. This talk shares our design, implementation, and optimization of Alluxio metadata service (master node) to address the scalability challenges.

Tag: raft