• Search
  • Sign In
  • Blog
  • Docs
  • EN
  • GitHub
  • Slack
Alluxio
  • Why Data Orchestration
  • Product
    • Alluxio Overview
    • Alluxio on AWS
    • Alluxio on GCP
    • Presto with Alluxio
    • Spark with Alluxio
    • Alluxio + Intel
    • Alluxio + NetApp
  • Use Cases
    • Zero-copy Hybrid Bursting
    • Zero-copy Burst Across Datacenters
    • Cloud Analytics Caching
    • Accelerated Workloads for Object Stores
  • Community
    • Alluxio Community
    • Powered by Alluxio
    • Data Orchestration Summit
    • Alluxio Day
    • Product School
    • Meetups & Conferences
    • Newsletter
  • Enterprise
    • Editions
    • Pricing
    • Contact Us
  • Resources
    • Downloads
    • Documentation
    • FAQ
    • Learning Center
    • Videos
    • Tech Talks
    • Slides from Talks
    • White Papers
    • Case Studies
    • Solution Briefs
    • Events
  • Try Alluxio

Scalable Filesystem Metadata Services with RocksDB

July 22, 2019

Tags: alluxio engineering, meetup, metadata management, performance, scale, storage, unified namespace

Alluxio maintainer and founding engineer Calvin Jia presents on Scalable Filesystem Metadata Services with RocksDB at the RocksDB meetup at Twitter.

Alluxio provides a unified namespace where you can mount multiple different storage systems and access them through the same API. To serve the file system requests to operate on all the files and directories in this namespace, Alluxio masters must handle the file system metadata at a scale of all mounted systems combined. We are writing several engineering blogs describing the design and implementation of Alluxio master to address this scalability challenge. This is the first article focusing on metadata storage and service, particularly how to use RocksDB as an embedded persistent key-value store to encode and store the file system inode tree with high performance.

Resources:
Scalable Metadata Service in Alluxio: Storing Billions of Files
Store 1 Billion Files in Alluxio 2.0

Questions? Slack with the speakers, users, and many other community members!
Welcome to join Alluxio Bay Area Meetup Group to attend online meetups like this!
Scalable Filesystem Metadata Services with RocksDB from Alluxio, Inc.
  • Resources
    • Blog
    • White Papers
    • Tech Talks
    • Case Studies
    • Events
    • Slides from talks
    • Videos
  • Open Source
    • Community
    • Download
    • Mailing List
    • Slack
    • Powered By Alluxio
    • Newsletter
  • Support
    • Documentation
    • Account Sign In
    • Pricing
    • Services & Support
    • Contact Us
  • Company
    • About
    • Careers
    • News & Press
    • Awards
    • Partners

© Copyright 2023 Alluxio, Inc. All rights reserved.
Alluxio is a trademark of Alluxio, Inc.
Terms of Service | Privacy Policy

Newsletter Signup