fuse Archives | Alluxio

The power of data orchestration: Storage Acceleration and Servitization at Shopee

April 28, 2022

Shopee is the leading e-commerce platform in SouthEast Asia. In this presentation, Tianbao Ding and Haoning Sun from Shopee will share their Data Infra team’s recent project on acceleration with Presto and storage servitization. They will share the details on how Shopee leverages Alluxio to accelerate Presto query and provide standardized method of accessing data through Alluxio-Fuse and Alluxio-S3.

Tags: alluxio day, fuse, presto, s3, shopee

Machine Learning Model Training with Alluxio: Part 3 – Benchmarking

January 18, 2022 By Lu Qiu and Bin Fan

This blog is the last one in the machine learning series. Our first blog introduced the what and why of our solution, and the second blog compared traditional and Alluxio solutions. This blog will demonstrate how to set up and benchmark the end-to-end performance of the training process.

Speeding up TensorFlow and PyTorch with Alluxio

September 9, 2021

The Alluxio core engineering team re-designed things to come up with a more efficient and transparent way for users to leverage data orchestration through the POSIX interface. This enables much better performance for ML workloads where data is accessed via the POSIX interface.

Tags: data orchestration, fuse, ml, performance, POSIX, pytorch, tensorflow

Design and Implementation of Alluxio POSIX Support

August 31, 2021

Applications like Tensorflow, PyTorch can access data through Alluxio FUSE service without modifying any code just like accessing their local file systems by Unix/Linux POSIX API. This article describes the design and implementation of Alluxio FUSE service, its current status and future plans.

Tags: alluxio engineering, fuse, performance, POSIX

Speeding up TensorFlow and PyTorch with Alluxio

Alluxio Tech Talk * September 9, 2021

Driven by strong interests from our open-source community, the core team of Alluxio started to re-design an efficient and transparent way for users to leverage data orchestration through the POSIX interface.

Alluxio for Machine Learning Workloads

June 24, 2021

Tags: alluxio day, data orchestration, fuse, machine learning, POSIX

Alluxio Data Orchestration for Machine Learning

April 27, 2021

Alluxio’s capabilities as a Data Orchestration framework have encouraged users to onboard more of their data-driven applications to an Alluxio powered data access layer. Driven by strong interests from our open-source community, the core team of Alluxio started to re-design an efficient and transparent way for users to leverage data orchestration through the POSIX interface.

Tags: alluxio day, alluxio engineering, data orchestration, fuse, machine learning, POSIX

Alluxio-FUSE as a data access layer for Dask

April 27, 2021

At Aspect Analytics we intend to use Dask, a distributed computation library for Python, to deal with MSI data stored as large tensors. In this talk we explore using Alluxio and Alluxio FUSE as a data consolidation and caching layer for some of our bioinformatics workflows.

Tags: alluxio day, aspect analytics, caching, dask, fuse

Tag: fuse