What’s new in Alluxio 2.2
With this release comes the General Availability (GA) of Alluxio Structured Data Services (SDS), the subsystem of Alluxio responsible for managing and transforming structured data, such as databases, tables, and partitions.
Tag: performance
Integrating Google Cloud Dataproc with Alluxio for faster performance in the cloud
Alluxio Teck Talk *
Learn how to set up Google Cloud Dataproc with Alluxio so jobs can seamlessly read from and write to Cloud Storage. See how to run Dataproc Spark against a remote HDFS cluster.
The Practice of Presto & Alluxio in E-Commerce Big Data Platform
JD.com is China’s largest online retailer. It uses Alluxio to provide support for ad hoc and real-time stream computing, using Alluxio-compatible HDFS URLs and Alluxio as a pluggable optimization component.
Tags: alluxio, big data, performance, presto, use case
Enterprise Distributed Query Service Powered by Presto & Alluxio Across Clouds at WalmartLabs
This session talks about challenges associated with querying diverse data sources at Walmart and how those are tackled using Presto & Alluxio.
Tags: cloud, conference, data orchestration, data orchestration summit, performance, presto
How to Develop and Operate Cloud Native Data Platforms and Applications
In this talk, we share our lessons in building and rebuilding our monitoring systems and data platforms at Electronic Arts (EA).
Tags: cloud, conference, data orchestration, data orchestration summit, performance
Apache Iceberg – A Table Format for Huge Analytic Datasets
This talk includes why Netflix needed to build Iceberg, the project’s high-level design, and will highlight the details that unblock better query performance.
Tags: apache iceberg, conference, data orchestration, data orchestration summit, performance
Online Meetup: Powering Data Science and AI with Apache Spark, Alluxio, and IBM
Learn why leading companies are moving towards a decoupled compute and storage architecture, and the associated challenges and requirements. Hear about how Spark and Alluxio together can solve the challenges.
Tags: analytics, compute storage separation, hdfs, meetup, performance, spark, use case
Why Data Orchestration?
Large-scale analytics and AI/ML applications require efficient data access, with data increasingly distributed across multiple data stores in private data centers and clouds. Data platform teams also need the flexibility to introduce new data sources and move to new storage options with minimal changes or downtime for their applications. This paper delves further into what’s driving the need for–and what problems are solved with—an Alluxio data orchestration layer as part of a modern data platform.
Tags: cloud, compute storage separation, data orchestration, performance, storage
Community Office Hour: Building a Cloud Native Stack with EMR Spark, Alluxio, and S3
Learn how to set up EMR Spark with Alluxio so Spark jobs can seamlessly read from and write to S3. See the performance comparison between Spark on S3 with Spark, and Alluxio on S3.
Tags: aws s3, cloud, emr, office hour, performance, spark