Accelerate Auto Data Tagging with Alluxio and Spark in Hybrid Cloud – A Practice in WeRide
This blog shares the practice of using Alluxio and Spark to accelerate the auto data tagging system in WeRide, an autonomous driving technology company.
Tag: spark
Pair Spark with Alluxio to Modernize Your Data Platform
Alluxio is the data orchestration platform to unify data silos across heterogeneous environments. This is the last article in a series to give you the basics of Alluxio’s architecture and solution.
Spark + Alluxio Overview | Pair Spark with Alluxio to Modernize Your Data Platform
By bringing Alluxio together with Spark, you can modernize your data platform in a scalable, agile, and cost-effective way. In this post, we provide an overview of the Spark + Alluxio stack. We explain the architecture, discuss real-world examples, describe deployment models, and showcase performance and cost benchmarking.
Tags: analytics, cloud, data orchestration, data platform, overview, spark, storage
Alluxio + Spark: Accelerating Auto Data Tagging in WeRide
WeRide provides an overview of Alluxio + Spark use case, which has been deployed and running in production to accelerate auto data tagging in the autonomous driving development.
Tags: alluxio day, data tagging, spark, use case
Presto with Alluxio Overview – Architecture Evolution for Interactive Queries
Many companies have leveraged Alluxio to level up their current Presto platform, including Facebook, TikTok, Electronic Arts, Walmart, Tencent, Comcast, and more. They have gained significant benefits with Alluxio integrated into their Presto stack.
Tags: architecture, cloud, data orchestration, interactive queries, presto, spark, storage
Presto with Alluxio Overview – Architecture Evolution for Interactive Queries
Alluxio is the data orchestration platform to unify data silos across heterogeneous environments. The following blog will discuss the architecture combining Spark with Alluxio.
Best Practice in Accelerating Data Applications with Spark+Alluxio
This talk shares the designs and use cases of the Alluxio and Spark integrated solutions, as well as the best practice and “what not to do” in designing and implementing Alluxio distributed systems.
Tags: alluxio day, big data, data orchestration, distributed systems, spark
Advancing GPU Analytics with RAPIDS Accelerator for Spark and Alluxio
RAPIDS is a set of open source libraries enabling GPU aware scheduling and memory representation for analytics and AI. Spark 3.0 uses RAPIDS for GPU computing to accelerate various jobs including SQL and DataFrame. With compute acceleration from massive parallelism on GPUs, there is a need for accelerating data access and this is what Alluxio enables for compute in any cloud. In this talk, you will learn how to use Alluxio and Spark with RAPIDS Accelerator on NVIDIA GPUs without any application changes.
Evaluating Apache Spark and Alluxio for Data Analytics
This whitepaper details how to evaluate Alluxio’s data orchestration platform as a distributed cache for Apache Spark in a public cloud or on-premises. We discuss best practices and benchmarking results with a combination of standard industry benchmarking suites, such as TPC-DS and HiBench, on cloud storage.
Tags: analytics, benchmarks, cloud, data analytics, spark, whitepaper