We briefly introduce Alluxio and present different ways Alluxio can help Spark jobs, along with best practices. We also discuss how Alluxio can be deployed and used with a Spark data processing pipeline in the cloud.
Tags: alluxio engineering, apache spark, architecture, aws s3, cloud, cloud storage, conference, developer tips, hybrid cloud, machine learning, rdd
In the past year, the Alluxio project experienced significant improvement in performance and scalability and was extended with key new features including tiered storage, transparent naming, and unified namespace.
Tags: overview, performance, scale, storage, tiered storage, transparent naming
Lucene/SOLR Revolution 2017 – Timothy Potter, Lucidworks introduces Alluxio, the fastest growing open source project in the big data ecosystem, and shows how to leverage it for optimizing Solr performance. Basic integration scenarios and performance comparisons are also presented.
Tags: analytics, big data, cloud, data, hdfs, performance, spark
Strata Data Conference London 2017 – Learn about stream processing on Alluxio from real-world workloads at Qunar, as well as how to position Alluxio in the streaming architecture
Tags: architecture, big data, conference, data, data engineering, distributed systems, performance, storage, tiered storage, unified namespace
Global Big Data Conference 2017 – In the past year, the Alluxio project experienced significant improvement in performance and scalability and was extended with key new features including tiered storage, transparent naming, and unified namespace
Tags: alluxio engineering, apache spark, big data, compute, conference, data, data engineering, performance, scale, spark, storage, tiered storage
VAULT Conference 2017 – Haoyuan Li, CEO of Alluxio (formerly Tachyon), presents a keynote on the San Mateo-based startup’s journey thus far and the road ahead.
Tags: analytics, apache spark, big data, cloud, conference, storage, unified namespace
Ceph Days 2017 – Adit Madan presents on enabling fast big data analytics on Ceph with Alluxio.
Tags: alluxio engineering, analytics, big data, ceph, cloud object storage, cloud storage, conference, data, on-prem object storage, storage
Calvin Jia introduces Alluxio, explain how Alluxio can help Spark be more effective, show benchmark results with Spark RDDs and DataFrames, and describe production deployments with both Alluxio and Spark working together.
Tags: alluxio engineering, apache spark, aws s3, ceph, conference, data, data engineering, data orchestration, Gluster, Google Cloud Storage, hdfs, NFS, performance, scale, spark, storage
In this talk, we briefly introduce Alluxio, present several ways how Alluxio can help Spark be more effective, show benchmark results with Spark RDDs & DataFrames, and describe production deployments with both Alluxio and Spark working together.
Tags: alluxio engineering, apache spark, architecture, big data, cloud, compute storage separation, conference, data, performance, rdd, spark, storage