MesosCon Europe 2017 – Gene Pang discusses the architecture of Mesos, Spark and Alluxio to achieve an optimal architecture for enterprises.
Tags: alluxio engineering, apache spark, architecture, aws s3, ceph, compute, conference, data, data engineering, Google Cloud Storage, hdfs, spark, storage, unified namespace
Ceph Days 2017 – Adit Madan presents on enabling fast big data analytics on Ceph with Alluxio.
Tags: alluxio engineering, analytics, big data, ceph, cloud object storage, cloud storage, conference, data, on-prem object storage, storage
Calvin Jia introduces Alluxio, explain how Alluxio can help Spark be more effective, show benchmark results with Spark RDDs and DataFrames, and describe production deployments with both Alluxio and Spark working together.
Tags: alluxio engineering, apache spark, aws s3, ceph, conference, data, data engineering, data orchestration, Gluster, Google Cloud Storage, hdfs, NFS, performance, scale, spark, storage
This is an excerpt from the Accelerating Data Analytics on Ceph Object Storage with Alluxio whitepaper.
As the volume of data collected by enterprises has grown, there is a continual need to find efficient storage solutions. Owing to its simplicity, scalability and cost-efficiency object storage, including Ceph, has increasingly become a popular alternative to traditional file systems. In most cases the object storage system, on-premise or in the cloud, is decoupled from compute nodes where analytics is run. There are several benefits of this separation.
Haoyuan Li offers an overview of Alluxio (formerly Tachyon), a memory-speed virtual distributed storage system.
Tags: alluxio engineering, analytics, aws s3, big data, ceph, compute, conference, data, distributed systems, hdfs, storage, unified namespace
A demo video of how Ceph could be integrated with Big Data solution through Alluxio.
Tags: alluxio engineering, big data, ceph, cloud, cloud object storage, cloud storage, compute, compute storage separation, on-prem object storage, performance, storage
Big Data Day LA 2016 – In the past year, the Alluxio project experienced a tremendous improvement in performance and scalability and was extended with key new features including tiered storage, transparent naming, and unified namespace. At the same time, the Alluxio ecosystem has expanded to include support for more under storage systems and computation frameworks.
Tags: alluxio engineering, architecture, big data, ceph, cloud, cloud object storage, conference, Gluster, Google Cloud Storage, hdfs, performance, scale, storage, tiered storage, unified namespace