In this talk, we briefly introduce Alluxio, present several ways how Alluxio can help Spark be more effective, show benchmark results with Spark RDDs & DataFrames, and describe production deployments with both Alluxio and Spark working together.
Tags: alluxio engineering, apache spark, architecture, big data, cloud, compute storage separation, conference, data, performance, rdd, spark, storage
Strata+Hadoop 2016 – In the past year, the Alluxio project experienced a tremendous improvement in performance and scalability and was extended with key new features including tiered storage, transparent naming, and unified namespace. At the same time, the Alluxio ecosystem has expanded to include support for more under storage systems and computation frameworks.
Tags: alluxio engineering, architecture, big data, cloud, compute storage separation, conference, hadoop, performance, scale, storage, strata, tiered storage, unified namespace
Alluxio is used as a lightweight data access layer on the compute nodes to bring performance up to memory speeds without requiring a long running cluster. This talk will summarize why Alluxio’s architecture makes it a perfect fit for completing the on-demand cluster puzzle.
Tags: alluxio engineering, analytics, big data, compute, data, data engineering, meetup, performance, storage
Big Data Spark Online Training shares this demonstration video on how to install Alluxio (formerly Tachyon) on an Ubuntu operating system.
Tags: alluxio engineering, big data, data, performance, spark, storage
Southern California Data Science Conference 2016 – In the past year, the Alluxio project experienced a tremendous improvement in performance and scalability and was extended with key new features including tiered storage, transparent naming, and unified namespace. At the same time, the Alluxio ecosystem has expanded to include support for more under storage systems and computation frameworks.
Tags: alluxio engineering, architecture, big data, cloud, compute storage separation, conference, performance, scale, storage, tiered storage, unified namespace
A demo video of how Ceph could be integrated with Big Data solution through Alluxio.
Tags: alluxio engineering, big data, ceph, cloud, cloud object storage, cloud storage, compute, compute storage separation, on-prem object storage, performance, storage
Alluxio is the world’s first memory-speed virtual distributed storage system that bridges applications and underlying storage systems, providing unified data access orders of magnitudes faster than existing solutions. The Hadoop Distributed File System (HDFS) is a distributed file system for storing large volumes of data. HDFS popularized the paradigm of bringing computation to data and the co-located compute and storage architecture.
In this blog, we highlight two key benefits Alluxio brings to a compute cluster co-located with HDFS.
We are excited to announce a big data storage acceleration solution with Huawei. This solution combines Huawei’s FusionStorage with Alluxio’s memory-speed virtual distributed storage system to dramatically enhance the speed and efficiency of big data analytics for the enterprise.
Big Data Day LA 2016 – In the past year, the Alluxio project experienced a tremendous improvement in performance and scalability and was extended with key new features including tiered storage, transparent naming, and unified namespace. At the same time, the Alluxio ecosystem has expanded to include support for more under storage systems and computation frameworks.
Tags: alluxio engineering, architecture, big data, ceph, cloud, cloud object storage, conference, Gluster, Google Cloud Storage, hdfs, performance, scale, storage, tiered storage, unified namespace