compute Archives | Page 6 of 6

A Virtual Distributed Storage System

April 28, 2016

DataDriven NYC 2016 – In the past year, the Alluxio project experienced a tremendous improvement in performance and scalability and was extended with key new features including tiered storage, transparent naming, and unified namespace. At the same time, the Alluxio ecosystem has expanded to include support for more under storage systems and computation frameworks.

Tags: alluxio engineering, big data, compute, compute storage separation, data, data engineering, distributed systems, performance, scale, storage, tiered storage

Fast Big Data Analytics and Machine Learning Using Alluxio and Spark in Baidu

March 28, 2016

Strata+Hadoop World 2016 – Baidu deployed Alluxio to accelerate its big data analytics workload. Bin Fan and Haojun Wang explain why Baidu chose Alluxio, as well as the details of how they achieved a 30x speedup with Alluxio in their production environment with hundreds of machines. Based on the success of the big data analytics engine, Baidu is currently expanding the Alluxio and Spark infrastructure to accelerate other applications, such as machine learning.

Tags: analytics, big data, compute, data, data engineering, data orchestration, machine learning, performance, storage

Tachyon at Strata + Hadoop World Singapore 2015

December 2, 2015 by Bin Fan, Xiang Wen [Baidu], & Mingfei Shi [Intel]

Tachyon presents two talks at Strata + Hadoop World Singapore: Interactive data analytics with Spark on Tachyon in Baidu, and Make Tachyon ready for next-gen data center platforms with NVM

Tags: analytics, apache spark, big data, caching, compute, conference, data, spark, storage, strata

Tag: compute