Calvin Jia and Jiri Simsa explain how the current Alluxio tiered storage can be easily configured to use memory, SSDs, and hard drives in different tiers.
Tags: aws s3, big data, caching, conference, data, hdfs, storage, tiered storage, unified namespace
As the first meetup after the rebranding from Tachyon to Alluxio, we will first present exciting updates and new developments of the community. Followed by many new features and improvements in Alluxio 1.0 and 1.1 releases.
Tags: alluxio engineering, architecture, aws, aws s3, big data, cloud, cloud storage, compute, compute storage separation, data, meetup, performance, spark
Tachyon presents two talks at Strata + Hadoop World Singapore: Interactive data analytics with Spark on Tachyon in Baidu, and Make Tachyon ready for next-gen data center platforms with NVM
Tags: analytics, apache spark, big data, caching, compute, conference, data, spark, storage, strata
Tachyon: A reliable memory-centric distributed storage system presentation by founder Haoyuan Li.
Tags: apache spark, big data, data, hadoop, mapreduce, performance, spark, storage
Memory is the key to fast big data processing. This has been realized by many, and frameworks such as Spark and Shark already leverage memory performance. As data sets continue to grow, storage is increasingly becoming a critical bottleneck in many workloads. To address this need, we have developed Tachyon, a memory-centric fault-tolerant distributed storage … Continued
We introduce Tachyon, a memory centric fault-tolerant distributed file system, which enables reliable file sharing at memory-speed across cluster frameworks, such as Spark and MapReduce.
Tags: apache spark, big data, data, hadoop, mapreduce, performance, spark, storage
Shaoshan Liu (Baidu) presents how Tachyon can help improve big data analytics (ad-hoc query) efficiency within Baidu.
Tags: analytics, apache spark, big data, data, meetup, spark, storage
AMP Camps are Big Data training events organized by the UC Berkeley AMPLab about big data analytics, machine learning, and popular open-source software projects produced by the AMPLab.
Tags: alluxio engineering, analytics, big data, cloud, compute, machine learning