Tachyon Further Improve Spark’s Performance

Tags: , , , , ,

SPARK SUMMIT 2014

During the past several years, Spark has significantly changed the landscape of big data computing. It improves applications’ performance dramatically. However, there still remains several challenges, e.g. high GC overhead. In this talk, I will introduce Tachyon, a distributed in-memory storage system. In addition, I will talk about how Tachyon can further improve Spark’s performance and the integration between the two systems.