Two Sigma, a leading hedge fund with more than $50 billion under management, turned to Alluxio for help with bursting Spark workloads in a public cloud to enable hybrid workloads for on-premise HDFS. With Alluxio, Two Sigma sees better performance, increased flexibility and dramatically lower costs with the number of model runs per day increased by 4x and the cost of compute reduced by 95%.
Cloud bursting with Spark for on-premise Hadoop
Spark + Alluxio + HDFS
• 4x faster model processing time
• 10x faster data load time
• 95% reduction in cost of compute in the cloud
• No changes to applications or existing infrastructure