Two Sigma Case Study: Cloud bursting with Spark for on-premise Hadoop

Tags: , , , ,

Two Sigma, a leading hedge fund with more than $50 billion under management, turned to Alluxio for help with bursting Spark workloads in a public cloud to enable hybrid workloads for on-premise HDFS. With Alluxio, Two Sigma sees better performance, increased flexibility and dramatically lower costs with the number of model runs per day increased by 4x and the cost of compute reduced by 95%.

Two Sigma

Financial Services

Use Case
Cloud bursting with Spark for on-premise Hadoop

Application Stack
Spark + Alluxio + HDFS

Benefit Highlights
• 4x faster model processing time
• 10x faster data load time
• 95% reduction in cost of compute in the cloud
• No changes to applications or existing infrastructure