On-Demand Videos

Alluxio 2.0 is the most ambitious platform upgrade since the inception of Alluxio with greatly expanded capabilities to empower users to run analytics and AI workloads on private, public or hybrid cloud infrastructures leveraging valuable data wherever it might be stored. This preview release, now available for download, includes many advancements that will allow users to push the limits of their data-workloads in the cloud.

In this webinar, we will introduce the key new features and enhancements such as:

• Support for hyper-scale data workloads with tiered metadata storage, distributed cluster services, and adaptive replication for increased data locality
• Machine learning and deep learning workloads on any storage with the improved POSIX API
• Better storage abstraction with support for HDFS clusters across different versions & active sync with Hadoop

As data analytic needs have increased with the explosion of data, the importance of the speed of analytics and the interactivity of queries has increased dramatically

In this tech talk, we will introduce the Starburst Presto, Alluxio, and cloud object store stack for building a highly-concurrent and low-latency analytics platform. This stack provides a strong solution to run fast SQL across multiple storage systems including HDFS, S3, and others in public cloud, hybrid cloud, and multi-cloud environments.

You’ll learn about:

• The architecture of Presto, an open source distributed SQL engine,  as well as innovations by Starburst like as it’s cost-based optimizer
• How Presto can query data from cloud object storage like S3 at high performance and cost-effectively with Alluxio
• How to achieve data locality and cross-job caching with Alluxio no matter where the data is persisted and reduce egress costs

In addition, we’ll present some real world architectures & use cases from internet companies like JD.com and NetEase.com running the Presto and Alluxio stack at the scale of hundreds of nodes.

‍

Enterprises are increasingly looking towards object stores to power their big data & machine learning workloads in a cost-effective way. The combination of SwiftStack and Alluxio together, enables users to seamlessly move towards a disaggregated architecture. Swiftstack provides a massively parallel cloud object storage and multi-cloud data management system. Alluxio is a data orchestration layer, which sits between compute frameworks and storage systems and enables big data workloads to be deployed directly on SwiftStack. Alluxio provides data locality, accessibility and elasticity via its core innovations. With the Alluxio and Swiftstack solution, Spark, Presto, Tensorflow and Hive and other compute workloads can benefit from 10X performance improvement and dramatically lower costs. In this tech talk, we will provide a brief overview of the Alluxio and SwiftStack solution as well as the key use cases it enables.

You’ll learn about:

• The trends driving organizations towards object stores
• An overview of Swiftstack and Alluxio
• Deep dive into the benefits of the Swiftstack Data Analytics Solution with Alluxio

‍

The rise of compute intensive workloads and the adoption of the cloud has driven organizations to adopt a decoupled architecture for modern workloads – one in which compute scales independently from storage. While this enables scaling elasticity, it introduces new problems – how do you co-locate data with compute, how do you unify data across multiple remote clouds, how do you keep storage and I/O service costs down and many more.  

Enter Alluxio, a virtual unified file system, which sits between compute and storage that allows you to realize the benefits of a  hybrid cloud architecture with the same performance and lower costs.

In this webinar, we will discuss:

• Why leading enterprises are adopting hybrid cloud architectures with compute and storage disaggregated
• The new challenges that this new paradigm introduces
• An introduction to Alluxio and the unified data solution it provides for hybrid environments

‍