hybrid Archives

Hybrid Data Lake Architecture with Presto & Spark in the cloud accessing on-prem storage

September 29, 2020

In this talk, we describe the architecture to migrate analytics workloads incrementally to any public cloud (AWS, Google Cloud Platform, or Microsoft Azure) directly on on-prem data without copying the data to cloud storage.

Tags: cloud, data analytics, data lake, hdfs, hybrid, on-prem, presto, spark, storage

Accelerating Analytical Workloads for Public & Hybrid Clouds

New York Meetup * July 10, 2019

In this meetup, Dipti and HY will present a new approach to hybrid analytical workloads using Alluxio, an open source data orchestration layer, which sits between compute and storage layer. Applications like Apache Spark or TensorFlow can then seamlessly access multiple disparate data sources with consistent performance using data locality and abstraction that the data orchestration tier brings.

Tag: hybrid