hdfs Archives | Page 9 of 10

Tencent Case Study: Delivering Customized News to Over 100 Million Users per Month with Alluxio

April 8, 2018 By Can He (Tencent)

Tencent is one of the largest technology companies in the world and a leader in multiple sectors such as social networking, gaming, e-commerce, mobile and web portal. Tencent News, one of Tencent’s many offerings, strives to create a rich, timely news application to provide users with an efficient, high-quality reading experience. To provide the best experience to more than 100 million monthly active users of Tencent News, we leverage Alluxio with Apache Spark to create a scalable, robust, and performant architecture.

Accelerating Spark Workloads in a Mesos Environment

October 26, 2017 by Gene Pang

MesosCon Europe 2017 – Gene Pang discusses the architecture of Mesos, Spark and Alluxio to achieve an optimal architecture for enterprises.

Tags: alluxio engineering, apache spark, architecture, aws s3, ceph, compute, conference, data, data engineering, Google Cloud Storage, hdfs, spark, storage, unified namespace

Alluxio at Strata + Hadoop World San Jose 2017

March 16, 2017 by Calvin Jia

Calvin Jia introduces Alluxio, explain how Alluxio can help Spark be more effective, show benchmark results with Spark RDDs and DataFrames, and describe production deployments with both Alluxio and Spark working together.

Tags: alluxio engineering, apache spark, aws s3, ceph, conference, data, data engineering, data orchestration, Gluster, Google Cloud Storage, hdfs, NFS, performance, scale, spark, storage

Alluxio at Strata + Hadoop World NY 2016: The Journey thus far and the Road Ahead

September 28, 2016 by Haoyuan Li & Gene Pang

Haoyuan Li offers an overview of Alluxio (formerly Tachyon), a memory-speed virtual distributed storage system.

Tags: alluxio engineering, analytics, aws s3, big data, ceph, compute, conference, data, distributed systems, hdfs, storage, unified namespace

Alluxio Bay Area Joint Meetup at Samsung 2016: Unifying APIs, Accelerating ML, & Enabling Cloud Architectures

September 15, 2016 by Eric Anderson [Google], Gianmario Sapcagna [Pirelli], & Calvin Jia

Alluxio Bay Area Meetup hosted at Samsung. Talks to include presentations on Unifying APIs, Accelerating ML, & Enabling Cloud Architectures.

Tags: alluxio engineering, analytics, architecture, big data, cloud, data, hdfs, meetup, spark, storage, unified namespace

Using Alluxio to Improve the Performance and Consistency of HDFS Clusters

September 1, 2016 By Adit Madan

Alluxio is the world’s first memory-speed virtual distributed storage system that bridges applications and underlying storage systems, providing unified data access orders of magnitudes faster than existing solutions. The Hadoop Distributed File System (HDFS) is a distributed file system for storing large volumes of data. HDFS popularized the paradigm of bringing computation to data and the co-located compute and storage architecture.
In this blog, we highlight two key benefits Alluxio brings to a compute cluster co-located with HDFS.

Alluxio An Open Source Memory Speed Virtual Distributed Storage

August 23, 2016

Big Data Day LA 2016 – In the past year, the Alluxio project experienced a tremendous improvement in performance and scalability and was extended with key new features including tiered storage, transparent naming, and unified namespace. At the same time, the Alluxio ecosystem has expanded to include support for more under storage systems and computation frameworks.

Tags: alluxio engineering, architecture, big data, ceph, cloud, cloud object storage, conference, Gluster, Google Cloud Storage, hdfs, performance, scale, storage, tiered storage, unified namespace

Alluxio at Strata + Hadoop World San Jose 2016

July 6, 2016 by Calvin Jia & Jiri Simsa

Calvin Jia and Jiri Simsa explain how the current Alluxio tiered storage can be easily configured to use memory, SSDs, and hard drives in different tiers.

Tags: aws s3, big data, caching, conference, data, hdfs, storage, tiered storage, unified namespace

Tag: hdfs