Lucene/SOLR Revolution 2017 – Timothy Potter, Lucidworks introduces Alluxio, the fastest growing open source project in the big data ecosystem, and shows how to leverage it for optimizing Solr performance. Basic integration scenarios and performance comparisons are also presented.
Tags: analytics, big data, cloud, data, hdfs, performance, spark
In a real development environment our customers leverage ArcGIS to read and write geospatial data to a plethora of distributed data stores, such as Amazon S3, HDFS, or OpenStack Swift, and some of these data stores are not natively supported by the ArcGIS platform…
Tags: analytics, architecture, aws s3, case study, guest blog, performance
VAULT Conference 2017 – Haoyuan Li, CEO of Alluxio (formerly Tachyon), presents a keynote on the San Mateo-based startup’s journey thus far and the road ahead.
Tags: analytics, apache spark, big data, cloud, conference, storage, unified namespace
Ceph Days 2017 – Adit Madan presents on enabling fast big data analytics on Ceph with Alluxio.
Tags: alluxio engineering, analytics, big data, ceph, cloud object storage, cloud storage, conference, data, on-prem object storage, storage
Today, we’re excited to announce our partnership with Mesosphere to enable fast on-demand analytics with Alluxio via Mesosphere’s DC/OS in one-click. This partnership is a natural extension of the synergy between Alluxio and DC/OS. Alluxio, the world’s first system that unifies data at memory speed, allows enterprises to manage and analyze data stored across disparate storage systems on premise and in the cloud at memory speed. Mesosphere brings enterprises the power of cloud native technologies, with the control to run on any infrastructure – datacenter or cloud.
In this talk, we briefly introduce Alluxio, present several ways how Alluxio can help Spark be more effective, show benchmark results with Spark RDDs and DataFrames, and describe production deployments both Alluxio and Spark working together.
Tags: alluxio engineering, analytics, apache spark, big data, compute, conference, data, data engineering, spark, storage
This is an excerpt from the Accelerating Data Analytics on Ceph Object Storage with Alluxio whitepaper.
As the volume of data collected by enterprises has grown, there is a continual need to find efficient storage solutions. Owing to its simplicity, scalability and cost-efficiency object storage, including Ceph, has increasingly become a popular alternative to traditional file systems. In most cases the object storage system, on-premise or in the cloud, is decoupled from compute nodes where analytics is run. There are several benefits of this separation.
Alluxio is used as a lightweight data access layer on the compute nodes to bring performance up to memory speeds without requiring a long running cluster. This talk will summarize why Alluxio’s architecture makes it a perfect fit for completing the on-demand cluster puzzle.
Tags: alluxio engineering, analytics, big data, compute, data, data engineering, meetup, performance, storage
Haoyuan Li offers an overview of Alluxio (formerly Tachyon), a memory-speed virtual distributed storage system.
Tags: alluxio engineering, analytics, aws s3, big data, ceph, compute, conference, data, distributed systems, hdfs, storage, unified namespace