How to Develop and Operate Cloud-Native Data Platforms and Applications

Tags: , , ,

feat. Electronic Arts (EA) use cases

ALLUXIO ONLINE MEETUP

In cloud-based software stacks, there are varying degrees of automation across different layers: infrastructure, platform, and application. The mismatch in automation often breaks balance in devops, causing ops nightmares in platforms and applications. This talk will overview two projects at Electronic Arts (EA) that address the mismatch by data orchestration: One project automatically generates configurations for all components in a large monitoring system, which reduces the daily average number of alerts from ~1000 to ~20. The other project introduces Alluxio for caching and unifying address space across ETL and analytics workloads, which substantially simplifies architecture, improves performance, and reduces ops overheads.

In this online meetup, you will learn about:

  • Lessons learned in building and rebuilding EA’s monitoring systems
  • Redesigning data platform by replacing HDFS with Alluxio for data orchestration and help with scaling

Speakers:

Du Li is currently an Architect of Data Infrastructure at Electronic Arts. He worked in academia and industrial labs for many years after earning his Ph.D. degree from UCLA. Prior to joining EA in mid-2018, he was a software engineer at Yahoo and Apple.

Bin Fan is the founding engineer of Alluxio, Inc. and the PMC member of Alluxio open source project. Prior to Alluxio, he worked for Google where he won the Technical Infrastructure Award. Bin received his Ph.D. in Computer Science from Carnegie Mellon University working on distributed systems

Questions? Slack with the speakers, users, and many other community members!
Welcome to join Alluxio Global Online Meetup Group to attend online meetups like this!

Video:

Slides: