Talk Title: Transforming Production Cloud Workloads into Realistic System Benchmarks

Talk Abstract: Benchmarks are a valuable tool for evaluating systems but only if they can accurately capture the requirements of production workloads. For example, several benchmarks for database applications have become industry standards because they were refined over many decades based on the feedback of commercial companies and large organizations. However, this has proven to be much more difficult for cloud applications, as they evolve too rapidly for a traditional slow refinement process. In this talk, I will instead explore the use of production workloads to directly evaluate cloud research systems (e.g., serverless infrastructure, data processing pipelines, etc.). The MOC Alliance is uniquely positioned to unlock this higher standard in benchmarking because it drives research and open-source development with real workloads from a production cloud.

Bio: Adam Belay is an Associate Professor of Computer Science at the Massachusetts Institute of Technology, where he works on operating systems, runtime systems, and distributed systems. His current research interests lie in making datacenters faster, more efficient, and more secure. He is a member of the Parallel and Distributed Operating Systems Group, and a recipient of a Google Faculty Award, a Facebook Research Award, and the Stanford Graduate Fellowship. http://abelay.me