Rockhopper: A Robust Optimizer for Spark Configuration Tuning in Production Environment

Yiwen Zhu, Rathijit Sen, Brian Kroth, Sergiy Matusevych, Andreas C. Mueller, Tengfei Huang, Rahul Challapalli, Weihan Tang, Xin He, Mo Liu, Estera Kot, Sule Kahraman, Arshdeep Sekhon, Dario Bernal, Aditya Lakra, Shaily Fozdar, Dhruv Relwani, Rui Fang, Long Tian, Karuna Sagar Krishna, Ashit Gosalia, Carlo Curino, Subru KrishnanSIGMOD Conference Companion 2025 · DOI

BibTeX
@inproceedings{zhu2025rockhopper,
  author = {Yiwen Zhu and Rathijit Sen and Brian Kroth and Sergiy Matusevych and Andreas C. Mueller and Tengfei Huang and Rahul Challapalli and Weihan Tang and Xin He and Mo Liu and Estera Kot and Sule Kahraman and Arshdeep Sekhon and Dario Bernal and Aditya Lakra and Shaily Fozdar and Dhruv Relwani and Rui Fang and Long Tian and Karuna Sagar Krishna and Ashit Gosalia and Carlo Curino and Subru Krishnan},
  title = {{Rockhopper: A Robust Optimizer for Spark Configuration Tuning in Production Environment}},
  booktitle = {SIGMOD Conference Companion},
  year = {2025},
  doi = {10.1145/3722212.3724451},
}

Loading related content...

Figure