Towards Cognitive Automation of Data Science

Alain Biem, Maria Butrico, Mark Feblowitz, Tim Klinger, Yuri Malitsky, Kenney Ng, Adam Perer, Chandra Reddy, Anton Riabov, Horst Samulowitz, Daby M. Sow, Gerald Tesauro, Deepak S. Turaga

Abstract

A Data Scientist typically performs a number of tedious and time-consuming steps to derive insight from a raw data set. The process usually starts with data ingestion, cleaning, and transformation (e.g. outlier removal, missing value imputation), then proceeds to model building, and finally a presentation of predictions that align with the end-users objectives and preferences. It is a long, complex, and sometimes artful process requiring substantial time and effort, especially because of the combinatorial explosion in choices of algorithms (and platforms), their parameters, and their compositions. Tools that can help automate steps in this process have the potential to accelerate the time-to-delivery of useful results, expand the reach of data science to non-experts, and offer a more systematic exploration of the available options. This work presents a step towards this goal.
BibTeX
@inproceedings{biem2015towards,
  author = {Alain Biem and Maria Butrico and Mark Feblowitz and Tim Klinger and Yuri Malitsky and Kenney Ng and Adam Perer and Chandra Reddy and Anton Riabov and Horst Samulowitz and Daby M. Sow and Gerald Tesauro and Deepak S. Turaga},
  title = {{Towards Cognitive Automation of Data Science}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2015},
  doi = {10.1609/aaai.v29i1.9281},
}
Figure