Machine Learning for Cultural Heritage: A Survey

Marco Fiorucci, Marina Khoroshiltseva, Massimiliano Pontil, Arianna Traviglia, Alessio Del Bue, Stuart James

Abstract

Highlights • Analysis of Cultural Heritage (CH) and Machine Learning (ML) literature. • Taxonomy of ML algorithms and their respective application in CH. • Study of the interplay between CH and ML for future directions. Abstract The application of Machine Learning (ML) to Cultural Heritage (CH) has evolved since basic statistical approaches such as Linear Regression to complex Deep Learning models. The question remains how much of this actively improves on the underlying algorithm versus using it within a ‘black box’ setting. We survey across ML and CH literature to identify the theoretical changes which contribute to the algorithm and in turn them suitable for CH applications. Alternatively, and most commonly, when there are no changes, we review the CH applications, features and pre/post-processing which make the algorithm suitable for its use. We analyse the dominant divides within ML, Supervised, Semi-supervised and Unsupervised, and reflect on a variety of algorithms that have been extensively used. From such an analysis, we give a critical look at the use of ML in CH and consider why CH has only limited adoption of ML.
BibTeX
@article{fiorucci2020machine,
  author = {Marco Fiorucci and Marina Khoroshiltseva and Massimiliano Pontil and Arianna Traviglia and Alessio Del Bue and Stuart James},
  title = {{Machine Learning for Cultural Heritage: A Survey}},
  journal = {Pattern Recognition Letters},
  year = {2020},
  doi = {10.1016/j.patrec.2020.02.017},
}

Loading related content...

Figure