Topic Modelling vs Distant Supervision: A Comparative Evaluation Based on the Classification of Parliamentary Enquiries

Riza Batista-Navarro, Oliver Hawkins

Abstract

We investigate two different approaches to text classification, by categorising enquiries submitted to the House of Commons Library from elected Members of the UK Parliament. One is an unsupervised approach, i.e. topic modelling, and the other is a supervised approach based on weakly labelled data, i.e. distant supervision. Models were trained on two types of feature sets: one based only on bag of words, and the other combining bag of words with structured metadata attached to enquiries. Our results show that topic modelling obtains superior performance on this task, and that the incorporation of structured metadata as learning features contributes insignificantly to improved model performance.
BibTeX
@inproceedings{batistanavarro2019topic,
  author = {Riza Batista-Navarro and Oliver Hawkins},
  title = {{Topic Modelling vs Distant Supervision: A Comparative Evaluation Based on the Classification of Parliamentary Enquiries}},
  booktitle = {TPDL},
  year = {2019},
  doi = {10.1007/978-3-030-30760-8\_46},
}

Loading related content...

Figure