Joint learning of words and meaning representations for open-text semantic parsing

Antoine Bordes, Xavier Glorot, Jason Weston, Yoshua Bengio

Abstract

Open-text (or open-domain) semantic parsers are designed to interpret any statement in natural language by inferring a corresponding meaning representation (MR). Unfortunately, large scale systems cannot be easily machine-learned due to lack of directly supervised data. We propose here a method that learns to assign MRs to a wide range of text (using a dictionary of more than 70,000 words, which are mapped to more than 40,000 entities) thanks to a training scheme that combines learning from knowledge bases (WordNet and ConceptNet) with learning from raw text. The model jointly learns representations of words, entities and MRs via a multi-task training process operating on these diverse sources of data. Hence, the system ends up providing methods for knowledge acquisition and word-sense disambiguation within the context of semantic parsing in a single elegant framework. Experiments on these various tasks indicate the promise of the approach. 1
BibTeX
@inproceedings{bordes2012joint,
  author = {Antoine Bordes and Xavier Glorot and Jason Weston and Yoshua Bengio},
  title = {{Joint learning of words and meaning representations for open-text semantic parsing}},
  booktitle = {International Conference on Artificial Intelligence and Statistics},
  year = {2012},
  url = {https://openreview.net/forum?id=STzfe4kIBlq},
}

Loading related content...

Figure