Abstract
Named Entity Recognition (NER) typically relies on static dictionaries, which struggle with the dynamic nature of language. This paper proposes a geometric approach by modeling named entity distributions as hyperspheres in high-dimensional embedding space. By defining entities through their topological structure rather than rigid lists, the authors demonstrate improved performance in both monolingual and cross-lingual NER tasks.
Introduction
Traditional NER models often treat named entities as discrete items in a closed dictionary. However, language evolves rapidly, rendering static lists obsolete. This research shifts the focus toward the "gathering feature" of named entities—the observation that entities like people, places, and organizations occupy specific, dense regions in vector space. By modeling these regions as hyperspheres, the authors provide an "open" definition of entities that can be mapped across languages.
Methodology
The proposed framework consists of three primary components:
- Hypersphere Modeling: Word embeddings are analyzed to identify clusters of entity types. Each type is modeled as a hypersphere defined by a center vector ($C$) and a radius ($R$). Any word falling within this sphere is considered a potential named entity.
- Cross-lingual Mapping: Using a Wasserstein Generative Adversarial Network (WGAN), the model learns to align embedding spaces between a source language (e.g., English) and a target language (e.g., Chinese). This allows the projection of "entity spheres" across languages without requiring target-language dictionaries.
- Feature Enhancement: The Euclidean distance of a word from the hypersphere center is normalized into a $z$-score. This geometric "cue" is then integrated as a feature into state-of-the-art models like BiLSTM-CRF and BERT.
Experimental Setup
The study utilized Word2Vec embeddings trained on Wikipedia dumps (14GB for English, 1.4GB for Chinese). Evaluation was conducted on standard benchmarks: CoNLL 2003 for English, and MSRA/CityU for Chinese. Initial hypersphere parameters were derived from self-collected dictionaries across five languages (English, Chinese, Dutch, German, and Spanish).
Results and Discussion
The integration of hypersphere features consistently improved NER performance across all tested models. In English, the F1-score for a BERT-based model rose from 91.62 to 91.81. In Chinese, the MSRA dataset saw a boost from 95.33 to 95.53 F1 using BERT, while a standard BiLSTM-CRF model improved by over 1.0 F1 point.
A key insight is the "Universal Center" phenomenon, where different entity types often overlap in lower-dimensional projections but separate in higher dimensions. Furthermore, the WGAN-based mapping proved effective for cross-lingual discovery, allowing the identification of Chinese entities using English hypersphere coordinates even in the absence of a Chinese dictionary.
Conclusion
Modeling named entities as hyperspheres offers a robust, geometrically-grounded alternative to static dictionaries. While the method currently depends on initial dictionaries for parameter estimation and is sensitive to embedding quality, it paves the way for more flexible, cross-lingual NER systems. Future work will explore more complex composition functions for multi-word entities to improve their representation in the hypersphere space.
Summary updated