Through the Lens of Core Competency: Survey on Evaluation of Large Language Models

Ziyu Zhuang, Qiguang Chen, Longxuan Ma, Mingda Li, Yi Han, Yushan Qian, Haopeng Bai, Zixian Feng, Weinan Zhang, Ting LiuarXiv 2023 · OpenReview

Introduction

The rapid evolution of Large Language Models (LLMs) like GPT-4 and LLaMA has outpaced traditional Natural Language Processing (NLP) benchmarks. Metrics such as GLUE and SuperGLUE, once the gold standard, are now easily surpassed, leaving a fragmented landscape of thousands of disparate evaluation tasks. This paper addresses the inadequacy of current benchmarks in capturing "emergent abilities"—complex skills that appear only at scale—and the lack of a systematic link between these tasks and real-world model utility.

To bridge this gap, the authors propose a "Core Competency" framework, borrowing from corporate recruitment methodologies. Instead of focusing on isolated scores, this approach groups tasks into structured domains to assess a model's underlying capabilities.

The Core Competency Architecture

The proposed architecture organizes LLM evaluation into four primary pillars:

  1. Knowledge: Encompassing linguistic (grammar, semantics) and world knowledge (common sense, domain-specific).
  2. Reasoning: Covering causal, deductive, inductive, abductive, analogical, and multi-hop reasoning.
  3. Reliability: Focusing on truthfulness (hallucination) and calibration (uncertainty estimation).
  4. Safety: Addressing harmful content, social bias, and privacy.

Mapping the Benchmarking Landscape

The survey categorizes over 540 tasks to provide a roadmap for researchers. Key benchmarks are mapped to specific competencies to help identify which models excel in particular areas.

Knowledge and Reasoning Benchmarks

Linguistic knowledge is often evaluated through datasets like BLiMP, while world knowledge is tested via WikiFact or TruthfulQA. Reasoning, considered an "advanced" ability, is measured through complex tasks like GSM8K for mathematics or COPA for causal reasoning.

Table 1: Representative datasets for evaluating Knowledge competencies, including linguistic and world knowledge.
Table 2: Representative datasets for evaluating Reasoning competencies, ranging from causal to mathematical induction.

Key Insights and Ideas

  • Emergent Abilities: Reasoning and tool manipulation exhibit non-linear performance curves, emerging sharply once models exceed specific parameter thresholds.
  • Reliability vs. Knowledge: A model's vast knowledge does not guarantee reliability. "Linguistic calibration"—the ability to verbally express uncertainty—is a distinct and critical competency that often degrades after Reinforcement Learning from Human Feedback (RLHF).
  • The "Fraud" Problem: Similar to job applicants memorizing answers, LLMs suffer from training set leakage. The authors argue for dynamic evaluation sets that are updated regularly to maintain validity.

Conclusion and Future Directions

While LLMs have largely mastered linguistic tasks, they continue to struggle with extrinsic hallucinations and complex planning. Future evaluation frameworks must focus on Planning (goal-oriented decision-making) and Coding (self-evolving capabilities). Furthermore, there is an urgent need for "clean" evaluation data to mitigate the effects of data leakage from massive web-crawled training sets.

Summary updated

Abstract

From pre-trained language model (PLM) to large language model (LLM), the field of natural language processing (NLP) has witnessed steep performance gains and wide practical uses. The evaluation of a research field guides its direction of improvement. However, LLMs are extremely hard to thoroughly evaluate for two reasons. First of all, traditional NLP tasks become inadequate due to the excellent performance of LLM. Secondly, existing evaluation tasks are difficult to keep up with the wide range of applications in real-world scenarios. To tackle these problems, existing works proposed various benchmarks to better evaluate LLMs. To clarify the numerous evaluation tasks in both academia and industry, we investigate multiple papers concerning LLM evaluations. We summarize 4 core competencies of LLM, including reasoning, knowledge, reliability, and safety. For every competency, we introduce its definition, corresponding benchmarks, and metrics. Under this competency architecture, similar tasks are combined to reflect corresponding ability, while new tasks can also be easily added into the system. Finally, we give our suggestions on the future direction of LLM's evaluation.
BibTeX
@misc{zhuang2023through,
  author = {Ziyu Zhuang and Qiguang Chen and Longxuan Ma and Mingda Li and Yi Han and Yushan Qian and Haopeng Bai and Zixian Feng and Weinan Zhang and Ting Liu},
  title = {{Through the Lens of Core Competency: Survey on Evaluation of Large Language Models}},
  year = {2023},
  eprint = {2308.07902},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2308.07902},
}
Figure