The Role of Chess in Artificial Intelligence Research Robert Levinson (Chair)

IJCAI 1991

TL;DR

This panel discussion argues that while computer chess has driven significant AI progress, its focus on brute-force performance has led to a neglect of fundamental AI research areas. The panelists propose that chess can and should be revitalized as a testbed for machine learning, knowledge representation, and cognitive modeling, moving beyond mere engineering for speed.

What Problem Does This Paper Address?

The paper addresses a perceived stagnation in the role of chess within Artificial Intelligence (AI) research. For decades, chess was a cornerstone for AI development, pushing boundaries in search algorithms and problem-solving. However, with computers now achieving grandmaster level and even competing with human world champions, the AI community seems to be losing appreciation for chess as a research domain. This shift is attributed to a focus on engineering for performance (brute-force search) rather than scientific inquiry into core AI principles. The panelists aim to re-evaluate chess's significance, highlight its past contributions, and advocate for its future use as a fundamental testbed for broader AI objectives, including machine learning and cognitive science.

Methods

The paper doesn't present a single, unified method but rather a collection of perspectives from a panel discussion. The methods discussed and advocated for include:

  • Brute-force search and alpha-beta pruning: Acknowledged as highly effective and foundational in past computer chess, but now seen as potentially limiting for future AI research.
  • Knowledge-based search algorithms: Discussed as an area that has seen less progress than expected, with a call for more research into how knowledge can be effectively integrated.
  • Knowledge representation and acquisition: Highlighted as a critical but under-researched area in computer chess, with a need for machines to take more responsibility for acquiring and utilizing knowledge.
  • Machine learning techniques: Advocated as a crucial area for future chess research, including genetic algorithms, neural networks, temporal-difference learning, and explanation-based generalization.
  • Pattern-oriented approaches: Introduced as an alternative to traditional search, focusing on learning and representing patterns of interaction between pieces and squares, exemplified by the "Morph" system.
  • Experiential learning: Emphasized over learning-by-example, suggesting systems should learn from their own playing experience.
  • Dynamic re-ordering of moves and pruning criteria: Techniques to improve search efficiency by intelligently selecting which lines of play to explore.
  • Game-based testing and competition: Proposed as a valuable method for comparing and advancing AI algorithms across various domains, not just chess.

Datasets

Not discussed in the paper. The paper mentions the availability of "on-line high quality chess game databases" as a resource for knowledge acquisition, but no specific datasets are detailed or used for evaluation within the presented panel discussions.

Key Insights and Ideas

  • Success breeds complacency: The very success of brute-force search in chess has led to a neglect of more fundamental AI research questions, as "engineering" for speed has overshadowed scientific inquiry.
  • Chess as a "game of intelligence" is still relevant: Despite current trends, chess's well-defined structure, rich problem-solving domain, and readily available expertise make it an ideal testbed for AI.
  • Human vs. Machine reasoning: Existing psychological studies suggest human players use different reasoning modes than current chess programs, offering valuable insights for AI development.
  • The need for machines to learn knowledge: Instead of relying solely on human-programmed expertise, future AI systems should be capable of discovering and acquiring knowledge themselves.
  • Beyond brute force: While brute force has been successful, it's insufficient for tackling the full complexity of intelligence. Areas like knowledge representation, learning, and planning are crucial for deeper AI progress.
  • Go as a potentially better domain: One panelist suggests Go might offer even more advantages than chess for certain types of AI research due to its complexity and simpler domain.
  • Competitive testing is vital: Chess championships have historically served as a valuable benchmark for AI progress, and this model could be applied to other AI domains.

Key Results

The paper is a panel discussion and does not present quantitative results in the traditional sense. However, it highlights several qualitative "results" and observations:

  • Past AI contributions from chess: Techniques like alpha-beta search and iterative deepening have found applications in other AI domains.
  • Current limitations of chess AI: Many AI techniques have proven too slow for real-time, high-performance chess applications, leading to their abandonment in favor of brute-force methods.
  • "Morph" system's approach: Demonstrates a pattern-oriented, adaptive system that learns from experience and aims to play a complete game, rather than a subdomain, with minimal reliance on search.
  • Expert inputs can be detrimental: The example of Deep Thought's evaluation function shows that human expert inputs can sometimes introduce biases and negatively impact performance.
  • The future of human-chess competition: Predictions suggest computers will defeat human world champions in matches within the next 10-25 years, shifting the focus to how humans achieve expertise.

Limitations and Future Work

Limitations:

  • Focus on performance over science: The paper acknowledges that the field of computer chess has evolved into an "engineering" discipline, with less emphasis on fundamental AI research.
  • Inadequacy of conventional AI techniques: Many traditional AI methods are deemed too slow for real-time chess applications, limiting their practical use.
  • Limited exploration of machine learning: Despite its potential, machine learning has not been extensively applied to chess research.
  • "Morph" system's current limitations: While promising, "Morph" is currently limited to 1-ply of search, though deeper search is considered possible.

Future Work:

  • Revitalize chess as an AI testbed: Encourage the use of chess for exploring machine learning, knowledge representation, planning, and cognitive modeling.
  • Develop machines that learn knowledge: Shift responsibility for knowledge acquisition from humans to the machines themselves.
  • Explore alternative AI approaches: Investigate pattern-oriented and other non-search-heavy methods for chess and other complex domains.
  • Apply competitive testing to other AI fields: Extend the model of chess championships to other areas like theorem proving and natural language understanding.
  • Investigate Go as a research domain: Explore Go's potential for driving AI research in planning, goal-directed search, and machine learning.
  • Develop novel game-playing competitions: Create events where AI programs must learn and adapt to new, undefined games, fostering more general AI capabilities.

Summary updated

BibTeX
@inproceedings{1991role,
  title = {{The Role of Chess in Artificial Intelligence Research Robert Levinson (Chair)}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {1991},
}

Loading related content...

Figure