DocExplore: overcoming cultural and physical barriers to access ancient documents

Pierrick Tranouez, Stéphane Nicolas, Vladislavs Dovgalecs, Alexandre Burnett, Laurent Heutte, Yiqing Liang, Richard M. Guest, Michael C. FairhurstACM Symposium on Document Engineering 2012 · DOI

TL;DR

This paper introduces DocExplore, an integrated software suite designed to make ancient digitized documents more accessible and engaging. It tackles the challenges of understanding historical texts by allowing experts to enrich them with contextual information and enabling the creation of interactive, multimedia presentations for the public.

What Problem Does This Paper Address?

Many historical documents, such as ancient manuscripts, are locked away in institutions due to their fragility and the significant effort required to understand them. While digitization is a first step, it doesn't overcome the cultural and linguistic barriers that prevent general access. Understanding these documents often requires deep contextual knowledge of the era, language, and historical background, which is not readily available to the public. This paper addresses the need for a system that bridges the gap between scholarly expertise and public engagement with these valuable historical artifacts.

Methods

DocExplore is a software suite composed of three main applications:

  • Manuscript Management Tool (MMT): This tool allows scholars and archivists to create "virtual codices" from digitized document images. Users can then augment these documents with various forms of data and metadata, including transcriptions, annotations, comments, images, videos, and hyperlinks. A key feature is the ability to define "Regions of Interest" (ROIs) within document pages, which can be anything from a specific word to an illustration. The MMT also incorporates advanced pattern recognition and word spotting techniques to search for specific words or graphical patterns within document images, even without prior segmentation.
  • Authoring Tool: This application enables users (archivists, heritage professionals) to build multimedia presentations from the augmented documents. These presentations can be linear (like a book) or non-linear (graph-based with hyperlinks), allowing for curated exploration of the content and its associated metadata.
  • Viewer: This is the public-facing application that presents the multimedia creations. It offers an interactive experience, including 3D rendering of manuscripts and natural page-flipping gestures. Crucially, it provides access to the supplementary material (transcriptions, translations, annotations, etc.) embedded by scholars via the MMT.

Datasets

Not explicitly discussed in the paper. The authors mention using medieval manuscripts and historical documents for their work and testing.

Key Insights and Ideas

  • Augmented Documents as a Bridge: The core idea is to create "augmented documents" that combine the raw digitized artifact with rich contextual information provided by experts. This approach aims to make historical documents understandable and engaging for a broader audience.
  • Bridging Scholarly and Public Access: DocExplore is designed to serve multiple user groups: scholars and researchers (MMT), heritage professionals (Authoring Tool), and the general public (Viewer). This multi-tiered approach ensures that expertise is captured and then effectively disseminated.
  • Beyond Simple Digitization: The paper emphasizes that digitization alone is insufficient. The true value lies in adding layers of interpretation, context, and interactive features that bring historical documents to life.
  • Word Spotting for Ancient Texts: Recognizing the limitations of traditional OCR for ancient, often degraded, handwritten documents, the paper highlights word spotting as a more efficient and effective method for searching and retrieving information.
  • Interactive 3D Presentations: The use of 3D modeling and textured rendering in the viewer aims to provide a more immersive and natural experience, mimicking the feel of handling a physical book.

Key Results

  • The MMT has been used by historians to annotate and transcribe over a thousand pages of medieval manuscripts, with many transcriptions aligned with pictured words to build a learning base for pattern recognition algorithms.
  • The DocExplore suite has been demonstrated at ancient book trade fairs, receiving positive feedback from attendees.
  • Preliminary experiments with word spotting have shown promising results in returning highly relevant and precise locations of requested words, with efforts underway to improve precision and recall.

Limitations and Future Work

  • Formal Evaluation: The authors acknowledge that the precision and recall of their advanced search tool (word spotting) need to be more formally evaluated and improved.
  • Pattern Recognition Extension: Future work includes integrating more advanced pattern recognition functionalities to allow searching for free-form graphical patterns in a seamless manner, complementing text search.
  • Exhibition Integration: The DocExplore software suite is planned to be an essential part of an upcoming exhibition in September 2013 on "Writings from the Middle Ages to Present Time in the Anglo-Norman Region."

Summary updated

BibTeX
@inproceedings{tranouez2012docexplore,
  author = {Pierrick Tranouez and Stéphane Nicolas and Vladislavs Dovgalecs and Alexandre Burnett and Laurent Heutte and Yiqing Liang and Richard M. Guest and Michael C. Fairhurst},
  title = {{DocExplore: overcoming cultural and physical barriers to access ancient documents}},
  booktitle = {ACM Symposium on Document Engineering},
  year = {2012},
  doi = {10.1145/2361354.2361399},
}
Figure