Assessing the accessibility of E-learning

Morten Goodwin, Iain Sutherland, Frode Roarson, Tom DrangeAustralasian 2012

Abstract

Equal participation for people with special needs is an important objective in education politics. Governments have a strong emphasis on enabling education for all citizens. The trend of using e-learning both for on-campus and remote delivery of students has the potential of enabling new opportunities for people who previously faced challenges following education. On the other hand, providing online education bears the risk of creating new barriers. This paper examines different stages of providing educational content and delivering teaching material online. This is based on practical experiences from Noroff University College providing a bachelor degree in a security-related area. Based on both practical experiences and state-of-the-art literature review, we analyze potential accessibility barriers and investigate how the barriers can be identified and removed based on state-of-the-art accessibility measurement techniques. Consequently, this paper is a first step towards a methodology on assessing e-learning content based on accessibility. This methodology would assist others in obtaining an overview concerning the degree of accessibility of their own learning materials.

Introduction: The Digital Wall

The shift toward e-learning is a double-edged sword. For students with special needs, digital delivery offers the potential for flexible hours and the use of personalized assistive technologies. However, if not designed correctly, these systems create new "digital walls."

A major gap exists in how higher education institutions handle accessibility: most act reactively, fixing materials only when a specific student requests it. There is a lack of a proactive, standardized way to measure the "accessibility health" of an entire course. Furthermore, accessibility is not just about a single PDF; it is a chain that includes the Learning Management System (LMS) and the live interaction between students and teachers. If any link in that chain breaks, the student is excluded.

A Holistic Methodology for Accessibility

To address these gaps, the authors propose a unified methodology that treats e-learning as an ecosystem. Rather than focusing on isolated files, the framework evaluates the relationship between the student and three distinct pillars of the digital classroom.

The three-pillar model of e-learning accessibility centered on the student.

The Three Pillars

  1. Content (Document Accessibility): Focused primarily on PDFs and static materials, the authors map 14 specific WCAG 2.0 techniques (e.g., correct reading order, alt-text for images, and structural headings) to evaluate teaching materials.
  2. Learning Platform (Web Accessibility): Since an LMS (like Moodle or Blackboard) is used to create and submit work, the authors treat it as an authoring tool. They apply the ATAG 2.0 (Authoring Tool Accessibility Guidelines) to assess the interface.
  3. Interaction (Interactive Media): This covers live video streams and messaging. The authors suggest using WCAG 2.0 guidelines for time-based media, such as providing descriptive labels for audio-only content and "mini-lecture" text summaries as alternatives to live video.

Quantifying Accessibility: The Scoring System

To make these assessments actionable, the authors introduce a quantifiable scoring system designed to provide a clear metric for course quality:

$$Score = 1 - \frac{\text{Number of barriers}}{\text{Number of instances a test can fail}}$$

The final course score is a weighted average of these three pillars, resulting in a value between 0 and 1, which can be mapped to a standard A-F grading scale. This allows institutions to visualize where a course succeeds or fails across the three dimensions.

Practical Insights and Case Studies

The methodology is built on practical case studies from Noroff University College (NUC) while delivering a bachelor’s degree in digital security. Key findings include:

  • The LMS Notification Gap: A critical discovery was that Moodle’s built-in chat failed students because it lacked audible notifications. Switching to platforms like Skype, which provide both visual and sound alerts, led to an immediate and massive increase in student engagement.
  • The "Mini-Lecture" Strategy: Real-time captioning for live video is often prohibitively expensive. The authors propose "mini-lectures"—written summaries of core content—as a high-impact, low-cost alternative that benefits both hearing-impaired students and those with reading difficulties.
  • Platform Limitations: Even widely used platforms like Moodle, which claim accessibility, were found to be difficult for visually impaired users using screen readers like NVDA (Non-Visual Desktop Access).

Conclusion and Future Directions

This research argues that making content accessible from the start is more cost-effective and inclusive than tailoring it for individual students reactively. While the scoring system provides a robust framework, future work is needed to empirically verify the methodology with a wider range of courses and real users with diverse accessibility requirements. Additionally, the accessibility of the LMS for teachers (the "authoring" side) remains a significant area for further study to ensure the entire educational lifecycle is inclusive.

Summary updated

Abstract

Equal participation for people with special needs is an important objective in education politics. Governments have a strong emphasis on enabling education for all citizens. The trend of using e-learning both for on campus and remote delivery of students has the potential of enabling new opportunities for people who previously faced challenges following education. On the other hand, providing online education bears the risk of creating new barriers. This paper examines different stages of providing educational content and delivering teaching material online. This is based on practical experiences from Noroff University College providing a bachelor degree in a security related area. Based on both practical experiences and state of the art literature review, we analyze potential accessibility barriers, and investigate how the barriers can be identified and removed based on state of the art accessibility measurement techniques. Consequently, this paper is a first step towards a methodology on assessing e-learning content based on accessibility. This methodology would assist others in obtaining an overview concerning the degree of accessibility of their own learning materials.
BibTeX
@inproceedings{goodwin2012assessing,
  author = {Morten Goodwin and Iain Sutherland and Frode Roarson and Tom Drange},
  title = {{Assessing the accessibility of E-learning}},
  booktitle = {Australasian},
  year = {2012},
}
Figure