A Time-Optimized Content Creation Workflow for Remote Teaching

Sebastian Hofstätter, Sophia Althammer, Mete Sertkan, Allan HanburyarXiv 2021 · arXiv

TL;DR

Researchers at TU Wien developed an automated, low-overhead workflow for creating high-quality remote teaching materials by leveraging ubiquitous platforms like YouTube and GitHub. By using a custom Python toolchain to automate transcription and timestamping, they provided students with a polished, navigable learning experience while keeping post-production time sustainable for educators.

What Problem Does This Paper Address?

The shift to remote teaching often forces educators into a difficult trade-off: spend dozens of hours manually editing videos and transcripts to create a "polished" experience, or settle for raw, unedited recordings that are difficult for students to navigate. Existing specialized platforms for lecture hosting often come with high costs or significant server maintenance burdens.

The authors sought a "third way"—a workflow that produces high-quality, searchable, and navigable content (like YouTube chapters and accurate transcripts) using free, ubiquitous tools, all while minimizing the time educators spend on "post-production" tasks.

Methods

The authors’ workflow is built on four main pillars, moving from standard office tools to automated cloud services:

  1. Content Creation: Educators record narrations directly within PowerPoint on a per-slide basis. This modular approach allows for easy fixes or slide additions without re-recording the entire lecture.
  2. The Custom Toolchain: A Python-based program treats the .pptx file as a compressed ZIP to extract raw audio and slide text. It sends the audio to the Azure Speech API for transcription. Crucially, it uses the extracted slide text as "hints" to help the AI correctly recognize technical jargon (e.g., "TF-IDF" or "BERT").
  3. Automated Formatting: The tool automatically generates two key outputs:
  4. A Markdown transcript for GitHub, organized by slide.
  5. A list of YouTube timestamps mapped to slide titles, which triggers YouTube’s native "Chapter" UI.
  6. Human-in-the-Loop Polishing: To ensure 100% accuracy, students are invited to fix minor transcription errors via GitHub Pull Requests in exchange for bonus points.
Figure 1: Overview of our content creation & dissemination workflow: ➊We create our presentations in PowerPoint and add narrations per slide; ➋We use both the native export functionality of PowerPoint and our custom slide transcription program; ➌We distribute the exported formats on YouTube and GitHub. We also encourage students to fix transcripts, which we then use to improve the closed captions on YouTube as well.

Datasets

The workflow was evaluated during a Master-level "Information Retrieval" course at TU Wien in 2021.

  • Course Content: 11 pre-recorded lectures.
  • Evaluation Data: Feedback from 98 students (a 94% response rate of graded students).
  • Transcript Analysis: The authors used the wdiff utility to compare the initial AI-generated transcripts against the final student-corrected versions to measure accuracy.

Key Insights and Ideas

  • The "Hint" Advantage: Automated speech recognition often struggles with technical acronyms. By feeding the slide text into the API as context, the authors achieved a 94% word accuracy rate out of the box, even for highly specialized terminology.
  • Ubiquity over Specialization: Students overwhelmingly preferred using "everyday" platforms like YouTube and GitHub (83% preference) over university-specific, self-hosted learning management systems.
  • Navigation is King: The most successful feature was the YouTube Chapter UI. Providing exact timestamps for every slide transition transformed a long video into a searchable reference tool.
  • Crowdsourcing Quality: Every single transcript was corrected by students. This not only improved the material but also engaged students with the text-based version of the lecture.
Figure 2: The User interaction modes of the YouTube chapter feature (May 2021) for video timeline progress. Enabled by our automatically generated timestamps & chapter names from our transcription procedure.

Key Results

  • High Engagement with Navigation: 93% of students noticed the YouTube timeline chapters, and 66% used them actively to navigate the lectures.
  • Transcript Accuracy: The AI-generated transcripts required only a 6% average word-change to reach perfection.
  • Student Satisfaction: 98% of students recommended the lectures to others.
  • Sustainable Effort: The authors successfully maintained this high-quality output throughout a busy semester without exceeding their available time for course maintenance.
Figure 4: Feedback result for YouTube usage of our timeline feature by our students.

Limitations and Future Work

  • Transcript Adoption: While 92% of students used the PDF slides on GitHub, only about 27% regularly used the text transcripts. The authors suggest that future iterations should integrate the transcript text directly alongside the PDF slides to increase visibility.
  • GitHub Friction: Initially, parallel edits by students led to merge conflicts. The authors had to implement a "blocking" system using GitHub Issues to ensure only one student worked on a file at a time.
  • The "Hybrid" Challenge: Survey data suggested that if high-quality recordings are available, only 11% of students would attend every in-person lecture. The authors conclude that future in-person sessions must be incentivized with interactive elements that go beyond what a video can provide.

Summary updated

Abstract

We describe our workflow to create an engaging remote learning experience for a university course, while minimizing the post-production time of the educators. We make use of ubiquitous and commonly free services and platforms, so that our workflow is inclusive for all educators and provides polished experiences for students. Our learning materials provide for each lecture: 1) a recorded video, uploaded on YouTube, with exact slide timestamp indices, which enables an enhanced navigation UI; and 2) a high-quality flow-text automated transcript of the narration with proper punctuation and capitalization, improved with a student participation workflow on GitHub. All these results could be created by hand in a time consuming and costly way. However, this would generally exceed the time available for creating course materials. Our main contribution is to automate the transformation and post-production between raw narrated slides and our published materials with a custom toolchain. Furthermore, we describe our complete workflow: from content creation to transformation and distribution. Our students gave us overwhelmingly positive feedback and especially liked our use of ubiquitous platforms. The most used feature was YouTube's chapter UI enabled through our automatically generated timestamps. The majority of students, who started using the transcripts, continued to do so. Every single transcript was corrected by students, with an average word-change of 6%. We conclude with the positive feedback that our enhanced content formats are much appreciated and utilized. Important for educators is how our low overhead production workflow was sustainable throughout a busy semester.
BibTeX
@misc{hofstatter2021time,
  author = {Sebastian Hofstätter and Sophia Althammer and Mete Sertkan and Allan Hanbury},
  title = {{A Time-Optimized Content Creation Workflow for Remote Teaching}},
  year = {2021},
  eprint = {2110.05601},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2110.05601},
}
Figure