Convening during COVID-19: Lessons learnt from organizing virtual workshops in 2020

Mandana Samiei, Caroline Weis, Larissa Schiavo, Tatjana Chavdarova, Fariba YousefiarXiv 2020 · arXiv

TL;DR

This paper details the experiences and lessons learned from organizing the first-ever virtual "un-workshop" for Women in Machine Learning (WiML) during the COVID-19 pandemic. It offers practical advice on navigating the challenges of virtual event planning, from registration and technology choices to communication and volunteer management, providing a valuable guide for future virtual conference organizers.

What Problem Does This Paper Address?

The COVID-19 pandemic forced many academic and professional events, including workshops, to transition online. This presented a significant challenge for organizers, who had to adapt traditional in-person formats to a virtual environment without much prior experience or established best practices. Specifically, the WiML community, accustomed to its traditional in-person "un-workshop" format which emphasizes participant-driven discussions and networking, faced the problem of how to replicate this interactive and engaging experience in a virtual setting. This paper addresses the gap in knowledge regarding the practicalities and potential pitfalls of organizing such events, aiming to provide a roadmap for others facing similar circumstances.

Methods

The authors describe their approach to organizing the WiML "Un-Workshop" at ICML 2020, which was adapted from the un-conference format. Key methodological aspects include:

  • Un-conference Format Adaptation: The core of the un-conference, focusing on participant-driven discussions and reducing formal talks, was maintained. This involved a large number of breakout sessions and a focus on informal interaction.
  • Platform Selection and Integration: A multi-platform approach was adopted, leveraging Zoom for breakout sessions, SlidesLive for pre-recorded talks, Sli.do for Q&A, and Gather.town for poster sessions and networking. The paper discusses the considerations for choosing these platforms, emphasizing robustness, ease of use, and event type compatibility.
  • Structured Registration and Submission: A carefully designed Google form was used for registration and participant submissions (breakout session proposals, poster abstracts). This form was iterated upon to ensure it captured necessary information and aligned with the virtual format.
  • Volunteer Management and Communication: A hierarchical volunteer structure with "supervolunteers" was implemented to manage the event across different time zones. Communication strategies included weekly Zoom meetings, a Slack channel for organizers, and a dedicated Slack workspace for day-of-event coordination.
  • Dry Runs and Preparation: Multiple dry runs were conducted for breakout session leaders and poster presenters to ensure familiarity with the platforms and troubleshoot potential issues.

Datasets

Not discussed in the paper.

Key Insights and Ideas

  • The "Un-conference" Translates Well Virtually: The core principle of participant-driven discussions and informal interaction, central to the un-conference format, proved to be highly effective even in a virtual setting, fostering engagement and lively discussions.
  • Platform Choice is Crucial and Complex: No single platform is a silver bullet. A multi-platform strategy is often necessary, but requires careful consideration of each platform's strengths, weaknesses, cost, and the technical proficiency of attendees. Integrating these platforms smoothly is a significant challenge.
  • Over-communication is Key: Especially with geographically dispersed teams and participants, clear, frequent, and redundant communication is vital to avoid misunderstandings and ensure everyone is on the same page.
  • Volunteer Structure is Essential for Scalability: A well-defined volunteer structure, with clear roles and responsibilities, is critical for managing the operational load of a virtual event, particularly across multiple time zones.
  • Dry Runs are Non-Negotiable: Thorough dry runs for both organizers and participants, especially for interactive elements like breakout sessions and poster presentations, are essential for a smooth event.
  • Gather.town Offers a Unique Social Experience, but with Caveats: While Gather.town provided a joyful and interactive poster session experience, the authors noted issues with poster uploads and capacity limitations, suggesting areas for future improvement.
  • Virtual Events Can Increase Accessibility and Diversity: The virtual format, by reducing costs associated with travel and accommodation, made the workshop more accessible to a wider range of participants, potentially increasing diversity.

Key Results

  • High Attendance and Engagement: Despite organizational challenges, the un-workshop was carried out with no disruptions and achieved great engagement and participation.
  • Positive Feedback on Breakout Sessions: Breakout sessions received overwhelmingly positive feedback, with over 95% of respondents recommending their repetition with minor changes.
  • Increased Accessibility: The virtual format and WiML funding contributed to high attendance, with many attendees reporting it was their first-ever machine learning conference and a valuable opportunity for networking.
  • Successful Volunteer Management: The implemented volunteer structure and documentation helped manage inquiries and ensure a smoother event day.

Limitations and Future Work

  • Platform Integration Complexity: The use of multiple platforms led to some confusion for attendees on how to access different channels. Future work could involve providing a more unified guide or a single platform that integrates all functionalities.
  • Capacity Issues in Interactive Platforms: The poster session in Gather.town experienced capacity issues, suggesting the need for better solutions for managing simultaneous interactions in virtual spaces. Dynamic passlist updates for platforms like Gather.town were also identified as a potential improvement.
  • Technical Troubleshooting: While the paper outlines common failure modes in Gather.town, ongoing technical support and clear troubleshooting guides are crucial for future virtual events.
  • User Verification: The paper touches upon limited user verification on platforms like YouTube/Facebook Live, highlighting a potential security concern for future events.
  • Future Platform Development: The authors suggest that Gather.town could benefit from allowing PDF uploads for posters, which would simplify the process for organizers using platforms like CMT or EasyChair.

Summary updated

BibTeX
@misc{samiei2020convening,
  author = {Mandana Samiei and Caroline Weis and Larissa Schiavo and Tatjana Chavdarova and Fariba Yousefi},
  title = {{Convening during COVID-19: Lessons learnt from organizing virtual workshops in 2020}},
  year = {2020},
  eprint = {2012.01191},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2012.01191},
}
Figure