Abstract
This study surveyed librarians, researchers, administrators, and others engaged in research on the impact of academic libraries on student success. This study, sponsored by an ACRL Impact Grant, specifically sought to expand the ACRL Academic Library Impact report, which defined strategic directions for library impact research, largely defined from the perspective of high-level administrators. This study addressed this limitation by surveying and interviewing professional librarians who are directly conducting library impact research, asking about their research experience, their attitudes about impact research, and their response to the ACRL report. Notable findings include differences in attitudes between librarians and library administrators about the helpfulness of impact research, administrators’ greater agreement with the ACRL report themes, and some pushback among librarians regarding quantitative impact research who are interested in qualitative research and findings that lead to more actionable improvement.
Introduction
In the current "accountability culture" of higher education, academic libraries face mounting pressure to demonstrate their direct contribution to institutional goals, such as student retention and GPA. Landmark publications like the ACRL’s Academic Library Impact (ALI) report have attempted to provide a roadmap for this research. However, these frameworks often reflect the priorities of high-level administrators and provosts rather than the librarians tasked with executing the research.
This study, authored by James Cheng and Starr Hoffman, investigates the potential misalignment between these two groups. By focusing on "practitioner-researchers," the authors explore whether the strategic research agenda matches the motivations, confidence levels, and perceived needs of those on the front lines.
Methodology
The researchers utilized a mixed-methods approach to capture a holistic view of the field:
- Quantitative: A 34-question survey was distributed to professional listservs (e.g., ARL-ASSESS, ACRL Forum), yielding 43 complete responses from a mix of librarians and administrators.
- Qualitative: Seven semi-structured interviews were conducted to delve deeper into the values and attitudes underlying the survey data.
Data analysis involved Python and Pandas for quantitative cleaning, Tableau for visualization, and values coding for qualitative interpretation. The study remains exploratory, prioritizing descriptive insights over comparative hypothesis testing.
The "Proving" vs. "Improving" Tension
A central finding of the research is the divergent motivation for conducting impact research. Administrators largely view research as a tool for external validation—proving the library's value to provosts and stakeholders to secure funding or meet accreditation requirements. In contrast, librarians prioritize internal improvement, seeking data that allows them to iteratively refine services to better support students.
This tension manifests in how the groups perceive the utility of research. While 86% of administrators believed their research aided in university accreditation, only 32% of librarians shared this view. Conversely, 65% of librarians believed their work directly improved student success, compared to only 40% of administrators.
Preparation and the Confidence Paradox
There is a notable "confidence paradox" regarding research preparation. Librarians reported feeling significantly better prepared by their professional Library and Information Science (LIS) education than administrators did. As shown in Figure 1, 83% of librarians felt their LIS degree prepared them for impact research, compared to only 57% of administrators.
Despite this perceived preparation, librarians exhibited lower overall confidence in their final results. While 100% of administrators expressed confidence in the "level of rigor" of their research, only 61% of librarians felt the same. This suggests that while librarians value their educational background, they may feel the practical demands of high-stakes impact research exceed the training provided in standard MLIS programs.
Rigor and Statistical Anxiety
The study highlights a specific gap in quantitative skills. Librarians reported their lowest confidence levels in data analysis (43%) and interpreting statistical results (45%). This "statistical anxiety" often leads librarians to define rigor through the lens of local utility—whether the data is "good enough" to make a decision—rather than meeting the stringent standards of high-impact peer-reviewed journals.
Furthermore, some researchers expressed skepticism about the feasibility of isolating library impact. They argued that student success is influenced by a myriad of confounding variables, making direct correlations feel like "blind propaganda" rather than objective science. This has led to a call for more qualitative, theory-grounded research that captures the "human piece" of the library experience.
Conclusion and Future Directions
The disconnect between administrators and librarians suggests a need for a more integrated approach to library impact research. To bridge this gap, the authors propose several interventions:
- Curriculum Reform: LIS programs should mandate more robust research methods and statistics courses to alleviate the confidence gap in quantitative analysis.
- Methodological Diversity: Future research agendas should move beyond quantitative metrics to include qualitative frameworks that provide actionable insights for service improvement.
- Strategic Alignment: Administrators and librarians must work together to ensure that research designed to "prove" value to external stakeholders also provides the necessary data to "improve" local practice.
By addressing these disparities, the profession can move toward a research model that is both strategically useful for the institution and practically meaningful for the students the library serves.
Summary updated