Regression Analysis of ICT Impact Factors on Early Adolescents’ Reading Proficiency in Five High-Performing Countries

Ya Xiao, Yang Liu, Jie HuFrontiers in Psychology 2019 · DOI

TL;DR

This study investigates how Information and Communication Technology (ICT) impacts reading proficiency in high-achieving countries. It reveals that students' attitudes towards ICT, specifically their interest and perceived autonomy, are more strongly linked to high reading proficiency than the mere availability or use of ICT. This suggests a need to focus on fostering positive attitudes and cognitive engagement with technology for effective reading education.

What Problem Does This Paper Address?

In today's digital age, Information and Communication Technology (ICT) is ubiquitous, and its influence on education, particularly reading proficiency, is a significant area of research. While previous studies have explored the relationship between ICT and reading, there's a need for a deeper understanding of which ICT-related factors are most influential, especially in contexts where students already demonstrate high levels of reading achievement. This paper addresses this by examining the impact of ICT availability, usage, and attitudes on the reading proficiency of 15-year-olds in five countries renowned for their high performance in international assessments like PISA. The goal is to move beyond simply acknowledging ICT's presence and to pinpoint the specific aspects of ICT engagement that truly foster strong reading skills.

Methods

The researchers employed a multiple linear regression (MLR) model to analyze the data. This standard statistical technique allows for the examination of the relationship between a dependent variable (reading proficiency) and multiple independent variables (ICT factors, demographic covariates). The study utilized the R computing language for data analysis. A key methodological aspect was the use of plausible values (PVs) for reading scores, a standard practice in large-scale assessments like PISA, to account for measurement error. To handle missing data, the missForest() function was used for imputation, a non-parametric method suitable for mixed-type data. The analysis also involved checking for assumptions like homoscedasticity and endogeneity.

Datasets

The study exclusively used the Program for International Student Assessment (PISA) 2015 dataset. This dataset is publicly available from the OECD. The sample comprised 37,155 15-year-old students from five representative countries with extremely high reading proficiency: Singapore, New Zealand, Australia, Finland, and France. These countries were selected based on having at least 2% of their students achieving Level 6 in reading proficiency in the PISA 2015 assessment.

Key Insights and Ideas

  • Attitudes Trump Availability/Use: The most striking insight is that students' attitudes towards ICT (interest and perceived autonomy) are more strongly associated with high reading proficiency than simply having access to ICT or actively using it. This suggests that how students feel about and engage with technology cognitively is more critical than the mere presence or frequency of its use.
  • The Double-Edged Sword of ICT Availability: Both ICT availability at home and at school were found to be negatively correlated with reading proficiency. This counterintuitive finding might point to issues with the quality of ICT use, such as overuse, addiction to entertainment, or lack of proper guidance, rather than the availability itself.
  • Nuances in ICT Use: While ICT use at school in general was negatively associated with reading proficiency, the study found no significant connection between ICT use outside of school for schoolwork and reading proficiency. This highlights the importance of how and where ICT is applied.
  • Interest and Autonomy as Drivers: Students' interest in ICT and their perceived autonomy in using it were positively linked to higher reading scores. This suggests that fostering a sense of control and genuine curiosity about digital tools can enhance learning outcomes.
  • Social Interaction's Mixed Bag: While interest and autonomy were positive, perceived ICT competence and enjoyment of social interaction through ICT were negatively associated with reading proficiency. This implies that using ICT primarily for social communication might detract from reading focus.

Key Results

  • Negative Impact of ICT Availability: A one-point increase in ICT availability at home was associated with a decrease of approximately 7.094 points in reading scores, while availability at school led to a decrease of about 6.308 points.
  • Negative Impact of ICT Use at School: Using ICT at school was linked to a decrease of approximately 6.225 reading score points per unit increase. Similarly, ICT use for entertainment outside of school showed a negative correlation, with a decrease of about 7.236 points.
  • Positive Impact of ICT Attitudes: A one-point increase in students' interest in ICT was associated with an increase of approximately 9.308 reading score points. Perceived autonomy related to ICT use showed an even stronger positive association, with an increase of about 21.076 points.
  • Negative Impact of Other Attitudes: Conversely, perceived ICT competence was negatively associated with reading scores (-2.597 points per unit increase), and enjoyment of social interaction through ICT led to a decrease of about 14.065 points.
  • Demographic Factors: Higher socioeconomic status (ESCS) was positively correlated with reading proficiency, while being male (compared to female) was negatively correlated.

Limitations and Future Work

The authors acknowledge that the study's reliance on self-reported data from the PISA questionnaire raises concerns about endogeneity, where the relationship between variables might be influenced by unmeasured factors. They suggest that future research could employ methods like the Hausman test or score matching approaches to address this. Additionally, they recommend the application of more advanced statistical models, such as linear mixed-effects models, for future PISA-based studies. The study's focus on high-performing countries provides valuable insights, but future work could expand the scale and scope of research to include a broader range of countries to enhance generalizability. The authors also emphasize the need for timely scrutiny and appropriate integration of ICT as a cognitive tool, not just an instructional medium, to foster effective reading.

Summary updated

Abstract

The popularity of information and communication technology (ICT) has had a significant influence on the reading proficiency of early adolescents. Achieving excellent reading proficiency, which is related not only to a student's inherent talent but also to various impact factors, can greatly enhance the effectiveness of reading education. The Program for International Student Assessment (PISA) 2015 provides an international view on the reading proficiency of 15-year-olds in a computer-based testing environment. In this study, a multiple linear regression model was constructed using the computing language R to investigate the association between student-level ICT impact factors (the availability of ICT, the use of ICT and attitudes toward ICT) and reading proficiency among early adolescents. The sample included 37,155 15-year-olds from five representative countries with extremely high reading proficiency. The results showed that the students' ICT-related attitudinal factors concerning their interest in ICT and perceived autonomy in using ICT, rather than ICT availability and ICT use, were closely associated with high reading proficiency. In addition, ICT devices should be integrated not only as instructional media but also as a cognitive tool for teaching reading with timely and appropriate scrutiny.
BibTeX
@inproceedings{xiao2019regression,
  author = {Ya Xiao and Yang Liu and Jie Hu},
  title = {{Regression Analysis of ICT Impact Factors on Early Adolescents’ Reading Proficiency in Five High-Performing Countries}},
  booktitle = {Frontiers in Psychology},
  year = {2019},
  doi = {10.3389/fpsyg.2019.01646},
}
Figure