Graph-Community-Enabled Personalized Course-Job Recommendations with Cross-Domain Data Integration

Guo‐Qing Zhu, Yan Chen, Shutian WangSustainability 2022 · DOI

TL;DR

This paper introduces a novel Graph-Community-Enabled (GCE) model that integrates educational and career data using heterogeneous graphs and community detection. By bridging the gap between course skills and job requirements through skill communities, GCE significantly improves personalized course and job recommendations, outperforming existing methods.

What Problem Does This Paper Address?

In today's information-rich world, students and professionals are overwhelmed by the sheer volume of online course and job postings. Existing recommendation systems often struggle to provide truly personalized and effective suggestions because they tend to focus on either education or career data in isolation. A major challenge is the "skills gap" – the mismatch between skills learned in academic settings and those demanded by the job market. Furthermore, the vocabulary used to describe skills in courses and job descriptions can differ significantly, making direct comparison difficult. This paper aims to tackle these issues by creating a unified system that leverages cross-domain data integration to offer more accurate and meaningful course and job recommendations.

Methods

The core of this research lies in the Graph-Community-Enabled (GCE) model. Here's a breakdown of the key techniques:

  • Heterogeneous Graph Construction: The system builds a complex graph that represents entities from both the education (courses, skills) and career (jobs, skills) domains. These entities are connected by various types of relationships (e.g., "course covers skill," "job requires skill," "course pre-requisite").
  • Skill Community Detection: To address the vocabulary mismatch between course and job skills, the researchers employ the Infomap algorithm to partition skills into communities. This helps group similar skills, regardless of their exact phrasing, and facilitates better matching.
  • Cross-Domain Data Integration: Skills act as the crucial bridge connecting the education and career domains within the heterogeneous graph.
  • Random Walk Algorithm: A random walk algorithm is used on this graph to explore paths and identify relevant recommendations. This technique is adept at uncovering complex, indirect relationships between nodes.
  • Meta-Path Based Ranking: Specific "meta-paths" (sequences of node types and relationships) are defined to capture different recommendation scenarios (e.g., a student looking for courses based on a career goal, or an employee seeking jobs based on completed courses). A ranking function based on these meta-paths and community structure is used to score candidate recommendations.

Datasets

The study utilizes two primary datasets:

  • Education Data:
    • Indiana University Bloomington's Luddy School of Informatics, Computing, and Engineering (IUB-SICE) course enrollment logs and catalog data (covering six departments, 7824 students, 371 courses over 10 semesters).
  • 957 MOOCs from Coursera, along with their associated skill sets (1101 skills).
  • Job/Career Data:
    • Job postings scraped from Careerbuilder, focusing on trending IT job titles.
  • The final dataset includes 20,000 jobs and 1611 skills.

The paper notes that the skills from courses and jobs often use different vocabularies, with only 79 skills overlapping in their initial dataset.

Key Insights and Ideas

  • Skills as the Universal Bridge: The research strongly emphasizes that skills are the most effective intermediary for connecting disparate educational and career data. By treating skills as a common language, the system can overcome vocabulary differences.
  • Community Detection for Semantic Alignment: Grouping skills into communities is a clever way to handle semantic similarity without relying on perfect keyword matches. This allows for more robust connections between courses and jobs.
  • Heterogeneous Graphs Capture Richer Relationships: Moving beyond simple user-item interactions, heterogeneous graphs allow for the modeling of complex relationships between multiple entity types (courses, jobs, skills), leading to more nuanced recommendations.
  • Meta-Paths Tailor Recommendations: Defining specific meta-paths for different user scenarios (e.g., freshman vs. experienced professional) allows the recommendation system to adapt to diverse needs and goals.
  • Shorter Meta-Paths Can Be More Informative: The study suggests that shorter meta-paths might be more effective because they link more directly relevant entities, reducing noise from distant connections.

Key Results

The GCE model demonstrated superior performance across various evaluation metrics (Precision@K, MAP@K, NDCG@K) compared to baseline methods in both course and job recommendation tasks.

  • Overall Superiority: The GCE model consistently outperformed text-based (BM25, Word2Vec, BERT) and graph-enabled (GE) models.
  • Best Performing Variant: GCE(Bert), which uses BERT for skill embedding, achieved the highest scores across most scenarios.
  • Significant Improvements: GCE(Bert) showed improvements of up to 0.25 in P@20, 0.21 in MAP@20, and 0.16 in NDCG@20 compared to the best text-based model (BERT). It also outperformed GE(Bert) by 0.23 in P@20, 0.13 in MAP@20, and 0.11 in NDCG@20.
  • Scenario-Specific Performance: The GCE model was particularly effective for users with no prior course or work experience (Scenarios 1 and 4), suggesting that their input is less noisy and more directly influential.

Limitations and Future Work

The authors acknowledge several limitations and propose future directions:

  • Limited Skill Overlap: A significant challenge is the low overlap (only 79 skills) between the course and job skill vocabularies in their dataset.
  • Single Dataset Validation: The study primarily used one education and one job dataset. Future work will involve validating the model on more diverse datasets.
  • Improving Graph Quality: Future research aims to enhance the heterogeneous graph by:
  • Unifying skill terms and classifications using external knowledge bases (e.g., Wikipedia).
  • Adding new node types (e.g., companies, instructors) and edge types (e.g., salary information).
  • More Complex Ranking Models: The current study used a simple graph ranking model. Future work will explore more sophisticated graph ranking models and learning algorithms to further boost recommendation performance.
  • Leveraging User Feedback: Incorporating user feedback will be crucial for training models and improving recommendation accuracy.

Summary updated

Abstract

With millions of students/employees browsing course information and job postings every day, the need for accurate, effective, meaningful, and transparent course and job recommender systems is more evident than ever. The current recommendation research has attracted wide attention in the academic and industrial areas. However, existing studies primarily focus on content analysis and user feature extraction of courses or jobs and fail to investigate the problem of cross-domain data integration between career and education. At the same time, it also fails to fully utilize the relations between courses, skills, and jobs, which helps to improve the accuracy of the recommendation. Therefore, this study aims to propose a novel cross-domain recommendation model that can help students/employees search for suitable courses and jobs. Employing a heterogeneous graph and community detection algorithm, this study presents the Graph-Community-Enabled (GCE) model that merges course profiles and recruiting information data. Specifically, to address the skill difference between occupation and curriculum, the skill community calculated by the community detection algorithm is used to connect curriculum and job information. Then, the innovative heterogeneous graph approach and the random walk algorithm enable cross-domain information recommendation. The proposed model is evaluated on real job datasets from recruitment websites and the course datasets from MOOCs and higher education. Experiments show that the model is obviously superior to the classical baselines. The approach described can be replicated in a variety of education/career situations.
BibTeX
@inproceedings{zhu2022graph,
  author = {Guo‐Qing Zhu and Yan Chen and Shutian Wang},
  title = {{Graph-Community-Enabled Personalized Course-Job Recommendations with Cross-Domain Data Integration}},
  booktitle = {Sustainability},
  year = {2022},
  doi = {10.3390/su14127439},
}
Figure