Predictive Modeling for Occupational Safety Outcomes and Days Away from Work Analysis in Mining Operations

Anurag Desai Yedla, Fatemeh Davoudi Kakhki, Ali JannesariInternational Journal of Environmental Research and Public Health 2020 · DOI

TL;DR

This paper explores using machine learning to predict occupational safety outcomes and days away from work in the mining industry. It demonstrates that analyzing unstructured text narratives from accident reports, rather than just structured tabular data, significantly improves the prediction of injury outcomes, highlighting the rich information contained in these narratives.

What Problem Does This Paper Address?

The mining industry is notoriously hazardous, with a significant number of accidents and injuries occurring annually. While efforts are made to improve safety, predicting the severity and outcome of these incidents remains a challenge. Traditional safety analysis often relies on structured data, which may not capture the full context of an accident. This paper addresses the need for more effective predictive models by investigating the utility of machine learning, particularly by leveraging the often-underutilized textual descriptions of mining accidents. The goal is to identify factors that lead to severe injuries and predict the duration of lost workdays, ultimately aiming to enhance safety management and reduce workplace incidents.

Methods

The researchers employed several machine learning techniques, including Logistic Regression, Decision Trees, Random Forests, and Artificial Neural Networks (ANNs). A key aspect of their methodology was training these models on two distinct types of data:

  • Fixed Field Entries: This refers to the structured, tabular data typically found in accident reports (e.g., accident type, body part injured, occupation).
  • Injury Narratives: This involves the unstructured text descriptions of how accidents occurred. To process these narratives, they utilized Word Embeddings (specifically Word2vec) to convert words into numerical vectors, capturing semantic relationships. These word vectors were then combined with TF-IDF scores to create narrative representations.

To address the common issue of imbalanced datasets in safety analysis, they also implemented synthetic data augmentation using word embeddings. This technique aimed to generate more training data for underrepresented injury classes. The performance of all models was evaluated using metrics like Accuracy and F1 Score for classification tasks (injury outcome) and Mean Squared Error (MSE) and Root Mean Squared Error (RMSE) for regression tasks (days away from work).

Datasets

The primary dataset used in this study was the Mine Safety and Health Administration (MSHA) accident injuries dataset. This publicly available dataset contains information on accidents reported by mine operators and contractors in the US from 2000 to 2018. The dataset includes both structured (fixed field) entries and unstructured narrative descriptions of the accidents. The authors pre-processed this dataset by removing irrelevant columns and handling missing values.

Key Insights and Ideas

  • Narratives Hold Crucial Information: The most significant finding is that models trained on accident narratives consistently outperformed those trained solely on structured tabular data for predicting the outcome of an injury. This suggests that the descriptive details in narratives contain valuable context not captured by structured fields alone.
  • Word Embeddings Unlock Textual Data: The use of Word2vec and TF-IDF to represent narratives as numerical vectors was crucial for enabling machine learning models to process and learn from the textual data.
  • Data Augmentation Helps, But with Caveats: Synthetic data augmentation using word embeddings showed promise in improving the F1 scores for underrepresented classes, particularly for ANNs. However, it also led to a slight decrease in overall performance for some models, suggesting that the generation of "fake" narratives needs careful tuning.
  • Different Data for Different Tasks: While narratives excelled at predicting injury outcomes, structured tabular data (specifically including time-related features like shift start and accident time, and experience) proved more effective for predicting days away from work.

Key Results

  • Injury Outcome Prediction: Random Forest models trained on injury narratives achieved the highest F1 score (0.93) and accuracy (93%) among all models tested for predicting injury outcomes. ANNs also showed strong performance with narratives.
  • Days Away from Work Prediction: Artificial Neural Networks (ANNs) trained on fixed field entries demonstrated the best performance, with the lowest RMSE (0.62), for predicting days away from work.
  • Feature Importance: For predicting injury outcomes using fixed field data, the "Nature of Injury" was identified as the most influential feature, followed by "Injured body part" and "Occupation."

Limitations and Future Work

The authors acknowledge several limitations:

  • Lack of Weather Data: The dataset did not include weather-related features, which could potentially impact injury severity.
  • Missing Demographic Data: Information on injured workers' demographics (like age and gender) was not available, preventing an analysis of their influence on injury outcomes.
  • No Probabilistic Risk Analysis by Gender: The absence of gender data limits the ability to perform a probabilistic risk analysis based on gender.

Future work suggested includes:

  • Exploring deep learning techniques like Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) for text analysis.
  • Investigating Generative Adversarial Networks (GANs) for more advanced text generation and data augmentation to tackle class imbalance.
  • Incorporating weather-related features and demographic data into future models.
  • Developing models for estimating the probability of each days-away-from-work class based on incident features.

Summary updated

Abstract

Mining is known to be one of the most hazardous occupations in the world. Many serious accidents have occurred worldwide over the years in mining. Although there have been efforts to create a safer work environment for miners, the number of accidents occurring at the mining sites is still significant. Machine learning techniques and predictive analytics are becoming one of the leading resources to create safer work environments in the manufacturing and construction industries. These techniques are leveraged to generate actionable insights to improve decision-making. A large amount of mining safety-related data are available, and machine learning algorithms can be used to analyze the data. The use of machine learning techniques can significantly benefit the mining industry. Decision tree, random forest, and artificial neural networks were implemented to analyze the outcomes of mining accidents. These machine learning models were also used to predict days away from work. An accidents dataset provided by the Mine Safety and Health Administration was used to train the models. The models were trained separately on tabular data and narratives. The use of a synthetic data augmentation technique using word embedding was also investigated to tackle the data imbalance problem. Performance of all the models was compared with the performance of the traditional logistic regression model. The results show that models trained on narratives performed better than the models trained on structured/tabular data in predicting the outcome of the accident. The higher predictive power of the models trained on narratives led to the conclusion that the narratives have additional information relevant to the outcome of injury compared to the tabular entries. The models trained on tabular data had a lower mean squared error compared to the models trained on narratives while predicting the days away from work. The results highlight the importance of predictors, like shift start time, accident time, and mining experience in predicting the days away from work. It was found that the F1 score of all the underrepresented classes except one improved after the use of the data augmentation technique. This approach gave greater insight into the factors influencing the outcome of the accident and days away from work.
BibTeX
@article{yedla2020predictive,
  author = {Anurag Desai Yedla and Fatemeh Davoudi Kakhki and Ali Jannesari},
  title = {{Predictive Modeling for Occupational Safety Outcomes and Days Away from Work Analysis in Mining Operations}},
  journal = {International Journal of Environmental Research and Public Health},
  year = {2020},
  doi = {10.3390/ijerph17197054},
}
Figure