Download PDFOpen PDF in browser

Automated Gaze Recognition within a Block-based Sensor Data Analytics Platform for Construction Students

9 pagesPublished: May 26, 2024

Abstract

The construction industry is increasingly harnessing sensing technologies to overcome manual data collection limitations and address the need for advanced data analysis. This places an aggravated demand for associated skills to interpret sensor data. Yet, a substantial gap exists between the level of academic preparation and the actual needs of the industry, leading to an underprepared workforce. In this study, ActionSens, a Block-Based Programming Environment, is implemented as an educational tool that combines sensor data from Inertial Measurement Units with machine learning algorithms. This integration enables the classification of construction activities, offering construction students a platform to explore and learn about sensor data analytics. However, in a pedagogical setting, an enhanced learning experience can be achieved through the integration of automated classification models that intelligently detect learners’ focus with the potential to provide context-specific support. This study utilizes 19 construction students’ eye-tracking data to train and evaluate machine learning models to detect learners’ visual focus on specific Areas of Interest within ActionSens. Ensemble, Neural Network, and K-Nearest Neighbor performed the best for both raw and SMOTE-oversampled datasets. The Ensemble had an edge in recognizing Areas of Interest, achieving top precision, recall, F1-score, and AUC in the oversampled data.

Keyphrases: block programming, data analytics, eye tracking, machine learning, sensor data

In: Tom Leathem, Wes Collins and Anthony Perrenoud (editors). Proceedings of 60th Annual Associated Schools of Construction International Conference, vol 5, pages 175-183.

BibTeX entry
@inproceedings{ASC2024:Automated_Gaze_Recognition_within,
  author    = {Mohammad Khalid and Abiola Akanmu and Adedeji Afolabi and Homero Murzi and Ibukun Awolusi},
  title     = {Automated Gaze Recognition within a Block-based Sensor Data Analytics Platform for Construction Students},
  booktitle = {Proceedings of 60th Annual Associated Schools of Construction International Conference},
  editor    = {Tom Leathem and Wes Collins and Anthony Perrenoud},
  series    = {EPiC Series in Built Environment},
  volume    = {5},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2632-881X},
  url       = {/publications/paper/JHm1},
  doi       = {10.29007/98tm},
  pages     = {175-183},
  year      = {2024}}
Download PDFOpen PDF in browser