Skip to main content

Exploring the Touch and Motion Features in Game-Based Cognitive Assessments

Intarasirisawat, Jittrapol, Ang, Chee Siang, Efstratiou, Christos, Dickens, Luke, Page, Rupert (2019) Exploring the Touch and Motion Features in Game-Based Cognitive Assessments. Journal of Interactive, Mobile, Wearable and Ubiquitous Technologies, 3 (3). ISSN 2474-9567. (In press) (doi:10.1145/3351245)

PDF - Author's Accepted Manuscript
Download (3MB) Preview Download (3MB)
Official URL


Early detection of cognitive decline is important for timely intervention and treatment strategies to prevent further dete- rioration or development of more severe cognitive impairment, as well as identify at risk individuals for research. In this paper, we explore the feasibility of using data collected from built-in sensors of mobile phone and gameplay performance in mobile-game-based cognitive assessments. Twenty-two healthy participants took part in the two-session experiment where they were asked to take a series of standard cognitive assessments followed by playing three popular mobile games in which user-game interaction data were passively collected. The results from bivariate analysis reveal correlations between our proposed features and scores obtained from paper-based cognitive assessments. Our results show that touch gestural interaction and device motion patterns can be used as supplementary features on mobile game-based cognitive measurement. This study provides initial evidence that game related metrics on existing off-the-shelf games have potential to be used as proxies for conventional cognitive measures, specifically for visuospatial function, visual search capability, mental flexibility, memory and attention.

Item Type: Article
DOI/Identification number: 10.1145/3351245
Uncontrolled keywords: cognitive assessment, serious games, mobile health
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 75 Electronic computers. Computer science
Divisions: Faculties > Sciences > School of Engineering and Digital Arts > Digital Media
Depositing User: Jim Ang
Date Deposited: 21 Aug 2019 10:52 UTC
Last Modified: 09 Feb 2020 04:11 UTC
Resource URI: (The current URI for this page, for reference purposes)
Ang, Chee Siang:
Efstratiou, Christos:
  • Depositors only (login required):


Downloads per month over past year