Skip to main content

Exploring the Touch and Motion Features in Game-Based Cognitive Assessments

Intarasirisawat, Jittrapol, Ang, Chee Siang, Efstratiou, Christos, Dickens, Luke, Page, Rupert (2019) Exploring the Touch and Motion Features in Game-Based Cognitive Assessments. Journal of Interactive, Mobile, Wearable and Ubiquitous Technologies, 3 (3). Article Number 87. ISSN 2474-9567. (doi:10.1145/3351245) (KAR id:75919)

PDF Author's Accepted Manuscript
Language: English
Download (3MB) Preview
[thumbnail of Exploring the Touch and Motion Features in Game-Based Cognitive_Final.pdf.pdf]
This file may not be suitable for users of assistive technology.
Request an accessible format
Official URL


Early detection of cognitive decline is important for timely intervention and treatment strategies to prevent further dete- rioration or development of more severe cognitive impairment, as well as identify at risk individuals for research. In this paper, we explore the feasibility of using data collected from built-in sensors of mobile phone and gameplay performance in mobile-game-based cognitive assessments. Twenty-two healthy participants took part in the two-session experiment where they were asked to take a series of standard cognitive assessments followed by playing three popular mobile games in which user-game interaction data were passively collected. The results from bivariate analysis reveal correlations between our proposed features and scores obtained from paper-based cognitive assessments. Our results show that touch gestural interaction and device motion patterns can be used as supplementary features on mobile game-based cognitive measurement. This study provides initial evidence that game related metrics on existing off-the-shelf games have potential to be used as proxies for conventional cognitive measures, specifically for visuospatial function, visual search capability, mental flexibility, memory and attention.

Item Type: Article
DOI/Identification number: 10.1145/3351245
Uncontrolled keywords: cognitive assessment, serious games, mobile health
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 75 Electronic computers. Computer science
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Engineering and Digital Arts
Depositing User: Jim Ang
Date Deposited: 21 Aug 2019 10:52 UTC
Last Modified: 16 Feb 2021 14:06 UTC
Resource URI: (The current URI for this page, for reference purposes)
Ang, Chee Siang:
Efstratiou, Christos:
  • Depositors only (login required):


Downloads per month over past year