NotiMind: Utilizing Responses to Smart Phone Notifications as Affective sensors

Kanjo, Eiman and Kuss, Daria and Ang, Chee Siang (2017) NotiMind: Utilizing Responses to Smart Phone Notifications as Affective sensors. IEEE Access, . ISSN 2169-3536. E-ISSN 2169-3536. (doi:https://doi.org/10.1109/ACCESS.2017.2755661) (Full text available)

PDF - Author's Accepted Manuscript

Creative Commons Licence
This work is licensed under a Creative Commons Attribution 4.0 International License.
Download (2MB) Preview
[img]
Preview
Official URL
http://dx.doi.org/10.1109/ACCESS.2017.2755661

Abstract

Today’s mobile phone users are faced with large numbers of notifications on social media, ranging from new followers on Twitter and emails to messages received from WhatsApp and Facebook. These digital alerts continuously disrupt activities through instant calls for attention. This paper examines closely the way everyday users interact with notifications and their impact on users’ emotion. Fifty users were recruited to download our application NotiMind and use it over a five-week period. Users’ phones collected thousands of social and system notifications along with affect data collected via self-reported PANAS tests three times a day. Results showed a noticeable correlation between positive affective measures and keyboard activities. When large numbers of Post and Remove notifications occur, a corresponding increase in negative affective measures is detected. Our predictive model has achieved a good accuracy level using three different “in the wild” classifiers (F-measure 74-78% within- subject model, 72-76% global model). Our findings show that it is possible to automatically predict when people are experiencing positive, neutral or negative affective states based on interactions with notifications. We also show how our findings open the door to a wide range of applications in relation to emotion awareness on social and mobile communication.

Item Type: Article
Uncontrolled keywords: Mobile Sensing, Affective Computing, Mobile Computing, Mobile Social media, Machine Learning
Subjects: Q Science > QA Mathematics (inc Computing science) > QA 75 Electronic computers. Computer science
Divisions: Faculties > Sciences > School of Engineering and Digital Arts > Digital Media
Depositing User: Jim Ang
Date Deposited: 26 Sep 2017 13:47 UTC
Last Modified: 27 Sep 2017 08:57 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/63578 (The current URI for this page, for reference purposes)
  • Depositors only (login required):

Downloads

Downloads per month over past year