Prendinger, Helmut, Alvarez, Nahum, Sanchez-Ruiz, Antonio, Cavazza, Marc, Catarino, Joã, Prada, Rui, Fujimoto, Shuji, Shigematsu, Mika (2016) Intelligent Biohazard Training Based on Real-Time Task Recognition. ACM Transactions on Intelligent Interactive Systems, 6 (3). Article Number 21. ISSN 2160-6455. E-ISSN 2160-6463. (doi:10.1145/2883617) (Access to this publication is currently restricted. You may be able to access a copy if URLs are provided) (KAR id:57813)
PDF
Publisher pdf
Language: English Restricted to Repository staff only |
|
|
![]() |
Official URL: http://dx.doi.org/10.1145/2883617 |
Abstract
Virtual environments offer an ideal setting to develop intelligent training applications. Yet, their ability to support complex procedures depends on the appropriate integration of knowledge-based techniques and natural interaction. In this article, we describe the implementation of an intelligent rehearsal system for biohazard laboratory procedures, based on the real-time instantiation of task models from the trainee’s actions. A virtual biohazard laboratory has been recreated using the Unity3D engine, in which users interact with laboratory objects using keyboard/mouse input or hand gestures through a Kinect device. Realistic behavior for objects is supported by the implementation of a relevant subset of common sense and physics knowledge. User interaction with objects leads to the recognition of specific actions, which are used to progressively instantiate a task-based representation of biohazard procedures. The dynamics of this instantiation process supports trainee evaluation as well as real-time assistance. This system is designed primarily as a rehearsal system providing real-time advice and supporting user performance evaluation. We provide detailed examples illustrating error detection and recovery, and results from on-site testing with students from the Faculty of Medical Sciences at Kyushu University. In the study, we investigate the usability aspect by comparing interaction with mouse and Kinect devices and the effect of real-time task recognition on recovery time after user mistakes.
Item Type: | Article |
---|---|
DOI/Identification number: | 10.1145/2883617 |
Uncontrolled keywords: | Bio-safety risk management, training application, virtual worlds |
Subjects: |
Q Science > QA Mathematics (inc Computing science) > QA 76 Software, computer programming, > QA76.76.E95 Expert Systems (Intelligent Knowledge Based Systems) Q Science > QA Mathematics (inc Computing science) > QA 76 Software, computer programming, > QA76.9.H85 Human computer interaction |
Divisions: | Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Engineering and Digital Arts |
Depositing User: | Marc Cavazza |
Date Deposited: | 07 Oct 2016 14:40 UTC |
Last Modified: | 17 Aug 2022 12:21 UTC |
Resource URI: | https://kar.kent.ac.uk/id/eprint/57813 (The current URI for this page, for reference purposes) |
- Export to:
- RefWorks
- EPrints3 XML
- BibTeX
- CSV
- Depositors only (login required):