Skip to main content
Kent Academic Repository

Deep labeller: automatic bounding box generation for synthetic violence detection datasets

Nadeem, Muhammad Shahroz, Kurugollu, Fatih, Saravi, Sara, Atlam, Hany F., Franqueira, Virginia N. L. (2023) Deep labeller: automatic bounding box generation for synthetic violence detection datasets. Multimedia Tools and Applications, 83 (4). pp. 10717-10734. ISSN 1573-7721. (doi:10.1007/s11042-023-15621-5) (KAR id:101823)

Abstract

Manually labelling datasets for training violence detection systems is time-consuming, expensive, and labor-intensive. Mind wandering, boredom, and short attention span can also cause labelling errors. Moreover, collecting and distributing sensitive images containing violence has ethical implications. Automation is the future for labelling sensitive image datasets. Deep labeller is a two-stage Deep Learning (DL) method that uses pre-trained DL object detection methods on MS-COCO for automatic labelling. The Deep Labeller method labels violent and nonviolent images in WVD and USI. In stage 1, WVD generates weak labels using synthetic images. In stage 2, the Deep labeller method is retrained on weak labels. USI dataset is used to test our method on real-world violence. Deep labeller generated weak and strong labels with an IoU of 0.80036 in stage 1 and 0.95 in stage 2 on the WVD. Automatically generated labels. To test our method’s generalisation power, violent and nonviolent image labels on USI dataset had a mean IoU of 0.7450.

Item Type: Article
DOI/Identification number: 10.1007/s11042-023-15621-5
Uncontrolled keywords: Data labelling · Violence detection · WVD · USI · Synthetic virtual violence
Subjects: Q Science > Q Science (General) > Q335 Artificial intelligence
Q Science > QA Mathematics (inc Computing science)
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
University-wide institutes > Institute of Cyber Security for Society
Funders: University of Kent (https://ror.org/00xkeyj56)
Depositing User: Virginia Franqueira
Date Deposited: 24 Jun 2023 12:51 UTC
Last Modified: 11 Jan 2024 12:26 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/101823 (The current URI for this page, for reference purposes)

University of Kent Author Information

Franqueira, Virginia N. L..

Creator's ORCID: https://orcid.org/0000-0003-1332-9115
CReDIT Contributor Roles:
  • Depositors only (login required):

Total unique views for this document in KAR since July 2020. For more details click on the image.