Nadeem, Muhammad Shahroz, Kurugollu, Fatih, Saravi, Sara, Atlam, Hany F., Franqueira, Virginia N. L. (2023) Deep labeller: automatic bounding box generation for synthetic violence detection datasets. Multimedia Tools and Applications, 83 (4). pp. 10717-10734. ISSN 1573-7721. (doi:10.1007/s11042-023-15621-5) (KAR id:101823)
PDF
Publisher pdf
Language: English
This work is licensed under a Creative Commons Attribution 4.0 International License.
|
|
Download this file (PDF/2MB) |
Preview |
Request a format suitable for use with assistive technology e.g. a screenreader | |
Official URL: https://doi.org/10.1007/s11042-023-15621-5 |
Abstract
Manually labelling datasets for training violence detection systems is time-consuming, expensive, and labor-intensive. Mind wandering, boredom, and short attention span can also cause labelling errors. Moreover, collecting and distributing sensitive images containing violence has ethical implications. Automation is the future for labelling sensitive image datasets. Deep labeller is a two-stage Deep Learning (DL) method that uses pre-trained DL object detection methods on MS-COCO for automatic labelling. The Deep Labeller method labels violent and nonviolent images in WVD and USI. In stage 1, WVD generates weak labels using synthetic images. In stage 2, the Deep labeller method is retrained on weak labels. USI dataset is used to test our method on real-world violence. Deep labeller generated weak and strong labels with an IoU of 0.80036 in stage 1 and 0.95 in stage 2 on the WVD. Automatically generated labels. To test our method’s generalisation power, violent and nonviolent image labels on USI dataset had a mean IoU of 0.7450.
Item Type: | Article |
---|---|
DOI/Identification number: | 10.1007/s11042-023-15621-5 |
Uncontrolled keywords: | Data labelling · Violence detection · WVD · USI · Synthetic virtual violence |
Subjects: |
Q Science > Q Science (General) > Q335 Artificial intelligence Q Science > QA Mathematics (inc Computing science) |
Divisions: |
Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing University-wide institutes > Institute of Cyber Security for Society |
Funders: | University of Kent (https://ror.org/00xkeyj56) |
Depositing User: | Virginia Franqueira |
Date Deposited: | 24 Jun 2023 12:51 UTC |
Last Modified: | 11 Jan 2024 12:26 UTC |
Resource URI: | https://kar.kent.ac.uk/id/eprint/101823 (The current URI for this page, for reference purposes) |
- Link to SensusAccess
- Export to:
- RefWorks
- EPrints3 XML
- BibTeX
- CSV
- Depositors only (login required):