Smart Surveillance Systems: a Transformer-Based Approach for Recognizing Suspicious Activities

Amidst the expanding landscape of the Internet of Things (IoT), integrating intelligent surveillance systems within smart environments is crucial for enhancing public safety and security. This study presents a transformer-based activity recognition (TAR) system that leverages IoT enabled surveillance to autonomously detect and localize suspicious activities in real time. The system utilizes the ResNet 50 architecture for feature extraction and the Detection Transformer (DETR) for precise activity detection. The system was developed using a custom dataset of 6684 images, collected from diverse surveillance environments and augmented to improve training. The dataset encompasses both suspicious and non-suspicious activities, ensuring broad representation. Key performance metrics, including precision, recall, mean average precision (mAP), class loss, box loss, and generalized intersection over union (GIoU), were evaluated to assess the system’s efficacy. The model achieves an accuracy of 91.07