Physical Threat Detection: Enhancing Security for Businesses
This project is from team GenY-AI, which was awarded the Second Prize in the Alibaba Cloud Singapore AI Hackathon.

Project Introduction
The project aims to develop a disrupting application that leverages AI, GenAI, and machine learning to enhance detection capabilities and provide real-time VoIP alerts to security personnel on site for suspicious behaviors. This will allow businesses to proactively respond to security threats efficiently.
Project Value
- Wide range of suspicious behavior recognition: Existing solutions are limited in the number of types of suspicious behaviors that can be detected. Our solution attempts to expand this range by training it on significant amounts of CCTV footage.
- Real-time alerts: Existing solutions perform suspicious behavior recognition on past CCTV footage and do not incorporate any preventive attempts. Our solution incorporates real-time alerts such that immediate actions can be taken.
- On-demand modifications: Regarding deployment, clients may require changes to the application based on various reasons (e.g. lighting condition of the site, differing requirements, etc). Our solution provides a co-pilot that allows clients to perform such changes themselves, thereby removing the need for continuous engineer involvement.
Solution
- Action recognition module: We utilize a 3D-convolution based classifier to classify a person's action based on a sequence of frames of that person. The model is trained to classify based on a wide range of suspicious behavior. We also made optimizations to ensure the model's ability to run in real time.
- Real-time alert system: Following the classifications from 1, we also provide real-time alerts when a person's behavior is detected as suspicious/threatening. An image-to-text model (PromptCap) is also utilized to provide text description of the detected suspect. Finally, we utilize a text-to-speech model (Intelligent Speech Interaction) to convert the textual descriptions to audio, which is then sent to security personnel on-site for immediate actionability.
- On-demand modifications: We incorporate a text-to-python module (Qwen-7B) to allow on-demand modifications to our application to suit the client’s needs. The user simply needs to insert a textual prompt (e.g. add "running" to the list of suspicious behavior) and the text-to-python module will make changes to the application to incorporate the requested feature without interrupting execution.
Technology Highlights
We utilized PAI to deploy our Qwen instance. While our image-to-text (Promptcap) and action recognition models are not from Alibaba, we also utilized PAI for those models. In particular, we utilized PAI to train our action recognition model, as well as to host Promptcap to perform inference.
Alibaba Cloud Products Used
About the Team
Hendricks Corp is committed to more than just delivering software or services. We are dedicated to our client’s mission and business needs. We adopt your goals and make them our own to drive success for our clients. This personal commitment, combined with our own values, allows Hendricks Corp to offer a comprehensive portfolio of innovative and intelligent AI and video solutions and services for the commercial, government, and private sectors.
With over 20 years of experience, our quality starts with the people providing our solutions. Hendricks Corp’s culture is to take personal pride and consistently strive for excellence in all our endeavors.
Read previous post:
Read next post:
-
-
Alibaba Cloud Project Hub
148 posts | 29 followers
Follow
Comments
-
-
Alibaba Cloud Project Hub
148 posts | 29 followers
Follow
Related Products
-
QwenWork
QwenWork is dedicated to helping employees strengthen their professional competitiveness in the AI era and to enabling enterprises to improve organizational effectiveness.
Learn More -
Token Plan
Build more, spend less. One plan, every modality.
Learn More -
Alibaba Cloud Model Studio
A one-stop generative AI platform to build intelligent applications that understand your business, based on Qwen model series such as Qwen-Max and other popular models
Learn More -
Qoder
From Assisted to Autonomous — Adapting to Every Programming Need
Learn More
More Posts by Alibaba Cloud Project Hub
- Aftershock: The Disaster Simulator That Grades Qwen Agent Societies
- NaLog Agronomist Agent: An Agronomist With Perfect Memory in Every Farmer's Pocket
- FORGE: The Hands-Free Voice Copilot for the Technician With Greasy Gloves
- Split Decision: Nine AI Judges, Two AI Journalists, and a Verdict You Can Verify
- Dailies: The Quality-Control Layer AI Video Was Missing
- Qwen Memory Agent: Treating Memory as a Measurable Engineering Problem
- Drama916: Cinematic Vertical Stories, Without the Crew
- ColdGuard: Is This Vaccine Safe, or Has It Already Degraded?
- Sentinel Qwen Ensemble: The Autonomous Forensic Investigator That Can't Bluff
- Tarmac: Five AI Agents Negotiate the Storm, and One Mediator Signs the Ruling