Queen SDK overview
Queen SDK is a smart retouching SDK developed by the Alibaba Cloud video cloud team. It provides image retouching, face retouching, chroma key, stickers, makeup, gesture recognition, body shaping, hairdressing, and AR writing on Android, iOS, and web for live streaming, video conferencing, and short video production. Queen SDK supports mobile and web platforms.
Introduction
Queen SDK uses proprietary vision algorithms for face and body detection and recognition. Queen SDK provides basic and advanced face retouching, face shaping, makeup, stickers, chroma key, and gesture and posture recognition on Android, iOS, and web. You can use it on Android, iOS, and web.
Benefits
-
Proprietary facial keypoint detection: 106 basic points and 280 high-accuracy points for vivid retouching.
-
Regularly optimized vision algorithms with real-time rendering.
-
Continuously updated effects, filters, stickers, and materials.
-
Comprehensive developer support with timely issue resolution.
Features
|
Feature |
Description |
|
Face retouching |
Supports whole face (five styles) and manual retouching. Manual options: skin whitening, smoothing, brightening, rosy cheeks, sharpening, saturation and contrast adjustment, eye bag and wrinkle removal (neck, forehead, nasolabial folds), teeth whitening, eye brightening, lipstick, and blush. Intensity is adjustable for each effect. |
|
Face shaping |
Whole face shaping (five styles) and manual shaping with the following effects:
|
|
Makeup |
Whole face makeup (simple, pure, vintage, mature) and manual makeup (lipstick, aegyo-sal, blush, eyebrow, highlight, eyeshadow, eyeliner, eyelash). Intensity is adjustable. Effects adapt to facial movements in real time. |
|
Face play |
Fun effects such as pixelation and facemasks based on face detection and tracking. |
|
Filters |
34 built-in filters with real-time rendering. More filters are added regularly. |
|
Stickers |
79 stickers (static and animated) that track faces and adapt to expressions in real time. New stickers are added regularly. |
|
Chroma keying |
Blue and green screen support. Separates the human body from complex backgrounds under various lighting conditions and angles with real-time tracking. |
|
Image matting |
Separates the human body from complex backgrounds under various lighting conditions and angles with real-time tracking for background replacement. Note
Use this feature for background blur, transparent backgrounds, and background replacement. |
|
Gesture recognition |
Detects hand keypoints and recognizes 25 gestures (numbers, heart, fist, claw, Vulcan salute, and more) plus dynamic gestures. |
|
Movement detection |
Identifies 13 static postures (hand raising, hand heart, arms akimbo, superman pose, and more) and 9 movements (rope jumping, jumping jack, squat, arm circle, diamond stretch, chest stretch, sit-up, push-up, kneeling push-up). Counts repetitions in real time. |
|
Body shaping |
Slims bodies, legs, arms, necks, and waists, lengthens legs, resizes heads, and enlarges breasts. Natural effects produce well-proportioned results. |
|
Hairdressing |
Accurately identifies hair areas in various postures and background environments, and provides 8 hair colors. |
|
AR writing |
Tracks hand and finger movements to write or draw on screen in real time. Useful for live streaming, teaching, and interactive scenarios. |
|
Animoji |
Captures facial angles and expressions to animate characters. Supports 51 expressions including winking, blinking, and mouth, eye, and eyebrow movements. |
|
Liveness detection |
Verifies liveness by analyzing movements such as mouth opening, head shake to the right, and lifting or lowering the head. |
|
Unusual behavior detection |
Detects phone holding, earphone wearing, and display monitors. Also detects leaving the camera range, standing up, sitting down, and hand raising. |
|
Face authentication and similarity check |
Grades facial similarity from various angles using keypoint detection and feature calculation algorithms. |
Use cases
-
Live streaming
Real-time retouching for streamers.
-
Long and short videos
Rich effects for video production.
-
Online education
Natural retouching effects for teachers in online classes.
-
Video conferencing
Real-time retouching and interaction effects for video calls.
Get started
-
Download the Queen SDK demo to try it out.
-
Download Queen SDK and integrate it into your app.