Queen SDK overview

Updated at:
Copy as MD

Queen SDK is a smart retouching SDK developed by the Alibaba Cloud video cloud team. It provides image retouching, face retouching, chroma key, stickers, makeup, gesture recognition, body shaping, hairdressing, and AR writing on Android, iOS, and web for live streaming, video conferencing, and short video production. Queen SDK supports mobile and web platforms.

Introduction

Queen SDK uses proprietary vision algorithms for face and body detection and recognition. Queen SDK provides basic and advanced face retouching, face shaping, makeup, stickers, chroma key, and gesture and posture recognition on Android, iOS, and web. You can use it on Android, iOS, and web.

Benefits

  • Proprietary facial keypoint detection: 106 basic points and 280 high-accuracy points for vivid retouching.

  • Regularly optimized vision algorithms with real-time rendering.

  • Continuously updated effects, filters, stickers, and materials.

  • Comprehensive developer support with timely issue resolution.

Features

Feature

Description

Face retouching

Supports whole face (five styles) and manual retouching. Manual options: skin whitening, smoothing, brightening, rosy cheeks, sharpening, saturation and contrast adjustment, eye bag and wrinkle removal (neck, forehead, nasolabial folds), teeth whitening, eye brightening, lipstick, and blush. Intensity is adjustable for each effect.

Face shaping

Whole face shaping (five styles) and manual shaping with the following effects:

  • One-way shaping: slim faces, trim lower jaws, narrow cheekbones, enlarge and widen eyes, and add smiles.

  • Two-way shaping: adjust face length, chin length and width, philtrum length, lip thickness, eye distance, and hairline position. Also shapes lips, canthi (corners of the eyes), noses, and nose alae (lateral walls of the nose).

Makeup

Whole face makeup (simple, pure, vintage, mature) and manual makeup (lipstick, aegyo-sal, blush, eyebrow, highlight, eyeshadow, eyeliner, eyelash). Intensity is adjustable. Effects adapt to facial movements in real time.

Face play

Fun effects such as pixelation and facemasks based on face detection and tracking.

Filters

34 built-in filters with real-time rendering. More filters are added regularly.

Stickers

79 stickers (static and animated) that track faces and adapt to expressions in real time. New stickers are added regularly.

Chroma keying

Blue and green screen support. Separates the human body from complex backgrounds under various lighting conditions and angles with real-time tracking.

Image matting

Separates the human body from complex backgrounds under various lighting conditions and angles with real-time tracking for background replacement.

Note

Use this feature for background blur, transparent backgrounds, and background replacement.

Gesture recognition

Detects hand keypoints and recognizes 25 gestures (numbers, heart, fist, claw, Vulcan salute, and more) plus dynamic gestures.

Movement detection

Identifies 13 static postures (hand raising, hand heart, arms akimbo, superman pose, and more) and 9 movements (rope jumping, jumping jack, squat, arm circle, diamond stretch, chest stretch, sit-up, push-up, kneeling push-up). Counts repetitions in real time.

Body shaping

Slims bodies, legs, arms, necks, and waists, lengthens legs, resizes heads, and enlarges breasts. Natural effects produce well-proportioned results.

Hairdressing

Accurately identifies hair areas in various postures and background environments, and provides 8 hair colors.

AR writing

Tracks hand and finger movements to write or draw on screen in real time. Useful for live streaming, teaching, and interactive scenarios.

Animoji

Captures facial angles and expressions to animate characters. Supports 51 expressions including winking, blinking, and mouth, eye, and eyebrow movements.

Liveness detection

Verifies liveness by analyzing movements such as mouth opening, head shake to the right, and lifting or lowering the head.

Unusual behavior detection

Detects phone holding, earphone wearing, and display monitors. Also detects leaving the camera range, standing up, sitting down, and hand raising.

Face authentication and similarity check

Grades facial similarity from various angles using keypoint detection and feature calculation algorithms.

Use cases

  • Live streaming

    Real-time retouching for streamers.

  • Long and short videos

    Rich effects for video production.

  • Online education

    Natural retouching effects for teachers in online classes.

  • Video conferencing

    Real-time retouching and interaction effects for video calls.

Get started