Queen SDK is a smart retouching SDK developed by Alibaba's video cloud team. This SDK provides a wide range of features including image retouching, face retouching, chroma key, stickers, makeup, gesture recognition, body shaping, hairdressing, and augmented reality (AR) writing. You can use these features in live streaming, video conferencing, and short video production scenarios. This topic describes the benefits, core features, and scenarios of Queen SDK.

Introduction

Alibaba Cloud Queen SDK is an easy-to-use smart retouching SDK that provides a variety of powerful features. Queen SDK adopts the in-house intelligent vision algorithm, and face and human body detection and recognition technologies. It provides video creators with editing and processing capabilities such as basic face retouching, advanced face retouching, face shaping, makeup, stickers, chroma key, and gesture and posture recognition on mobile devices and PCs. Queen SDK provides sufficient capabilities to meet the diverse retouching requirements during live streaming and video production.

Benefits

  • The proprietary facial keypoint detection technology can recognize 106 basic points and 280 high-accuracy points. This technology makes retouching effects more vivid.
  • The intelligent vision algorithm and real-time rendering technology are optimized on a regular basis to continuously improve user experience.
  • Face retouching and shaping effects, filters, stickers, and materials are continuously updated and improved to provide more options for retouching.
  • Comprehensive developer support provides timely solutions to issues, and ensures the reliability of services.

Features

Feature Description
Face retouching Supports auto face retouching and manual face retouching. Auto face retouching provides five intensity levels. Manual face retouching allows you to whiten and smoothen the skin, add rosy cheeks, sharpen images, remove eye bags, nasolabial folds, wrinkles, cervical stripes, and forehead wrinkles, whiten teeth, brighten eyes, apply lipstick and blush, and brighten the skin. You can adjust the intensity level for each effect.
Face shaping Supports auto face shaping and manual face shaping. Auto face shaping provides five types of styles. Manual face shaping supports the following effects:
  • One-way shaping: You can slim faces and lower jaws, narrow cheekbones, enlarge and widen eyes, and make smiles.
  • Two-way shaping: You can adjust the length of faces, chins, and philtrums, the width of chins, the thickness of lips, the distance between eyes, and the position of hairlines. You can also shape lips and canthi, and resize noses and nose wings.
Makeup Supports auto makeup and manual makeup. Auto makeup provides five styles, such as vitality, charm, vigor, and elegance. Manual makeup provides five effects: highlight, eye color change, lipstick, eye makeup, and blush. You can adjust the intensity level for each effect. Makeup effects follow faces based on facial movements and expressions.
Filters Provides 34 filters. More filters will be provided in the future. Real-time rendering is supported for a better user experience.
Stickers Provides static and animated stickers. Dozens of stickers are provided. More stickers will be provided in the future. Stickers well fit faces and follow faces based on expressions and movements in real time.
Chroma key Supports both the blue screen and green screen for chroma key. Human bodies can be recognized and extracted from the background from all angles, even if the background is busy and the human bodies are moving.
Background replacement Supports background replacement in real life. Human bodies can be recognized and extracted from the background from all angles, even if the background is busy and the human bodies are moving.
Gesture recognition Accurately detects and captures key points of hands and gesture movements, and recognizes 25 mainstream gestures such as number, heart, fist, claw, and Vulcan salute and a variety of dynamic gestures.
Movement detection Identifies 13 static postures such as raising hands, hand heart, arms akimbo, and superman pose, and 9 movements including rope jumping, jumping jack, squat, arm circle, diamond stretch, chest stretch, sit-up, push-up, and kneeling push-up. These postures and movements are counted in real time.
Auto face retouching Supports intelligent adjustment of retouching parameters in different background environments, and calculates the most suitable retouching parameters in real time based on objective conditions such as the background, light, and skin color.
Body shaping Allows you to slim bodies, legs, arms, necks, and waists, lengthen legs, resize heads, and enlarge breasts. The natural body shaping effects make bodies well-proportioned.
Hairdressing Accurately identifies hair areas in various postures and background environments, and provides eight hair colors.
AR writing Tracks hand and finger movements to allow you to write and draw in the air in real time. This feature can be used in a variety of business scenarios such as live streaming, teaching, and advanced interaction. Examples of advanced interaction include lucky draw, red envelope, and quiz.

Common scenarios

  • Live streaming

    Applies to various live streaming scenarios that require real-time retouching.

  • Long and short videos

    Provides a rich set of effects for video production to meet your business requirements.

  • Online education

    Helps teachers improve their appearance in the class. The natural retouching effects make teachers look more approachable.

  • Video conferencing

    Provides real-time retouching and interaction effects during video conferences.