TIGEREYE, Inc. is developing a multimodal AI platform designed to address social challenges leveraging AI's "eyes" and "ears", adhering to its vision of "from recognition to communication". The company provides AI agents that can "understand and communicate" in real time by integrating recognition-based AI, such as facial recognition, skeleton estimation, emotion analysis, speech understanding, and natural language processing (NLP), with large language models (LLMs) and speech synthesis technology.

▶ Watch the full interview

The biggest challenge was providing Japanese language support. Specifically, TIGEREYE's unique prompt rule design and LoRA fine-tuning were essential for accurately interpreting Japanese layout during optical character recognition (OCR) and managing the mix of honorific and colloquial language in Office Agent.

Alibaba Cloud was chosen for its processing power capability to run LLMs and a reliable support system. Close collaboration with Alibaba Cloud's technical support engineers enabled quick confirmation and responses to inquiries not addressed in manuals or online resources, such as specific sizing details.

The following outcomes were attained by calibrating Qwen as a "local LLM" and leveraging high-performance processing capability for accelerated learning.

● TTS/Voice Cloning: Reduced learning time by 25%, significantly improving the naturalness of synthesized speech.
● Dual OCR: Improved form classification accuracy by 12%. This capability is currently being tested and implemented in local public service sectors and medical institutions.
● Office Agent LLM: Increased dialogue success rate to over 87% in internal business support scenarios, such as Slack integration and application assistance.

TIGEREYE aims to continue enhancing Japanese language support across models, data, and evaluation. It strives to optimize the use of computing resources by advancing GPU schedulers and reservation control. Additionally, it will focus on optimizing Qwen's RAG model and expanding voice input/output features to enhance the product's completeness.

Furthermore, the company aims to strengthen its collaboration with the marketing and Go-to-Market strategies to commercialize generative AI. TIGEREYE looks forward to deepening its partnership with Alibaba Cloud and working together to shape this emerging industry.