Elasticsearch를 사용한 새로운 AI 검색 솔루션
자세히 알아보기 >데이터 마이그레이션, 데이터 동기화, 데이터 분석
자세히 알아보기 >Alibaba Cloud Es가 Rag 기반 AI 검색을 향상시키는 방법
자세히 알아보기>● 벡터 검색
● 스파스 인코더 모델
● ML 추론: 감정, NER
● RRF를 통한 하이브리드 검색
● 서버리스를위한 새로운 아키텍처
혜택
-
2배의 비용 효율성
Alibaba Cloud 기반의 고성능 검색 엔진으로 자체 구축 솔루션 대비 2배의 비용 효율 제공.
-
높은 탄력성
최대 비즈니스 수요를 충족하는 뛰어난 탄력적 확장성으로 중단 없는 서비스와 시스템 안정성을 보장.
-
오픈소스 호환
기본 Elasticsearch 사용자는 서비스를 원활하게 전환하고 활용할 수 있어 비즈니스에 클라우드를 신속하게 도입 가능.
-
유지 보수 필요 없음
시스템 배포, 확장 및 경보 관리가 사용자 개입 없이 원활하게 처리되므로 비즈니스를 중단 없이 운영 가능.
특징
-
LLM과 통합된 AI 검색
LLM과 통합 된 AI 검색
BM25f 및 하이브리드 검색과 함께 최첨단 관련성 순위와 컨텍스트별 검색을 위한 사용자 지정 트랜스포머 모델 관리가 통합되어 있으며, Qwen과 같은 거대 언어 모델과의 통합을 통해 더욱 강화되었습니다.
-
고관련성 시맨틱 검색
고관련성 시맨틱 검색
모델 학습이 필요 없는 머신러닝 지원 검색을 제공하며, 고밀도 임베딩 생성 및 검색을 위해 Elasticsearch 벡터 데이터베이스를 활용하고 Learned Sparse Encoder를 통해 시맨틱 검색 기능을 제공합니다.
-
하이브리드 정보 검색
하이브리드 정보 검색
페타바이트 규모의 다국어 전체 텍스트 및 벡터 기반 검색을 RESTful API를 통해 빠른 응답으로 제공하며, 맞춤형 AI 검색 환경을 위해 Reciprocal Rank Fusion과 같은 하이브리드 랭킹 기술을 지원합니다.
-
자연어 처리(NLP)
자연어 처리(NLP)
광범위한 NLP 작업과 모델을 지원하여 고밀도 임베딩에 대한 검색과 타사 트랜스포머 모델을 사용할 수 있으며, AI 기반 데이터 애플리케이션 구축을 위한 LangChain과 같은 도구로 보완됩니다.
-
종합관리 플랫폼
종합관리 플랫폼
멀티 시나리오 모니터링을 위한 Kibana, 원격 계정 통합, 안전한 엔터프라이즈급 데이터 관리를 위한 RBAC 등 데이터 집계, 분석, 시각화를 위한 다양한 도구를 제공합니다
-
클라우드 네이티브 플랫폼의 우수성
클라우드 네이티브 플랫폼의 우수성
완전 관리형 클러스터, 고가용성, 탄력적 오케스트레이션, 라이프사이클 관리, 보안, Elastic.co와의 파트너십을 통한 비용 효율적인 서버리스 컴퓨팅 옵션을 갖춘 클라우드 네이티브 Elasticsearch 서비스가 특징입니다.
Function Comparison
Cloud-native operations management platform and engine enhancements based on advanced commercial features to provide higher performance and stability at a lower cost than open source
| Function Classification | Function | Function Description | Enterprise Version | Open Source Version |
|---|---|---|---|---|
AI Assistant |
Hybrid RAG |
Combining search and generation to improve answer accuracy | ✓ | ✕ |
|
Vector Search |
Efficiently optimizes the process of finding similar items in making it ideal for recommendation systems | ✓ | ✕ | |
|
Third-party ML Support |
Support the integration of custom machine learning models to adapt to specific needs | ✓ | ✕ | |
|
ELSER Semantic Search |
Enhance user experience by leveraging deep learning for accurate semantic search results | ✓ | ✕ | |
|
Observability Alerts |
Monitor observability in real-time and get timely alerts | ✓ | ✕ | |
|
Elastic Al Assistant Generative AI |
Generative Al insights and guidance throughout UI | ✓ | ✕ | |
|
Machine Learning Anomaly Detection |
Automatically identify anomalous patterns and behaviors in data using machine learning algorithms | ✓ | ✕ | |
Cluster O&M Management |
Flexible Matching and Expansion |
Support smooth one-click cluster resiliency scaling | ✓ | ✕ |
|
One-click Version Upgrade |
Support instance and kernel version upgrade | ✓ | ✕ | |
|
Data Backup and Disaster Recovery |
Multi-availability zones in the same city, off-site disaster recovery and automatic backup of data | ✓ | ✕ | |
|
Cluster Parameter Configuration |
Flexible YML/GC configuration and scenario-based configuration parameter templates | ✓ | ✕ | |
|
Cluster Plug-in Management |
Flexible installation of over 20 system plug-ins and customized plug-ins | ✓ | ✕ | |
|
Synonym and Split Word Upload |
Support uploading synonyms/subtitles and dynamic loading of OSS thesaurus | ✓ | ✕ | |
|
Logging and Monitoring Metrics |
Various types of cluster logs and cloud monitoring, advanced monitoring of fine-grained indicators of the large disk | ✓ | ✕ | |
|
Intelligent Operation and Maintenance |
Provide more than 20 diagnostic items of health testing to detect potential risks | ✓ | ✕ | |
Security Features |
VPC Access Whitelist |
Support VPC access, whitelist configuration and HTTPS access protocols | ✓ | ✕ |
|
Secure Encryption |
Static data storage encryption and SSL/TLS node transfer encryption | ✓ | ✕ | |
|
Access Authentication |
RAM-based access control and LDAP authentication | ✓ | ✕ | |
|
Privilege Control |
RBAC-based customized role and field level access rights | ✓ | ✕ | |
Stability |
Qos Rate Limiting Plugin |
Support configuration of cluster Index-Level read/write rate limiting for enhanced stability | ✓ | ✕ |
|
Slow Query Isolation Pool |
Cost tracking and logical Isolation of query requests for enhanced stability | ✓ | ✕ | |
|
Hot and Cold Query Isolation Plugin |
CPU and memory isolation and circuit breaker for shared nodes handling hot and cold queries | ✓ | ✕ | |
Performance Optimization |
Analyticsearch Retrieval Analysis |
Query concurrency optimization for dramatic query performance improvement | ✓ | ✕ |
|
Temporal Query Pruning |
Time-range data pruning to improve performance of temporal-ordered queries | ✓ | ✕ | |
|
Physical Replication Plugin |
Real-time incremental synchronization of master replica slices to improve write performance | ✓ | ✕ | |
|
Faster Bulk Write Aggregation Plugin |
Batching bulk write requests effectively increases cluster write throughput by aggregating multiple write operations into a single batch | ✓ | ✕ | |
Engine Features |
Indexing Service |
10X elastic index construction in the cloud and pay-as-you-write to reduce costs | ✓ | ✕ |
|
Openstore Intelligent Storage Engine |
Intelligent hybrid storage to eliminate the need for reserved storage capacity in reducing costs | ✓ | ✕ | |
|
Timestream Plugin for Time-Series Queries |
Time-Series data model and PromQL query enhace metrics read/write performance | ✓ | ✕ | |
| Index Compression Plugin | Reduction in index storage by over 40% based on multiple index compression algorithms | ✓ | ✕ | |
|
Alibabacloud-SQL Plugin |
Support for richer SQL query capabilities | ✓ | ✕ | |
|
AliNLP Tokenization Plugin |
Enhance tokenization capabilities by integrating DAMO Academy's NLP technology | ✓ | ✕ | |
|
ES|QL |
Generate charts of ESIQL query results | ✓ | ✕ |
AI Assistant
Hybrid RAG
Combining search and generation to improve answer accuracy
✓
✕
Vector Search
Efficiently optimizes the process of finding similar items in making it ideal for recommendation systems
✓
✕
Third-party ML Support
Support the integration of custom machine learning models to adapt to specific needs
✓
✕
ELSER Semantic Search
Enhance user experience by leveraging deep learning for accurate semantic search results
✓
✕
Observability Alerts
Monitor observability in real-time and get timely alerts
✓
✕
Elastic Al Assistant Generative AI
Generative Al insights and guidance throughout UI
✓
✕
Machine Learning Anomaly Detection
Automatically identify anomalous patterns and behaviors in data using machine learning algorithms
✓
✕
Cluster O&M Management
Flexible Matching and Expansion
Support smooth one-click cluster resiliency scaling
✓
✕
One-click Version Upgrade
Support instance and kernel version upgrade
✓
✕
Data Backup and Disaster Recovery
Multi-availability zones in the same city, off-site disaster recovery and automatic backup of data
✓
✕
Cluster Parameter Configuration
Flexible YML/GC configuration and scenario-based configuration parameter templates
✓
✕
Cluster Plug-in Management
Flexible installation of over 20 system plug-ins and customized plug-ins
✓
✕
Synonym and Split Word Upload
Support uploading synonyms/subtitles and dynamic loading of OSS thesaurus
✓
✕
Logging and Monitoring Metrics
Various types of cluster logs and cloud monitoring, advanced monitoring of fine-grained indicators of the large disk
✓
✕
Intelligent Operation and Maintenance
Provide more than 20 diagnostic items of health testing to detect potential risks
✓
✕
Security Features
VPC Access Whitelist
Support VPC access, whitelist configuration and HTTPS access protocols
✓
✕
Secure Encryption
Static data storage encryption and SSL/TLS node transfer encryption
✓
✕
Access Authentication
RAM-based access control and LDAP authentication
✓
✕
Privilege Control
RBAC-based customized role and field level access rights
✓
✕
Stability
Qos Rate Limiting Plugin
Support configuration of cluster Index-Level read/write rate limiting for enhanced stability
✓
✕
Slow Query Isolation Pool
Cost tracking and logical Isolation of query requests for enhanced stability
✓
✕
Hot and Cold Query Isolation Plugin
CPU and memory isolation and circuit breaker for shared nodes handling hot and cold queries
✓
✕
Performance Optimization
Analyticsearch Retrieval Analysis
Query concurrency optimization for dramatic query performance improvement
✓
✕
Temporal Query Pruning
Time-range data pruning to improve performance of temporal-ordered queries
✓
✕
Physical Replication Plugin
Real-time incremental synchronization of master replica slices to improve write performance
✓
✕
Faster Bulk Write Aggregation Plugin
Batching bulk write requests effectively increases cluster write throughput by aggregating multiple write operations into a single batch
✓
✕
Engine Features
Indexing Service
10X elastic index construction in the cloud and pay-as-you-write to reduce costs
✓
✕
Openstore Intelligent Storage Engine
Intelligent hybrid storage to eliminate the need for reserved storage capacity in reducing costs
✓
✕
Timestream Plugin for Time-Series Queries
Time-Series data model and PromQL query enhace metrics read/write performance
✓
✕
Reduction in index storage by over 40% based on multiple index compression algorithms
✓
✕
Alibabacloud-SQL Plugin
Support for richer SQL query capabilities
✓
✕
AliNLP Tokenization Plugin
Enhance tokenization capabilities by integrating DAMO Academy's NLP technology
✓
✕
ES|QL
Generate charts of ESIQL query results
✓
✕
고객 시나리오
-
AI 검색
-
로그/표시기 분석
-
웹 호스팅
-
보안
로그/표시기 분석
분석 시나리오
접속 로그 및 행동 로그를 분석하여 관련 지표를 신속하게 확보하고 이를 비즈니스 사용자에게 제공할 수 있습니다.
권장되는 서비스 통합
MaxCompute
웹 호스팅
검색 시나리오
사이트에서 데이터의 빠른 인덱싱을 수행하여 기존 데이터의 빠른 인덱싱 및 정확한 검색을 지원합니다.
권장되는 서비스 통합
ECS
보안
분석 시나리오
보안 비즈니스 로그용
