Container Service for Kubernetes:Build an AI Q&A assistant with Dify

1. Configure the prompt: Copy the following content into the Instructions field. Prompts improve response accuracy with instructions and constraints.

   You will act as Dify's AI assistant, dedicated to answering customers' questions about Dify products and their features. Your responses should be based on the existing knowledge base to ensure accuracy. If a question is beyond your knowledge, please honestly inform them that you do not know the answer, in order to maintain the integrity of the information. Please communicate in a friendly and warm tone, and feel free to use emoticons appropriately to enhance the interactive experience.

2. Add the knowledge base to the context: Click Add in the Context area to add the knowledge base, enabling accurate and professional answers.

3. Click Releases > Update to save and apply the configuration.

1. Publicly shared website.

   The AI application you create with Dify can be published as a web application accessible on the internet, which will operate based on your prompt and orchestration settings. For more information, see Publish as a public web app.

2. API-based calls.

   Dify provides APIs for all applications based on the "Backend-as-a-Service" concept, allowing developers to leverage the power of large language models in their front-end applications without worrying about complex back-end architecture and deployment. For more information, see Develop with APIs.

3. Redevelopment based on front-end components.

   If you are developing a new product from scratch or are in the prototype design phase, use Dify to quickly publish an AI site. For more information, see Redevelop based on front-end components.

4. Embedding in your enterprise or personal website.

   Dify supports embedding your AI application into your business website. Use this capability to create an official AI customer service, business Q&A, and other applications with your business data in minutes. For more information, see Embed in a website.

Example: Embed into a website

Embed your LLM application into an enterprise or personal website.

This example is for demonstration purposes. For data security in a production environment, also enable the Access Control feature.

1. Enable public access for the ack-dify service and open the external IP in your browser. For more information, see Access the Dify service.

   

2. Quickly build a simple web application in your ACK cluster to debug your AI Q&A assistant.

   This deploys a web application on your ACK cluster to host the embedded Dify LLM application.

   1. Get the Dify service code.

      As shown in the figure, choose a method to embed the chat application's code into your website.

   2. In the cluster, create a Deployment to run your web application and create a Service to expose it.

      The following is a simple YAML example that shows how to deploy an Nginx server with static HTML.

      1. Log on to the Container Service for Kubernetes (ACK) console. On the ConfigMaps page, set the namespace to default, and then click Create from YAML. Copy the YAML content below into the template and modify the window.difyChatbotConfig, src, and id parameters based on the Dify service code that you have obtained.

         See the example below.

         YAML content

         apiVersion: apps/v1
         kind: Deployment
         metadata:
           name: web-deployment
         spec:
           replicas: 2
           selector:
             matchLabels:
               app: web
           template:
             metadata:
               labels:
                 app: web
             spec:
               containers:
               - name: web
                 image: registry.openanolis.cn/openanolis/nginx:1.14.1-8.6
                 ports:
                 - containerPort: 80
                 volumeMounts:
                 - name: web-content
                   mountPath: /usr/share/nginx/html
               volumes:
               - name: web-content
                 configMap:
                   name: web-config
           
         
         ---
         apiVersion: v1
         kind: Service
         metadata:
           name: web-service
         spec:
           selector:
             app: web
           ports:
             - protocol: TCP
               port: 80
               targetPort: 80
           type: LoadBalancer
         
         
         ---
         apiVersion: v1
         kind: ConfigMap
         metadata:
           name: web-config
         data:
           index.html: |
             <!DOCTYPE html>
             <html lang="en">
             <head>
                 <meta charset="UTF-8">
                 <meta name="viewport" content="width=device-width, initial-scale=1.0">
                 <title>The simplest website service</title>
                 <style>
                     #dify-chatbot-bubble-button {
                         background-color: #1C64F2 !important;
                     }
                 </style>
             </head>
             <body>
                 <h1>Welcome to my website!</h1>
             
             
                 <script>
                  window.difyChatbotConfig = {
                   token: 'W1b8mRL******yiD6',
                   baseUrl: 'http://8.154.XX.XX'
                  }
                 </script>
                 <script
                  src="http://8.154.XX.XX/embed.min.js"
                  id="W1b8mRL******yiD6"
                  defer>
                 </script>
                 <style>
                   #dify-chatbot-bubble-button {
                     background-color: #1C64F2 !important;
                   }
                 </style>
         
         
         
             </body>
             </html>

      2. Check the deployment status. The deployment succeeds when both pods are in the Running state.

      3. Enable public access for the deployed service.

         For data security in a production environment, we recommend that you also enable the Access Control feature.

         

         After configuration, you will see the External IP of the web-service service. Open this IP in your browser.

         

         Important

         • If you want other devices to access the service, make sure your cluster's firewall or security group allows traffic on port 80. For more information, see Add a security group rule.

         • Ensure your code and third-party code are secure to prevent potential XSS or malicious code embedding. This is a basic example for demonstration purposes only; you can expand and modify it based on your needs.

      4. Example Result.