Simple Log Service:Instal LoongCollector di Kubernetes

Kluster ACK yang sudah ada

1. Masuk ke Konsol ACK. Di panel navigasi kiri, klik Clusters.

2. Di halaman Clusters, klik nama kluster Anda. Di panel navigasi kiri, klik Components and Add-ons.

3. Di tab Logs and Monitoring, temukan LoongCollector, lalu klik Install.

4. Setelah instalasi, SLS secara otomatis membuat resource berikut di wilayah kluster, yang dapat dilihat di Konsol Simple Log Service.

   Type	Parameter	Deskripsi
   Project	k8s-log-${cluster_id}	Unit manajemen sumber daya yang mengisolasi log dari layanan berbeda.
   machine group	k8s-group-${cluster_id}	Machine group untuk pengumpulan log loongcollector-ds.
   	k8s-group-${cluster_id}-cluster	Machine group untuk pengumpulan metrik loongcollector-cluster.
   	k8s-group-${cluster_id}-singleton	Machine group untuk pengumpulan instans tunggal.

   Penting

   LoongCollector tidak membuat LogStore bernama config-operation-log. Jika sudah ada, LoongCollector tidak menulis ke dalamnya.

Kluster ACK baru

Tugas berumur pendek (Job/CronJob)

# 1. Tunggu LoongCollector siap
echo "[$(date)] Aplikasi: Menunggu LoongCollector siap..."
until [[ -f /tasksite/cornerstone ]]; do
  sleep 1
done
echo "[$(date)] Aplikasi: LoongCollector siap, memulai logika aplikasi"
# 2. Jalankan logika inti aplikasi (pastikan log ditulis ke direktori bersama)
echo "Hello, World!" >> /app/logs/business.log
# 3. Simpan kode keluar
retcode=$?
echo "[$(date)] Aplikasi: Tugas selesai dengan kode keluar: $retcode"
# 4. Beri tahu LoongCollector bahwa tugas aplikasi selesai
touch /tasksite/tombstone
echo "[$(date)] Aplikasi: Tombstone dibuat, keluar"
exit $retcode

Layanan berumur panjang (Deployment / StatefulSet)

# Definisikan fungsi penanganan sinyal
_term_handler() {
    echo "[$(date)] [nginx-demo] Menerima SIGTERM, memulai shutdown mulus..."
    # Kirim sinyal QUIT ke Nginx untuk berhenti mulus
    if [ -n "$NGINX_PID" ]; then
        kill -QUIT "$NGINX_PID" 2>/dev/null || true
        echo "[$(date)] [nginx-demo] Mengirim SIGQUIT ke PID Nginx: $NGINX_PID"
        # Tunggu Nginx berhenti secara mulus
        wait "$NGINX_PID"
        EXIT_CODE=$?
        echo "[$(date)] [nginx-demo] Nginx berhenti dengan kode keluar: $EXIT_CODE"
    fi
    # Beri tahu LoongCollector bahwa kontainer aplikasi telah berhenti
    echo "[$(date)] [nginx-demo] Menulis file tombstone"
    touch /tasksite/tombstone
    exit $EXIT_CODE
}
# Daftarkan penanganan sinyal
trap _term_handler SIGTERM SIGINT SIGQUIT
# Tunggu LoongCollector siap
echo "[$(date)] [nginx-demo]: Menunggu LoongCollector siap..."
until [[ -f /tasksite/cornerstone ]]; do 
    sleep 1
done
echo "[$(date)] [nginx-demo]: LoongCollector siap, memulai logika aplikasi"
# Mulai Nginx
echo "[$(date)] [nginx-demo] Memulai Nginx..."
nginx -g 'daemon off;' &
NGINX_PID=$!
echo "[$(date)] [nginx-demo] Nginx dimulai dengan PID: $NGINX_PID"
# Tunggu proses Nginx
wait $NGINX_PID
EXIT_CODE=$?
# Juga beri tahu LoongCollector jika keluar bukan karena sinyal
if [ ! -f /tasksite/tombstone ]; then
    echo "[$(date)] [nginx-demo] Keluar tak terduga, menulis tombstone"
    touch /tasksite/tombstone
fi
exit $EXIT_CODE

Tugas berumur pendek (Job/CronJob)

apiVersion: batch/v1
kind: Job
metadata:
  name: demo-job
spec:
  backoffLimit: 3                   
  activeDeadlineSeconds: 3600        
  completions: 1                     
  parallelism: 1                    
  template:
    spec:
      restartPolicy: Never         
      terminationGracePeriodSeconds: 300 
      containers:
        # Kontainer aplikasi
        - name: demo-job
          image: debian:bookworm-slim
          command: ["/bin/bash", "-c"]
          args:
            - |
              # Tunggu LoongCollector siap.
              echo "[$(date)] Bisnis: Menunggu LoongCollector siap..."
              until [[ -f /tasksite/cornerstone ]]; do 
                sleep 1
              done
              echo "[$(date)] Bisnis: LoongCollector siap, memulai logika bisnis"
              # Jalankan logika aplikasi.
              echo "Hello, World!" >> /app/logs/business.log
              # Simpan kode keluar.
              retcode=$?
              echo "[$(date)] Bisnis: Tugas selesai dengan kode keluar: $retcode"
              # Beri tahu LoongCollector bahwa tugas selesai.
              touch /tasksite/tombstone
              echo "[$(date)] Bisnis: Tombstone dibuat, keluar"
              exit $retcode
          # Permintaan dan batas resource
          resources:
            requests:
              cpu: "100m"
              memory: "128Mi"
            limits:
              cpu: "500"
              memory: "512Mi"
          # mount volume
          volumeMounts:
            - name: app-logs
              mountPath: /app/logs
            - name: tasksite
              mountPath: /tasksite
        # Kontainer sidecar LoongCollector
        - name: loongcollector
          image: aliyun-observability-release-registry.cn-hongkong.cr.aliyuncs.com/loongcollector/loongcollector:v3.1.1.0-20fa5eb-aliyun
          command: ["/bin/bash", "-c"]
          args:
            - |
              echo "[$(date)] LoongCollector: Memulai inisialisasi"
              # Mulai layanan LoongCollector.
              /etc/init.d/loongcollectord start
              # Tunggu konfigurasi diunduh dan layanan siap.
              sleep 15
              # Verifikasi status layanan.
              if /etc/init.d/loongcollectord status; then
                echo "[$(date)] LoongCollector: Layanan berhasil dimulai"
                touch /tasksite/cornerstone
              else
                echo "[$(date)] LoongCollector: Gagal memulai layanan"
                exit 1
              fi
              # Tunggu kontainer aplikasi selesai.
              echo "[$(date)] LoongCollector: Menunggu kontainer bisnis selesai"
              until [[ -f /tasksite/tombstone ]]; do 
                sleep 2
              done
              echo "[$(date)] LoongCollector: Bisnis selesai, menunggu transmisi log"
              # Beri waktu cukup untuk mengirim log yang tersisa.
              sleep 30
              echo "[$(date)] LoongCollector: Menghentikan layanan"
              /etc/init.d/loongcollectord stop
              echo "[$(date)] LoongCollector: Shutdown selesai"
          # pemeriksaan kesehatan
          livenessProbe:
            exec:
              command: ["/etc/init.d/loongcollectord", "status"]
            initialDelaySeconds: 30
            periodSeconds: 10
            timeoutSeconds: 5
            failureThreshold: 3
          # Permintaan dan batas resource
          resources:
            requests:
              cpu: "100m"
              memory: "128Mi"
            limits:
              cpu: "500m"
              memory: "512Mi"
          # variabel lingkungan
          env:
            - name: ALIYUN_LOGTAIL_USER_ID
              value: "your-user-id"
            - name: ALIYUN_LOGTAIL_USER_DEFINED_ID
              value: "your-user-defined-id"
            - name: ALIYUN_LOGTAIL_CONFIG
              value: "/etc/ilogtail/conf/cn-hongkong/ilogtail_config.json"
            - name: ALIYUN_LOG_ENV_TAGS
              value: "_pod_name_|_pod_ip_|_namespace_|_node_name_"
            # Suntikkan metadata pod.
            - name: "_pod_name_"
              valueFrom:
                fieldRef:
                  fieldPath: metadata.name
            - name: "_pod_ip_"
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP
            - name: "_namespace_"
              valueFrom:
                fieldRef:
                  fieldPath: metadata.namespace
            - name: "_node_name_"
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
          # mount volume
          volumeMounts:
            - name: app-logs
              mountPath: /app/logs
              readOnly: true
            - name: tasksite
              mountPath: /tasksite
            - name: tz-config
              mountPath: /etc/localtime
              readOnly: true
      # Definisi volume
      volumes:
        - name: app-logs
          emptyDir: {}
        - name: tasksite
          emptyDir:
            medium: Memory
            sizeLimit: "10Mi"
        - name: tz-config
          hostPath:
            path: /usr/share/zoneinfo/Asia/Shanghai

Layanan berumur panjang (Deployment / StatefulSet)

apiVersion: apps/v1
kind: Deployment
metadata:
  name: nginx-demo
  namespace: production
  labels:
    app: nginx-demo
    version: v1.0.0
spec:
  replicas: 3
  strategy:
    type: RollingUpdate
    rollingUpdate:
      maxUnavailable: 1      
      maxSurge: 1          
  selector:
    matchLabels:
      app: nginx-demo
  template:
    metadata:
      labels:
        app: nginx-demo
        version: v1.0.0    
    spec:
      terminationGracePeriodSeconds: 600  # Periode shutdown mulus 10 menit
      containers:
        # Kontainer aplikasi - Aplikasi web
        - name: nginx-demo
          image: anolis-registry.cn-zhangjiakou.cr.aliyuncs.com/openanolis/nginx:1.14.1-8.6          
          # Perintah startup dan penanganan sinyal
          command: ["/bin/sh", "-c"]
          args:
            - |
              # Definisikan penanganan sinyal.
              _term_handler() {
                  echo "[$(date)] [nginx-demo] Menerima SIGTERM, memulai shutdown mulus..."
                  # Kirim sinyal QUIT ke Nginx untuk berhenti mulus.
                  if [ -n "$NGINX_PID" ]; then
                      kill -QUIT "$NGINX_PID" 2>/dev/null || true
                      echo "[$(date)] [nginx-demo] Mengirim SIGQUIT ke PID Nginx: $NGINX_PID"
                      # Tunggu Nginx berhenti secara mulus.
                      wait "$NGINX_PID"
                      EXIT_CODE=$?
                      echo "[$(date)] [nginx-demo] Nginx berhenti dengan kode keluar: $EXIT_CODE"
                  fi
                  # Beri tahu LoongCollector bahwa kontainer aplikasi telah berhenti.
                  echo "[$(date)] [nginx-demo] Menulis file tombstone"
                  touch /tasksite/tombstone
                  exit $EXIT_CODE
              }
              # Daftarkan penanganan sinyal.
              trap _term_handler SIGTERM SIGINT SIGQUIT
              # Tunggu LoongCollector siap.
              echo "[$(date)] [nginx-demo]: Menunggu LoongCollector siap..."
              until [[ -f /tasksite/cornerstone ]]; do 
                sleep 1
              done
              echo "[$(date)] [nginx-demo]: LoongCollector siap, memulai logika bisnis"
              # Mulai Nginx.
              echo "[$(date)] [nginx-demo] Memulai Nginx..."
              nginx -g 'daemon off;' &
              NGINX_PID=$!
              echo "[$(date)] [nginx-demo] Nginx dimulai dengan PID: $NGINX_PID"
              # Tunggu proses Nginx keluar.
              wait $NGINX_PID
              EXIT_CODE=$?
              # Jika proses keluar tanpa sinyal, beri tahu LoongCollector.
              if [ ! -f /tasksite/tombstone ]; then
                  echo "[$(date)] [nginx-demo] Keluar tak terduga, menulis tombstone"
                  touch /tasksite/tombstone
              fi
              exit $EXIT_CODE
          # Permintaan dan batas resource
          resources:
            requests:
              cpu: "200m"
              memory: "256Mi"
            limits:
              cpu: "1000m"
              memory: "1Gi"
          # mount volume
          volumeMounts:
            - name: nginx-logs
              mountPath: /var/log/nginx
            - name: tasksite
              mountPath: /tasksite
            - name: tz-config
              mountPath: /etc/localtime
              readOnly: true
        # Kontainer sidecar LoongCollector
        - name: loongcollector
          image: aliyun-observability-release-registry.cn-shenzhen.cr.aliyuncs.com/loongcollector/loongcollector:v3.1.1.0-20fa5eb-aliyun
          command: ["/bin/bash", "-c"]
          args:
            - |
              echo "[$(date)] LoongCollector: Memulai inisialisasi"
              # Mulai layanan LoongCollector.
              /etc/init.d/loongcollectord start
              # Tunggu konfigurasi diunduh dan layanan siap.
              sleep 15
              # Verifikasi status layanan.
              if /etc/init.d/loongcollectord status; then
                echo "[$(date)] LoongCollector: Layanan berhasil dimulai"
                touch /tasksite/cornerstone
              else
                echo "[$(date)] LoongCollector: Gagal memulai layanan"
                exit 1
              fi
              # Tunggu kontainer aplikasi selesai.
              echo "[$(date)] LoongCollector: Menunggu kontainer bisnis selesai"
              until [[ -f /tasksite/tombstone ]]; do 
                sleep 2
              done
              echo "[$(date)] LoongCollector: Bisnis selesai, menunggu transmisi log"
              # Beri waktu cukup untuk mengirim log yang tersisa.
              sleep 30
              echo "[$(date)] LoongCollector: Menghentikan layanan"
              /etc/init.d/loongcollectord stop
              echo "[$(date)] LoongCollector: Shutdown selesai"
          # pemeriksaan kesehatan
          livenessProbe:
            exec:
              command: ["/etc/init.d/loongcollectord", "status"]
            initialDelaySeconds: 30
            periodSeconds: 10
            timeoutSeconds: 5
            failureThreshold: 3
          # Permintaan dan batas resource
          resources:
            requests:
              cpu: "100m"
              memory: "128Mi"
            limits:
              cpu: "2000m"
              memory: "2048Mi"
          # variabel lingkungan
          env:
            - name: ALIYUN_LOGTAIL_USER_ID
              value: "${your_aliyun_user_id}"
            - name: ALIYUN_LOGTAIL_USER_DEFINED_ID
              value: "${your_machine_group_user_defined_id}"
            - name: ALIYUN_LOGTAIL_CONFIG
              value: "/etc/ilogtail/conf/${your_region_config}/ilogtail_config.json"
            # Aktifkan mode full drain untuk mengirim semua log saat pod berhenti.
            - name: enable_full_drain_mode
              value: "true"
            # Tambahkan informasi lingkungan pod sebagai tag log.
            - name: "ALIYUN_LOG_ENV_TAGS"
              value: "_pod_name_|_pod_ip_|_namespace_|_node_name_|_node_ip_"
            # Dapatkan informasi pod dan node.
            - name: "_pod_name_"
              valueFrom:
                fieldRef:
                  fieldPath: metadata.name
            - name: "_pod_ip_"
              valueFrom:
                fieldRef:
                  fieldPath: status.podIP
            - name: "_namespace_"
              valueFrom:
                fieldRef:
                  fieldPath: metadata.namespace
            - name: "_node_name_"
              valueFrom:
                fieldRef:
                  fieldPath: spec.nodeName
            - name: "_node_ip_"
              valueFrom:
                fieldRef:
                  fieldPath: status.hostIP
          # mount volume
          volumeMounts:
            - name: nginx-logs
              mountPath: /var/log/nginx
              readOnly: true
            - name: tasksite
              mountPath: /tasksite
            - name: tz-config
              mountPath: /etc/localtime
              readOnly: true
      # Definisi volume
      volumes:
        - name: nginx-logs
          emptyDir: {}
        - name: tasksite
          emptyDir:
            medium: Memory
            sizeLimit: "50Mi"
        - name: tz-config
          hostPath:
            path: /usr/share/zoneinfo/Asia/Shanghai