Simple Log Service:Logtail configurations (Legacy)

sensitive_keys parameters

• Parameters

  Parameter	Type	Required	Example	Description
  key	string	Yes	content	The name of the log field.
  type	string	Yes	const	The data masking method. Valid values: const: Replaces sensitive content with the value of the const field. md5: Replaces sensitive content with its corresponding MD5 hash.
  regex_begin	string	Yes	'password':'	Regex prefix for locating sensitive content. Uses RE2 syntax.
  regex_content	string	Yes	[^']*	Regex for the sensitive content. Uses RE2 syntax.
  all	boolean	Yes	true	Whether to replace all sensitive content in the field. true (recommended): Replaces all sensitive content. false: Replaces only the first match.
  const	string	No	"********"	This parameter is required if you set type to const.

• Configuration example

  For example, if the value of the content field in a log is [{'account':'1812213231432969','password':'04a23f38'}, {'account':'1812213685634','password':'123a'}], you can replace the value of the password field with ******** by setting sensitive_keys as follows.

  sensitive_keys = [{"all": true,
  "const": "********",
  "regex_content": "[^']*",
  "regex_begin": "'password':'",
  "type": "const",
  "key": "content"}]                    

• Sample log

  [{'account':'1812213231432969','password':'********'}, {'account':'1812213685634','password':'********'}]

Advanced parameters

Basic parameters

Full regex and simple mode parameters

• Parameters

  Parameter	Type	Required	Example	Description
  key	array	Yes	["content"]	Field names for the raw log content.
  logBeginRegex	string	No	.*	Regex for the start of a log entry.
  regex	string	No	(.*)	Regex for field extraction.

• Configuration example

  {
      "configName": "logConfigName", 
      "outputType": "LogService", 
      "inputType": "file", 
      "inputDetail": {
          "logPath": "/logPath", 
          "filePattern": "*", 
          "logType": "common_reg_log", 
          "topicFormat": "default", 
          "discardUnmatch": false, 
          "enableRawLog": true, 
          "fileEncoding": "utf8", 
          "maxDepth": 10, 
          "key": [
              "content"
          ], 
          "logBeginRegex": ".*", 
          "regex": "(.*)"
      }, 
      "outputDetail": {
          "projectName": "test-project", 
          "logstoreName": "test-logstore"
      }
  }

JSON mode parameters

Delimiter mode parameters

• Parameters

  Parameter	Type	Required	Example	Description
  separator	string	No	,	Choose the separator matching your log format. Collect logs in delimiter mode.
  quote	string	Yes	\	Quote character for wrapping fields that contain the separator. Enclosed content is parsed as one field. Collect logs in delimiter mode.
  key	array	Yes	[ "ip", "time"]	Field names for the raw log content.
  timeKey	string	Yes	time	Field from the key list to use as the time field.
  autoExtend	boolean	No	true	Whether to upload when split fields are fewer than configured keys. For example, a log is 11|22|33|44|55, the separator is a vertical bar (|), and the log content is parsed into 11, 22, 33, 44, and 55. The keys are set to A, B, C, D, and E respectively. true: When collecting the log 11|22|33|55, 55 is uploaded to Simple Log Service as the value for key D. false: When collecting the log 11|22|33|55, this log entry is discarded because the number of fields does not match the number of keys.

• Configuration example

  {
      "configName": "logConfigName", 
      "logSample": "testlog", 
      "inputType": "file", 
      "outputType": "LogService", 
      "inputDetail": {
          "logPath": "/logPath", 
          "filePattern": "*", 
          "logType": "delimiter_log", 
          "topicFormat": "default", 
          "discardUnmatch": true, 
          "enableRawLog": true, 
          "fileEncoding": "utf8", 
          "maxDepth": 999, 
          "separator": ",", 
          "quote": "\"", 
          "key": [
              "ip", 
              "time"
          ], 
          "autoExtend": true
      }, 
      "outputDetail": {
          "projectName": "test-project", 
          "logstoreName": "test-logstore"
      }
  }