All Products
Search

This Product

    Simple Log Service:OSSIngestionConfigurationSource

    Document Center

    Simple Log Service:OSSIngestionConfigurationSource

    Last Updated:May 07, 2026

    Parameter

    Type

    Description

    Example

    object

    The configuration for ingesting data from OSS.

    endpoint

    string

    The OSS endpoint.

    oss-cn-hangzhou.aliyuncs.com
    bucket

    string

    The name of the OSS bucket.

    ossbucket
    compressionCodec

    string

    The compression type of the source files.

    none
    encoding

    string

    The encoding of the source files.

    UTF-8
    interval

    string

    The check interval for new files.

    never
    pattern

    string

    A regular expression to filter files by path.

    .*
    prefix

    string

    The path prefix for filtering files.

    prefix
    restoreObjectEnabled

    boolean

    Specifies whether to import archived files.

    true
    startTime

    integer

    Imports only files modified after this time. The value is a Unix timestamp in seconds.

    1714274081
    endTime

    integer

    Imports only files modified before this time. The value is a Unix timestamp in seconds.

    1714360481
    timeField

    string

    The field containing the log time.

    __time__
    timeFormat

    string

    The format of the time field.

    yyyy-MM-dd HH:mm:ss
    timePattern

    string

    The regular expression to extract the time value from a log.

    [0-9]{0,2}\/[0-9a-zA-Z]+\/[0-9:,]+
    timeZone

    string

    The time zone of the timestamp in the source data.

    GMT+08:00
    useMetaIndex

    boolean

    Specifies whether to use the OSS metadata index to accelerate file discovery.

    false
    roleARN

    string

    The Role ARN to use for accessing the OSS bucket.

    acs:ram::12345:role/aliyunlogdefaultrole
    tagPackId

    boolean

    Specifies whether to enable context retrieval.

    true
    processorId

    string

    The ID of the writer processor.

    ingest-processor-1756802123-953901
    format

    object

    Defines the format of the source data.

    any

    The data format of the objects in OSS.

    • Single-line Text Log: {"type":"Line"}

    • CSV:

    {
  "type": "CSV",
  "fieldDelimiter": ",",   // Delimiter
  "quoteChar": "\"",      // Quote character
  "escapeChar": "\\",    // Escape character
  "firstRowAsHeader": true,    // Use first row as header
  "maxLines": 1,    // Max lines per log
  "skipLeadingRows": 0   // Rows to skip at the beginning
}

    • Single-line JSON: {"type": "JSON"}

    • Multi-line Text Log:

    {
  "type": "Multiline",
  "match": "after", // Pattern matching position
  "pattern": "\\d+", // Regular expression
  "maxLines": 10 // Max lines per log
}

    • ORC: {"type": "ORC"}

    • Parquet: {"type": "Parquet"}

    • Alibaba Cloud OSS Access Log: {"type": "ossAccessLog"}

    • Alibaba Cloud CDN Download Log: {"type": "cdnDownloadedLog"}

    {"type": "Line"}
    advancedParameters

    object

    any