AzureBlobIngestionConfigurationSource

Updated at:
Copy as MD

Parameter

Type

Description

Example

object

Contains the configuration for ingesting data from Azure Blob Storage.

compressionCodec

string

The compression codec for the source data. Valid values are none, snappy, and gzip.

none

encoding

string

The character encoding of the source files.

UTF-8

interval

string

The interval at which to check for new files to ingest.

30m

pattern

string

A pattern used to filter files by path.

.*

prefix

string

The file path prefix used to filter files.

prefix

tagPackId

boolean

Specifies whether to enable context query.

false

startTime

integer

Ingests only files modified after this time, specified as a Unix timestamp.

1714274081

endTime

integer

Ingests only files modified before this time, specified as a Unix timestamp.

1714360481

timeField

string

The source field for the time value.

__time__

timeFormat

string

The format of the time field.

yyyy-MM-dd HH:mm:ss

timePattern

string

The pattern used to extract the time value.

[0-9]{0,2}\/[0-9a-zA-Z]+\/[0-9:,]+

timeZone

string

The time zone of the time field.

GMT+08:00

processorId

string

The ID of the processor that receives the data.

ingest-processor-1756802123-953901

accountName

string

The name of the Azure Blob Storage account.

test001

accountKey

string

The access key for the Azure Blob Storage account.

dGVzdGtleQ==

containerName

string

The name of the container in Azure Blob Storage.

test-container

endpoint

string

The service endpoint for Azure Blob Storage.

https://your-storage.blob.core.windows.net

format

object

The format of the source data.

any

Defines the properties of the data format.

{"type": "line"}

advancedParameters

object

any