edit-icon download-icon

Parameter description

Last Updated: Oct 20, 2017

The following parameter configurations can be used in Hadoop code:

Attribute Name Default Value Description
fs.oss.accessKeyId None AccessKey ID needed for the access to OSS (optional).
fs.oss.accessKeySecret None AccessKey Secret needed for the access to OSS (optional).
fs.oss.securityToken None STS token needed for the access to OSS (optional).
fs.oss.endpoint None The endpoint for the access to OSS (optional).
Fs.oss.multipart.thread.number 5 Concurrency of OSS upload part copy.
fs.oss.copy.simple.max.byte 134217728 The size ceiling of the files for the copy within OSS using general interface.
fs.oss.multipart.split.max.byte 67108864 The size ceiling of the file slices for the copy within OSS using general interface.
fs.oss.multipart.split.number 5 The number of the file slices for the copy within OSS using general interface. By default, it is consistent with the copy concurrency.
fs.oss.impl com.aliyun.fs.oss.nat.NativeOssFileSystem OSS file system implementation class.
fs.oss.buffer.dirs /mnt/disk1,/mnt/disk2,… The local temporary files directory of OSS. By default, the data disk of the cluster is used.
fs.oss.buffer.dirs.exists false Whether the temporary files directory of OSS is ensured to exist.
Fs.oss.client.connection.timeout 50000 Connection timeout of the OSS Client (Unit: millisecond).
fs.oss.client.socket.timeout 50000 The socket timeout of the OSS Client (Unit: millisecond).
fs.oss.client.connection.ttl -1 Connection survival time.
fs.oss.connection.max 1024 The maximum connection count.
io.compression.codec.snappy.native false Identify whether the Snappy file is a standard Snappy file. By default, Hadoop recognizes Hadoop-modified Snappy files.
Thank you! We've received your feedback.