使用ListDoctorHDFSDirectories API批量擷取HDFS目錄分析結果-開源巨量資料平台 E-MapReduce-阿里雲 - E-MapReduce

透過EMR Doctor批次獲取特定目錄分析結果，目錄不超過5級。

介面說明

list Doctor HDFSNodes

調試

您可以在OpenAPI Explorer中直接運行該介面，免去您計算簽名的困擾。運行成功後，OpenAPI Explorer可以自動產生SDK程式碼範例。

調試

授權資訊

下表是API對應的授權資訊，可以在RAM權限原則語句的Action元素中使用，用來給RAM使用者或RAM角色授予調用此API的許可權。具體說明如下：

操作：是指具體的許可權點。
存取層級：是指每個操作的存取層級，取值為寫入（Write）、讀取（Read）或列出（List）。
資源類型：是指操作中支援授權的資源類型。具體說明如下：
- 對於必選的資源類型，用前面加 * 表示。
- 對於不支援資源級授權的操作，用全部資源表示。
條件關鍵字：是指雲產品自身定義的條件關鍵字。
關聯操作：是指成功執行操作所需要的其他許可權。操作者必須同時具備關聯操作的許可權，操作才能成功。

操作

存取層級

資源類型

條件關鍵字

關聯操作

emr:ListDoctorHDFSDirectories

list

*All Resource

*

無

請求參數

名稱	類型	必填	描述	樣本值
RegionId	string	是	地域 ID。	cn-hangzhou
ClusterId	string	是	叢集 ID。	c-b933c5aac8fe****
NextToken	string	否	標記當前開始讀取的位置。	DD6B1B2A-5837-5237-ABE4-FF0C89568980
MaxResults	integer	否	一次獲取的最大記錄數。	20
DateTime	string	是	其日期和時間資訊以 ISO 8601 格式表示，例如：2023 年 1 月 1 日為 2023-01-01。	2023-01-01
DirPath	string	否	目錄名稱。目錄不超過 5 級。如果不填寫，就是全量目錄分析。	/tmp/test
OrderType	string	否	排序方向。取值： ASC：升序排列 DESC：降序排列	ASC
OrderBy	string	否	排序依據。取值： totalFileCount: 總檔案個數。 largeFileCount: 大檔案個數。大檔案指的是 1 GB 以上大小的檔案。 mediumFileCount: 中檔案個數。中檔案指的是 128 MB 以上，1 GB 以下大小的檔案。 smallFileCount: 小檔案個數。小檔案指的是 10 MB 以上，128 MB 以下大小的檔案。 tinyFileCount: 極小檔案個數。極小檔案指的是 0 MB 以上，10 MB 以下大小的檔案。 emptyFileCount: 空檔案個數。空檔案指的是 0 MB 大小的檔案。 hotDataSize: 熱資料的資料量大小。熱資料指的是 7 日內有訪問的資料。 warmDataSize: 溫資料的資料量大小。溫資料指的是 7 日內沒有訪問的資料，但是 30 日以內有訪問的資料。 coldDataSize: 冷資料的資料量大小。冷資料指的是 30 日內沒有訪問的資料，但是 90 日以內有訪問的資料。 freezeDataSize: 極冷資料的資料量大小。極冷資料指的是 90 日以內都沒有訪問的資料。 totalDataSize: 總資料量大小。 totalFileDayGrowthCount: 總檔案個數日增量。 largeFileDayGrowthCount: 大檔案個數日增量。大檔案指的是 1 GB 以上大小的檔案。 mediumFileDayGrowthCount: 中檔案個數增量。比中檔案指的是 128 MB 以上，1 GB 以下大小的檔案。 smallFileDayGrowthCount: 小檔案個數日增量。小檔案指的是 10 MB 以上，128 MB 以下大小的檔案。 tinyFileDayGrowthCount: 極小檔案個數日增量。極小檔案指的是 0 MB 以上，10 MB 以下大小的檔案。 emptyFileDayGrowthCount: 空檔案個數日增量。空檔案指的是 0 MB 大小的檔案。 hotDataDayGrowthSize: 熱資料的資料量日增量大小。熱資料指的是 7 日內有訪問的資料。 warmDataDayGrowthSize: 溫資料的資料量日增量大小。溫資料指的是 7 日內沒有訪問的資料，但是 30 日以內有訪問的資料。 coldDataDayGrowthSize: 冷資料的資料量日增量大小。冷資料指的是 30 日內沒有訪問的資料，但是 90 日以內有訪問的資料。 freezeDataDayGrowthSize: 極冷資料的資料量日增量大小。極冷資料指的是 90 日以內都沒有訪問的資料。 totalDataDayGrowthSize: 全部資料的資料量日增量大小。 totalFileCountDayGrowthRatio: 總檔案個數日環比。 largeFileCountDayGrowthRatio: 大檔案個數日環比。大檔案指的是 1 GB 以上大小的檔案。 mediumFileCountDayGrowthRatio: 中檔案個數日環比。比中檔案指的是 128 MB 以上，1 GB 以下大小的檔案。 smallFileCountDayGrowthRatio: 小檔案個數日環比。小檔案指的是 10 MB 以上，128 MB 以下大小的檔案。 tinyFileCountDayGrowthRatio: 極小檔案個數日環比。極小檔案指的是 0 MB 以上，10 MB 以下大小的檔案。 emptyFileCountDayGrowthRatio: 空檔案個數日環比。空檔案指的是 0 MB 大小的檔案。	smallFileCount

返回參數

名稱	類型	描述	樣本值
	object	返回資料
Data	array<object>	HDFS 批次目錄分析資料。
	array<object>	HDFS 目錄分析資料。
DirPath	string	目錄名稱。	/tmp/test
Depth	integer	目錄層級。	2
User	string	目錄屬主。	DW
Group	string	目錄屬組。	DW
Metrics	object	指標資訊。
TotalFileCount	object
Name	string		totalFileCount
Value	integer		51683279
Unit	string		”“
Description	string		Number of total files
LargeFileCount	object
Name	string		largeFileCount
Value	integer		123
Unit	string		”“
Description	string		Number of large files
MediumFileCount	object
Name	string		mediumFileCount
Value	integer		323
Unit	string		”“
Description	string		Number of medium files
SmallFileCount	object
Name	string		smallFileCount
Value	integer		12345
Unit	string		”“
Description	string		Number of small files
TinyFileCount	object
Name	string		tinyFileCount
Value	integer		232131
Unit	string		""
Description	string		Number of tiny files
EmptyFileCount	object
Name	string		emptyFileCount
Value	integer		15595897
Unit	string		”“
Description	string		Number of empty files
HotDataSize	object
Name	string		hotDataSize
Value	integer		6701531944206
Unit	string		MB
Description	string		Size of the hot data size
WarmDataSize	object
Name	string		warmDataSize
Value	integer		4062349775577
Unit	string		MB
Description	string		Size of the warm data size
ColdDataSize	object
Name	string		coldDataSize
Value	integer		5570958082267
Unit	string		MB
Description	string		Size of the cold data size
FreezeDataSize	object
Name	string		freezeDataSize
Value	integer		1231312431
Unit	string		MB
Description	string		Size of the freeze data size
TotalDataSize	object
Name	string		totalDataSize
Value	integer		62086342083623
Unit	string		MB
Description	string		Total data size in megabytes (MB)
TotalFileDayGrowthCount	object
Name	string		totalFileDayGrowthCount
Value	integer		27809
Unit	string		”“
Description	string		Day growth count of total files
LargeFileDayGrowthCount	object
Name	string		largeFileDayGrowthCount
Value	integer		2
Unit	string		”“
Description	string		Day growth count of large files
MediumFileDayGrowthCount	object
Name	string		mediumFileDayGrowthCount
Value	integer		176
Unit	string		”“
Description	string		Day growth count of medium files
SmallFileDayGrowthCount	object
Name	string		smallFileDayGrowthCount
Value	integer		12345
Unit	string		”“
Description	string		Day growth count of small files
TinyFileDayGrowthCount	object
Name	string		tinyFileDayGrowthCount
Value	integer		-123
Unit	string		”“
Description	string		Day growth count of tiny files
EmptyFileDayGrowthCount	object
Name	string		emptyFileDayGrowthCount
Value	integer		114
Unit	string		”“
Description	string		Day growth count of empty files
HotDataDayGrowthSize	object
Name	string		hotDataDayGrowthSize
Value	integer		123154
Unit	string		MB
Description	string		Day growth size of hot data
WarmDataDayGrowthSize	object
Name	string		warmDataDayGrowthSize
Value	integer		-64806998319
Unit	string		MB
Description	string		Day growth size of warm data
ColdDataDayGrowthSize	object
Name	string		coldDataDayGrowthSize
Value	integer		-182636577752
Unit	string		MB
Description	string		Day growth size of cold data
FreezeDataDayGrowthSize	object
Name	string		freezeDataDayGrowthSize
Value	integer		-167683929450
Unit	string		MB
Description	string		Day growth size of freeze data
TotalDataDayGrowthSize	object
Name	string		totalDataDayGrowthSize
Value	integer		256482228248
Unit	string		MB
Description	string		Day growth size of total data
TotalFileCountDayGrowthRatio	object
Name	string		totalFileCountDayGrowthRatio
Value	number		0.02
Unit	string		”“
Description	string		Day growth ratio of total files
LargeFileCountDayGrowthRatio	object
Name	string		largeFileCountDayGrowthRatio
Value	number		0.39
Unit	string		”“
Description	string		Day growth ratio of large files
MediumFileCountDayGrowthRatio	object
Name	string		mediumFileCountDayGrowthRatio
Value	number		0.19
Unit	string		”“
Description	string		Day growth ratio of medium files
SmallFileCountDayGrowthRatio	object
Name	string		smallFileCountDayGrowthRatio
Value	number		0.02
Unit	string		”“
Description	string		Day growth ratio of small files
TinyFileCountDayGrowthRatio	object
Name	string		tinyFileCountDayGrowthRatio
Value	number		0.003
Unit	string		”“
Description	string		Day growth ratio of tiny files
EmptyFileCountDayGrowthRatio	object
Name	string		emptyFileCountDayGrowthRatio
Value	number		0.005
Unit	string		”“
Description	string		Day growth ratio of empty files
HotDataSizeDayGrowthRatio	object
Name	string		hotDataSizeDayGrowthRatio
Value	number		0.1114
Unit	string		”“
Description	string		Day growth ratio of hot data size
WarmDataSizeDayGrowthRatio	object
Name	string		warmDataSizeDayGrowthRatio
Value	number		-0.015
Unit	string		”“
Description	string		Day growth ratio of warm data size
ColdDataSizeDayGrowthRatio	object
Name	string		coldDataSizeDayGrowthRatio
Value	number		-0.03
Unit	string		”“
Description	string		Day growth ratio of cold data size
FreezeDataSizeDayGrowthRatio	object
Name	string		freezeDataSizeDayGrowthRatio
Value	number		-0.09
Unit	string		”“
Description	string		Day growth ratio of freeze data size
TotalDataSizeDayGrowthRatio	object
Name	string		totalDataSizeDayGrowthRatio
Value	number		0.14
Unit	string		”“
Description	string		Day growth ratio of total data size
RequestId	string	請求 ID。	DD6B1B2A-5837-5237-ABE4-FF0C8944****
NextToken	string	返回讀取到的資料位置。	DD6B1B2A-5837-5237-ABE4-FF0C89568980
MaxResults	integer	本次請求所返回的最大記錄條數。	20
TotalCount	integer	本次請求條件下的資料總量。	200

樣本

正常返回樣本

JSON格式

{
  "Data": [
    {
      "DirPath": "/tmp/test",
      "Depth": 2,
      "User": "DW",
      "Group": "DW",
      "Metrics": {
        "TotalFileCount": {
          "Name": "totalFileCount",
          "Value": 51683279,
          "Unit": "”“\n",
          "Description": "Number of total files\n"
        },
        "LargeFileCount": {
          "Name": "largeFileCount",
          "Value": 123,
          "Unit": "”“\n",
          "Description": "Number of large files\n"
        },
        "MediumFileCount": {
          "Name": "mediumFileCount",
          "Value": 323,
          "Unit": "”“\n",
          "Description": "Number of medium files\n"
        },
        "SmallFileCount": {
          "Name": "smallFileCount",
          "Value": 12345,
          "Unit": "”“\n",
          "Description": "Number of small files\n"
        },
        "TinyFileCount": {
          "Name": "tinyFileCount\n",
          "Value": 232131,
          "Unit": "\"\"",
          "Description": "Number of tiny files"
        },
        "EmptyFileCount": {
          "Name": "emptyFileCount",
          "Value": 15595897,
          "Unit": "”“\n",
          "Description": "Number of empty files"
        },
        "HotDataSize": {
          "Name": "hotDataSize",
          "Value": 6701531944206,
          "Unit": "MB\n",
          "Description": "Size of the hot data size\n"
        },
        "WarmDataSize": {
          "Name": "warmDataSize\n",
          "Value": 4062349775577,
          "Unit": "MB\n",
          "Description": "Size of the warm data size\n"
        },
        "ColdDataSize": {
          "Name": "coldDataSize",
          "Value": 5570958082267,
          "Unit": "MB",
          "Description": "Size of the cold data size\n"
        },
        "FreezeDataSize": {
          "Name": "freezeDataSize",
          "Value": 1231312431,
          "Unit": "MB\n",
          "Description": "Size of the freeze data size\n"
        },
        "TotalDataSize": {
          "Name": "totalDataSize",
          "Value": 62086342083623,
          "Unit": "MB\n",
          "Description": "Total data size in megabytes (MB)\n"
        },
        "TotalFileDayGrowthCount": {
          "Name": "totalFileDayGrowthCount",
          "Value": 27809,
          "Unit": "”“\n",
          "Description": "Day growth count of total files\n"
        },
        "LargeFileDayGrowthCount": {
          "Name": "largeFileDayGrowthCount",
          "Value": 2,
          "Unit": "”“\n",
          "Description": "Day growth count of large files\n"
        },
        "MediumFileDayGrowthCount": {
          "Name": "mediumFileDayGrowthCount",
          "Value": 176,
          "Unit": "”“\n",
          "Description": "Day growth count of medium files\n"
        },
        "SmallFileDayGrowthCount": {
          "Name": "smallFileDayGrowthCount",
          "Value": 12345,
          "Unit": "”“\n",
          "Description": "Day growth count of small files\n"
        },
        "TinyFileDayGrowthCount": {
          "Name": "tinyFileDayGrowthCount",
          "Value": -123,
          "Unit": "”“\n",
          "Description": "Day growth count of tiny files"
        },
        "EmptyFileDayGrowthCount": {
          "Name": "emptyFileDayGrowthCount",
          "Value": 114,
          "Unit": "”“\n",
          "Description": "Day growth count of empty files\n"
        },
        "HotDataDayGrowthSize": {
          "Name": "hotDataDayGrowthSize",
          "Value": 123154,
          "Unit": "MB\n",
          "Description": "\t\nDay growth size of hot data\n"
        },
        "WarmDataDayGrowthSize": {
          "Name": "warmDataDayGrowthSize",
          "Value": -64806998319,
          "Unit": "MB\n",
          "Description": "Day growth size of warm data\n"
        },
        "ColdDataDayGrowthSize": {
          "Name": "coldDataDayGrowthSize",
          "Value": -182636577752,
          "Unit": "MB\n",
          "Description": "Day growth size of cold data\n"
        },
        "FreezeDataDayGrowthSize": {
          "Name": "freezeDataDayGrowthSize",
          "Value": -167683929450,
          "Unit": "MB\n",
          "Description": "Day growth size of freeze data\n"
        },
        "TotalDataDayGrowthSize": {
          "Name": "totalDataDayGrowthSize",
          "Value": 256482228248,
          "Unit": "MB\n",
          "Description": "Day growth size of total data\n"
        },
        "TotalFileCountDayGrowthRatio": {
          "Name": "totalFileCountDayGrowthRatio\n",
          "Value": 0.02,
          "Unit": "”“\n",
          "Description": "Day growth ratio of total files\n"
        },
        "LargeFileCountDayGrowthRatio": {
          "Name": "largeFileCountDayGrowthRatio",
          "Value": 0.39,
          "Unit": "”“\n",
          "Description": "Day growth ratio of large files\n"
        },
        "MediumFileCountDayGrowthRatio": {
          "Name": "mediumFileCountDayGrowthRatio",
          "Value": 0.19,
          "Unit": "”“\n",
          "Description": "Day growth ratio of medium files\n"
        },
        "SmallFileCountDayGrowthRatio": {
          "Name": "smallFileCountDayGrowthRatio",
          "Value": 0.02,
          "Unit": "”“\n",
          "Description": "Day growth ratio of small files\n"
        },
        "TinyFileCountDayGrowthRatio": {
          "Name": "tinyFileCountDayGrowthRatio",
          "Value": 0.003,
          "Unit": "”“\n",
          "Description": "Day growth ratio of tiny files\n"
        },
        "EmptyFileCountDayGrowthRatio": {
          "Name": "emptyFileCountDayGrowthRatio",
          "Value": 0.005,
          "Unit": "”“\n",
          "Description": "Day growth ratio of empty files"
        },
        "HotDataSizeDayGrowthRatio": {
          "Name": "hotDataSizeDayGrowthRatio",
          "Value": 0.1114,
          "Unit": "”“\n",
          "Description": "Day growth ratio of hot data size\n"
        },
        "WarmDataSizeDayGrowthRatio": {
          "Name": "\t\nwarmDataSizeDayGrowthRatio\n",
          "Value": -0.015,
          "Unit": "”“\n",
          "Description": "Day growth ratio of warm data size\n"
        },
        "ColdDataSizeDayGrowthRatio": {
          "Name": "coldDataSizeDayGrowthRatio",
          "Value": -0.03,
          "Unit": "”“\n",
          "Description": "Day growth ratio of cold data size\n"
        },
        "FreezeDataSizeDayGrowthRatio": {
          "Name": "freezeDataSizeDayGrowthRatio",
          "Value": -0.09,
          "Unit": "”“",
          "Description": "Day growth ratio of freeze data size\n"
        },
        "TotalDataSizeDayGrowthRatio": {
          "Name": "totalDataSizeDayGrowthRatio",
          "Value": 0.14,
          "Unit": "”“\n",
          "Description": "Day growth ratio of total data size\n"
        }
      }
    }
  ],
  "RequestId": "DD6B1B2A-5837-5237-ABE4-FF0C8944****",
  "NextToken": "DD6B1B2A-5837-5237-ABE4-FF0C89568980",
  "MaxResults": 20,
  "TotalCount": 200
}

錯誤碼

HTTP status code	錯誤碼	錯誤資訊
400	ConflictParameters	Parameters that must not be used together. %s
400	IncompleteSignature	The request signature is invalid.
400	InvalidAction	The action %s requested is invalid.
400	InvalidParameter	The specified parameter %s is not valid.
400	InvalidParameterValue	The input parameter %s is invalid or out of range.
400	MissingAction	The action %s requested is missing.
400	MissingParameter	The input parameter %s that is mandatory for processing this request is not supplied.
400	NotAuthorized	You do not have permission to perform this action. %s
400	ThrottlingException	The request was denied due to request throttling. %s
500	InternalError	The request processing has failed due to some unknown error, exception or failure.
404	ResourceNotFound	The resource not found by %s.
503	ServiceFailure	The request has failed due to a temporary failure of %s service.
503	ServiceUnavailable	The request has failed due to a temporary failure of the server.

訪問錯誤中心查看更多錯誤碼。

變更歷史

更多資訊，參考變更詳情。