The logs of the Hadoop Distributed File System (HDFS) service is stored in the /mnt/disk1/log/hadoop-hdfs directory. This topic describes the logs of each component of the HDFS service.
| Component | Log file | Description |
|---|---|---|
| ZKFailoverController (ZKFC) | hadoop-hdfs-zkfc-*.out | The process startup logs of the ZKFC. Specific startup exceptions are displayed in the .out file. |
| hadoop-hdfs-zkfc-*.log | The process run logs of the ZKFC, including the internal logs of the ZKFC. | |
| zkfc-gc.log.0.current | The Java Virtual Machine-Garbage Collection (JVM-GC) logs of the ZKFC. This type of log is supported in a cluster of E-MapReduce (EMR) V3.43.0, EMR V5.8.0, or a minor version later than EMR V3.43.0 or EMR V5.8.0. | |
| NameNode | hadoop-hdfs-namenode-*.out | The process startup logs of the NameNode. Specific startup exceptions are displayed in the .out file. |
| hadoop-hdfs-namenode-*.log | The process run logs of the NameNode, including the internal logs of the NameNode. | |
| hdfs-audit.log | The audit logs of the NameNode. | |
| namenode-gc.log.0.current | The JVM-GC logs of the NameNode. This type of log is supported in a cluster of EMR V3.43.0, EMR V5.8.0, or a minor version later than EMR V3.43.0 or EMR V5.8.0. | |
| JournalNode | hadoop-hdfs-journalnode-*.out | The process startup logs of the JournalNode. Specific startup exceptions are displayed in the .out file. |
| hadoop-hdfs-journalnode-*.log | The process run logs of the JournalNode, including the internal logs of the JournalNode. | |
| journalnode-gc.log.0.current | The JVM-GC logs of the JournalNode. This type of log is supported in a cluster of EMR V3.43.0, EMR V5.8.0, or a minor version later than EMR V3.43.0 or EMR V5.8.0. | |
| DataNode | hadoop-hdfs-datanode-*.out | The process startup logs of the DataNode. Specific startup exceptions are displayed in the .out file. |
| hadoop-hdfs-datanode-*.log | The process run logs of the DataNode, including the internal logs of the DataNode. | |
| datanode-gc.log.0.current | The JVM-GC logs of the DataNode. This type of log is supported in a cluster of EMR V3.43.0, EMR V5.8.0, or a minor version later than EMR V3.43.0 or EMR V5.8.0. |