1回答
- 新しい順
- 投票が多い順
- コメントが多い順
0
Input/Output errors almost always indicate a network connection problem between the DataSync agent and HDFS NameNode or HDFS DataNodes. You can check this here:
You need to validate the namenode metadata service port (IPC port) set on the core-site.xml under the following property: fs.defaultFS or fs.default.name, depending upon your Hadoop distribution.
$ grep -A 2 -B 1 -i fs.default core-site.xml
<property>
<name>fs.defaultFS</name>
<value>hdfs://ip-xx-xx-xx-xx.ec2.internal:8020</value>
</property>
You must also validate the datanode port setting under dfs.datanode.address property.
$ grep -A 2 -B 1 -i dfs.datanode.address hdfs-site.xml
<property>
<name>dfs.datanode.address</name>
<value>xxx.xxx.xxx.xxx:1004</value>
</property>
Are you using Simple Authentication or Kerberos Authentication?
回答済み 2年前
関連するコンテンツ
- AWS公式更新しました 8ヶ月前
I am using Simple authentication.