brokerLoad语句
LOAD
LABEL gaofeng_broker_load_HDD
(DATA INFILE("hdfs://eoop/user/coue_data/hive_db/couta_test/ader_lal_offline_0813_1")INTO TABLE ads_user
)WITH BROKER "hdfs_broker"
("dfs.nameservices"="eadhadoop","dfs.ha.namenodes.eadhadoop" = "nn1,nn2","dfs.namenode.rpc-address.eadhadoop.nn1" = "h4:8000","dfs.namenode.rpc-address.eadhadoop.nn2" = "z7:8000","dfs.client.failover.proxy.provider.eadhadoop" = "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider","hadoop.security.authentication" = "kerberos","kerberos_principal" = "ou3.CN","kerberos_keytab_content" = "BQ8uMTYzLkNPTQALY291cnNlXgAAAAFfVyLbAQABAAgCtp0qmxxP8QAAAAE="
);
报错
任务Cancelled
type:ETL_RUN_FAIL; msg:errCode = 2, detailMessage = No source file in this table(ads_user).
解决
broker load语句中的DATA FILE路径写错了,需要写的是文件,而不是目录
这个目录是我把表直接export出去的目录,brokerLoad时不能使用这个,而是要使用底下的众多文件
将
hdfs://eoop/user/coue_data/hive_db/couta_test/ader_lal_offline_0813_1
修改为
hdfs://eoop/user/coue_data/hive_db/couta_test/ader_lal_offline_0813_1/*
即可