455cd40137
### What changes were proposed in this pull request? Adding Kerberos support for HDFS storage type. The following five parameters need to be configured: | key | value | | :--: | :--: | | celeborn.storage.hdfs.kerberos.enabled | true | | celeborn.storage.hdfs.kerberos.principal | userREALM | | celeborn.storage.hdfs.kerberos.keytab | /path/test.keytab | | celeborn.hadoop.hadoop.security.authorization | kerberos | | celeborn.hadoop.dfs.namenode.kerberos.principal | hdfs/_HOSTREALM | ### Why are the changes needed? Connecting to HDFS with Kerberos enabled requires support for keytab login. ### Does this PR introduce _any_ user-facing change? Add 3 configurations. celeborn.storage.hdfs.kerberos.enabled celeborn.storage.hdfs.kerberos.principal celeborn.storage.hdfs.kerberos.keytab ### How was this patch tested? Test in Kerberos enabled HDFS cluster. Closes #2072 from liujiayi771/hdfs-kerberos. Authored-by: joey.ljy <joey.ljy@alibaba-inc.com> Signed-off-by: zky.zhoukeyong <zky.zhoukeyong@alibaba-inc.com> |
||
|---|---|---|
| .. | ||
| client.md | ||
| columnar-shuffle.md | ||
| ha.md | ||
| index.md | ||
| master.md | ||
| metrics.md | ||
| network.md | ||
| quota.md | ||
| worker.md | ||