97f0bae87d
### Why are the changes needed? The default behavior of HDFS is to set the permission of a file created with `FileSystem.create` or `FileSystem.mkdirs` to `(P & ^umask)`, where `P` is the permission in the API call and umask is a system value set by `fs.permissions.umask-mode` and defaults to `0022`. This means, with default settings, any mkdirs call can have at most `755` permissions. The same issue also got reported in [SPARK-30860](https://issues.apache.org/jira/browse/SPARK-30860) ### How was this patch tested? Manual test. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #7148 from pan3793/fs-mkdirs. Closes #7148 7527060ac [Cheng Pan] fix f64913277 [Cheng Pan] Fix spark.kubernetes.file.upload.path permission Authored-by: Cheng Pan <chengpan@apache.org> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|---|---|---|
| .. | ||
| src | ||
| web-ui | ||
| pom.xml | ||