### What changes were proposed in this pull request? Lock flushBuffer field and flush method to make sure thread safe access. ### Why are the changes needed? When stageEnd, worker will commit files and filewriters would be closed, the speculative task may still push data to the file writer, if the push task increment numPendingWrites. the commit thread which hold the filewriter object lock will need wait the pending writes decrement to 0. but push thread need the filewriter object lock to decrement numPendingWrites, this cause deadlock.. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? UT Closes #1534 from RexXiong/CELEBORN-626. Authored-by: Shuang <lvshuang.tb@gmail.com> Signed-off-by: Cheng Pan <chengpan@apache.org> |
||
|---|---|---|
| .. | ||
| src | ||
| pom.xml | ||