Skip to content

Commit

Permalink
feat: Filter splits that do not require compaction
Browse files Browse the repository at this point in the history
  • Loading branch information
zhourui999 committed Apr 19, 2024
1 parent 0ed2e7b commit 3165576
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,7 @@ public void run(SourceContext<Tuple2<Split, String>> ctx) throws Exception {
.filter(
split -> {
DataSplit dataSplit = (DataSplit) split;
if (dataSplit.dataFiles().size() <= 1) {
if (dataSplit.dataFiles().isEmpty()) {
return false;
}
return dataSplit.dataFiles().stream()
Expand Down

0 comments on commit 3165576

Please sign in to comment.