Skip to content

[To dev/1.3] Pipe: Reduced the DN -> CN reporter to 3s & reverted the load conversion in parallel commit & Avoid lock acquisition in pipe task agent for too long & Used cached thread pool + caller runs policy for schema parallel task & Removed WAL usage for pipe and added insertNode mem-ctrl & Lengthened the start pipe reload interval & Enabled waiting to send + progressIndex persist at shutdown hook #15826

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Caideyipi merged 23 commits into from
Jun 26, 2025
Merged

[To dev/1.3] Pipe: Reduced the DN -> CN reporter to 3s & reverted the load conversion in parallel commit & Avoid lock acquisition in pipe task agent for too long & Used cached thread pool + caller runs policy for schema parallel task & Removed WAL usage for pipe and added insertNode mem-ctrl & Lengthened the start pipe reload interval & Enabled waiting to send + progressIndex persist at shutdown hook #15826

Changes from 1 commit
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
b7e7dad
partial
Caideyipi Jun 26, 2025
71f7c88
wal deletion
Caideyipi Jun 26, 2025
078a057
continue deletion
Caideyipi Jun 26, 2025
4dd437d
Update CheckpointManager.java
Caideyipi Jun 26, 2025
cb182d4
Release memory
Caideyipi Jun 26, 2025
f6b1cb3
Parital
Caideyipi Jun 26, 2025
12c21dd
update PipeInsertNodeTabletInsertionEvent
luoluoyuyu Jun 26, 2025
a078b1f
Remove useless
Caideyipi Jun 26, 2025
523b9c2
Merge branch 'multi-fix' of https://github.com/Caideyipi/iotdb into m…
Caideyipi Jun 26, 2025
9241bcc
Update PipeRealtimeDataRegionHybridExtractor.java
Caideyipi Jun 26, 2025
09a0e61
Update Metric.java
Caideyipi Jun 26, 2025
ac7272a
setup
VGalaxies Jun 25, 2025
31a3a02
Fix
Caideyipi Jun 26, 2025
56f97e8
modify pipeStuckRestartMinIntervalMs
luoluoyuyu Jun 26, 2025
2cb4692
Pipe/IoTV2: Persist progress index locally before shutdown to accurat…
SteveYurongSu Jun 19, 2025
4bf2e71
Merge branch 'multi-fix' of https://github.com/Caideyipi/iotdb into m…
Caideyipi Jun 26, 2025
9923977
add MaxWaitFinishTime
luoluoyuyu Jun 26, 2025
3ff163d
update PipeConfig
luoluoyuyu Jun 26, 2025
66d1631
Fix
Caideyipi Jun 26, 2025
c8014b1
Merge branch 'multi-fix' of https://github.com/Caideyipi/iotdb into m…
Caideyipi Jun 26, 2025
6e7ff7f
Update WalDeleteOutdatedNewTest.java
Caideyipi Jun 26, 2025
213236d
Update PipeMemoryManager.java
Caideyipi Jun 26, 2025
a8cfd04
Update CommonConfig.java
Caideyipi Jun 26, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
modify pipeStuckRestartMinIntervalMs
  • Loading branch information
@luoluoyuyu
luoluoyuyu committed Jun 26, 2025
commit 56f97e89f1f4b86f2bdee478e8dd9fd04bb142d3
2 changes: 1 addition & 1 deletion iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/conf/CommonConfig.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -276,7 +276,7 @@ public class CommonConfig {
private long pipeMaxAllowedLinkedTsFileCount = Long.MAX_VALUE; // Deprecated
private float pipeMaxAllowedLinkedDeletedTsFileDiskUsagePercentage = 0.1F;
private long pipeStuckRestartIntervalSeconds = 120;
private long pipeStuckRestartMinIntervalMs = 5 * 60 * 1000L; // 5 minutes
private long pipeStuckRestartMinIntervalMs = 10 * 60 * 1000L; // 5 minutes
private boolean pipeEpochKeepTsFileAfterStuckRestartEnabled = false;
private long pipeFlushAfterLastTerminateSeconds = 30;
private long pipeFlushAfterTerminateCount = 30;
Expand Down
Loading