[1.78] Only rate limit backfills (#27735) - #27770
Merged
nickvikeras merged 1 commit intoAug 20, 2026
Merged
Conversation
## Description We have had a few blips where a read load spike causes the write rate limits to kick in while the cluster autoscales which leads to lag. This PR lets writes for pipelines who are ahead of the "tip of chain" bypass flow control. "Tip of chain" being defined as the latest checkpoint known to the ingestion client at indexer startup. These tip-of-chain writes are already paced by chain execution, and the additional load on the DB by simply keeping up with that pace in minimal. Plus most clients would rather accept some high percentile read latency for fresher data during these load spikes than make the opposite trade. ## Test plan Given the dependency on real workloads and bigtable behavior, the easiest way to test it for real is to deploy it. We should stop seeing lag spikes during minor load spikes in prod when this is deployed.
nickvikeras
requested review from
amnn,
evan-wall-mysten,
tpham-mysten and
wlmyng
August 20, 2026 13:52
nickvikeras
temporarily deployed
to
sui-typescript-aws-kms-test-env
August 20, 2026 13:52 — with 
GitHub Actions
Inactive
GitHub Actions
Inactive
|
The latest updates on your projects. Learn more about Vercel for GitHub.
2 Skipped Deployments
|
tpham-mysten
approved these changes
Aug 20, 2026
nickvikeras
enabled auto-merge (squash)
August 20, 2026 13:56
nickvikeras
merged commit Aug 20, 2026
ea19d79
into
releases/sui-v1.78.0-release
62 of 63 checks passed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Cherry-pick of #27735 to the 1.78 release branch.
Original commit: bfdabd3