Skip to content

cloud: add changefeed OSS configuration for premium. - #23585

Open
ginkgoch wants to merge 11 commits into
pingcap:release-8.5from
ginkgoch:premium-cdc-cloudstorage-support
Open

cloud: add changefeed OSS configuration for premium.#23585
ginkgoch wants to merge 11 commits into
pingcap:release-8.5from
ginkgoch:premium-cdc-cloudstorage-support

Conversation

@ginkgoch

@ginkgoch ginkgoch commented Aug 20, 2026

Copy link
Copy Markdown
Collaborator

First-time contributors' checklist

What is changed, added or deleted? (Required)

Add document for guiding changefeed to sink to Alicloud OSS on cloud premium.

Which TiDB version(s) do your changes apply to? (Required)

Tips for choosing the affected version(s):

By default, CHOOSE MASTER ONLY so your changes will be applied to the next TiDB major or minor releases. If your PR involves a product feature behavior change or a compatibility change, CHOOSE THE AFFECTED RELEASE BRANCH(ES) AND MASTER.

For details, see tips for choosing the affected versions.

  • master (the latest development version)
  • v9.0 (TiDB 9.0 versions)
  • v8.5 (TiDB 8.5 versions)
  • v8.1 (TiDB 8.1 versions)
  • v7.5 (TiDB 7.5 versions)
  • v7.1 (TiDB 7.1 versions)
  • v6.5 (TiDB 6.5 versions)

What is the related PR or file link(s)?

  • This PR is translated from:
  • Other reference link(s):

AI agent involvement

  • The changes in this PR were primarily made by an AI agent on behalf of the PR author.

Do your changes match any of the following descriptions?

  • Delete files
  • Change aliases
  • Need modification after applied to another branch
  • Might cause conflicts after applied to another branch

Summary by CodeRabbit

  • Documentation
    • Updated cloud storage changefeed guidance for TiDB Cloud Dedicated and Premium instances.
    • Clarified plan-specific restrictions, version requirements, changefeed limits, and destination options.
    • Added Premium guidance for Amazon S3 and Alibaba Cloud OSS.
    • Added Dedicated guidance for Google Cloud Storage, Azure Blob Storage, and Alibaba Cloud OSS.
    • Expanded Alibaba Cloud OSS setup instructions with bucket creation, RAM credentials, required permissions, and destination configuration details.

@ti-chi-bot ti-chi-bot Bot added contribution This PR is from a community contributor. missing-translation-status This PR does not have translation status info. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Aug 20, 2026
@coderabbitai

coderabbitai Bot commented Aug 20, 2026

Copy link
Copy Markdown

Review Change Stack

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

The changefeed cloud storage guide now separates Dedicated and Premium instructions. It adds Premium destination guidance and Dedicated instructions for configuring Alibaba Cloud OSS, including bucket setup, RAM permissions, credentials, and destination fields.

Changes

Cloud storage documentation

Layer / File(s) Summary
Plan-specific guide structure
tidb-cloud/changefeed-sink-to-cloud-storage.md
The guide separates Dedicated and Premium restrictions and destination configuration. It scopes destination content to the applicable plan.
Alibaba Cloud OSS destination instructions
tidb-cloud/changefeed-sink-to-cloud-storage.md
Dedicated instructions now cover OSS bucket creation, RAM permissions, AccessKey credentials, and destination fields.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Merge Risk: 🟡 Moderate · up to 8980b

The change adds Alibaba Cloud OSS guidance for Premium, but the current text can hide the setup from Premium users, blocks a prerequisite with a broken link, and recommends OSS access without clear bucket/prefix scoping or AccessKey rotation. These gaps can prevent successful setup or encourage overly broad credential access, so the PR is not merge-ready until the documentation is corrected or explicitly accepted.

Suggested reviewers: qiancai

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description explains the documentation change and includes the checklist, but it does not select the required affected TiDB version. Select the applicable version checkbox, including release-8.5 or master as appropriate, and ensure it matches the PR target branch.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title clearly identifies the main change: adding Alibaba Cloud OSS changefeed configuration guidance for TiDB Cloud Premium.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0 files. (1 skipped: 1 unsupported.)
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 3


ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: 9a250efc-20e7-4bb8-8ebf-75e4472c3ea5

📥 Commits

Reviewing files that changed from the base of the PR and between 8274565 and e5f8fdd.

📒 Files selected for processing (1)
  • tidb-cloud/changefeed-sink-to-cloud-storage.md

Included review availability: Your plan provides up to 4 included reviews per hour; 3 remain after this review.

Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md
Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md Outdated
Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md Outdated
@qiancai qiancai added translation/no-need No need to translate this PR. area/tidb-cloud This PR relates to the area of TiDB Cloud. labels Aug 20, 2026
@ti-chi-bot ti-chi-bot Bot removed the missing-translation-status This PR does not have translation status info. label Aug 20, 2026
@qiancai qiancai self-assigned this Aug 20, 2026
Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md Outdated
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
@ti-chi-bot

ti-chi-bot Bot commented Aug 20, 2026

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from qiancai. For more information see the Code Review Process.
Please ensure that each of them provides their approval before proceeding.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Caution

Some comments are outside the diff and can’t be posted inline due to platform limitations.

⚠️ Outside diff range comments (1)
tidb-cloud/changefeed-sink-to-cloud-storage.md (1)

189-189: 🎯 Functional Correctness | 🟡 Minor | ⚡ Quick win

Fix the broken bucket-creation link.

The linked page currently returns Alibaba Cloud’s 404 page. The current bucket-creation document uses a different path. (alibabacloud.com)

Committable replacement
-    1. Create an OSS bucket in the same region as your TiDB cluster. For detailed instructions, see [Create buckets](https://www.alibabacloud.com/help/en/oss/user-guide/create-buckets).
+    1. Create an OSS bucket in the same region as your TiDB cluster. For detailed instructions, see [Create a bucket](https://www.alibabacloud.com/help/en/oss/user-guide/create-a-bucket-4).

As per path instructions, run ./scripts/verify-links.sh for link-sensitive Markdown changes when practical.

Source: Path instructions


ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: b730e093-b151-4ab8-bd30-448b665da478

📥 Commits

Reviewing files that changed from the base of the PR and between e5f8fdd and b2e7e1a.

📒 Files selected for processing (1)
  • tidb-cloud/changefeed-sink-to-cloud-storage.md

Included review availability: Your plan provides up to 4 included reviews per hour; 3 remain after this review.

@qiancai qiancai changed the title Add changefeed OSS configuration for premium. cloud: add changefeed OSS configuration for premium. Aug 20, 2026
@qiancai qiancai added the for-cloud-release This PR is related to TiDB Cloud release. label Aug 20, 2026
Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md
Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md Outdated
Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

♻️ Duplicate comments (2)
tidb-cloud/changefeed-sink-to-cloud-storage.md (2)

194-206: ⚠️ Potential issue | 🟠 Major

Scope OSS permissions and document AccessKey rotation.

Lines 195-200 list OSS actions but do not restrict them to the changefeed bucket and prefix. Alibaba Cloud requires bucket-level authorization for oss:ListObjects; object actions can be limited to a specific prefix. Add a custom policy with an oss:Prefix condition and prefix-scoped object resources. Also document secure storage and rotation of the AccessKey pair. (alibabacloud.com)

Committable replacements
-    3. Grant the RAM user OSS permissions. For the required permissions, see [OSS permissions and access control](https://www.alibabacloud.com/help/en/oss/user-guide/permissions-and-access-control-overview). The RAM user needs at least the following permissions:
-
-        - `oss:ListObjects`
-        - `oss:GetObject`
-        - `oss:PutObject`
-        - `oss:DeleteObject`
+    3. Attach a custom RAM policy that follows least privilege. Scope `oss:ListObjects` to `acs:oss:*:*:<BucketName>` and restrict it with an `oss:Prefix` condition for `<prefix>/`. Scope `oss:GetObject`, `oss:PutObject`, and `oss:DeleteObject` to `acs:oss:*:*:<BucketName>/<prefix>/*`. For policy examples, see [Control OSS access with RAM policies](https://www.alibabacloud.com/help/en/oss/user-guide/access-control-base-on-ram-policy).
     - **Access Key Secret**: enter the AccessKey Secret from the RAM user.
+
+    > **Note:**
+    >
+    > Store the AccessKey pair securely. To rotate it, create a new AccessKey pair, update and verify the changefeed, then disable and delete the old pair.

As per path instructions, “for every actionable issue, provide a GitHub committable suggestion block” when the replacement is contiguous.

Sources: Path instructions, MCP tools


39-43: ⚠️ Potential issue | 🟠 Major

Use one plan scope for the Alibaba Cloud OSS flow.

Line 41 advertises Alibaba Cloud OSS for TiDB Cloud Premium, but Lines 186-209 render the OSS instructions only for plan="dedicated". Premium readers cannot see the required setup. Line 212 also describes only a Dedicated connection and omits Alibaba Cloud OSS. Confirm the intended plan, then use the same plan scope in the wrapper and completion text.

As per path instructions, a regular review comment is appropriate because the fix “needs clarification from the author.”

Also applies to: 186-187

Source: Path instructions


ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: ac713597-9be0-4818-9061-f8020ce4463d

📥 Commits

Reviewing files that changed from the base of the PR and between b2e7e1a and 8980b7e.

📒 Files selected for processing (1)
  • tidb-cloud/changefeed-sink-to-cloud-storage.md

Included review availability: Your plan provides up to 4 included reviews per hour; 3 remain after this review.

@ti-chi-bot ti-chi-bot Bot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Aug 21, 2026
@ginkgoch
ginkgoch requested a review from sdojjy August 21, 2026 12:11
@ti-chi-bot

ti-chi-bot Bot commented Aug 21, 2026

Copy link
Copy Markdown

@sdojjy: adding LGTM is restricted to approvers and reviewers in OWNERS files.

Details

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md Outdated
Comment thread TOC-tidb-cloud-premium.md Outdated
Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md Outdated
@ti-chi-bot ti-chi-bot Bot added the needs-1-more-lgtm Indicates a PR needs 1 more LGTM. label Aug 24, 2026
@ti-chi-bot

ti-chi-bot Bot commented Aug 24, 2026

Copy link
Copy Markdown

[LGTM Timeline notifier]

Timeline:

  • 2026-08-24 02:24:01.681564682 +0000 UTC m=+468476.852658795: ☑️ agreed by qiancai.

github-actions Bot pushed a commit to qiancai/pingcap-docsite-preview that referenced this pull request Aug 24, 2026
Comment thread tidb-cloud/changefeed-sink-to-cloud-storage.md Outdated
Co-authored-by: Grace Cai <qqzczy@126.com>
github-actions Bot pushed a commit to qiancai/pingcap-docsite-preview that referenced this pull request Aug 24, 2026
@ti-chi-bot

ti-chi-bot Bot commented Aug 24, 2026

Copy link
Copy Markdown

@ginkgoch: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
pull-verify cf49cfd link true /test pull-verify

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/tidb-cloud This PR relates to the area of TiDB Cloud. contribution This PR is from a community contributor. for-cloud-release This PR is related to TiDB Cloud release. needs-1-more-lgtm Indicates a PR needs 1 more LGTM. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. translation/no-need No need to translate this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants