Skip to content

chore: Migrate gsutil usage to gcloud storage - #14931

Closed
gurusai-voleti wants to merge 3 commits into
google:masterfrom
gurusai-voleti:ai-gsutil-migration-9adfba10cb904976b26dee7234dec5dc
Closed

chore: Migrate gsutil usage to gcloud storage#14931
gurusai-voleti wants to merge 3 commits into
google:masterfrom
gurusai-voleti:ai-gsutil-migration-9adfba10cb904976b26dee7234dec5dc

Conversation

@gurusai-voleti

Copy link
Copy Markdown
Contributor

Automated: Migrate {target_path} from gsutil to gcloud storage

This CL is part of the on going effort to migrate from the legacy gsutil tool to the new and improved gcloud storage command-line interface.
gcloud storage is the recommended and modern tool for interacting with Google Cloud Storage, offering better performance, unified authentication, and a more consistent command structure with other gcloud components. 🚀

Automation Details

This change was generated automatically by an agent that targets users of gsutil.
The transformations applied are based on the gsutil to gcloud storage migration guide.

⚠️ Action Required: Please Review and Test Carefully

While we have based the automation on the migration guide, every use case is unique.
It is crucial that you thoroughly test these changes in environments appropriate to your use-case before merging.
Be aware of potential differences between gsutil and gcloud storage that could impact your workflows.
For instance, the structure of command output may have changed, requiring updates to any scripts that parse it. Similarly, command behavior can differ subtly; the gcloud storage rsync command has a different file deletion logic than gsutil rsync, which could lead to unintended file deletions.

Our migration guides can help guide you through a list of mappings and some notable differences between the two tools.

Standard presubmit tests are run as part of this CL's workflow. If you need to target an additional test workflow or require assistance with testing, please let us know.

Please verify that all your Cloud Storage operations continue to work as expected to avoid any potential disruptions in production.

Support and Collaboration

The GCS CLI team is here to help! If you encounter any issues, have a complex use case that this automated change doesn't cover, or face any other blockers, please don't hesitate to reach out.
We are happy to work with you to test and adjust these changes as needed.

Contact: gcs-cli-hyd@google.com

We appreciate your partnership in this important migration effort!

#gsutil-migration

@github-actions

Copy link
Copy Markdown

gurusai-voleti is a new contributor to projects/wolfssl. The PR must be approved by known contributors before it can be merged. The past contributors are: hunsche, JacobBarthelmeh, maflcko, guidovranken, ejohnstown, philljj, Uriah-wolfSSL, tim-weller-wolfssl


def _gsutil_execute(*args, parallel=True):
"""Executes a gsutil command, passing |*args| to gsutil and returns the
"""Executes a gcloud storage command, passing |*args| to it and returns the

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewer: I would be careful about approving this since you would need to test it on a live cifuzz run (I can share how I do this) to verify it doesn't break. I think it might break because I think I only installed gsutil in the docker containers because gcloud took up 1 GB of space.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sushantkhanna FYI, reviewer asking to test the setup, can you help with you opinion in this case

@gurusai-voleti
gurusai-voleti force-pushed the ai-gsutil-migration-9adfba10cb904976b26dee7234dec5dc branch from 492dce0 to e2dec1e Compare April 7, 2026 06:33
@gurusai-voleti
gurusai-voleti force-pushed the ai-gsutil-migration-9adfba10cb904976b26dee7234dec5dc branch from e2dec1e to cd15d3c Compare May 4, 2026 09:41
@gurusai-voleti
gurusai-voleti force-pushed the ai-gsutil-migration-9adfba10cb904976b26dee7234dec5dc branch from cd15d3c to e221070 Compare May 11, 2026 14:04

@ViniciustCosta ViniciustCosta left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @gurusai-voleti could you split this PR into smaller ones?

  • One for the changes under /docs, which should be trivial to land
  • Multiple for the changes under /infra that should target specific parts of the infra folder (base-images, builds, cifuzz, etc.)
  • One for the changes under /projects which are specific for the onboarded projects build files

Thanks!

@gurusai-voleti

gurusai-voleti commented Jul 6, 2026

Copy link
Copy Markdown
Contributor Author

Hey @gurusai-voleti could you split this PR into smaller ones?

  • One for the changes under /docs, which should be trivial to land
  • Multiple for the changes under /infra that should target specific parts of the infra folder (base-images, builds, cifuzz, etc.)
  • One for the changes under /projects which are specific for the onboarded projects build files

Thanks!

created multiple PRs

#15842
#15843

#15844
#15845
#15846
#15847

@ViniciustCosta

@ViniciustCosta

Copy link
Copy Markdown

Closing as we are landing these changes in smaller PRs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants