Skip to content

Add additional logging to the cleanup process #861

Description

@krysal

Problem

Currently, the cleanup process only records the final number of cleaned rows. We want to have more information on how many rows are affected and what type of cleanup is applied (malformed URL fixed, tag filtering) in order to develop a strategy to apply these changes on the upstream database and remove the steps from the ingestion server.

Additional context

Previous attempt at WordPress/openverse-api#1126

Metadata

Metadata

Assignees

Labels

✨ goal: improvementImprovement to an existing user-facing feature🟧 priority: highStalls work on the project or its dependents🤖 aspect: dxConcerns developers' experience with the codebase🧱 stack: ingestion serverRelated to the ingestion/data refresh server

Type

No type

Projects

Status
✅ Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions