Skip to content

Add JSONB distributions column and batch retrieval for genomicdist#110

Open
sanghoonio wants to merge 3 commits intomasterfrom
bedstats_jsonb
Open

Add JSONB distributions column and batch retrieval for genomicdist#110
sanghoonio wants to merge 3 commits intomasterfrom
bedstats_jsonb

Conversation

@sanghoonio
Copy link
Member

@sanghoonio sanghoonio commented Feb 24, 2026

Add a distributions JSONB column to bed_stats for storing full distribution arrays from gtars genomicdist output. Filter bedset statistics aggregation to only numeric columns so AVG/STDDEV skip the new JSONB field. Add get_batch() method for efficient multi-ID bed record retrieval.

Changes:

  • ...

TODO:

  • Version of pepdbagent updated in __version__.py file
  • Changelog updated

…pport

Add a `distributions` JSONB column to `bed_stats` for storing full
distribution arrays from gtars genomicdist output. Filter bedset
statistics aggregation to only numeric columns so AVG/STDDEV skip
the new JSONB field. Add `get_batch()` method for efficient multi-ID
bed record retrieval.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@sanghoonio
Copy link
Member Author

sanghoonio commented Feb 24, 2026

Adding a nullable JSONB column is safe with a manual ALTER TABLE bed_stats ADD COLUMN distributions JSONB;. Existing rows get NULL. New pipeline runs populate it.

Also, didn't have the docker container set up to test fully.

- Remove S3 upload calls from bed add/update paths; retain S3 delete
  for legacy object cleanup
- Add aggregation module with collection-level stat computation
- Replace BedSetPlots with BedSetStats backed by bedset_stats JSONB column
- Remove _calculate_statistics and get_plots from bedsets
- Add distributions JSONB column to Bed table with batch retrieval
- Add get_batch and aggregate_collection to bedfile agent
- Thread distributions param through get_stats

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant