feat(specs): add Bayesian evidence status - #6879
stevenMevans merged 3 commits into
Conversation
🪓 The generated code will be pushed at the end of the CI.Action triggered by commit Please do not push any generated code to this pull request. |
d1e5371 to
3e9150f
Compare
4ba0f8e to
ca60e31
Compare
e8dcdf5 to
a6d4be0
Compare
ca60e31 to
3d103e3
Compare
3d103e3 to
b700fbe
Compare
a6d4be0 to
5adfb77
Compare
5adfb77 to
6912498
Compare
6912498 to
55ffd31
Compare
f7de49b to
4443e84
Compare
5249961 to
7aa75f9
Compare
4f91eb5 to
ace28ef
Compare
6990353 to
c4063b1
Compare
201b544 to
79fd2dd
Compare
c4063b1 to
8afdd45
Compare
79fd2dd to
9058f2e
Compare
0abf87e to
0a95144
Compare
87e3085 to
1c07b54
Compare
0a95144 to
82f22e7
Compare
367e917 to
d207a39
Compare
There was a problem hiding this comment.
🟢 Approval recommended
Only a minor documentation ambiguity remains; the schema change is otherwise consistent and complete.
Pull request overview
Adds Bayesian evidence status to shared A/B testing metric schemas so generated clients can assess result trustworthiness.
Changes:
- Adds optional metric evidence.
- Defines five evidence statuses and examples.
File summaries
| File | Description |
|---|---|
specs/abtesting-v3/common/schemas/Variant.yml |
Defines Bayesian metric evidence and status values. |
Review details
- Files reviewed: 1/1 changed files
- Comments generated: 1
- Review effort level: Balanced
💡 Configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
63cdcb5 to
2b60dc3
Compare
8d1bbdf to
0eeddeb
Compare
0eeddeb to
8a415b2
Compare
93a507d
8a415b2 to
93a507d
Compare
53985a0
into
feat/abtesting-v3/bayesian-fields
🧭 What and Why
Exposes the backend evidence verdict for each treatment metric comparison so clients can determine whether that result is trustworthy yet.
🎟 JIRA Ticket: OPTIM-2883
Changes included:
variants[].metrics[].bayesian.evidence.statusto Get, List, and Timeseries responses.enough,not_enough,collecting,no_data, andunavailable.hasEnoughEvidencefield.🧪 Test
Green CI