Skip to content

feat(api): support audio fixture playback in Live sessions - #2946

Merged
jiayuhuang-openai merged 1 commit into
mainfrom
castiron/promotions/pr-301
Oct 15, 2026
Merged

jiayuhuang-openai merged 1 commit into
mainfrom
castiron/promotions/pr-301

Conversation

@yoni-oai

Copy link
Copy Markdown
Contributor

Summary

Send an audio fixture in a Live session and use the typed events to follow its playback.

Changes

  • Send up to 30 seconds of Base64-encoded raw mono PCM16 little-endian audio at 24 kHz, with no WAV or other container header with session.output_audio.fixture.play.
  • Handle session.output_audio.fixture.playing when the server accepts the audio, and correlate it with the play event using client_event_id.
  • Handle session.output_audio.fixture.played when the server mixer drains. Audio buffered by the transport may still be playing.

@jiayuhuang-openai
jiayuhuang-openai marked this pull request as ready for review October 15, 2026 03:51
@jiayuhuang-openai
jiayuhuang-openai requested a review from a team as a code owner October 15, 2026 03:51
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 15, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-15T22:05:46.505759Z 7420666 New commits
🔒 Security Review ✅ Completed 2026-10-15T22:06:22.650015Z 7420666 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@openai-sdks

openai-sdks Bot commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

OkTest Summary

✅ 236/236 SDK tests passed in 6.691s for Node SDK PR #2946.

Test results — 42 files
Test Result Time
tests/chat-completions-complex-body.test.ts ✅ Passed 140ms
tests/chat-completions-create.test.ts ✅ Passed 131ms
tests/chat-completions-stream.test.ts ✅ Passed 103ms
tests/files-content-binary.test.ts ✅ Passed 95ms
tests/files-create-multipart.test.ts ✅ Passed 82ms
tests/files-list-pagination.test.ts ✅ Passed 95ms
tests/initialize-config.test.ts ✅ Passed 160ms
tests/instance-isolation.test.ts ✅ Passed 115ms
tests/models-list.test.ts ✅ Passed 80ms
tests/responses-background-lifecycle.test.ts ✅ Passed 119ms
tests/responses-body-method-errors.test.ts ✅ Passed 162ms
tests/responses-cancel-timeout.test.ts ✅ Passed 195ms
tests/responses-cancel.test.ts ✅ Passed 124ms
tests/responses-compact-retries.test.ts ✅ Passed 153ms
tests/responses-compact.test.ts ✅ Passed 134ms
tests/responses-create-advanced-stream.test.ts ✅ Passed 97ms
tests/responses-create-advanced.test.ts ✅ Passed 98ms
tests/responses-create-disconnect.test.ts ✅ Passed 1.02s
tests/responses-create-errors.test.ts ✅ Passed 109ms
tests/responses-create-malformed-api-responses.test.ts ✅ Passed 81ms
tests/responses-create-retries.test.ts ✅ Passed 175ms
tests/responses-create-stream-failures.test.ts ✅ Passed 77ms
tests/responses-create-stream-timeout.test.ts ✅ Passed 2.142s
tests/responses-create-stream-wire.test.ts ✅ Passed 1.05s
tests/responses-create-stream.test.ts ✅ Passed 80ms
tests/responses-create-terminal-states.test.ts ✅ Passed 150ms
tests/responses-create-timeout.test.ts ✅ Passed 221ms
tests/responses-create.test.ts ✅ Passed 137ms
tests/responses-delete.test.ts ✅ Passed 135ms
tests/responses-input-items-errors.test.ts ✅ Passed 116ms
tests/responses-input-items-list.test.ts ✅ Passed 118ms
tests/responses-input-items-options.test.ts ✅ Passed 110ms
tests/responses-input-tokens-count-timeout.test.ts ✅ Passed 210ms
tests/responses-input-tokens-count.test.ts ✅ Passed 111ms
tests/responses-malformed-inputs.test.ts ✅ Passed 643ms
tests/responses-not-found-errors.test.ts ✅ Passed 189ms
tests/responses-parse.test.ts ✅ Passed 105ms
tests/responses-retrieve-retries.test.ts ✅ Passed 144ms
tests/responses-retrieve.test.ts ✅ Passed 163ms
tests/responses-stored-method-errors.test.ts ✅ Passed 283ms
tests/retry-behavior.test.ts ✅ Passed 2.933s
tests/sdk-error-shape.test.ts ✅ Passed 164ms

View OkTest run #38814344902

SDK merge (787ee866048c) · head (7420666147d4) · base (35bfd1f8832c) · OkTest (63b471b22245)

@github-actions

github-actions Bot commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Castiron custom code

Evaluated main: 35bfd1f8832cb199e0b210a9a5d698f158f8c000.

Trusted main policy: 35bfd1f8832cb199e0b210a9a5d698f158f8c000.

Mixed files: 47 → 50

3 newly customized · 0 customizations removed · 0 existing customizations changed · 3 generated baselines changed

Compared 35bfd1f8832c → 7420666147d4. Generated baselines verified.

File Result Current custom patch
scripts/castiron/CUSTOM_CODE.md Generated baseline changed +3 / −1
scripts/castiron/custom_code_budget.py Generated baseline changed +16 / −6
scripts/castiron/test_custom_code_budget.py Generated baseline changed +23 / −2
47 existing customizations unchanged
  • api.md
  • src/client.ts
  • src/resources/admin/organization/usage.ts
  • src/resources/audio/transcriptions.ts
  • src/resources/audio/translations.ts
  • src/resources/beta/agents/agents.ts
  • src/resources/beta/agents/environments/environments.ts
  • src/resources/beta/agents/environments/files.ts
  • src/resources/beta/agents/sessions/artifacts.ts
  • src/resources/beta/agents/sessions/sessions.ts
  • src/resources/beta/assistants.ts
  • src/resources/beta/beta.ts
  • src/resources/beta/index.ts
  • src/resources/beta/responses/internal-base.ts
  • src/resources/beta/responses/responses.ts
  • src/resources/beta/responses/ws-base.ts
  • src/resources/beta/responses/ws.ts
  • src/resources/beta/threads/index.ts
  • src/resources/beta/threads/runs/index.ts
  • src/resources/beta/threads/runs/runs.ts
  • src/resources/beta/threads/threads.ts
  • src/resources/chat/completions/completions.ts
  • src/resources/chat/completions/index.ts
  • src/resources/conversations/index.ts
  • src/resources/embeddings.ts
  • src/resources/files.ts
  • src/resources/fine-tuning/checkpoints/permissions.ts
  • src/resources/images.ts
  • src/resources/live/forks/ws-base.ts
  • src/resources/live/forks/ws.ts
  • src/resources/live/sideband/ws-base.ts
  • src/resources/live/sideband/ws.ts
  • src/resources/live/ws-base.ts
  • src/resources/live/ws.ts
  • src/resources/responses/internal-base.ts
  • src/resources/responses/responses.ts
  • src/resources/responses/ws-base.ts
  • src/resources/responses/ws.ts
  • src/resources/skills/skills.ts
  • src/resources/skills/versions/versions.ts

7 more in the full report.

A changed generated baseline means this report cannot reliably identify which handwritten lines changed.

Inspect the custom-code diff

Download the exact patch produced by this run (requires repository access):

gh run download 38814397284 --repo openai/openai-node \
  --name castiron-custom-code-38814397284-1 --dir /tmp/castiron-custom-code-38814397284-1
git apply --stat /tmp/castiron-custom-code-38814397284-1/custom-code.patch
cat /tmp/castiron-custom-code-38814397284-1/custom-code.patch

Or reproduce it from an SDK checkout containing the vendored reporter:

git fetch --no-tags origin 35bfd1f8832cb199e0b210a9a5d698f158f8c000 7420666147d42794ace1e4da55489569b4161ace
python3 scripts/castiron/custom_code_report.py report \
  --base 35bfd1f8832cb199e0b210a9a5d698f158f8c000 \
  --head 7420666147d42794ace1e4da55489569b4161ace --fetch --require-head-hash --public \
  --out /tmp/castiron-custom-code-7420666147d4
cat /tmp/castiron-custom-code-7420666147d4/custom-code.patch

This is the current full custom patch for mixed files, not an attribution of only the handwritten lines changed by this PR.

Full report and patch

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: f55082ae6d

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/resources/live/sideband/sideband.ts
Castiron-Internal-PR: openai/openai-node-internal#301
Castiron-Source-SHA: 5a2d2f47630e354666d32d56080f95833868885e
Castiron-Public-Base-SHA: 35bfd1f
@yoni-oai
yoni-oai force-pushed the castiron/promotions/pr-301 branch from f55082a to 7420666 Compare October 15, 2026 22:02

@jbeckwith-oai jbeckwith-oai left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed all nine changed files at 7420666. No blocking issues found.

The earlier WebRTC concern is fixed: both OpenAILiveWebRTC and LiveDataChannel exclude fixture.play from their outgoing event union while retaining the server acknowledgments. Primary/fork/sideband WebSocket unions, nullable event_id handling, queue/no-replay behavior, and the changed public-snapshot manifest hashes also check out.

Static source/security review only; no local tests or live calls. Current hosted checks are green. The Node 22 log includes all 53 WebRTC tests plus successful packed CJS/ESM/browser checks; Node 24 and 26 jobs are also green.

@jiayuhuang-openai
jiayuhuang-openai added this pull request to the merge queue Oct 15, 2026
Merged via the queue into main with commit 41d0966 Oct 15, 2026
40 checks passed
@openai-sdks openai-sdks Bot mentioned this pull request Oct 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants