Skip to content

API "Streaming is required" error message is outdated #1430

@Achierius

Description

@Achierius

Providing a max_tokens parameter greater than ~20k tokens without using the streaming API produces an error which references "https://github.com/anthropics/anthropic-sdk-python#long-requests", a heading which no longer exists since 0e409217.

Two points:

  1. This error message should be re-pointed to wherever the documentation currently lives
  2. What is the right thing to do here, if for whatever reason we cannot use the streaming API? It no longer seems possible to omit the max_tokens field when making an API request, so I assume the prior advice is no longer appropriate. I can call _calculate_nonstreaming_timeout to determine the 'safe non-streaming maximum' but that's obviously brittle.

Full error:

  File "<snip>/proj/api.py", line 615, in _execute_request
    text, inp, out, cached = await self._execute_anthropic(request, model_id, self._get_anthropic())
                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<snip>/proj/api.py", line 441, in _execute_anthropic
    response = await client.messages.create(**kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<snip>/.venv/lib64/python3.14/site-packages/anthropic/resources/messages/messages.py", line 2425, in create
    timeout = self._client._calculate_nonstreaming_timeout(
        max_tokens, MODEL_NONSTREAMING_TOKENS.get(model, None)
    )
    File "<snip>/.venv/lib64/python3.14/site-packages/anthropic/_base_client.py", line 732, in _calculate_nonstreaming_timeout
    raise ValueError(
    ...<2 lines>...
    )
ValueError: Streaming is required for operations that may take longer than 10 minutes. See https://github.com/anthropics/anthropic-sdk-python#long-requests for more details

This is with v0.88, but as far as I can tell there were no changes to the relevant documentation files since then.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions