Repository navigation
Opt-in: queue messages sent from a T3 client ahead of agent-sent messages #29613
AnalogCyan
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Problem
I run an orchestrator thread that worker threads and an outside relay report to with
t3_thread_send. While the orchestrator is busy, each report queues and later gets its own turn. A message I type in the web or mobile client queues behind all of them in arrival order. With a steady stream of agent reports, a short correction from me has waited more than ten minutes to reach the agent.What exists today covers part of this:
t3_queuereorder lets the agent move my message forward without interrupting anything. But it costs the agent a tool call every turn, it depends on the agent remembering, and the list entries carry no sender, so the agent can't reliably tell which queued runs are mine (queueEntry).Proposal
An opt-in server setting, off by default. When it's on, a message sent from a T3 client is placed ahead of queued agent and automation messages when it is queued:
queuePositionat enqueue. Later reorders (thet3_queuetool, the UI buttons proposed in Reorder queued messages from the thread UI #29368) still work, replay stays deterministic, and whatever t3_queue_reorder can't move a message ahead of queued automatic completion deliveries #25646 decides about completions is unaffected.The orchestrator already has the test this needs:
sentByUserFromClientis what lets a client message release a held queue today. The change would sit wherequeuePositionis assigned, plus the setting.Limits
This ranks by channel, not by person. Anything that sends through a client connection counts as the user, the same as for held-queue release today. Guest messages should probably not move up.
Related: #15456 and #21240 (telling user messages apart from automation), #15815, #29368, #25646.
Would you take this direction? If so, I can open a focused PR.
All reactions