Skip to content

[TRTLLM-17267][refactor] Move the embeddings, mm_encoder and tokenize handlers into serving classes - #21575

Draft
JunyiXu-nv wants to merge 31 commits into
NVIDIA:mainfrom
JunyiXu-nv:dev-junyix-feat-serve-embeddings-mm-encoder
Draft

JunyiXu-nv wants to merge 31 commits into
NVIDIA:mainfrom
JunyiXu-nv:dev-junyix-feat-serve-embeddings-mm-encoder