[TRTLLM-14903][fix] Free partially-allocated warmup dummy KV blocks and count spec extra tokens in warmup block estimates - #17162

[TRTLLM-14903][fix] Free partially-allocated warmup dummy KV blocks and count spec extra tokens in warmup block estimates#17162

brnguyen2 merged 8 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

brnguyen2:fix/TRTLLM-14903-estimation-warmup-leakbrnguyen2/TensorRT-LLM:fix/TRTLLM-14903-estimation-warmup-leakCopy head branch name to clipboard