Skip to content

Fix warmup in bench_offline_throughput.py - #2449

Merged
merrymercy merged 1 commit into
mainfrom
pr-fix-warmup
Dec 11, 2024
Merged

merrymercy merged 1 commit into
mainfrom
pr-fix-warmup

Conversation

@merrymercy

Copy link
Copy Markdown
Collaborator

we should warmup the correct batch size.

@merrymercy
merrymercy merged commit f854829 into main Dec 11, 2024
@merrymercy
merrymercy deleted the pr-fix-warmup branch December 11, 2024 14:16
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant