Skip to content

Fix gemlite import - #2553

Merged
merrymercy merged 3 commits into
mainfrom
pr-fix-gemlite
Dec 23, 2024
Merged

merrymercy merged 3 commits into
mainfrom
pr-fix-gemlite

Conversation

@merrymercy

Copy link
Copy Markdown
Collaborator

We do not need to import gemlite cache in the benchmark scripts.
They should already be set from python/sglang/srt/layers/torchao_utils.py

@merrymercy

Copy link
Copy Markdown
Collaborator Author

cc @jerryzh168

Comment thread python/sglang/bench_one_batch.py Resolved
Comment thread python/sglang/srt/utils.py Resolved
Comment thread python/sglang/srt/utils.py Resolved
Comment thread python/sglang/srt/utils.py Resolved
@merrymercy
merrymercy merged commit 23e5e50 into main Dec 23, 2024
@merrymercy
merrymercy deleted the pr-fix-gemlite branch December 23, 2024 04:21
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant