Clone the repository
Deployment
The deployment script is based on Baseten’s documentation ofRun any LLM with vLLM.
Launch command:
Test call
Baseten endpoints expect the
Api-Key prefix in the Authorization header.