serving-llms-vllm Guide

Name: serving-llms-vllm
Author: nousresearch

vLLM: high-throughput LLM serving, OpenAI API, quantization.

170,110 starsby nousresearch

When to use serving-llms-vllm

vLLM: high-throughput LLM serving, OpenAI API, quantization.

How to use serving-llms-vllm

serving-llms-vllm is a Claude skill in the SKILL.md format. Add it to your Claude environment from the source repository below, then it activates as a user-invocable skill when your task matches its description.

Skill source

https://raw.githubusercontent.com/nousresearch/hermes-agent/main/skills/mlops/inference/vllm/SKILL.md

Details

PlatformClaude

CategoryCode & Development

Invocationuser-invocable

Modelany

Maintainernousresearch

LicenseMIT

serving-llms-vllm Guide

When to use serving-llms-vllm

How to use serving-llms-vllm

Details

Resources