Skip to content

Commit 08af673

Browse files
velaraptor-runpodvelaraptor-runpod
committed
update banner
1 parent 6edea3c commit 08af673

2 files changed

Lines changed: 3 additions & 1 deletion

File tree

‎.runpod/README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
![vLLM worker banner](https://cpjrphpz3t5wbwfe.public.blob.vercel-storage.com/worker-vllm_banner.jpeg)
1+
![vLLM worker banner](https://image.runpod.ai/preview/vllm/vllm-banner.png)
22

33
Run LLMs using [vLLM](https://docs.vllm.ai) with OpenAI-compatible and Anthropic-compatible APIs on Runpod's Load Balancer for high-throughput, multi-worker scalability.
44

‎README.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
11
# OpenAI-Compatible vLLM Load Balancer
2+
![vLLM worker banner](https://image.runpod.ai/preview/vllm/vllm-banner.png)
3+
24

35
A FastAPI-based load balancer for serving vLLM models on Runpod. Built on top of [worker-vllm](https://github.com/runpod-workers/worker-vllm) as the base inference engine, extending it with Runpod's load balancer protocol and additional API endpoints.
46

0 commit comments

Comments
 (0)