vllm

High-throughput, memory-efficient LLM inference engine

softwareMachine LearningLLMInferenceServing

Alternatives

one-api

one-api is an LLM API management and key redistribution system that supports multiple providers under a single API. It provides a unified interface for managing keys and redistributing them to various applications.

✦ Best for developers with multiple llm providers

FreeMITWebLinuxAI-PoweredCross-PlatformUnified API

“Provides a unified API to serve and manage LLMs, directly competing with vllm's inference serving role.”

About the Product

Unclaimed Listing

Socials

github twitter

Platforms

Linux Windows Mac

Target AudienceAI developers and researchers

Is this your tool?

Claim this page to update details, reply to user reviews, and drive more traffic to your product.

Claim this Product →

Show you’re listed

Add this badge to your website. It links back to this page.

Get your badge →