list_of_llm_inference_engines

Table of Contents

List of LLM inference engines
- - vLLM
  - llama.cpp
  - ExLlamaV2
  - Aphrodite

List of LLM inference engines

vLLM

Main article: vLLM

llama.cpp

Main article: llama.cpp

ExLlamaV2

Main article: exllamav2

Aphrodite

Main article: aphrodite

list_of_llm_inference_engines.txt · Last modified: 2025/04/18 01:37 by Severian