vllm
vllm-project/vllmLLM Serving
A high-throughput and memory-efficient inference and serving engine for LLMs.
- gpt
- llm
- pytorch
- model-serving
- transformer
- llm-serving
- inference
- llama
More in AI and Agents
The model-definition framework for pretrained models in text, computer vision, audio, video, and multimodal tasks, for inference and training.
168.1kupdated today5.20.2
A framework for building agents and LLM-powered applications.
148.4kupdated todaylangchain-core==1.7.0
A general-purpose automatic speech recognition model trained on 680k hours of multilingual and multitask supervised data.
111.2kupdated 1mo ago20250625
Faster, lower-memory LLM fine-tuning, as a Python library or a desktop app.
78.5kupdated today0.1.910-beta
An intelligent memory layer for AI agents enabling personalized interactions.
67.8kupdated 1d agots-v3.3.1
A framework for orchestrating role-playing autonomous AI agents for collaborative task solving.
60.1kupdated today1.15.30
Agent skills for scientific research and analysis with Python libraries like scikit-learn, polars, and biopython.
54.4kupdated 5d ago2.72.0