Repositories list

• gpustack

  Public
  A GPU cluster manager that configures and orchestrates inference engines like vLLM and SGLang for high-performance AI model deployment.

  cudainferenceopenai+ 15

  cudainferenceopenaillamamaasrocmascendllmllm-servingvllm+ 8

  Python

  •

  Apache License 2.0

  •511511 forks•4.9k4.9k stars•535535 issues•3030 pull requests•Updated Apr 24, 2026Apr 24, 2026

• gpustack-ui

  Public
  TypeScript

  •

  Apache License 2.0

  •5656 forks•7979 stars•22 issues•55 pull requests•Updated Apr 24, 2026Apr 24, 2026

• core-ui

  Public
  TypeScript

  •00 forks•00 stars•00 issues•00 pull requests•Updated Apr 24, 2026Apr 24, 2026

• gpustack.github.io

  Public
  HTML

  •22 forks•11 star•00 issues•00 pull requests•Updated Apr 24, 2026Apr 24, 2026

• gpustack-higress-plugin

  Public
  Go

  •33 forks•22 stars•00 issues•00 pull requests•Updated Apr 17, 2026Apr 17, 2026

• community-inference-backends

  Public
  Community Inference Backends for GPUStack V2

  Python

  •

  Apache License 2.0

  •88 forks•1212 stars•00 issues•00 pull requests•Updated Apr 17, 2026Apr 17, 2026

• runtime

  Public
  Provides a unified interface to detect GPU resources and manages GPU workloads.

  Python

  •

  Apache License 2.0

  •1515 forks•1414 stars•00 issues•33 pull requests•Updated Apr 8, 2026Apr 8, 2026

• .github

  Public
  Meta-Github repository for all GPUStack repositories.

  github-metadata

  github-metadata

  Apache License 2.0

  •44 forks•11 star•00 issues•00 pull requests•Updated Apr 1, 2026Apr 1, 2026

• gguf-parser-go

  Public
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

  gollama-cppgguf+ 2

  gollama-cppggufstable-diffusion-cppllama-box

  Go

  •

  MIT License

  •2424 forks•265265 stars•11 issue•00 pull requests•Updated Mar 25, 2026Mar 25, 2026

• runner

  Public
  Collection of Dockerfiles to build images for various inference services across different accelerated backends.

  Dockerfile

  •

  Apache License 2.0

  •99 forks•1212 stars•00 issues•00 pull requests•Updated Mar 13, 2026Mar 13, 2026

• benchmark-runner

  Public
  Python

  •

  Apache License 2.0

  •22 forks•33 stars•11 issue•00 pull requests•Updated Mar 6, 2026Mar 6, 2026

• vox-box

  Public
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

  pythontext-to-speechtts+ 5

  pythontext-to-speechttsspeech-to-textsttaudio-processingasropenai-compatible-api

  Python

  •

  Apache License 2.0

  •3333 forks•209209 stars•1616 issues•22 pull requests•Updated Dec 23, 2025Dec 23, 2025

• llama-box

  Public archive
  LM inference server implementation based on *.cpp.

  cpptransformerdiffusion+ 2

  cpptransformerdiffusionggufopenai-compatible-api

  C++

  •

  MIT License

  •2828 forks•295295 stars•22 issues•00 pull requests•Updated Nov 24, 2025Nov 24, 2025

• gpustack-helper

  Public
  Python

  •

  Apache License 2.0

  •22 forks•11 star•11 issue•00 pull requests•Updated Aug 26, 2025Aug 26, 2025

• fastfetch

  Public
  Like neofetch, but much faster because written mostly in C.

  C

  •

  MIT License

  •750750 forks•22 stars•00 issues•00 pull requests•Updated Oct 24, 2024Oct 24, 2024

• gguf-packer-go

  Public
  Deliver LLMs of GGUF format via Dockerfile.

  gollamagguf

  gollamagguf

  Go

  •

  MIT License

  •55 forks•1515 stars•00 issues•00 pull requests•Updated Oct 24, 2024Oct 24, 2024