Pinned Loading

1. vllm-project/vllm-torchtpu vllm-project/vllm-torchtpu Public

   Python 126 41

2. sgl-project/sglang-torchtpu sgl-project/sglang-torchtpu Public

   SGLang's TorchTPU Plugin

   Python 74 29

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96.3k 24.4k

4. vllm-project/tpu-inference vllm-project/tpu-inference Public

   Moving to vllm-project/vllm-jax. TPU inference for vLLM, with unified JAX and PyTorch support.

   Python 477 356

5. AI-Hypercomputer/maxtext AI-Hypercomputer/maxtext Public

   A simple, performant, and scalable Jax LLM!

   Python 2.5k 638

6. AI-Hypercomputer/JetStream AI-Hypercomputer/JetStream Public

   JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

   Python 472 70