Alibaba

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

XQUIC Library released by Alibaba is a cross-platform implementation of QUIC and HTTP/3 protocol.

A high-performance web server and reverse proxy, 100% compatible with nginx.

An evaluation and evolution tool for Agent Skills.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.

An end-to-end agent project for GPU kernel implementation, analysis, profiling, and iterative optimization. It helps an agent turn PyTorch logic or an existing kernel into a high-performance GPU kernel through a structured, profile-driven workflow.

ANOLISA (Agentic Nexus Operating Layer & Interface System Architecture)

A lightweight, lightning-fast, in-process vector database