Pinned Loading

1. kiln kiln Public

   LLM inference engine in C++/CUDA with a Python API. KV caching (including a paged cache with shared prompt prefixes), INT8/INT4 quantization, LoRA, and an OpenAI-compatible server, checked against …

   C++

2. Consensa Consensa Public

   Distributed vector database in Go: hand-written Raft, HNSW search, gRPC API, TLA+ specs

   Go

3. aegis-observability aegis-observability Public

   Finds which service actually caused an outage, not just the loudest one. Builds a graph from Kafka trace data and takes the service nothing points at as the root cause: 78/78 on simulated outages. …

   Python

4. cleartext-api cleartext-api Public

   Async ML inference API: FastAPI returns a task ID while batched Celery workers run BERT. Model-versioned Redis cache, queue-based rejection, and a replayable dead-letter queue.

   Python 1

5. kv-store kv-store Public

   LSM-tree key-value store in Python — write-ahead log, memtable, SSTables with Bloom filters, size-tiered compaction. Crash-safe and verified with a real kill -9 recovery test. Redis-style TCP proto…

   Python

6. go-auth-service go-auth-service Public

   JWT identity service in Go. Rotating refresh tokens with reuse detection — replaying a consumed token revokes every session — plus Redis-backed revocation and rate limiting that degrades to in-memo…

   Go