Rust Streaming RAG Gateway
Rust · Tokio · Tonic/gRPC · Qdrant · Rig
A streaming RAG backend for document ingestion, semantic retrieval, and grounded LLM responses over a strongly typed gRPC API. Async streaming with Tokio keeps tokens flowing to clients under concurrent load, while Qdrant handles vector search and Rig wires the model calls.