Skip to content
#

gpu-orchestration

Here are 3 public repositories matching this topic...

Language: All
Filter by language

Distributed document RAG system with intelligent GPU/CPU orchestration. Auto-discovers heterogeneous nodes, routes workloads adaptively, and achieves 60x+ speedups through VRAM-aware load balancing. Privacy-first architecture with 4 interfaces (CLI, API, MCP, Web UI). Real distributed systems engineering, not just an API wrapper.

  • Updated Nov 3, 2025
  • Python

Improve this page

Add a description, image, and links to the gpu-orchestration topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the gpu-orchestration topic, visit your repo's landing page and select "manage topics."

Learn more