Search. Pull. Build.

livekit-server is an open-source media server for real-time audio, video, and data, designed for low latency and scalability

livekit-sip is a SIP-to-WebRTC bridge that connects phone calls to LiveKit rooms

llm-d Router components — the Endpoint Picker (EPP) ext-proc endpoint selector, the prefill/decode disaggregation sidecar, and the request coordinator — for cache- and load-aware routing of LLM inference traffic.

llm-d Router components — the Endpoint Picker (EPP) ext-proc endpoint selector, the prefill/decode disaggregation sidecar, and the request coordinator — for cache- and load-aware routing of LLM inference traffic.

llm-d Router components — the Endpoint Picker (EPP) ext-proc endpoint selector, the prefill/decode disaggregation sidecar, and the request coordinator — for cache- and load-aware routing of LLM inference traffic.

Kubernetes operator for the vLLM Production Stack, vLLM's reference system for K8S-native cluster-wide deployment, that manages LoRA adapters, vLLM runtimes, routers and cache servers through CRDs.

Local Path Provisioner provides a way for the Kubernetes users to utilize the local storage in each node.