io.github.AIops-tools/inference-aiops icon

Inference AIops

by AIops-tools

io.github.AIops-tools/inference-aiops

Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 39 tools.

Version 0.8.0 · latest
AI Tools
Local
View source

Inference AIops · v0.8.0 (latest)

by AIops-tools

75