Search results
Extract triples with Ollama or vLLM, store them in a graph database, and explore them in a GPU-accelerated web UI Cut memory ~3.5× vs FP16 while keeping accuracy close to FP8, then validate with an OpenAI-compatible endpointIntermediate60 MINQuantize Models to NVFP4 with NVIDIA Model Optimizer
Chat from the terminal against local vLLM with the self-improving Nous Research agent (Telegram optional) Isolate OpenClaw with kernel-level policies and route inference to a local model High-throughput serving for 30+ models, with continuous batching and an OpenAI-compatible APIIntermediate30 MINServe LLMs with vLLM
Items per page
of 1 pages