Turning on the generator's reasoning moved accuracy more than any retrieval architecture.
Python · OpenSearch · LightRAG · Graph-R1 · Search-R1
Read the write-upAI Infrastructure Engineer
AI Lead at WPP Enterprise Solutions · Poznań, Poland
Building production AI systems, LLM infrastructure, inference platforms and cloud-native ML solutions.
Turning on the generator's reasoning moved accuracy more than any retrieval architecture.
Python · OpenSearch · LightRAG · Graph-R1 · Search-R1
Read the write-upA mid-range GPU most published benchmarks skip in favour of the H100.
Python · vLLM · SGLang · TensorRT-LLM · AIPerf
Read the write-upThree cloud multi-model patterns compared on what each makes easy - not a cost benchmark.
Triton · ONNX · SageMaker · Azure ML · Vertex AI
Read the write-up
How much KV cache an inference engine reserves decides how many requests it can run at once, and that often matters more than the engine. Measured on Qwen3-32B with vLLM, SGLang and TensorRT-LLM on a single L40S, with the flags to control it in each engine.

Nine retrieval strategies from 2024-2026 - naive and reranked hybrid search, MetaRAG, agentic RAG, A-RAG, Search-R1, LightRAG and Graph-R1 - benchmarked on the same OpenSearch index, the same base generator and the same 1,000 questions. In this benchmark the biggest lever turned out to be the generator's reasoning, not the retrieval architecture.

A systematic comparison of three leading LLM inference engines - vLLM, SGLang, and TensorRT-LLM - benchmarked on Qwen3-32B across concurrency scaling, long-context, quantization, and MoE workloads on a single NVIDIA L40S GPU.