Evaluation

A systematic guide to lexical retrieval, dense retrieval, hybrid fusion, reranking, evaluation, observability, and production governance in RAG systems.

Explains how to build an observability and evaluation system for RAG that covers runtime execution, retrieval quality, generation quality, and continuous regression testing.

Introduces OpenTelemetry’s core components and observability signals, and explains how to use them with AI agents, RAG, and production systems.

An introduction to RAG chunking design, progressing from fixed chunks to structural, contextualized, and evaluation-driven approaches.

Explains the role, calculation, appropriate use cases, and main limitations of RRF in multi-retriever fusion for RAG.

An introduction to the roles of dense search, sparse search, RRF, and rerankers in an enterprise RAG retrieval pipeline.

Use this article as a reference when building an enterprise RAG system.

Drawing on Latent Space’s interview with Shunyu Yao, this article reviews ReAct, Reflexion, Tree of Thoughts, memory, benchmarks, ACI, and Agent UX, and summarizes the importance of tools, environments, evaluation, and interface design when putting AI agents into practice.

Starting from the trend of platforms absorbing basic RAG pipelines, this article examines the high-premium skills AI application engineers should prioritize in 2026: evaluation and observability, data governance and access control, and deep engineering capabilities for agentic workflows.

A systematic tour of the entire LLM training pipeline—from data pipelines, scaling laws, system constraints, synthetic data, distillation, post-training, and evaluation systems to agent training—and how these mechanisms affect model selection, evaluation, and harness design for AI application engineers.