https://sinimite.work/en/categories/aifundamentals/Recent content in AIFundamentals on SiBloghttps://sinimite.work/images/og-default.svg?v=20260525-210321https://sinimite.work/images/og-default.svg?v=20260525-210321Hugo -- 0.156.0en-USSat, 02 May 2026 00:00:00 +0000https://sinimite.work/en/posts/llm-from-hidden-state-to-token-output/Sat, 02 May 2026 00:00:00 +0000https://sinimite.work/en/posts/llm-from-hidden-state-to-token-output/Why does Chain of Thought work? Why are longer prompts not always better? Why do models hallucinate? These apparently unrelated engineering phenomena are different expressions of the same core mechanism. This article uses one master key to open five doors in LLM engineering.https://sinimite.work/en/posts/llm-training-for-ai-engineers/Sat, 04 Apr 2026 12:00:00 +0900https://sinimite.work/en/posts/llm-training-for-ai-engineers/A panoramic guide to LLM training for AI application engineers, covering pretraining, post-training, distillation, reward design, agent training, and harness engineering, so you can understand where model capabilities come from and how training decisions affect real-world deployment.https://sinimite.work/en/posts/entropy-in-llm/Fri, 27 Mar 2026 00:00:00 +0000https://sinimite.work/en/posts/entropy-in-llm/Entropy runs through the entire LLM lifecycle: training uses cross-entropy as the loss, inference uses temperature to control output entropy, evaluation uses perplexity, and products can use entropy signals to detect hallucinations. This article maps the complete picture from an AI engineer's perspective.https://sinimite.work/en/posts/llm-api-kv-cache/Thu, 05 Mar 2026 11:09:00 +0900https://sinimite.work/en/posts/llm-api-kv-cache/KV Cache is a key concept connecting Transformer theory with LLM engineering and deployment. Understanding it completes the path from how a model computes to how it runs.https://sinimite.work/en/posts/llm-chain-of-thought-cot/Wed, 04 Mar 2026 21:51:00 +0900https://sinimite.work/en/posts/llm-chain-of-thought-cot/Understand what LLM Chain-of-Thought (CoT) is and how prompt engineering can elicit Chain-of-Thought (CoT) from an LLM.https://sinimite.work/en/posts/understanding-transformer-intuition/Tue, 24 Feb 2026 12:00:00 +0900https://sinimite.work/en/posts/understanding-transformer-intuition/My first formal blog post.