https://abhinandan.one https://abhinandan.one/hero.jpg https://abhinandan.one/hero-photo.jpg 2026-10-12T05:59:11.509Z weekly 1 https://abhinandan.one/about monthly 0.9 https://abhinandan.one/projects 2026-05-20T00:00:00.000Z monthly 0.9 https://abhinandan.one/artifacts 2026-10-12T05:59:11.509Z weekly 0.9 https://abhinandan.one/contributions daily 0.7 https://abhinandan.one/resume monthly 0.8 https://abhinandan.one/ml_resume monthly 0.8 https://abhinandan.one/forward_deployed_resume monthly 0.8 https://abhinandan.one/agentflow-pro 2026-05-20T00:00:00.000Z monthly 0.85 https://abhinandan.one/smartmemo 2026-03-15T00:00:00.000Z monthly 0.85 https://abhinandan.one/orchflow 2026-02-20T00:00:00.000Z monthly 0.85 https://abhinandan.one/agenteval 2026-01-25T00:00:00.000Z monthly 0.85 https://abhinandan.one/artifacts/building-a-quantized-l2-kv-cache-for-sglang-hiqcache https://abhinandan.one/og/artifacts/building-a-quantized-l2-kv-cache-for-sglang-hiqcache 2026-10-13T12:39:14.292Z monthly 0.8 https://abhinandan.one/artifacts/understanding-attention-from-scratch https://mehqnbdhdsgejnmdvvjc.supabase.co/storage/v1/object/public/artifact-images/artifacts/understanding-attention-from-scratch/1791307793884-3q23mpo9b8i.png Understanding Attention From Scratch — demo https://i.ytimg.com/vi/tvAnjRb605w/hqdefault.jpg I think if you have ever spent even a single day learning about current models, then attention is most probably the first term you may have heard. And when it comes to the architecture of these… https://www.youtube-nocookie.com/embed/tvAnjRb605w yes 2026-10-06T17:42:39.065Z monthly 0.8 https://abhinandan.one/artifacts/prefill-decode-made-crystal-clear https://mehqnbdhdsgejnmdvvjc.supabase.co/storage/v1/object/public/artifact-images/artifacts/prefill-decode-made-crystal-clear/1790946591343-2ax7f1193kr.png 2026-10-02T13:58:38.825Z monthly 0.8 https://abhinandan.one/artifacts/measuring-adaptive-speculative-decoding-in-sglang https://mehqnbdhdsgejnmdvvjc.supabase.co/storage/v1/object/public/artifact-images/artifacts/measuring-adaptive-speculative-decoding-in-sglang/1790238498396-mqhhm2ie70l.jpg 2026-10-03T11:46:38.499Z monthly 0.8 https://abhinandan.one/artifacts/building-a-mini-inference-engine-from-scratch https://abhinandan.one/og/artifacts/building-a-mini-inference-engine-from-scratch Building a Mini Inference Engine from Scratch — demo https://i.ytimg.com/vi/0-gmk9ND6yc/hqdefault.jpg Most of us know that LLMs are auto-regressive, i.e., they generate token one by one. We also know that they have a concept of KV caching and can process multiple requests together, requests of… https://www.youtube-nocookie.com/embed/0-gmk9ND6yc yes 2026-09-23T11:25:27.735Z monthly 0.8 https://abhinandan.one/artifacts/building-a-semantic-cache-that-does-not-trust-cosine https://abhinandan.one/og/artifacts/building-a-semantic-cache-that-does-not-trust-cosine Building a Semantic Cache that Does Not Trust Cosine — demo https://i.ytimg.com/vi/UoHwsRx7J-I/hqdefault.jpg Usually semantic caches for LLMs work on embeddings and cosine similarity. You take the new prompt, turn it into a vector, find the closest old prompt, and if the score is high enough you reuse the… https://www.youtube-nocookie.com/embed/UoHwsRx7J-I yes 2026-09-23T08:34:02.344Z monthly 0.8 https://abhinandan.one/artifacts/running-a-health-voice-all-private-on-your-mac https://mehqnbdhdsgejnmdvvjc.supabase.co/storage/v1/object/public/artifact-images/artifacts/health-voice-assistant/1782451691575-byd54z6ysfr.png Running a Health Voice: All Private on Your Mac — demo https://i.ytimg.com/vi/KEieS276Rrw/hqdefault.jpg There is this promise that a doctor can just talk, and a note will write itself. It feels good & easy when you say it like that. Talk, note, done. But the patient's voice has to go somewhere, and… https://www.youtube-nocookie.com/embed/KEieS276Rrw yes 2026-09-23T08:25:36.270Z monthly 0.8 https://abhinandan.one/artifacts/building-a-rag-based-search-system-for-an-enterprise https://mehqnbdhdsgejnmdvvjc.supabase.co/storage/v1/object/public/artifact-images/artifacts/enterprise-rag/1782369244122-if90wrbuvz.png https://mehqnbdhdsgejnmdvvjc.supabase.co/storage/v1/object/public/artifact-images/artifacts/enterprise-rag/1782369256521-w32xw4euc.png Building a RAG based Search System for an Enterprise — demo https://i.ytimg.com/vi/00RRYFfVe_Y/hqdefault.jpg There will be only 0.000001% people in tech who have not heard the word RAG. Embed a few documents, find the close ones, paste them into a prompt. The answer comes back. It feels good & easy. You can… https://www.youtube-nocookie.com/embed/00RRYFfVe_Y yes 2026-09-23T08:31:13.386Z monthly 0.8