https://toddwbucy.github.io/toddwbucy_research_blog/tags/kv-cache/Recent content in Kv-Cache on Todd W. Bucy — Research BlogHugoen-usMon, 18 May 2026 00:00:00 +0000https://toddwbucy.github.io/toddwbucy_research_blog/blog/2026/05/latency-is-the-enemy-of-agency/Mon, 18 May 2026 00:00:00 +0000https://toddwbucy.github.io/toddwbucy_research_blog/blog/2026/05/latency-is-the-enemy-of-agency/<p><strong>Why an Engineer with the Hardware in Front of Him Wants AI to Do Better</strong></p> <p><img src="https://toddwbucy.github.io/toddwbucy_research_blog/images/blog/latency-is-the-enemy-of-agency/title.jpg" alt="" /></p> <p><em>Personal note in a series that has been making architectural arguments. The architectural papers describe what the framework is. This piece describes why someone would build it. Specifically: why I built it, what about current AI deployment offends me as someone who actually understands the hardware, and what the architectural commitments come from.</em></p>