Tagged: engineering
Google's Best Bug Hunter Is a Small Model Run Five Times. You Can't Have It.
AI

Google's Best Bug Hunter Is a Small Model Run Five Times. You Can't Have It.

On July 21 Google shipped Gemini 3.5 Flash Cyber, a small fine-tune that found 55 confirmed vulnerabilities in V8 against 36 for Opus 4.6, by being called up to five times inside CodeMender. The recipe is copyable. The model is not: it goes to governments and trusted partners only.

AWS Started Metering Coding Agents Like Infrastructure. The Metrics Came From the IDE Era.
AI

AWS Started Metering Coding Agents Like Infrastructure. The Metrics Came From the IDE Era.

On July 20 Amazon CloudWatch shipped Coding Agent Insights, ingesting OpenTelemetry metrics straight out of Claude Code, Codex and GitHub Copilot. The coding agent moved from the tools budget to the infrastructure budget, which is the right call. The metric set is not: tokens, cost, sessions, lines of code, commits and edit acceptance all measure the middle of the work, the part the agent took over.

AI Context Windows Got 10x Bigger. Nobody Changed Their Architecture.
AI

AI Context Windows Got 10x Bigger. Nobody Changed Their Architecture.

Million-token context windows changed everything about what's possible, but most teams are still building for 4K limits.

The Pilot-to-Production Gap Is Where AI Projects Go to Die
ARCHITECTURE

The Pilot-to-Production Gap Is Where AI Projects Go to Die

GPT-5.4 can handle a million tokens. But most application architectures were designed for 4K-32K contexts, and the jump to 1M doesn't just expand capacity, it breaks fundamental assumptions about how you build.

Prompt Caching Is the Difference Between a Viable AI Product and a Bankrupt One
AI

Prompt Caching Is the Difference Between a Viable AI Product and a Bankrupt One

Claude Code treats prompt cache misses like server outages. The engineering behind that decision saves millions in API costs.

Your AI Stack Is Already Legacy
AI

Your AI Stack Is Already Legacy

The frameworks and abstractions built twelve months ago are already getting in the way. The models got good enough that the middleware became the bottleneck.

All engineering ai agents architecture context-windows