← Founder Notes
Archive

Agent traffic now dwarfs human traffic in production. microsoft's first production-scale copilot…

Yethikrishna ROriginal on Threads

agent traffic now dwarfs human traffic in production. microsoft's first production-scale copilot study sampled 3.2m users, 13m sessions and 95 trillion tokens, finding 87% of llm calls are agent-initiated and cache hit rates fall 26 points at agent depths.

the cache was built for chat, not for agents.

Context

The arXiv preprint 2608.00101, submitted 30 July 2026 by authors from Microsoft Azure Research and UIUC, samples GitHub Copilot traces from June 2026: 3.2M users, 13M sessions, 761M LLM calls and 95T tokens. It reports about 87 percent of calls agent-initiated against 13 percent user-initiated, and KV cache hit rates averaging 90 percent within a turn and falling to 55 percent across turn boundaries. A figure caption says same-model boundaries cause a 26 percent average drop and model-switch boundaries near-complete invalidation.

How it compares

These are GitHub Copilot coding-agent traces, not all Copilot or all agent traffic. The 87 percent is a share of LLM calls inside those traces, not traffic versus human web traffic. The 26 in the paper is the average drop across same-model boundaries, with relative or points unclear in the caption, so fall 26 points at agent depths is not supported as stated; the 90 to 55 percent is a 35 point gap. The cache was built for chat, not for agents is the author's take.

Related work

Watch next

  • The peer-reviewed version and other vendors' serving traces.

Sources

  1. Production-scale agent traces (arXiv 2608.00101)arxiv.org

Provenance

The note above is reproduced unedited from the original post, first published on Threads on 20 September 2026 at 08:02 IST. Sources are the papers and datasets the note draws on.

View the original post
Embed this note
<iframe src="https://founder.myndlabs.tech/notes/embed/agent-traffic-now-dwarfs-human-traffic-in-production-DdfhSEEiEcm" width="480" height="420" style="border:0;max-width:100%" loading="lazy" title="Agent traffic now dwarfs human traffic in production. microsoft's first production-scale copilot…"></iframe>

More notes