← Running in production

Running in production

October 2026

• Oct 31, 2026 AI cost tracking & telemetry In the briefing →

  Google Cloud spend caps are generally available. Once a project hits its cap, pay-as-you-go and committed-use requests stop; Provisioned Throughput keeps running. For AI services the cap fires within minutes using estimated live costs, well before billing settles. Caps reset monthly, and a new API sets them per project. (official, docs)

• Oct 31, 2026 AI cost tracking & telemetry In the briefing →

  Anthropic renamed Max 5x to Max and Max 20x to Ultra, at the same $100 and $200 a month, and verified Ultra accounts no longer have the rolling five-hour session limit. The weekly allowance, 10 times Pro's, stays, so a long Claude Code session can now spend a week's budget in one go. Unverified accounts keep the cap until automatic checks clear them. (official, source)

• Oct 31, 2026 AI cost tracking & telemetry In the briefing →

  OpenTelemetry eBPF Instrumentation (OBI) reached 1.0, with stable configuration and deployment interfaces. It traces running Linux services without code changes, and its coverage includes model-provider calls, embeddings, vector retrieval, MCP tool calls, OpenAI-compatible gateways and Ollama. Payload capture is off unless configured. (official)

• Oct 30, 2026 AI cost tracking & telemetry In the briefing →

  OpenAI now lets subscribers on its $100, $200 and $500 monthly ChatGPT plans apply the same amount in API credits to one API organization, matching a benefit Anthropic gave Max and Team subscribers earlier this month. The help article does not say whether the credits expire. (official)

• Oct 29, 2026 AI cost tracking & telemetry In the briefing →

  Claude Enterprise gets smart reports, in-app surveys and pooled group budgets, all generally available. A smart report samples a team's transcripts and groups the work into workstreams with spend, deliverables and friction points for each. A pooled budget gives a group one monthly limit while member limits still apply, and alerts admins at 50%, 75%, 95% and 100%. Anthropic says the reports are not for judging individual performance. (official, source)

• Oct 29, 2026 AI cost tracking & telemetry In the briefing →

  GitHub Enterprise Cloud customers with an account team can now get Copilot for every licensed user, with no included allowance: usage meters against the enterprise budget from the first request. Completions keep working when the budget runs out, while Chat, code review and the cloud agent stop. Self-serve access comes later, and Copilot Standalone costs $10 per user per month. (official)

• Oct 27, 2026 AI cost tracking & telemetry In the briefing →

  Cloudflare's AI Gateway has an Auto Router in public beta. Set the model to cloudflare/auto and a classifier on Workers AI rates each request from 1 to 5 for complexity, ambiguity, stakes and dependence on earlier turns. It then picks a model by expected quality minus a cost penalty, within the gateway's existing spend limits. Cloudflare's own benchmark shows the router trailing some alternatives. (source)

• Oct 26, 2026 AI cost tracking & telemetry In the briefing →

  Claude Enterprise now merges chat and Cowork into one experience, generally available and switched on by default for existing organizations on November 16 unless an admin has already chosen. Four spend controls come with it: an Efficient mode limited to Sonnet and Haiku, per-role model entitlements, spend limits at organization, group and member level, and pooled group budgets. Zero-data-retention, HIPAA-ready and customer-managed-key organizations stay on their current setup. (official, official)

• Oct 25, 2026 AI cost tracking & telemetry Weekly recap Read the recap →

  Copilot's usage metrics API now names MCP servers and skills and breaks out usage by client, Claude Code and OpenCode included. Grafana's trace sampling went GA. (names, clients, Grafana)

• Oct 24, 2026 AI cost tracking & telemetry In the briefing →

  GitHub's Copilot usage metrics API added a totals_by_client breakdown, reporting requests, sessions and tokens from OpenCode, Claude Code, Codex, Zed, JetBrains and other clients using Copilot models. GitHub calls the client field a "best-effort grouping, not a verified identity", and request_count counts model calls rather than prompts. (official)

• Oct 24, 2026 AI cost tracking & telemetry In the briefing →

  OpenTelemetry now lets stable SDKs, instrumentation libraries and exporters ship security fixes in patch releases even when they change behavior: rejecting input, truncating or dropping telemetry, or failing on bad configuration. Public APIs and semantic conventions stay protected. (official)

• Oct 23, 2026 AI cost tracking & telemetry In the briefing →

  GitHub's Copilot usage metrics API now reports custom skills, custom agents, MCP servers, slash commands and plugins by name instead of lumping them under "other", with up to 25 entries per record, up from five. Names come from Copilot CLI 1.0.97 or later, the Copilot app, ACP integrations and SDK 1.0.21, not from IDE chat, and only for days processed after the change. (official)

• Oct 21, 2026 AI cost tracking & telemetry In the briefing →

  Respan open-sourced a Rust AI gateway after a January LiteLLM upgrade caused connection failures it never diagnosed, ending two years and 100,000 lines of wrapper code. Providers, routing and MCP tools are plugins compiled into the binary and run in registration order, so a cache placed ahead of a security check can answer before the check runs. (source)

• Oct 21, 2026 AI cost tracking & telemetry In the briefing →

  Grafana made volumetric trace sampling generally available, spreading a sampling budget across services and request types; Grafana claims trace volume can drop 90%. Dropped traces stay retrievable by trace ID for 24 hours but leave search. Agent runs that emit a span per model call and tool step are where the volume comes from. (official)

• Oct 18, 2026 AI cost tracking & telemetry In the briefing →

  Accenture will reportedly fund only $29 of Claude usage per employee per month, with anything above that charged to a project's budget code. Some staff had been spending around $1,000 a month, according to 404 Media, which first reported the internal memo. Accenture has not confirmed the figure. (source) (unconfirmed)

• Oct 18, 2026 AI cost tracking & telemetry Weekly recap Read the recap →

  Copilot's OpenTelemetry data can now name the user without capturing prompts, BigQuery added token quotas, and Grafana proposed error budgets for agent behavior. Accenture reportedly caps staff Claude spend at $29 a month (unconfirmed). (Copilot, BigQuery, Grafana, Accenture)

• Oct 17, 2026 AI cost tracking & telemetry In the briefing →

  Grafana Labs proposes running agent quality the way SRE teams run uptime. Each evaluation, such as groundedness, request fulfilled or PII exposed, becomes its own SLI, with a target like 95% of conversations fulfilled over 30 days. The 5% left over is an error budget that slow drift uses up before any alert fires. It is a method, not a shipped product. (official, source)

• Oct 16, 2026 AI cost tracking & telemetry In the briefing →

  A pre-registered study ran a fixed five-agent review-and-fix pipeline over 465 agent-authored pull requests with three models. Each point of CodeHealth, a maintainability score, came with 3.5% to 6.1% lower token cost, mostly in the review stage. Adjusting for the size of the scored files absorbed the effect. (paper)

• Oct 15, 2026 AI cost tracking & telemetry In the briefing →

  BigQuery added token quotas for its generative AI SQL functions such as AI.GENERATE and AI.IF. Daily input and output caps apply per project and per user, with thinking tokens counted as output; defaults are 200 billion input and 20 billion output tokens per project. Lowering a quota takes effect immediately. A query that runs out midway skips the remaining rows and marks them with a quota error rather than failing outright. (official)

• Oct 14, 2026 AI cost tracking & telemetry In the briefing →

  LangSmith added AI Search for agent traces: describe a behavior in plain language ("did PII leak?", "did the user get frustrated?") and a fast model reads each condensed trajectory, capped at 8K tokens, and streams back matches. It combines with existing filters such as errored-only traces. It is a public beta on LangSmith Cloud at no extra cost, switched on by an org admin. (official)

• Oct 13, 2026 AI cost tracking & telemetry In the briefing →

  Enterprise admins can now attach a user to GitHub Copilot's OpenTelemetry data through a managed telemetry setting. Identity capture adds the GitHub login, local OS account and host name, while prompts, responses, tool arguments, tool output and policy detail are five separate switches, all off by default. It covers Copilot CLI, the Copilot app and VS Code Agent Host sessions. (official)

• Oct 11, 2026 AI cost tracking & telemetry In the briefing →

  Ai2 replaced priority-based GPU scheduling, under which nearly every job ended up marked high priority, with GPU-time budgets that managers split across programs and projects, fair-share over a 7-day window, and an 8-hour protected minimum runtime. Over 30 days teams got 98% of the GPU hours they were owed, occupancy held at 98%, and p90 queue wait for debug jobs fell from 2 hours to 30 seconds. (official)

• Oct 11, 2026 AI cost tracking & telemetry Weekly recap Read the recap →

  Max and Team plans gained monthly API credits that lapse each cycle. Copilot usage metrics have undercounted agent activity, with no backfill, and Ai2's GPU-time budgets cut p90 debug-job waits from 2 hours to 30 seconds. (credits, metrics, Ai2)

• Oct 10, 2026 AI cost tracking & telemetry In the briefing →

  The fifth part of Stack Overflow's guide to running LLM systems gets specific. Send every model call through one gateway that tags tokens and dollars by tenant, capability and model. Warn at 80% of a daily budget and stop at 100%, add a platform-wide ceiling because per-tenant caps don't add up to one, and count retries, since retry and tool loops multiply spend unnoticed. (official)

• Oct 9, 2026 AI cost tracking & telemetry In the briefing →

  Goodfire launched agent monitors for Baseten customers that run small probes over a model's internal activations and call an LLM judge only on flagged steps. On Kimi K3, Goodfire puts a million exchanges at about $185 against $5,420 for a cheap judge reading every step, catching 93% of malicious hacking sessions. (source)

• Oct 8, 2026 AI cost tracking & telemetry In the briefing →

  Anthropic is adding monthly API credits to Claude subscriptions: $100 on Max 5x, $200 on Max 20x, and $20 or $100 per Team seat, pooled up to $500. They cover the API, Managed Agents and the Agent SDK, not interactive Claude Code or cloud marketplaces, and expire each billing cycle. Free, Pro and Enterprise get none. (official)

• Oct 7, 2026 AI cost tracking & telemetry In the briefing →

  Copilot usage metrics have been undercounting agent activity since several IDEs moved agent sessions to the Copilot SDK without tagging which IDE they came from. VS Code 1.139.0 fixes it now, Visual Studio 18.12 this month, JetBrains in late October and Eclipse and Xcode in November. GitHub cannot backfill the missing data. (official)

• Oct 4, 2026 AI cost tracking & telemetry In the briefing →

  Simon Willison argues that pay-per-use APIs and clouds should ship hard spending caps on by default, with uncapped billing an explicit opt-in, because coding agents now deploy things that can run up bills overnight. AWS added project spend limits in September and Google Cloud added spend caps in July, but both are opt-in. (source)

• Oct 4, 2026 AI cost tracking & telemetry Weekly recap Read the recap →

  OpenAI's $200 Pro plan halves to 10x the Plus allowance on October 30, with a new $500 tier. Dynatrace closed its Arize purchase, Grafana Tempo 3.1 can redact PII across traces in one query, and Simon Willison argued for hard spending caps on by default. (Pro, Arize, Tempo, caps)

• Oct 2, 2026 AI cost tracking & telemetry In the briefing →

  Dynatrace closed its $915 million purchase of Arize. Both the open-source Phoenix tracer and the commercial AX product stay supported while Arize's tracing moves into the Dynatrace platform. (source)

• Oct 1, 2026 AI cost tracking & telemetry In the briefing →

  Grafana Tempo 3.1 can redact leaked PII across many traces with a single TraceQL query, dry run first, instead of listing trace IDs by hand. An experimental trace-diff endpoint, also exposed as a tool on Tempo's MCP server, returns only the structural differences between two traces, so an assistant investigating a regression reads far less context. (official)