Running in production
November 2026
-
AI cost tracking & telemetry In the briefing →
GitHub's Copilot impact dashboard now counts engagement with Copilot Chat and the VS Code Agents window, and the metrics API gains
chatandvscode_agententries. "Passive users" become "Chat-first users". Only 28-day reports from now on include the new features, so earlier periods aren't comparable. (official) -
AI cost tracking & telemetry Weekly recap Read the recap →
Grok Bot limits were throttled without notice, OpenAI told Pro users ChatGPT and Codex will share one allowance, and Ramp saw token spend stall then rise 8.9%. Apple reportedly cut engineers' daily AI cap from $300 to $200. (Grok, allowance, Ramp, Apple) (unconfirmed)
-
AI cost tracking & telemetry In the briefing →
Ramp's card and bill data shows company spend on AI tokens grew only 1.5% across August and September combined, after 42% in July, then rose 8.9% in the month to October 23. The median company spends $12 to $15 per employee per month; the top tenth spends $600 to $1,000. Ramp's economist says almost all of it comes from venture-backed tech companies. (source)
-
AI cost tracking & telemetry In the briefing →
OpenTelemetry JS SDK 3.0 raises the minimum to Node.js 22.15.0, merges the tracing packages into
@opentelemetry/sdk-trace, ships ESM alongside CommonJS, and marks logs stable. The API package has no breaking changes, and the 2.x SDK gets a year of support. Agent services pinned to Node 20 need an upgrade before they can move. (official) -
AI cost tracking & telemetry In the briefing →
Apple reportedly cut its engineers' daily AI spending cap from $300 to $200 in October, with some teams dropping to $100 and a $25 limit under discussion outside engineering, according to Bloomberg via TechCrunch. Apple has not confirmed it. (source) (unconfirmed)
-
AI cost tracking & telemetry In the briefing →
Google tested routing a 50-task coding benchmark through a cheap classifier that sends each task to Flash-Lite first and escalates only flagged ones. The router solved all 50, as Gemini Flash on low thinking did, at lower cost and latency. A regex-and-length heuristic scored 93.8% on its tuning set but 70.6% on unseen tasks. Capping output at 300 tokens broke 7 of 25 hard tasks. (official)
-
AI cost tracking & telemetry In the briefing →
The Copilot usage API now separates bring-your-own-key and enterprise custom-model traffic from Copilot-hosted usage, with new per-user and aggregate fields such as
totals_by_local_byokandis_custom_enterprise_model. Local counts come from client telemetry, so they run low when telemetry is off, and there is no backfill. (official) -
AI cost tracking & telemetry In the briefing →
Grafana Alloy's OTel engine, an OpenTelemetry Collector distribution that reads standard Collector YAML with no Alloy syntax, reached public preview in Alloy v1.21.0. It runs as
alloy otel --config=config.yamland deploys through the Helm chart or the OpenTelemetry Operator. (official) -
AI cost tracking & telemetry In the briefing →
Google's Mandiant and threat-intelligence group detail LLMJacking: attackers use stolen cloud credentials, leaked API keys or exposed Ollama endpoints to enable Bedrock, Gemini or Azure model services on a victim's account and resell the access. Single incidents passed $100,000 in a day and $1 million before revocation. Stolen keys are tested with
max_tokens=1requests that stay under volume alerts. Google's advice: alert whenever an AI service is enabled, scope keys per model, set per-model spending caps, and patch gateways such as LiteLLM. (official) -
AI cost tracking & telemetry In the briefing →
Grok Bot subscribers found weekly limits maxed out over the weekend, some jumping from 50% to 100% without heavy use. Elon Musk said on X the change was deliberate, as serving costs were "unsustainably high relative to revenue." There is no formal notice and no word on what the limits now are. (source)
-
AI cost tracking & telemetry In the briefing →
OpenAI told Pro subscribers by email that ChatGPT and Codex will draw from one allowance, according to BleepingComputer. Unlimited Instant doesn't count against it, while heavier models and longer tasks use more. Remaining usage and reset times sit under Settings > Usage, and running out means waiting, upgrading or buying credits. The email gave no start date and no numbers. (source)
-
AI cost tracking & telemetry In the briefing →
App-hosting platform Northflank told customers to assume every environment variable was decrypted and to rotate all keys, after Wiz alerted it to a breach. Customers have since reported unauthorized use of the AI API keys stored there. Wiz counts at least nine breaches of AI developer platforms in October, Railway, OpenCode and Warp among them, many aimed at AI credentials. In two cases it investigated, stolen keys made about 2.5 million Bedrock calls costing roughly $100,000. Northflank has not said how attackers got in. (source)
-
AI cost tracking & telemetry Weekly recap Read the recap →
Claude Enterprise added pooled group budgets and smart reports, and Google Cloud spend caps went GA. Anthropic's renamed Ultra plan dropped the five-hour session cap, and OpenTelemetry's eBPF instrumentation reached 1.0 with model and MCP call tracing. (Claude Enterprise, spend caps, OBI)