GPT-Live matches Moshi, Crawshaw bets on rebase, Baseten credits Blackwell
Every URL the pipeline pulled into ranking for this issue — primary sources plus the supporting and contradicting findings each Researcher returned. Inline citations in the issue point back here.
Sources
How we built a realtime system for responsive voice AI in six months openai.com
GPT-Live enables continuous voice interaction with AI, using a turnless speech model and low-latency architecture for faster, more natural conversations.
Quoting David Crawshaw’s prompt simonwillison.net
Set up a nightly cron job that executes the prompt: fetch upstream changes to the
and rebase all local changes on top of upstream. Check that the software works as intended and replace the current version. — David Crawshaw’s prompt , Devtools must be open source Tags: prompt-engineering , coding-agents , generative-ai , ai , llms , open-source
Devtools must be open source (exe.dev) simonwillison.net
My comment on Devtools must be open source (exe.dev) — Hacker News. One of the arguments for open source software for end-users has always been the freedom to examine and modify how that software works. The reality for most people - even expert programmers - has been that the freedom is more about being able to lean on other people to do that. Most people can’t justify the time commitment needed to read and then modify the code for tools they use very often. I think LLMs have changed that equat…
The Inference Engineering Masterclass — Philip Kiely & Ali Taha, Baseten latent.space
Baseten just raised a $13B Series F and is now one of the leading kings of inference engineering. We go into everything you need to know for autoregressive and diffusion engineering.
Quoting Steve Yegge simonwillison.net
Steve Yegge’s self-hosting coding agent Gas Town worked through Opus 4.6 but collapsed on 4.7, when the model developed a habit of endlessly fiddling with its own scaffolding instead of converging on real tasks. Yegge calls the regression the final straw for the project.
Don’t be a meat proxy simonwillison.net
Niklas Gruhn’s term targets workers who relay model responses verbatim to colleagues without reading or validating them. His prescription: prompt freely, but rewrite the answer in your own words as a certificate that you actually understood and checked it.
References
BuildFastWithAI review (Jul 2026) buildfastwithai.com
GPT-Live’s primary achievement is sub-second latency, averaging approximately 232 milliseconds… matches the natural cadence of human pauses
OpenAI developer community thread on Realtime truncation community.openai.com
the API often continues to emit transcript deltas for text that was generated but never actually heard by the user… developers are forced to implement complex client-side logic to manually ‘rewind’ the transcript to the exact millisecond of the interruption
IETF draft-uberti-tsvwg-warp datatracker.ietf.org
SPED (STUN Protocol for Embedding DTLS)… piggybacking DTLS handshake data directly inside STUN Binding Requests and Responses; SNAP avoids the standard SCTP handshake by embedding parameters within the initial SDP exchange
arXiv paper on context compaction governance decay arxiv.org
safety violations can rise from 0% to nearly 60% after multiple compaction cycles if constraints are not explicitly ‘pinned’ or quarantined from the summary
Medium explainer on Kyutai Moshi medium.com
Moshi achieves a theoretical latency of 160ms (200ms in practice) by predicting audio tokens directly from a neural audio codec while modeling parallel streams for the user and the AI
Runtimewire analysis of GPT-Live stack runtimewire.com
primary capacity question shifted from ‘How many requests per GPU?’ to ‘How many concurrent sessions can the system sustain while keeping every frame on schedule?’
ValueAdd VC — Baseten pricing/valuation breakdown valueaddvc.com
The Series F was reportedly raised across two tranches priced at $11 billion and $13 billion… inference volume grew 40x while revenue grew 20x, indicating either a significant drop in per-unit pricing or a monetization lag.
Google Cloud blog — Baseten on Blackwell A4 VMs cloud.google.com
Baseten integrated NVIDIA Blackwell-based A4 virtual machines via Google Cloud, resulting in a 25% improvement in cost-performance for latency-sensitive tasks and a 225% boost for high-throughput workloads.
Particula.tech — SGLang vs vLLM comparison particula.tech
SGLang’s RadixAttention uses a radix tree to automatically cache and reuse partial conversation histories, whereas vLLM’s automatic prefix caching typically requires exact block-level matches… SGLang can achieve up to 30% higher throughput in multi-turn scenarios.
IoT Digital Twin PLM — engine benchmarks 2026 iotdigitaltwinplm.com
TensorRT-LLM remains the gold standard, often delivering 20-40% lower per-token latency than vLLM at low batch sizes… the core trade-off is a 10-90 minute build process for every unique model-GPU-dtype combination.
LinearB blog — review of Kiely’s Inference Engineering book linearb.io
The text sometimes explains basic concepts like linear layers while simultaneously tackling advanced CUDA kernels… general model benchmarks like MMLU are often orthogonal to enterprise adoption.
Angel Investors Network — Baseten Series F analysis angelinvestorsnetwork.com
The valuation tripled in just five months, up from $5 billion in January 2026, leading some experts to warn that the private market has outpaced public-market multiples.
David Crawshaw, ‘Devtools must be open source’ (blog.exe.dev) blog.exe.dev
I almost never need to see the import blocks… get it off the screen so I can focus on the meat. The source code is the extension system.
The New Stack — ‘Curl’s Daniel Stenberg: AI is DDoSing open source’ thenewstack.io
Between 2019 and 2025 the confirmed-vulnerability rate on curl reports fell from 15% to under 5% as AI-generated ‘slop’ flooded triage; Stenberg described it as a ‘Denial-of-Service attack’ on human maintainers.
BleepingComputer — ‘Curl ending bug bounty program after flood of AI slop reports’ bleepingcomputer.com
Curl officially ended its bug bounty on Jan 31, 2026 after nearly seven years and >$100,000 in payouts, citing an unsustainable maintainer tax from unverified AI submissions.
Pragmatic Engineer — ‘Is GitHub still best for AI-native development?’ blog.pragmaticengineer.com
GitGoodBench found frontier models like GPT-4o achieved only a 21.11% solve rate on complex Git scenarios, including interactive rebases and merge conflict resolution.
htek.dev — ‘Hookflows: governed Git for AI agents’ htek.dev
Agents should be barred from raw Git commands and instead interact with governed CLI extensions that enforce workflow rules — otherwise they routinely branch off the wrong HEAD, stage .env files, or force-push over teammates.
RedMonk video interview with Daniel Stenberg on ‘AI onslop’ redmonk.com
A contributor spends five minutes prompting an agent while a maintainer must spend hours reviewing the resulting ‘unmanageable disaster’ — a principal-agent imbalance Crawshaw’s model doesn’t address for public projects.
