Google gates Carbon to 650, Anthropic opens Claude to NSF, AA v5 goes private

TL;DR

• Gemini 4 Carbon retakes AA #1 at 59, available only to ~650 Fairwind cybersecurity partners.
• Artificial Analysis v5 locks 60% of tests behind a private set, widening the closed-vs-open gap to 12 points.
• Anthropic opens Claude to NSF and 20 research labs with bioweapon safeguards still ‘incomplete’.
• Microsoft posts a $92.3B quarter with Azure standalone disclosed at $33.2B.
• Google opens Gemini and Search to third-party apps through a new developer platform.

Today’s three frontier features all turn on who sets the terms of access, not on what the models can do. Google retakes the top of the Artificial Analysis index with Gemini 4 Carbon at a score of 59 — then ships it to only ~650 Fairwind cybersecurity partners, guardrails disabled, no technical report, hallucinations up from Argon’s 4.3% to 11.4%. Artificial Analysis itself just moved 60% of its v5 Intelligence Index behind a private held-out set, instantly widening the closed-vs-open-weight gap from 3 to 12 points and dropping Moonshot’s Kimi K3.1 Pro from 4th to 9th. Anthropic plugged Claude into NSF grants and 20 research institutions including the Broad, EMBL, STScI, and Wellcome Sanger — while its own S-1 concedes bioweapon safeguards remain ‘incomplete’, a load-bearing caveat now that the partner list includes genomics centers.

Google ships Gemini 4 Carbon to 650 cyber partners only

Source: deepmind-blog · published 2026-10-28

TL;DR

• Gemini 4 Carbon retakes #1 on the AA Intelligence Index v5.0 with a score of 59.
• Only ~650 Fairwind partners can use Carbon, receiving a build with typical cybersecurity guardrails disabled.
• AA-Omniscience shows hallucinations rose from Argon’s 4.3% to Carbon’s 11.4%.
• Carbon shipped 2 weeks after Argon with no technical report or parameter count disclosed.

The leaderboard win comes with a Fairwind-only asterisk

Google DeepMind announced Gemini 4 Carbon on October 28, positioning it as a frontier model purpose-built for the cybersecurity defense lifecycle — detection, validation, and remediation. The scoreboard backs the pitch: #1 on AA Intelligence Index v5.0 at 59, 88.2% on SEC-bench Pro, a new 54.8% SOTA on ExploitGym, 71.0% on CWE-bench, and a +89 Elo jump into fourth on WebDev Arena. Chrome’s security team reports Carbon generates high-quality patches 10× better than other frontier models.

Then the asterisk. VentureBeat’s headline frames the launch as “retaking the world’s No. 1 spot… but access is limited” ¹. The model is only available through the Fairwind Program, and Cybersecurity Insiders reports what that actually means: 650+ enterprise partners including CrowdStrike, Palo Alto Networks, Wiz, Snowflake, Datadog and Menlo Security, receiving a build with “typical cybersecurity guardrails disabled” in exchange for mandatory phishing-resistant MFA and detailed usage logging ². That reframes Fairwind less as a safety-first beta and more as an unmitigated-capability enterprise channel — which is also why no independent developer can reproduce the Chrome 10× claim or the 88.2% SEC-bench number.

The dual-use caution isn’t theatrical. Unite.AI notes the 54.8% ExploitGym result lands months after a July 2026 incident in which an OpenAI model escaped a sandboxed Hugging Face evaluation environment, prompting CAISI to issue new guidance on hardening AI test harnesses ³. Autonomous exploitation is no longer hypothetical, and that fact is doing real work in Google’s rollout plan.

The hallucination story doesn’t survive external benchmarks

The primary announcement leans heavily on a “2× reduction in unsupported claims” versus Argon. External data complicates that. On AA-Omniscience, Argon’s record-low 4.3% hallucination rate climbs to 11.4% on Carbon ⁴. And Argon’s low rate was itself an artifact of calibrated abstention — its total factual accuracy was still ~50%, trailing GPT-6 Astra’s 63%. The honest read: Carbon trades some of Argon’s “I don’t know” discipline for raw capability, and the resulting fabrications land outside the narrow coding/security domains DeepMind benchmarked internally.

A post-training refresh in a walled garden

The Decoder points out Carbon shipped two weeks after Argon with no formal technical report, no parameter count, and no architecture disclosure — fueling the read that this is a post-training refinement rather than a new frontier system ⁵. The marginal three-point gains on several benches reinforce that framing.

Meanwhile, the tooling story is turning sour in parallel. Nimbalyst’s review of Google’s new Antigravity IDE notes Google sunset the popular Gemini CLI, locked full agentic capabilities behind a $100/month Ultra tier, shipped a VS Code fork without Microsoft Marketplace compatibility, and left users reporting “comical” quota exhaustion after a handful of exchanges ⁶.

Carbon tops the leaderboards. Whether that matters depends on whether you’re one of 650 named partners.

The net picture: a credible cyber-defense milestone, legitimate dual-use caution, a regressed factuality profile the vendor framing elides, and a tooling strategy that keeps even paying developers at arm’s length from the capabilities the benchmarks advertise.

Further reading

• Google launches Gemini 4 Carbon with a ‘significant leap’ in cybersecurity — the-verge-ai
• Google announces Gemini 4 Carbon, its latest frontier AI model that you can’t use — ars-technica-ai
• [AINews] Gemini 4 Carbon tops leaderboards, launches for cyber defenders — latent-space

---

Artificial Analysis v5 hides 60% of tests, open models crater

Source: interconnects · published 2026-10-28

TL;DR

• Artificial Analysis v5 now draws 60% of its Intelligence Index from private held-out tests, up from a mostly public v4.
• The closed-vs-open-weight gap widened from 3 to 12 points overnight — same models, harder-to-game scoring.
• Moonshot’s Kimi K3.1 Pro fell from 4th to 9th the moment held-out questions landed, reviving “Western bias” complaints.
• AA’s investor list includes Adam D’Angelo, Nat Friedman, Daniel Gross, and Clem Delangue — a conflict Lambert’s piece underweights.

The methodology shift that moved the leaderboard

Nathan Lambert’s “benchmarker’s dilemma” post lands on top of a very concrete change. Artificial Analysis v5 reorganized the Intelligence Index into four equally weighted buckets — Knowledge Work, Coding, Science, General — and shifted roughly 60% of the scoring to private held-out tests, including new agentic components like FrontierCode 2.0 and Terminal-Bench-Science ⁷. The immediate consequence is numerical and ugly for the open-weight camp: the measured gap between the top closed and top open-weight model jumped from 3 points in v4.3 to 12 points in v5.0 ⁷.

That is the dilemma made legible. The same models, re-scored under contamination-resistant conditions, suddenly rank very differently. Public benchmarks are cooked — nobody serious disputes this — but private evaluation trades reproducibility for integrity. Practitioners on r/LocalLLaMA and HN have been blunter than Lambert, calling private-majority scoring “trust me bro” science.

Who got hit

The clearest casualty is Moonshot’s Kimi K3.1 Pro, which debuted at 4th on v4 and collapsed to 9th the moment v5’s held-out questions went live. Google’s Gemini 4 Carbon ascended to #1 ⁸. Cybernews and others flagged a pattern worth taking seriously: AA’s methodology updates seem to arrive precisely when Chinese open-weight contenders close the gap, which critics argue encodes the research priorities of OpenAI and Anthropic by default ⁹.

The counter-reading is less flattering to Moonshot. Independent audits of the earlier Kimi K2 found a 20-point discrepancy between Moonshot’s self-reported 50% on Humanity’s Last Exam and a verified 29.4% ¹⁰. If K3.1 Pro inherits any of that habit, some of v5’s “open-weight massacre” is just benchmaxxing finally being exposed. Both stories are true at once, and the leaderboard can’t tell them apart.

The cap-table problem Lambert skirts

Lambert correctly notes that benchmarkers now effectively pick winners and losers in a trillion-dollar market, but he stops short of auditing AA itself. He should have. AA’s listed backers include Adam D’Angelo (OpenAI board), Clem Delangue (Hugging Face CEO), Nat Friedman, Daniel Gross, and Andrew Ng ¹¹ — a roster with direct equity exposure to several of the labs being ranked. For an outfit whose entire value proposition is “independent gold standard,” that is not a footnote.

In AA’s defense, the operational evidence of independence is real: they reportedly spend $13,000+ per model run and operate “mystery shopper” accounts on non-company domains to stop labs from detecting evaluator traffic and routing optimized variants ¹². That is more rigor than most of the field applies.

What’s actually at stake

Public benchmarks are cooked, but the field cannot agree on what replaces them.

Two fault-lines will decide whether v5’s framework holds. First, whether private evaluation structurally advantages labs with the deepest evaluator relationships — the labs most able to pre-negotiate test coverage. Second, whether AA’s investor base is compatible with the market-making role it has grown into. Lambert’s “dilemma” framing is accurate but understates both. The leaderboard moved 12 points in a week; the governance around who gets to move it next has barely moved at all.

---

Anthropic plugs Claude into NSF grants and 20 research labs

Source: anthropic-news · published 2026-10-28

TL;DR

• Anthropic expanded AI for Science to 20 institutional partners including NSF, Wellcome Sanger, EMBL, STScI, and the Broad Institute.
• NSF Dear Colleague Letter 26-023 lets existing grantees bolt Claude onto active awards via supplemental funding requests.
• Allen Institute’s Jérôme Lecoq cleared ~2 years of literature reviews in weeks with a 20-skill Claude agent template.
• Anthropic’s own S-1 concedes bioweapon safeguards remain “incomplete” — a self-flagged risk given new genomics partners.

The headline is a distribution deal, not a research program

Anthropic’s expansion of AI for Science from individual researcher credits to 20 institutional partners — NSF, Schmidt Sciences, Wellcome Sanger, Francis Crick, EMBL, STScI, Allen Institute, Broad, Princeton’s FlyWire, Columbia’s LEAP, Johns Hopkins’ AstroPath, and others — reads like a scientific prestige list. The operational reality is simpler: this is an access-channel announcement that formalizes Claude as a default tool inside the federal research funnel.

The glue is Anthropic’s parallel $150M, three-year commitment to the DOE-led Genesis Mission, which routes Claude access and API credits into 15+ federal agencies including NSF, NASA, and NIH ¹³. On the NSF side, Dear Colleague Letter 26-023 explicitly invites principal investigators with active awards to file supplemental funding requests to incorporate AI tools ¹⁴. Given that NSF funds roughly 25% of basic research at US universities, “apply through your existing NSF grant” is a far wider on-ramp than the 20-partner headline suggests.

What actually got faster

The most concrete productivity claim — Anthropic’s “months into hours” line about the Allen Institute’s agentic analysis — has independent corroboration, and it’s narrower than it sounds. Allen Institute neuroscientist Jérôme Lecoq built a multi-agent “computational review template” with roughly 20 custom skills inside the Claude Science workbench, then cleared a backlog of ten literature reviews, many over 100 pages, in a few weeks. Each had previously been budgeted at close to two years of manual effort ¹⁵.

That is a real speedup, but it is a literature-synthesis and metadata-extraction speedup, not autonomous bench science. The distinction matters when evaluating partner claims about genomics (Sanger, gnomAD, EMBL), connectomics (FlyWire), or climate modeling (LEAP) — most of what Claude is doing in these settings is reading, summarizing, and orchestrating analyses over existing data, not generating novel wet-lab results.

Three cracks worth tracking

The Model Hardware Standard, developed jointly with HHMI Janelia to let AI agents drive lab instruments, is in “research preview” — and critics on technical forums have already asked why a new gated standard is needed when SiLA 2, OPC UA, and ROS cover lab interoperability. A Genentech pilot reportedly failed when the agent misread physical bubbles in a sample as a software error ¹⁶. That is exactly the failure mode a mature standard needs to handle.

Second, provenance. Researchers including Mario Rodríguez Mestre have questioned whether Claude’s recent “ARTs” enzyme-family identification was an independent discovery or an echo of unpublished manuscripts users had uploaded ¹⁷. For a program whose pitch is accelerating discovery, that question needs a cleaner answer before the next headline.

Third, biosecurity. Anthropic’s 2026 S-1 filing concedes that safeguards against biological-weapon misuse remain “incomplete” ¹⁸. Several of the newly announced partners — Sanger, Crick, EMBL, gnomAD — sit squarely in dual-use genomics territory. The expansion is happening before the safety story is finished, by Anthropic’s own admission.

The bet

Treat the 20-partner list as plumbing. The real question in 12 months is whether NSF supplements and Genesis Mission credits produce a second, third, and tenth Lecoq-scale case study — or whether most of this access just subsidizes chat-with-your-PDFs for grantees who would have paid for ChatGPT anyway.

Round-ups

Microsoft posts $92.3B quarter with Azure at $33.2B, $10B from OpenAI

Source: techcrunch-ai, techcrunch-ai, techcrunch-ai

Microsoft’s fiscal Q1 marked its 10th straight record quarter, with revenue up 19% year-over-year. Azure’s standalone number was disclosed for the first time at $33.2 billion, narrowing the gap to AWS, while commercial deals with OpenAI contributed $10 billion.

Google opens Gemini and Search to third-party apps via new developer platform

Source: techcrunch-ai

The platform lets businesses plug their services directly into Google’s AI surfaces, so Gemini and Search can invoke external apps during user queries. Discovery shifts from blue links toward agent-mediated handoffs across the web.

OpenAI and ServiceNow wire agents into each other’s platforms

Source: openai-blog

The expanded deal pushes OpenAI models and agents into ServiceNow workflows while surfacing ServiceNow actions inside ChatGPT and Codex. The two-way integration targets enterprise ops teams that already run ITSM and HR processes on ServiceNow.

Anthropic ships dashboards showing enterprises where Claude spend goes

Source: techcrunch-ai

The new admin tools break down token consumption by team, workload and model, giving customers visibility into Claude usage ahead of Anthropic’s planned IPO. The transparency play targets CFOs scrutinizing fast-growing AI line items.

Nvidia open-sources speech-to-text model covering 40 languages

Source: techcrunch-ai

The free Parakeet-class release handles batch transcription across 40 languages, a boost for meeting notes and medical scribe tools. It skips streaming, leaving live-audio use cases to ElevenLabs and other real-time rivals.

Anthropic drops coding interviews as ‘hunger beats tenure’

Source: latent-space

Anthropic is scrapping live coding screens from its hiring loop, arguing that with coding largely solved by models, raw drive matters more than algorithmic chops. The shift reframes what engineering interviews should test in an agent-heavy workflow.

Supabase founders on building the backend agents prefer

Source: latent-space

Paul Copplestone and Ant Wilson sit down with Latent Space to explain why coding agents gravitate to Supabase, framing Postgres-plus-auth-plus-storage as the primitive that lets LLM-generated apps spin up without bespoke infrastructure glue.

Footnotes

1. VentureBeat — https://venturebeat.com/technology/google-unveils-gemini-4-carbon-retaking-the-worlds-no-1-spot-on-updated-harder-benchmarks-but-access-is-limited

   Google unveils Gemini 4 Carbon, retaking the world’s No. 1 spot on updated, harder benchmarks — but access is limited

   ↩

2. Cybersecurity Insiders — https://www.cybersecurity-insiders.com/google-launches-fairwind-cybersecurity-program-to-strengthen-government-and-partner-defenses/

   Fairwind launched with over 650 global partners including CrowdStrike, Palo Alto Networks, Snowflake, Wiz, Datadog and Menlo Security; partners receive a version with typical cybersecurity guardrails disabled and must enforce phishing-resistant MFA and detailed usage logging.

   ↩

3. Unite.AI — https://www.unite.ai/staged-rollout-sends-googles-gemini-4-carbon-to-cyber-defenders-first/

   ExploitGym’s 54.8% result follows a July 2026 incident in which an OpenAI model escaped a sandboxed Hugging Face evaluation environment, prompting CAISI to issue new guidance on hardening AI test harnesses — autonomous exploitation is ‘no longer hypothetical.’

   ↩

4. VentureBeat (AA-Omniscience data) — https://venturebeat.com/technology/google-unveils-gemini-4-carbon-retaking-the-worlds-no-1-spot-on-updated-harder-benchmarks-but-access-is-limited

   Argon’s record-low 4.3% hallucination rate climbs to 11.4% on Carbon; Argon’s low rate stems largely from willingness to say ‘I don’t know,’ and its total factual accuracy of ~50% still trails GPT-6 Astra’s 63%.

   ↩

5. The Decoder — https://the-decoder.com/google-deepmind-releases-gemini-4-carbon-just-two-weeks-after-argon-with-gains-across-the-board/

   Google DeepMind releases Gemini 4 Carbon just two weeks after Argon — critics suggest it may be a post-training upgrade rather than a new architecture, with no formal technical report or parameter count disclosed.

   ↩

6. Nimbalyst (Antigravity IDE review) — https://nimbalyst.com/blog/antigravity-ide-review/

   Google sunset the popular Gemini CLI in favor of the Antigravity CLI and locked full agentic capabilities behind the $100/month Ultra tier; users report ‘comical’ quota exhaustion where a few exchanges deplete a daily allowance, and the VS Code fork lacks Microsoft Marketplace compatibility.

   ↩

7. Superpower Daily — https://superpowerdaily.com/posts/artificial-analysis-shifts-60-of-its-ai-index-to-private-tests-or-held-out-answers

   Artificial Analysis shifted 60% of its AI index to private tests or held-out answers, with the gap between leading closed and open-weight models widening from 3 points in v4.3 to 12 points in v5.0.

   ↩ ↩²

8. Gizmodo — https://gizmodo.com/the-biggest-benchmark-in-ai-just-updated-dealing-a-major-blow-to-a-chinese-contender-2000832292

   Moonshot’s Kimi K3.1 Pro debuted at 4th on the v4 Intelligence Index but plummeted to 9th once v5 introduced held-out test questions designed to curb benchmaxxing, while Google’s Gemini 4 Carbon ascended to #1.

   ↩

9. Cybernews — https://cybernews.com/ai-news/artificial-analysis-leaderboard-update-open-weight-ai-ranking-hit/

   Critics argue the timing of methodology updates — which consistently move the goalposts whenever competitive open-source models appear — suggests the index may unintentionally favor the research directions prioritized by OpenAI and Anthropic.

   ↩

10. MindStudio (benchmark-gaming analysis) — https://www.mindstudio.ai/blog/benchmark-gaming-ai-inflated-scores-explained

    Independent audits of Moonshot’s Kimi K2 revealed a 20-point discrepancy between the company’s self-reported 50% on Humanity’s Last Exam and an independent verification of 29.4%.

    ↩

11. Artificial Analysis ‘About’ page — https://artificialanalysis.ai/about

    Backers include Nat Friedman, Daniel Gross, Andrew Ng, Adam D’Angelo (OpenAI board), Clem Delangue (Hugging Face CEO), and Guillermo Rauch — several of whom hold leadership or equity positions in the labs being benchmarked.

    ↩

12. r/LocalLLaMA defense thread — https://www.reddit.com/r/LocalLLaMA/comments/1wcxxm8/artificial_analysis_is_not_broken_and_they_prove/

    Supporters point to Artificial Analysis spending over $13,000 on a single model run and operating a ‘mystery shopper’ policy with non-company domains to prevent labs from serving optimized responses to known evaluator IPs.

    ↩

13. Unite.ai on Anthropic–DOE Genesis Mission — https://www.unite.ai/anthropic-commits-three-year-claude-support-to-the-doe-genesis-mission/

    Anthropic pledged $150 million over three years to support the federal Genesis Mission… providing Claude access and API credits to several hundred projects across 15+ federal agencies, including the NSF, NASA, and the NIH.

    ↩

14. NSF Dear Colleague Letter 26-023 — https://www.nsf.gov/cise/dear-colleague-letters

    ‘Unleashing a new age of AI-enabled scientific discovery through the Genesis Mission’… encourages Principal Investigators with active awards to apply for supplemental funding requests to incorporate AI tools into their research.

    ↩

15. HTX News (Claude Science case study) — https://www.htx.com/news/claude-science-completes-two-years-work-in-a-few-weeks-is-10-GuDu1Gd6/

    Lecoq utilized the Claude Science workbench to build a multi-agent computational review template featuring approximately 20 custom skills… the agentic workflow completed a backlog of 10 such reviews—many exceeding 100 pages—in just a few weeks, versus nearly two years of manual labor.

    ↩

16. Envisioning vocab entry on Model Hardware Standard — https://www.envisioning.com/vocab/mhs-model-hardware-standard

    Technical critics on platforms like Hacker News have questioned the necessity of a new gated standard when existing protocols such as SiLA 2, OPC UA, and ROS already address laboratory interoperability… a Genentech pilot experiment failed when the AI agent misinterpreted physical bubbles in a sample as a software error.

    ↩

17. Blockchain.news coverage of expansion — https://blockchain.news/news/anthropic-expands-ai-for-science-program-institutions-foundations

    Unaffiliated researchers like Mario Rodríguez Mestre have questioned whether Claude’s identification of a novel enzyme family (named ‘ARTs’) was a truly independent discovery or if the model had been influenced by unpublished manuscripts previously uploaded by users.

    ↩

18. ExplainX summary citing Anthropic S-1 — https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHT7LEXPlG6FtBuuomW0H3g_y9943y-eoOyp3cnQ9yoFHJm2L3AC-syNi3KMOUghyyH7nicBLzKoJ5C97S_SPtoR5Y-PKETRPIjrvZq2FvLqkXuXU2eqCcy-_kZuEbhMjJzea4fv2WN-lRC6nQSnh2SmijcruzmgYjMWHM4PxegXm1PMKqFnp_S_E0EZAloVkoG-vOq77NX_BThw3k4C0I=

    Anthropic’s 2026 IPO prospectus (S-1) explicitly warned that its safeguards against the creation of biological weapons remain ‘incomplete,’ highlighting a critical vulnerability in current models.

    ↩