JS Wei (Jack) Sun

Beam-1.0 hallucinates 47%, Anthropic merges 30K PRs/day, RTX Spark hits 98°C

Every URL the pipeline pulled into ranking for this issue — primary sources plus the supporting and contradicting findings each Researcher returned. Inline citations in the issue point back here.

← Back to the issue

Sources

Welcome Beam: a 501B open model you can own, customize, and scale huggingface.co

Quoting Addy Osmani, Morgan Westlee Lunt, and Qing Wang simonwillison.net

We think “did a human read the code?” is an imprecise proxy for “what could go wrong with this change, and which check—automated or human—is the right one to catch it?” Asking that question also changed when review happens. Before, review was a gate at the end of the road: write the code, open a PR, wait for your colleague. Now, review runs continuously, more like spellcheck while you write. Most changes have been reviewed and fixed by Claude at least once before a human is asked to look. This…

A week with RTX Spark: everything we’ve learned using Nvidia’s new laptops theverge.com

Nvidia’s RTX Spark N1X processor is finally here, and we’ve been collectively testing a small fortune’s worth of powerful laptops sporting this new “superchip.” RTX Spark is designed to be a high-performing Arm-based SoC for laptops and small desktop computers, rivaling the best from Apple, Intel, AMD, and Qualcomm. It has loads of cores, Nvidia […]

LaTeX renderer simonwillison.net

A new LaTeX rendering tool encodes the full document in a URL #fragment, making every equation a shareable bookmark. Inspired by Tiny Little Office, the build pairs MathJax 4.1.3 and faster-latex WASM with an iframe sandbox for XSS protection, all generated via Claude Code prompts.

References

Artificial Analysis evaluation artificialanalysis.ai

Beam-1.0 recorded a hallucination rate of 47% on the AA-Omniscience benchmark… significantly higher than competitors like K2 Horizon (26%) and Qwen3.8 (30%)

YouTube review (independent) youtube.com

Hosting the model at 4-bit quantization requires roughly 300 GB of VRAM, translating to hardware costs ranging from $19,000 for high-end Mac Studio clusters to over $60,000 for enterprise-grade NVIDIA RTX PRO 6000 setups… competitors like DeepSeek V4.1 Flash offer superior performance on the same machines

The Daily Upside thedailyupside.com

a $25 billion valuation… backers include Nvidia, Sequoia Capital, and Lightspeed… a $6.3 billion compute agreement with SpaceX and a U.S. government-brokered deal to help South Korea develop a ‘sovereign AI’ ecosystem

Layer3Labs guide layer3labs.io

Reflection AI’s primary claim is a 3-to-4x improvement in inference efficiency over Z.ai’s GLM-5.2… achieved through reinforcement learning (RL) that explicitly penalized the model for using unnecessary tokens… critics express concern that the model may learn to avoid complex tasks entirely to minimize token costs—a phenomenon described as ‘learning to not solve the task’ if applied naively

PyTorch blog on Miles framework pytorch.org

Miles addresses the ‘distributed systems problem’ of modern RL by coordinating high-throughput rollout workers (via SGLang) with efficient training consuming those samples (via NVIDIA Megatron-LM)… Rollout Routing Replay (R3)… records expert routing in MoE models during rollout to ensure alignment during training

VentureBeat (on 2024 Reflection 70B scandal) venturebeat.com

independent testers found the model significantly underperformed its claims, with some researchers suggesting the initial release was merely a wrapper for other models or a mislabeled version of Llama 3

Simon Willison - Redesigning source control at Anthropic simonwillison.net

Scion’s architecture is heavily influenced by Meta’s Sapling/Mononoke, with former Mononoke lead Rain (sunshowers) arguing the initial lack of explicit attribution ‘bordered on plagiarism’ before Anthropic updated the post with a clarifying footnote.

DevOps.com - Anthropic Builds Its Own Source Control devops.com

A team of seven engineers built Scion in five months to handle 25 million daily checkouts; checkouts dropped from minutes to seconds and git status equivalents fell from 3.9 seconds to 19 ms, reclaiming roughly 25% of CI CPU capacity.

The New Stack - AI Code Review Burnout thenewstack.io

Industry benchmarks show most AI reviewers operate at 5-15% false-positive rates, but once FPR exceeds 20-30% developers reflexively dismiss warnings; a 10% FPR can waste 20+ engineering hours monthly for a mid-sized team.

Orizens blog - AI Code Review 2026 orizens.com

AI agents excel at anti-patterns and unused imports but frequently approve ‘architectural disasters’—code that violates design token hierarchies or breaks business-specific payment logic—because models reason over a limited context window and miss long-term system intent.

Macroscope - Greptile vs CodeRabbit 2026 macroscope.com

On the independent Martian Code Review Bench, Greptile scored F1 63.2 and CodeRabbit 61.8 on real OSS pull requests; vendor benchmarks diverge wildly (CodeRabbit 45.8% bug catch, Graphite Diamond 18.3%), so the recommended test is a side-by-side week measuring ‘acceptance rate.’

xgrowing.ai - Thorsten Ball / Orosz / Beck commentary xnews.xgrowing.ai

Orosz warns of ‘zombie code reviews’ where agents generate code faster than humans can comprehend, so teams approve PRs unread; Ball adds that ‘outsourcing the building outsources the learning,’ and Beck flags ‘re-soloing’ where developers use AI to bypass peer collaboration entirely.

StreetInsider / Nvidia launch release streetinsider.com

Nvidia launches RTX Spark laptops starting at $2,599

NVIDIA Developer Blog (‘Code, Test, and Deploy on One Machine’) developer.nvidia.com

Developers get a Windows Developer Config, PAIR for serving inference to other local devices, and a Switchyard model router that splits workloads between local agents and cloud APIs; NVIDIA claims compatibility with 97% of the top 15,000 Python packages and ships the first PyTorch-CUDA build for Windows on Arm.

Notebookcheck analysis (via r/hardware) reddit.com

Reviewers were explicitly barred from discussing battery life, thermals, or chassis-specific variables in the first wave of coverage — a ‘multi-level embargo’ critics called scummy.

StorageReview — Surface Laptop Ultra for Business storagereview.com

Qwen 3.5 (122B) ran at ~35.2 tokens/sec and Nemotron 3 Nano (30B) at 63.9 t/s, but the unit repeatedly hit 95–98°C and suffered power failures under sustained load; Microsoft’s own data shows a 170-second prefill wait on a 128K prompt.

Notebookcheck N1X deep-dive (via r/hardware) reddit.com

The N1X uses Cortex-X925 + A725 cores already superseded by newer Arm designs, and single-core Geekbench of ~2,718 trails Apple’s M4 Pro by roughly 30%; multi-core performance holds on battery but idle draw is unusually high at ~30W.

r/LocalLLM — ‘Mac Studio vs DGX Spark for a 24/7 on-prem AI’ reddit.com

For sustained local inference the Mac Studio M5 Ultra’s 1.2–2 TB/s bandwidth and 512GB ceiling beats Spark’s ~300 GB/s, but macOS lacks RDMA, native CUDA and FP4 tensor acceleration — developers describe Spark as the better ‘production-ready’ box despite lower bandwidth.

Jack Sun

Jack Sun, writing.

Engineer · Bay Area

Hands-on with agentic AI all day — building frameworks, reading what industry ships, occasionally writing them down.

Digest
All · AI Tech · AI Research · AI News
Writing
Essays
Elsewhere
Subscribe
All · AI Tech · AI Research · AI News · Essays

© 2026 Wei (Jack) Sun · jacksunwei.me Built on Astro · hosted on Cloudflare