JS Wei (Jack) Sun

Anthropic turns on SynthID, LeRobot loop hides RCE, Turnbull hallucinates tags

Every URL the pipeline pulled into ranking for this issue — primary sources plus the supporting and contradicting findings each Researcher returned. Inline citations in the issue point back here.

← Back to the issue

Sources

How Claude’s text watermark works anthropic.com

Don’t classify. Hallucinate! simonwillison.net

Don’t classify. Hallucinate! I still have quite a bit of older content on my blog that I never got round to tagging. My blog has 1,856 tags - likely too many to feed to an LLM in one go and say “which of these tags match the following content”. Doug Turnbull has a neat solution. Tell the model to output tags without any details of the existing vocabulary, then use vector embeddings against the existing corpus to find the concrete tags that are closest to the ones the model imagined might fit! H…

Record, train, and deploy from one place with Strands Agents, LeRobot, and Hugging Face Storage Buckets huggingface.co

References

SRI Lab, ETH Zurich (Probing SynthID) sri.inf.ethz.ch

SynthID-Text is more resistant to spoofing than other state-of-the-art schemes, but is paradoxically easier to ‘scrub’ or remove by naive adversaries; black-box queries can cheaply detect the watermark’s presence, letting attackers focus removal.

Moonlight review of ‘Robustness Assessment and Enhancement of Text Watermarking for Google’s SynthID’ (arXiv 2508.20228) themoonlight.io

Under copy-and-paste attacks the detector’s F1 drops from 1.0 to 0.788; Dipper (T5-XXL) paraphrasing pushes F1 to 0.842 with a 23% false-positive rate, and back-translation via French/Chinese further degrades detectability.

zk-f.com summarizing Scott Aaronson’s remarks zk-f.com

Aaronson noted SynthID-Text is ‘extremely similar’ to his 2022 proposal but criticized Google’s ‘stinginess’ in granting access to its detector, limiting utility for educators and independent researchers.

Sadasivan, Feizi et al., ‘Can AI-Generated Text be Reliably Detected?’ (ResearchGate) researchgate.net

Recursive paraphrasing dropped DetectGPT’s AUROC from 96.5% to 25.2%; the authors also demonstrate spoofing attacks that let adversaries infer a watermark’s signature without white-box access and frame human text as AI-generated.

SC World, ‘Market for AI watermark removal tools emerges after Anthropic’s Claude update’ scworld.com

A cat-and-mouse market emerged within days of Anthropic’s announcement, with GitHub projects and web tools claiming to neutralize Claude’s watermarks before the detection API is even public.

r/ClaudeAI thread on Anthropic’s watermark rollout reddit.com

Users report canceling subscriptions over concerns that watermarking degrades ‘human-like’ tone and could unfairly flag documents merely proofread by Claude as fully AI-generated.

Resecurity — CVE-2026-25874 disclosure resecurity.com

The flaw resides in LeRobot’s asynchronous inference PolicyServer, which uses unsafe pickle.loads() to deserialize attacker-controlled data over unauthenticated gRPC endpoints, allowing unauthenticated remote code execution on both robot client and policy server.

GBHackers — LeRobot RCE coverage gbhackers.com

Because the asynchronous inference design often runs with elevated privileges on GPU-backed servers, exploitation could allow attackers to hijack connected robots or pivot across the network.

Analytics India Magazine — Xet vs Git LFS analyticsindiamag.com

Aggressive deduplication can lead to file fragmentation, where chunks are scattered across different xorbs (64MB storage blocks), causing high read latency; Xet’s protocol intentionally skips some deduplication opportunities to maintain contiguous runs of chunks.

Hugging Face docs — Storage Buckets S3 gateway huggingface.co

Buckets are intentionally mutable and non-versioned to support high-throughput writes; the gateway is centralized in a single region and lacks Object Lock, lifecycle policies, and IAM-style bucket policies.

Hugging Face / NVIDIA — Isaac Lab-Arena + LeRobot huggingface.co

Isaac Lab-Arena can achieve up to 13.5× faster policy evaluation compared to sequential methods, enabling a sim-to-real loop where LeRobot handles data plumbing and Isaac Lab handles GPU-parallel simulation.

PhAIL benchmark discussion (r/MachineLearning) reddit.com

On the PhAIL benchmark, Pi0.5 and GR00T demonstrated the highest performance in industrial pick-and-place tasks, though both still require human intervention every 3.5 to 4 minutes.

Hacker News comment by Sharlin news.ycombinator.com

modern programming now encourages developers to purposefully solicit incorrect answers from a computer to eventually arrive at a correct one

softwaredoug.com — Doug Turnbull, ‘All Search is Structured Now’ softwaredoug.com

a naive BM25 baseline achieved a relevance score of 0.56, while an agent-driven BM25 tool (utilizing GPT-5 reasoning) improved this to 0.64

dev.to — ‘Why your LLM classifier doesn’t need the taxonomy’ dev.to

Passing this entire taxonomy into an LLM prompt as a schema is quietly expensive due to token costs and increased latency… embeddings of semantically similar terms—even if one is a hallucination—tend to cluster together in vector space

emergentmind.com — HyDE topic overview emergentmind.com

If the LLM generates a hypothetical document containing factual errors or ‘phantom findings,’ the vector search will retrieve documents that align with those falsehoods rather than the user’s actual intent

procycons.com — Long Document Classification Benchmark 2025 procycons.com

traditional models like XGBoost and Logistic Regression frequently outperform transformer-based models in both F1-score and cost-efficiency

Jack Sun

Jack Sun, writing.

Engineer · Bay Area

Hands-on with agentic AI all day — building frameworks, reading what industry ships, occasionally writing them down.

Digest
All · AI Tech · AI Research · AI News
Writing
Essays
Elsewhere
Subscribe
All · AI Tech · AI Research · AI News · Essays

© 2026 Wei (Jack) Sun · jacksunwei.me Built on Astro · hosted on Cloudflare