Astra, NeoMME, Funes: three efficiency wins, three checks pushed to the user
Every URL the pipeline pulled into ranking for this issue — primary sources plus the supporting and contradicting findings each Researcher returned. Inline citations in the issue point back here.
Sources
GPT‑6 Astra simonwillison.net
GPT‑6 Astra GPT-6 Astra is “rolling out today to a limited set of organizations and over the coming days will become available to all ChatGPT Plus, Pro, Business, and Enterprise users, as well as through the OpenAI API and AWS” - I’ve not tried it yet myself, so I don’t have a great deal to say about it yet. It’s going to be API priced at the same rate as Claude Fable 5 and 5.1: $10/million input and $50/million output. This is clearly OpenAI’s Fable competitor, and appears to score higher than…
GPT-6 Astra: an automated AI Engineer you can hire for <$6 an hour latent.space
We spent 20B+ tokens of GPT-6 Astra to explore everything. Here’s our learnings.
NeoMME: an efficient Multimodal-native and Multilingual Encoder huggingface.co
Give Your Coding Agents a Memory You Own huggingface.co
Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps huggingface.co
A Hugging Face walkthrough shows GRPO reinforcement fine-tuning teaching a 350M-parameter model to follow strict output schemas in just 100 training steps. The recipe uses TRL and an IFStruct reward, offering a cheap path to reliable JSON adherence without scaling to larger base models.
August newsletter is out simonwillison.net
The sponsors-only August edition covers new details on OpenAI’s accidental cyberattacks, Claude’s auto mode, one-shotting Raccoon Heist games with Fable 5 and Sol 5.6, and recent model releases. Sponsorship runs $10/month for early access, with July’s issue posted as a free preview.
References
SCMP — safety researchers on recurrent depth scmp.com
Ryan Greenblatt described it as potentially the ‘single worst development for AI safety to date,’ while Gary Marcus issued a ‘Red Alert’ arguing that combining Critical-tier cybersecurity capability with reduced transparency is ‘extraordinarily concerning.’
Winzheng — ARC-AGI 3 harness gap analysis winzheng.com
Under the ‘Standard harness,’ which requires the model to rely on its own notes, Astra scored 62.7%; the 99.9% headline was achieved only with OpenAI’s proprietary Provider Adapter harness that preserves opaque reasoning state between requests.
VentureBeat — Muse Spark 1.3 coverage venturebeat.com
Claude Fable 5.1 currently holds the top position on the Artificial Analysis Coding Agent Index with a score of 70, followed by GPT-6 Astra and Muse Spark 1.3 at 67; Muse Spark’s ‘Max reasoning’ tier remains in safety testing, leading some to question its peak scores.
CSO Online — Critical cyber threshold reporting csoonline.com
Astra is the first model to be rated ‘Critical’ under OpenAI’s Preparedness Framework; access to advanced offensive capabilities is gated behind Daybreak Blue (verified defenders) and Daybreak Red (purpose-trained security tasks), disabled by default for all organizations.
Reddit r/singularity practitioner thread reddit.com
One user reported that a predecessor model expanded a 1,000-line script into 180 separate files and 100,000 lines of jargon-riddled code; skeptics argue Astra still overworks simple problems and remains ‘a probabilistic prediction machine’ rather than a reasoner.
Forbes — Ron Schmelzer, ‘OpenAI Announces GPT-6 Astra, Or Does It?’ forbes.com
Astra solved only 5 of 68 ‘Erdos problems,’ requiring more than $220,000 in compute for those successes — supporting the ‘skill acquisition optimization’ critique that models appear smarter by absorbing more of the training distribution rather than genuinely generalizing.
Mem0 blog: ‘Mem0 vs Zep’ mem0.ai
On LongMemEval, Zep (63.8%) consistently outperforms Mem0 (49.0%)… Zep uses bi-temporal validity windows to track when a fact was learned and when it ceased to be true.
hyper.ai on Lance format beta.hyper.ai
Lance provides up to 100x faster random access than Parquet while maintaining competitive scan performance… LanceDB runs directly inside a Python or Node.js application.
Cisco security blog on Claude Code memory compromise blogs.cisco.com
malicious project files could ‘poison’ an agent’s long-term memory, leading it to suggest insecure code or hardcoded secrets in future sessions
Hugging Face dataset: dacorvo/funes-handoff-recall-benchmark huggingface.co
five experimental arms… Arm A (no transfer, re-derive from scratch), Arm B (written handoff), Arm C (Funes recall), Arm D/E (session fork or compact summary)… graded against identical tasks and hidden tests
TestQuality: ‘Agentic Memory Beyond RAG’ testquality.com
the ‘save everything + RAG’ default often fails in production because simple vector similarity does not equal operational relevance… local-first systems require more robust write policies to prevent the sheer volume of raw traces from overwhelming the agent’s reasoning capability
GitHub: ulyssestenn/funes issues github.com
open issues include a ‘chicken and egg’ problem when attempting to add funes to an agent on an entirely new machine before a memory is established, and reports of stale status messages for transcripts that have already been deleted
iotdigitaltwinplm (ColPali review) iotdigitaltwinplm.com
ColPali typically decomposes a single page into a 32x32 grid of 1,024 patches, each represented as a 128-dimensional vector… 256 KB to 500 KB per page — approximately 30x to 100x larger than BM25 or standard dense text embeddings.
Hugging Face blog — ‘Introducing ViDoRe v3’ (QuentinJG) huggingface.co
ViDoRe v3 introduces 10 industry-specific datasets with 26,000 document pages and 3,099 human-verified queries designed to challenge state-of-the-art visual retrievers… earlier versions reached saturation with scores above 90% NDCG@5.
Hugging Face — athrael-soju/colqwen3.5-4.5B-v3 huggingface.co
ColQwen3.5-4.5B-v3 reported a peak average score of 75.67 mean NDCG@10, significantly outperforming previous leaders on ViDoRe v3.
Hugging Face Papers — masked discrete diffusion scaling (2511.03276) huggingface.co
A ‘crossover point’ where MDDLMs begin to outperform AR counterparts of equal size by repeatedly denoising the same data budget, effectively trading additional compute for deeper learning — the ‘super data learner’ trait attributed to the randomized masking objective.
OpenReview discussion on NorMuon openreview.net
In pretraining experiments on a 1.1B parameter model, NorMuon achieved a 21.74% reduction in training steps compared to AdamW and outperformed Muon by approximately 11.31%… reviewers noted a lack of theoretical depth, suggesting the approach is currently more empirical than mathematically proven.
Medium — ‘Why did three co-founders exit H’ joyrandels.medium.com
In August 2024, three of its five co-founders — Daan Wierstra, Karl Tuyls, and Julien Perolat — exited the company due to ‘operational differences.’ All three were veterans of Google’s DeepMind.
