JS Wei (Jack) Sun

MASS mimics netcode, GPT/Claude patch replay leak, Hou et al. reframe learning

Every URL the pipeline pulled into ranking for this issue — primary sources plus the supporting and contradicting findings each Researcher returned. Inline citations in the issue point back here.

← Back to the issue

Sources

MASS: Multiplayer World Models with Authoritative Shared State huggingface.co

MASS separates shared world dynamics from view rendering to improve consistency and scalability in multiplayer video world models.

Stealing Reasoning Traces from Proprietary LLM APIs simonwillison.net

Stealing Reasoning Traces from Proprietary LLM APIs A vanity domain name ( stolen-thoughts.com ) for a neat paper : Anthropic, OpenAI, and Google return encrypted chain-of-thought blocks to clients that can be replayed across sessions, users, and models. We take a trace produced by a frontier model, replay it into a weaker sibling, jailbreak the weaker model, and recover the stronger model’s hidden reasoning in plaintext You can see an example of these encrypted blocks by running: curl https://…

Continual Learning in Transition huggingface.co

Continual learning is evolving from parameter updates to system-level adaptation across training and inference stages, guided by when, how, and where learning occurs.

Invisible Shortcuts: Why Vision Encoders Know Your Camera huggingface.co

Vision models pick up predictive signals from pixel-level traces left by acquisition and processing pipelines, effectively identifying the camera rather than the scene. Suppressing that sensitivity during pretraining improves out-of-distribution generalization and helps downstream tasks like generated-image detection avoid metadata-driven false correlations.

HarnessOpt-Bench: Evaluating LLMs at Harness Optimization huggingface.co

The benchmark asks frontier models to iteratively improve coding-agent harnesses under fixed evaluation budgets, scoring them by normalized gain against stochastic runs inside a trusted execution environment. Results show wide variation across models and tasks, undercutting the assumption that stronger base LLMs automatically make better optimizers.

Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skills huggingface.co

The taxonomy contrasts vision-language-action models that bake behavior into weights with code-as-policy systems where robots synthesize and repair their own skills at runtime. It maps degrees of self-improvement, cross-embodiment portability, and open questions around persistent skill libraries and emerging skill marketplaces.

MameLoshnLM: Yiddish Language Model and Evaluation Benchmark huggingface.co

Built by continued pretraining of Llama 3.1 8B on a curated Yiddish corpus, MameLoshnLM captures lexical and morphological patterns better than general multilingual models on a new multi-task evaluation. Weights and benchmark are released on GitHub to seed further low-resource language work.

Activity Frames: Deterministic Screen-Activity Compilation for Agent Memory and Replay huggingface.co

A deterministic compiler turns raw screen recordings into structured activity frames that shrink context size while beating LLM-written summaries on answer accuracy. The pipeline also quantifies routine overhead and recurrence, giving agent builders concrete bounds on inference cost and token spend during replay.

OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models huggingface.co

The suite exposes systematic leniency bias in vision-language judges scoring computer-using agents and releases OS-Shepherd reward models trained on 100K trajectories as cheaper alternatives to frontier VLMs. Hard and multi-step splits stress-test whether reward models generalize across operating systems and applications.

DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspaces huggingface.co

Agents must produce verifiable tabular answers from mixed files, databases, and documents, scored by deterministic checks over header-invariant column alignment and precision-aware normalization. Frontier models and harnesses show large accuracy gaps, exposing weaknesses in modality routing and constraint-aware relational sampling on realistic enterprise data.

CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Tasks huggingface.co

CalibForge synthesizes terminal tasks calibrated against solver behavior to improve agent training effectiveness and benchmark performance.

FactorJEPA: Factorizing Monolithic Futures into Layout-Agent-Interaction Channels for Crowded and Chaotic Global South Urban Worlds huggingface.co

FactorJEPA improves predictive world modeling in dense, chaotic urban settings by decomposing future states into structured layout, entity, and interaction factors, and introduces a large-scale dataset for this regime.

GST-Bench: Can VLMs Develop Global Spatial Awareness from Video? huggingface.co

The study introduces a video benchmark requiring global spatial reasoning across long videos and reveals that vision-language models struggle to build consistent global scene representations despite strong local perception.

EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning huggingface.co

EnvACE trains large language model agents via internal world rehearsal instead of external environments, improving long-horizon tool use through joint optimization of action and simulated response.

AgentOPSD: Recursive Self-Distillation for Agentic Reinforcement Learning huggingface.co

AgentOPSD uses recursive Bayesian belief updates over turn-level log-probability gaps to assign credit in long-horizon agentic reinforcement learning without extra critics or rollouts.

KVAE: Family of Tokenizers for Multimodal Generative Models huggingface.co

KVAE tokenizers for audio, image, and video achieve competitive reconstruction and generation quality compared to leading open-source alternatives while providing training details and open-source code.

SmartMage: Dynamic Modality Orchestration for 3D Scene Understanding huggingface.co

SmartMage is a multimodal large language model that dynamically selects and combines visual and geometric modalities based on query semantics to improve 3D scene understanding.

ChronoVision: Temporal Reasoning via Latent State Reconstruction huggingface.co

ChronoVision improves visual temporal reasoning by aligning latent imagery with logic through reconstructive prediction, ROI attention, and reinforcement learning, achieving strong results on video reasoning benchmarks.

Learning from Failures: Retrieval-Centric CoT via Hard Negatives for Unified Multimodal Retrieval huggingface.co

UniME-R1 improves multimodal retrieval by generating retrieval-centric reasoning guided by initial candidate feedback rather than query-only explanations.

WorldClaw: Agentic 3D Open-World Generation at Scale huggingface.co

WorldClaw is an agentic coarse-to-fine framework that generates large-scale editable 3D worlds from text by combining planning agents, semantic layouts, reusable assets, and render-based refinement.

ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routing huggingface.co

ContextMaster unifies multi-shot video generation, reference conditioning, and editing via role-aware context routing and privileged distillation to maintain history with fixed cost.

World-to-Wrist: Task-Conditioned Future Wrist Modeling for Fine-Grained Robot Manipulation huggingface.co

W2-VLA improves fine-grained robot manipulation by forecasting future wrist interactions via a latent interface between vision-language and wrist prediction, supported by structured progress annotations.

DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation huggingface.co

DyPES-VLA learns shared dynamics priors via future prediction and uses embodiment-specific mixture-of-experts action heads to enable cross-embodiment robot control without manual action alignment.

PaDoc: Layout-Grounded Parallel Decoding for Document Parsing huggingface.co

PaDoc is a layout-grounded document parser that uses branching region-level decoding over a shared page representation to improve speed and accuracy.

EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removal huggingface.co

EffectLearner uses vision-language reasoning and diffusion transformers to remove objects and their induced effects from videos with high fidelity and temporal coherence.

From Economic Agents to Agentic Economies: A Systems Blueprint for Economic World Models huggingface.co

Economic world models are generative agent-based simulations organized by a six-level capability ladder to build high-fidelity economic sandboxes and AI training substrates.

On-Policy Delta Distillation for Multilingual Math Reasoning huggingface.co

On-policy delta distillation improves multilingual mathematical reasoning and reduces cross-language performance gaps, though multilingual data is needed to preserve target-language outputs.

Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains huggingface.co

Researchers adapted NVIDIA’s Nemotron retrieval and generation stack for Modern Greek, showing that fine-tuned dense retrieval and reranking outperform baselines on specialist corpora, while a LoRA-tuned mixture-of-experts reader improves answer correctness and citation quality, and they released the HERA benchmark.

Task-Conditional Flow Matching for Balanced Multilingual Text Embedding Adaptation huggingface.co

Task-Conditional Flow Matching adapts multilingual embedding models with task-specific objectives and curriculum learning to improve performance across diverse multilingual tasks.

GaussianSelector: Lightweight Human-Guided Object Selection in 3D Gaussian Splatting with Graph Optimization huggingface.co

GaussianSelector enables efficient interactive 3D object selection from sparse views and scribbles by grouping native Gaussian primitives into superpoints and solving a graph-cut optimization.

Interpretable MEG Decoding of Perceived Speech: Cortical Sources and the Stimulus Features That Drive Retrieval huggingface.co

Redesigning a MEG-to-audio retrieval model with spherical harmonics, source-space mapping, and input interventions reveals that narrative speech structure, acoustic onsets, and intensity drive retrieval while reducing parameters.

References

aigovernance.com aigovernance.com

The team decoded more than 315,000 reasoning blocks scraped from 6,708 public agent trajectories and recovered 704 privacy artifacts, including 62 live API keys, 33 passwords, and 24 access tokens.

The Hacker News thehackernews.com

Many of these secrets appeared only inside the hidden reasoning layer — the model reasoned about a credential before redacting it from the visible response — leaving developers unaware that shared session logs contained live credentials.

startupfortune.com startupfortune.com

Reasoning segments in the style of GPT and Claude were far easier to extract from Kimi-K3 and GLM-5.2 than from other independent architectures, suggesting these models may have been distilled from stolen traces long before the vulnerability was publicly documented.

36kr.com eu.36kr.com

The authors themselves concede the anomalous-recall metric ‘cannot causally establish distillation,’ and critics note that models trained on overlapping public corpora naturally converge on similar reasoning fragments — what one reviewer called ‘synthetic data spill’ rather than active theft.

aiweekly.co aiweekly.co

Cryptographer Matthew Green reported the cross-session replay flaw through official bug bounty channels months earlier and was initially dismissed by both OpenAI and Anthropic before the ELLIS/Max Planck team’s public paper forced action.

Reddit r/LocalLLM discussion reddit.com

Commenters split on the framing: some argued that since users pay for the reasoning tokens they should have a right to see them, while others pointed out labs likely hide traces because models produce ‘unhinged’ intermediate content that would create PR problems — ‘stealing’ is the wrong word for data left wide open.

OpenTrain AI paper tracker opentrain.ai

Independent evaluation platforms… have flagged the implementation with ‘risk flags’ as of early August 2026, noting that a full, verifiable public reproduction may take several days to stabilize.

Hugging Face — AlayaWorld paper (2607.06291) huggingface.co

AlayaWorld was introduced in July 2026 as a full-stack, open-source framework… the same Alaya Lab team then released MASS in August 2026, with Khora as the specific model implementation addressing the multiplayer consistency problem.

worldsimulator.ai — comparative review worldsimulator.ai

Genie 3 maintains the highest global coherence at 720p/24fps with a one-minute memory window; Oasis generates Minecraft-style gameplay frame-by-frame but its ‘dream-like’ logic causes unpredictable environment shifts; MultiWorld outperforms baselines in multi-view consistency but remains monolithic.

arXiv 2604.21686 (MultiWorld framework) arxiv.org

MultiWorld… utilizes a ‘Multi-Agent Condition Module’ and a ‘Global State Encoder’ to ensure that multiple agents can act simultaneously while maintaining visual consistency across different camera angles.

YouTube — Khora / AlayaWorld demo coverage youtube.com

Khora was launched as a collaborative technical preview between Alaya Lab, YAHAHA (OphilusAI) and RhOS.ai, supported by Alibaba Cloud infrastructure, with public demos including an eight-player real-time deathmatch.

Jyo Pari blog — ‘RL’s Razor’ jyopari.github.io

Among the many policies that solve a new task, on-policy RL is biased toward the one that is closest in KL-divergence to the original model.

OpenReview — Continual Policy Optimization (Luo et al., 2026) openreview.net

Standard RL can still suffer severe forgetting in complex multimodal sequences; KL regularization is misaligned because it is evaluated on current-task data rather than prior distributions.

Zheng et al., ‘Spurious Forgetting in Continual Learning of Language Models’ researchgate.net

Freezing bottom layers doubled old-task retention from roughly 22% to 44%, outperforming EWC and generative replay without storing old data.

r/learnmachinelearning discussion of Google Nested Learning / HOPE reddit.com

5+ different update frequencies, each with unique learning rates and momentum buffers, makes the architecture nightmarish to tune… no official pip install or first-party production library.

Okoone — ‘Why AI coding agents still can’t handle real-world software’ okoone.com

Skill selection remains stable initially, but accuracy drops sharply once the library reaches a critical size… agents struggle to index more than 2,500 files or handle files exceeding 500KB.

KeepMyPrompts — ‘1M Context Windows Trap’ keepmyprompts.com

Multi-fact retrieval (NoLiMa) and reasoning-over-context (NeedleChain) scores typically plummet to 40–60%… a 1M-token query can cost up to 1,250x more than a tuned RAG pipeline.

Jack Sun

Jack Sun, writing.

Engineer · Bay Area

Hands-on with agentic AI all day — building frameworks, reading what industry ships, occasionally writing them down.

Digest
All · AI Tech · AI Research · AI News
Writing
Essays
Elsewhere
Subscribe
All · AI Tech · AI Research · AI News · Essays

© 2026 Wei (Jack) Sun · jacksunwei.me Built on Astro · hosted on Cloudflare