Split-LLM leaks off-audit, Uno's 3× disputed, CausalPFN called Rung 1

Sources

Privacy Failure in Split-LLM Training, The Returned Gradient Nullifies the Decoys huggingface.co

A split-LLM training system passed privacy checks but leaked real data rows through zero-gradient patterns, allowing token recovery attacks despite gradient clipping and noise.

Unlocking Lossless Speedups in LLMs via Discrete Diffusion huggingface.co

Diffusion-augmented autoregressive language models use parallel token sampling via distilled diffusion weights and a specialized sampler to accelerate inference without quality loss or draft models.

Causal Foundation Models huggingface.co

Causal foundation models apply pretrained neural networks to estimate causal effects on new datasets via in-context learning without fine-tuning.

SimpleMemVLA: A Simple but Effective Native-Video Memory for Vision-Language-Action Models huggingface.co

SimpleMemVLA skips dedicated memory modules and instead pipes timestamped video frames straight into a pretrained vision-language model, using its hidden states to drive a flow-matching action head. The approach beats purpose-built memory architectures on long-horizon manipulation benchmarks.

What Else Needs Fixing? Exploring Cost-Effective Test-Time Compute for Revision Propagation in Artifacts Generated Through Conversation huggingface.co

When users request a small edit during conversational artifact generation, LLMs must trace dependencies and update every affected section. The paper benchmarks how well models handle this propagation and tests cost-effective test-time compute strategies to fix the parts they miss.

EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents huggingface.co

EmbodiedSkills orchestrates robot agents through a fixed executable-skill interface with post-action verification, closing the loop between high-level skill selection and low-level VLA execution. The framework supports online adaptation and plugs into backbones like Qwen3-VL and OpenPI/pi0.5.

Unifying Conformal Language Tasks with In-Context Ensembles huggingface.co

The framework replaces hand-crafted conformal score functions with in-context learning and ensembling across LLM prompts, tightening prediction sets while preserving coverage guarantees. It applies uniformly across NLP retrieval tasks and formalizes a complementarity condition plus a saturation bound for the ensemble.

ENEAS: Embedding-guided Neural Ensemble for Adaptive Segmentation huggingface.co

ENEAS extends the SeC architecture with a text-prompting adapter and temporal memory, then adds a semantic verification layer that filters visual distractors through VLM refinement and embedding matching. It handles both instance tracking and open-vocabulary discovery in one model, with 3D reconstruction demos.

FlowBalance: Verifier-Grounded Self-Improvement from On-Policy Reasoning Experience huggingface.co

FlowBalance reweights reasoning trajectories using terminal-verifier signals and profile-based trajectory balance, guarding against false-positive self-guidance that plagues reverse-KL objectives. The method lifts mathematical reasoning accuracy by grounding token-level log-probability updates in verifier-calibrated group advantages.

Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation huggingface.co

TGOPD probes each prompt with verifier-scored samples to check teacher reliability, sending trustworthy cases through dense on-policy distillation and unreliable ones to GRPO-style reinforcement learning. The per-prompt routing improves both training efficiency and downstream accuracy over uniform distillation baselines.

One Symptom, Three Levers: A Critical Review of On-Policy Self-Distillation huggingface.co

On-policy self-distillation for mathematical reasoning uses privileged information to guide a model without a larger teacher, but suffers from reasoning collapse governed by token weighting, privileged context, and guidance dynamics.

Safety for Whom? Boundary-Aware Self-Distillation for Controlled LLM Safety Refusal huggingface.co

Narrow-boundary safety alignment uses self-generated refusal data and boundary-pair training to precisely control refusal boundaries, improving targeted refusal while reducing over-refusal and harmful responses.

References

ArcCompute — ‘Private LLMs in 2026’ arccompute.io

HIPAA and GDPR compliance mandates have made standard cloud APIs a liability … some CTOs are pivoting toward fully local, on-edge private LLMs, viewing distributed splitting as a temporary bridge rather than a final security destination.

USENIX Security ‘23 — Yue et al., gradient inversion on language models usenix.org

Gradient inversion attacks on language-model training can reconstruct tokens from intermediate gradients even under batching, and standard perturbation defenses often only shift the utility–privacy trade-off rather than close the channel.

ICML 2026 poster — DP-SGD-RC (Randomized Clipping) for LLMs icml.cc

Standard DP-SGD scales poorly with LLM context length and width; randomized clipping via Hutchinson-style trace estimation matches deterministic clipping utility on Llama 3.2 while cutting the memory overhead of per-sample clipping.

TPDP 2026 — Ullah, DP split-learning trade-offs tpdp.journalprivacyconfidentiality.org

Aggressive clipping introduces a non-vanishing bias that can stall convergence, while weaker regularization-style DP variants preserve accuracy but prove ineffective against reconstruction.

xbreak.ai / Loop-Suite ecosystem notes echo.xbreak.ai

The repository is part of the broader Loop-Suite ecosystem, which advocates for separating LLM-generated judgments from deterministic arithmetic, so safety verdicts are reproducible code-level bugs rather than model hallucinations.

arXiv 2605.24879 — SDAR split-learning reconstruction arxiv.org

A malicious server can train a ‘decodable simulator’ of the client’s private layers via adversarial regularization, reconstructing sensitive features and labels with high accuracy even without observing raw inputs.

implicator.ai coverage of Uno implicator.ai

DiffusionGemma retains a higher batch-size-one throughput (~836 tok/s vs Uno’s ~405 tok/s), [but] Uno’s architecture may still hold an edge in high-batch, long-context scenarios where memory management becomes the primary bottleneck

Developer’s Digest — DiffusionGemma explainer (context for O’Donoghue rebuttal) developersdigest.tech

a properly tuned vLLM setup achieved roughly 2,700 tokens/s at BF16 precision and exceeded 3,000 tokens/s using FP8 … nearly triple what was cited in the Uno paper

Inception Labs — Mercury 2 launch post inceptionlabs.ai

Mercury 2 tied the speculative ‘GPT-5 Mini’ on the AIME 2025 benchmark with a score of 91.1 … ranked second on quality while remaining the fastest model overall

alphaXiv — xPress causal refiner for diffusion drafters alphaxiv.org

xPress acts as a lightweight causal refiner, restoring missing dependencies across the diffusion block to increase acceptance length by up to 56%

Leonie Monigatti — Speculative Decoding survey leoniemonigatti.com

independently predicted tokens in a block might be individually likely but jointly improbable, leading to low acceptance rates

Hugging Face — z-lab/Qwen3.8-27B-DFlash2 checkpoint huggingface.co

DFlash 2 show speedups exceeding 6× on tasks like math reasoning and code generation, outperforming traditional multi-token prediction (MTP) and autoregressive drafting

OpenReview discussion on CausalFM (prior uncoverage) openreview.net

A single observational SCM can induce an exponentially large space of potential interventional distributions… if the synthetic meta-prior does not perfectly align with the real-world grounding prior, the model suffers from unavoidable posterior inconsistency and estimation bias.

Acalytica summary of Judea Pearl interviews acalytica.com

Pearl described these models as ‘statistics on steroids’ or ‘smart parrots’ that lack a parsimonious world model… because transformers are essentially functional approximators of conditional probabilities, they cannot perform the counterfactual reasoning (Rung 3) required for genuine understanding.

r/MachineLearning discussion of CausalPFN reddit.com

Reducing causal inference to a ‘benchmark-driven task’ akin to image classification is fundamentally misguided… causal inference is a substantive process of reasoning about mechanisms and assumptions—such as ‘strong ignorability’—which cannot be offloaded to a pre-trained model.

CausalPFN arXiv (2506.06039) — calibration methodology arxiv.org

CausalPFN uses a regression calibration framework where temperature parameters are tuned to ensure that outcome coverage serves as a reliable proxy for the unobservable Conditional Average Treatment Effect (CATE) calibration; empirically the Integrated Coverage Error for regression bounds the ICE for CATE.

lilys.ai independent review of the CFMs repo lilys.ai

The implementation lacks ‘prior-coverage diagnostics,’ meaning a model may provide a prediction for a dataset that looks nothing like its training prior without flagging the potential for high error… a ‘silent failure’ risk where the model produces a fast estimate that is nonetheless structurally ungrounded.

Causaly × Microsoft press release (June 2026) causaly.com

Merged large-scale scientific computation (simulation and analytics) with causal knowledge-graph reasoning… enables R&D teams to move from raw data signals to ‘cited, defensible decisions’ within a governed environment.