JS Wei (Jack) Sun

Meta opens Glimmer 30B, NVIDIA restricts Magpie TTS, Multiverse cuts VRAM 15×

Every URL the pipeline pulled into ranking for this issue — primary sources plus the supporting and contradicting findings each Researcher returned. Inline citations in the issue point back here.

← Back to the issue

Sources

Meta is back with Muse Glimmer: local, agentic, multimodal, and open source huggingface.co

Introducing Muse Glimmer simonwillison.net

Introducing Muse Glimmer Meta are back in the open weights game! Muse Glimmer is a brand new 30B model under a clean Apache 2.0 license (a step up from the janky Llama licenses of old). They claim to have optimized it for exactly the kind of things I’m looking for in a local model: End-to-end Agentic Task Completion. Muse Glimmer achieves strong success rates on full-task benchmarks including DeepSearch QA, MCP-Atlas, 𝛕-Bench and SWE-Bench, which measure its ability to work within scaffolds, wr…

Build Low-Latency Multilingual Voice Agents: Open Weights & Full Deployment Control with NVIDIA Magpie TTS huggingface.co

Making Knowledge Distillation Cheap Enough to Run at Scale huggingface.co

References

Simon Willison — ‘Introducing Muse Glimmer’ simonwillison.net

The pelican riding a bicycle came out pretty jumbled… but when I hooked it up to my llm-coding-agent plugin against a local checkout of Datasette it happily fired off a chain of tool calls to investigate the authentication logic and returned a coherent explanation. On my 128GB machine the 18GB quantized version leaves plenty of room for the rest of my dev environment.

themoonlight.io — review of DFlash block-diffusion drafter themoonlight.io

Traditional speculative decoding verifies tokens sequentially, but block diffusion models are trained with bidirectional attention… this training–verification mismatch causes an average of 46.9% of valid draft tokens to be discarded because a single early-block rejection invalidates subsequent tokens.

The Next Web — Muse Spark breach coverage thenextweb.com

The sandbox run by Irregular was ‘simply wired to the internet’ despite being intended for isolated simulation. Once the path was available, Muse Spark 1.1 identified and exploited a security vulnerability in a third-party service — the same configuration error was cited in prior breaches involving Anthropic’s Claude and OpenAI’s agents.

Futurum Group — ‘Meta reopens its models: PC play or policy play?’ futurumgroup.com

On the CI Memories privacy benchmark, Glimmer recorded a violation rate of 26.4, significantly higher than Google’s Gemma (12.1)… the shift to Apache 2.0 removes the 700-million MAU limit that previously delayed deployment for European banks and government agencies.

VentureBeat — Muse Glimmer launch analysis venturebeat.com

Meta’s most powerful frontier model, Muse Spark 1.2, remains largely proprietary and is offered via a paid API, though Zuckerberg promised an open-weights version would follow ‘soon.’ The new ‘Contributor’ tier offers $0.10 per million tokens in exchange for permission to train on user prompts and source code — a 12-to-21x discount critics call ‘data-for-discount.’

Forbes — coverage of Zuckerberg’s ‘Future is for Everyone’ manifesto forbes.com

Anthony Aguirre of the Future of Life Institute argues that safety regulation is ‘not compatible with open release’ of frontier models. Gary Marcus described the strategy as ‘open weights with all the good press but far fewer advantages,’ suggesting Meta is ‘open washing’ to avoid the same regulatory oversight faced by closed-model developers.

GitHub NVIDIA-NeMo/Speech Issue #15300 github.com

Magpie TTS generates duplicated audio segments at the end of a synthesis… input ‘Hello’ may produce outputs like ‘Hello! ello!’ or ‘Hello! HELLOU!’… a sequence-termination failure where the autoregressive model fails to predict the EOS token with high enough confidence.

TechBrew — ‘An open and not-so-shut debate’ techbrew.com

NVIDIA’s January 2026 update explicitly removed the zero-shot cloning capability from the public release… transitioning the feature to a ‘dormant’ state for most users, restricting its full power to a select group of safety partners after collaborating with voice-security firm Pindrop.

NVIDIA Open Model License (EULA PDF) d29g4g2dyqv443.cloudfront.net

Users are forbidden from using Magpie TTS or its outputs to develop or improve any AI models that are not NVIDIA models or their derivatives… users are required to indemnify NVIDIA against any third-party claims arising from their use or distribution of the model.

hyper.ai — open-weights TTS comparison hyper.ai

Kokoro-82M is lauded for its extreme efficiency; with only 82 million parameters, it can process text in under 0.3 seconds on almost any device, including CPUs and Macs without dedicated GPUs… Kokoro consistently tops open-weight Elo rankings.

ubos.tech — practitioner review ubos.tech

A rigid 20-second generation cap [is] a significant limitation for long-form content… the publicly released open weights do not include zero-shot voice cloning capabilities; this feature is restricted to specific ‘Zeroshot’ versions provided to partners.

Apple ML Research — Cut Your Losses (CCE) machinelearning.apple.com

CCE…only computes the logit for the correct target token and evaluates the log-sum-exp reduction on the fly, reducing the memory footprint for the loss computation from gigabytes to a mere 1 MB.

PyTorch blog — Peak Performance, Minimized Memory (Liger + torchtune) pytorch.org

Integrating Liger with torch.compile resulted in a 47% reduction in peak memory usage at batch sizes of 256… recent PyTorch versions have introduced native chunked linear_cross_entropy implementations.

themoonlight.io review of arXiv:2608.03796 themoonlight.io

Applying only intermediate-layer feature loss caused the student to collapse (MMLU falling to ~28%), whereas logit-level KL was essential for reaching the ~60% range; GSM8K reached 67.5% with the full recipe.

ResearchGate discussion of the paper researchgate.net

Simple top-k truncation provides biased estimates of the teacher’s true distribution… Random Sampling KD uses importance sampling to create an unbiased sparse cache that requires even less storage than top-k methods.

sakhanda.co practitioner analysis wire.sakhanda.co

At K=100, each token requires ~600 bytes… a 1 trillion token corpus results in a storage overhead of 600 Terabytes; logit-based distillation also requires identical tokenizers, limiting cross-family distillation.

Reddit r/tech_x thread on CompactifAI reddit.com

The ‘95% compression’ claim is often achieved on over-parameterized base models… developers point out that this definition of ‘lossless’ ignores outlier weights that are critical for edge-case reasoning.

Jack Sun

Jack Sun, writing.

Engineer · Bay Area

Hands-on with agentic AI all day — building frameworks, reading what industry ships, occasionally writing them down.

Digest
All · AI Tech · AI Research · AI News
Writing
Essays
Elsewhere
Subscribe
All · AI Tech · AI Research · AI News · Essays

© 2026 Wei (Jack) Sun · jacksunwei.me Built on Astro · hosted on Cloudflare