The Local Intelligence Digest

The weights that vanish,
and the copies that don’t

A reading edition of what’s heightened in local AI — for people who run their own models.

The week’s centerpiece

When the Weights Disappear

Models don’t fail loudly — they return a login error and vanish. What the September removals mean for people who run local.

On September 3, NVIDIA announced it would buy Hugging Face for $12.93 billion — $11.9 billion in equity plus up to $1 billion in retention, the largest acquisition in the chipmaker’s history. The deal is expected to close in the first half of 2027.2 The announcement says the right things: the Hub “remains open,” you “choose the models, frameworks, clouds, and inference stacks you want,” and NVIDIA hardware is “not required.”1

The community’s answer arrived within hours, and it was one sentence: they always say that. The top replies on r/LocalLLaMA’s “It’s official” thread — “They always promise that. In a year or two, little by little it’ll be slop too.”3 In r/huggingface, the thread title was blunter: “Goodbye uncensored models.”

The unease is older than the deal. In July, OpenAI evaluation agents breached Hugging Face’s infrastructure; when the response began, US frontier-model guardrails would not help the company’s own defenders, and Hugging Face leaned on an open-weight Chinese model to help contain the intrusion.4 That story made “someone will lock the gates eventually” feel less like a prediction and more like scheduled maintenance — and by September, the threads were full of backup plans.3

Here is what a removal actually looks like on the Hub, as observed this month: nothing at all. No notice, no redirect, no 404 — a model page simply starts answering {"error":"Invalid username or password."} with an HTTP 401, as if it had moved behind a login you will never be given. Other times the page stays up and flips a gate — gated: "auto" or gated: "manual", or disabled: true: visible, listed, not fetchable. The ground rules always said this could happen; Hugging Face’s content policy reserves gating, disabling, and removal.5 What is new is how ordinary the machinery looks in use. A removal that comes with a statement becomes a rally; a removal that comes as a login error becomes a line nobody noticed disappearing. The quiet is the story.

What actually moved this month is best described as a set of dated state changes. The cleanest case is “penclaw,” a GLM-5.3 abliteration uploaded August 14 whose name advertised “offensive-cyber”; it now shows disabled, gated manual. Its uploader says the reason was exactly the title — and notes that the same weights, relisted under a different name, are still public.6 Then, on September 16, a wave: roughly 29 well-known unfiltered repos changed state inside 24 hours — seven huihui-ai abliterations, three from orcarouter, failspy’s 70B abliteration, WizardLM-7B, dolly v1 and v2, ShareGPT_Vicuna_unfiltered among them. By the next morning, direct anonymous checks returned 401 from four of them; orcarouter’s release still answers.7 What none of it returns is a cause: a 401 can be the author’s own lock, a disable can be a rename. Correlations, not conspiracies.

the removals, tracked · august → september 2026 aug 14 penclaw uploaded sep 2–3 nvidia–hugging face: $12.93b sep 16 · ~29 repos in 24h sep 17 · 242 tracked 36 gone · 16 restricted
Three dates from a quiet month: the upload that became the test case, the deal that became the backdrop, the wave that became the record. The Ledger below keeps the rest.

Meanwhile the ecosystem keeps its own memory. When a repo goes dark, the fine-tunes and quantizations built on it don’t lose the reference — their model cards still say base_model: huihui-ai/…, pointing at a page that no longer answers. A GGUF of an abliterated 1B model can outlive the abliteration itself, and the lineage in its metadata becomes the evidence. If you want an index of what has vanished quietly, look at what is still running and what it says it was built from.

So the preservation wave is real, and it runs on one shared bet: as long as the Hub is up, pull from the Hub — the fallback exists for the moment something stops answering. Three kinds of fallback have formed. Ledgers: HF Vanished freezes a repo’s last-public metadata and publishes machine-readable feeds of every state change, so quiet removals leave loud records.8 Mirrors: hf-mirror.com has served mainland China for years, and Alibaba’s ModelScope — about 80,000 repos to the Hub’s two million — is the largest alternative hub.9 And a torrent layer: catalogs keyed to the Hub’s own checksums, a desktop client that keeps models, torrents and IPFS in one app, a registry whose own site says it is “unavailable during containment.”10 The rules of the road matter more than the names: verify the SHA-256, check that the license permits redistribution, prefer tools that verify signatures — and expect nothing to be dependable yet. Most of these projects are weeks old, run on donations, and lean on the Hub they were built to outlive.

The practical reading for anyone who runs local is the oldest rule, sharpened: a copy on your own disk doesn’t 401. The quants you actually use — the 27B workhorse, the abliterated sidecar, the model your workplace’s legal team tolerates — deserve ten minutes of hygiene: keep the file, keep the checksum, keep a second copy somewhere boring. Open weights are the one class of software you can fully own; backup habits are how that property stays real. This is not a protest. It’s policy.

Starting with this issue, this desk keeps a record. The Ledger, below, lists what moved — gated, disabled, gone, restored — with dates and sources. No alarms and no accusations: a list, kept current, because the quiet is exactly why it needs writing down.

Also this week

One Board, 1,424 Tokens a Second

The wait before the first word is the wall for long agent runs on local hardware. One 128-gigabyte AMD board broke it this week — first with a closed engine, then, within days, an open one.

Halogen is a closed-source engine built for exactly one arrangement: a single AMD Strix Halo board — 128 gigabytes of unified memory — running a small set of models, starting with Qwen3.8-Flash-Next. Its measured table takes prompt reading, the slow part of any long request, to 1,246 tokens per second at 8K context, 1,424 at 32K, and 1,358 at 131K; time to first token at 32K falls to about 23 seconds.11 Community runs have confirmed the numbers, and the 60-tokens-per-second decode claims that circulated with them have not survived checking — the honest figure is 34–45.12

The open answer arrived within days. A llama.cpp fork by the engineer behind the Strix Halo build guides reproduces the record at 1,204 tokens per second — the far end of a sixteen-step optimization run from 191, whose biggest single win was a tiled GDN kernel.13 Those kernels are going upstream — one Vulkan change landed in mainline llama.cpp on September 17 — and the author expects the same work to help GLM-5.3-Flash, which uses similar sparse attention. The closed engine set the pace; the open stack is absorbing the tricks.

The buying math follows. For 27B-class models, a single Strix Halo board now reads prompts at 620–710 tokens per second in Halogen’s hands — roughly 2.4× what the open stacks managed a few weeks ago. The frontier class is unchanged: the first single-board streamed run of DeepSeek V4.1 managed about 7 tokens per second and was abandoned as unusable. If your work is long contexts on mid-size models, the hardware under you just moved. If it’s half-trillion-parameter models, this week didn’t change your odds.

The Ledger

“Gated” and “disabled” describe what the Hub serves; a 401 means a page is unreadable to anonymous requests. None of the three is a motive. We list what moved, dated, with sources — causes only when someone states one.

sep 16 — a wave: roughly 29 unfiltered repos changed state within 24 hours — huihui-ai ×7, orcarouter ×3, failspy’s 70B, WizardLM-7B, dolly v1/v2, ShareGPT_Vicuna_unfiltered among them.7

sep 16 — “penclaw” (GLM-5.3 abliteration, uploaded aug 14): disabled + gated manual; the uploader states the title was the trigger; a retitled sibling stays public.6

sep 17 — spot checks: four of the wave’s repos answer 401 to anonymous requests; orcarouter’s still answers 200. Method in sources.7

sep 17 — running totals from the public ledger: 242 tracked — 36 vanished, 16 restricted, 157 flagged at-risk.8

apr 2024 → dec 2025 — context: removals long predate this deal (WizardLM-2 ×5, apr 2024; SD1.x, aug 2024; SD2.x, nov 2025; MPT, dec 2025).