SGLang released version 0.5.21 on October 2 with support for new models, faster inference paths, a Rust prefix cache core, and a long list of hardware optimizations. The feature that matters most to me is much less dramatic. Its new Decisions API turns a language or vision model
Local AI has never had only a model problem. It has had a setup problem. The weights may be free to download, but the useful system still asks someone to choose a model, find a compatible format, pick a quantization, configure a runtime, understand the memory limits, and tune the
OpenAI introduced Dots at DevDay on September 29, describing them as remarkably capable, always on agents built to handle ongoing responsibilities. The interesting part is not that another agent can browse, plan, and complete tasks. Plenty of systems can already assemble those pieces. The important change is persistence. An assistant
Anthropic released Claude Sonnet 5.5 on September 28. The company calls it a clear upgrade over Sonnet 5, says it runs 30 percent faster, and says it costs up to 30 percent less for most work. That is a meaningful product improvement. It is also another reason I think
NVIDIA announced its Open Agent Safety Platform today, and the important part is not the long partner list. It is where NVIDIA put the control boundary. OpenShell runs outside the agent and traces actions while enforcing policy. Sentry goes further by placing an independent watchdog on a BlueField 4 data
Ollama released version 0.40 as a release candidate on September 25 with one major change: supported model architectures now run through MLX by default on Apple Silicon. During the prerelease period, Ollama says it will test and enable more models. The example in its release notes is Qwen3.8.
A llama.cpp change merged on September 25 looks like a narrow Blackwell optimization. It is actually a useful preview of how local inference should work. The runtime can now read precision policy from model metadata and choose a different computation path for specific tensors. That sounds like plumbing. I
Dataiku announced Agent Management on September 24, a standalone product meant to find AI agents across an organization, measure their business and technical performance, and flag the ones carrying the most risk. The company says it works across platforms, including agents that were not built with Dataiku, and plans general
Hermes Agent 0.21.5 landed today as a patch release, but the numbers do not read like a small patch. Nous Research says the release collects about 460 merged pull requests since 0.21.4, spanning 1,610 non merge commits and 4,828 changed files. The full curated
Hugging Face announced on September 22 that Jun Kim, the creator and lead maintainer of oMLX, has joined the company to work on oMLX and related MLX tools full time. The project remains in the same repository, keeps its Apache 2.0 license, and stays under Kim's leadership.
vLLM 0.30 landed today with 762 commits from 315 contributors. It adds several new model families, more quantization paths, sparse attention work, and enough distributed serving machinery to fill a release on their own. The feature that caught my attention is much less flashy. Fast Start can keep post
SGLang 0.5.20 arrived with 713 contributions from 237 people, seven new models, a CPU simulator, and enough kernel work to keep a performance engineer busy for weeks. The part I care about is less glamorous. The release notes now read like a map of which models belong on