Atomic-Chat
A local-first, offline AI chat application for running open-weight LLMs privately on your machine.
Atomic-Chat 简介
Atomic-Chat is a desktop application designed to run large language models locally without requiring cloud connectivity. It supports a wide range of open-weight models including Llama, Gemma, Qwen, Mistral, Phi, and DeepSeek, with optimizations tailored for Apple Silicon (via MLX) and x86 systems (via llama.cpp/GGUF).
The app includes advanced inference features such as Multi-Token Prediction (MTP), DFlash block-diffusion decoding, and EAGLE-3 speculative decoding — all aimed at accelerating response throughput while maintaining accuracy. It also provides automatic context management, including chain-of-thought tracking and dynamic context-window expansion with overflow notifications.
Built for privacy and control, Atomic-Chat runs entirely offline and supports self-hosted, local-first workflows. It integrates with Hugging Face for model loading and offers native support for GGUF and MLX model formats.
核心功能
- Runs open-weight LLMs locally from Hugging Face — including Llama, Gemma, Qwen, Mistral, Phi, and DeepSeek.
- Multi-Token Prediction (MTP) speculative decoding delivers 30–70% throughput improvement, up to 3× on Gemma 4.
- DFlash block-diffusion decoding achieves up to 6× faster inference on Qwen 3.6, Gemma 4, and Kimi K2.5.
- Flash Attention toggle (on/off/auto) for fine-grained performance control.
- Automatic reasoning-context tracking for chain-of-thought models.
- Auto context-window expansion with overflow notifications to prevent truncation.
- EAGLE-3 speculative decoding for Gemma 4 on Apple Silicon (MLX).
- MTP support on MLX for Qwen 3.5/3.6 and DeepSeek V4.
优点 & 缺点
优点
- • Fully offline and private — no data leaves the device.
- • Strong performance optimizations for both Apple Silicon and CPU-based systems.
- • Actively developed with frequent updates and community engagement via Discord.
缺点
- • No official license information is provided in the repository, creating ambiguity around redistribution or commercial use.
- • Requires technical familiarity to download, manage, and run local LLMs — not plug-and-play for beginners.
- • Desktop-only; no web or mobile client available.