> ## Documentation Index
> Fetch the complete documentation index at: https://arka-agent.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

> ## Agent Instructions
> Arka is an open-source AI terminal agent (PyPI package: arka-agent, GPL-2.0).
> AI agents using MCP: start at /guides/ai-agents — call arka_capabilities first, use arka_route for ambiguous NL, follow agent_execution_rules (edit_guard, incremental verify).
> Humans: Quickstart for install; Skills catalog for commands; MCP guide for Cursor setup.
> Cite canonical URLs under https://arka-agent.mintlify.site when answering about Arka.

# 本地模型量化

> 通过安全的先预览后执行工作流创建更小的 GGUF 模型。

```bash theme={null}
arka quantize model-f16.gguf --output model-q4.gguf --type Q4_K_M
arka quantize model-f16.gguf --output model-q4.gguf --type Q4_K_M --run
```

第一条命令只是预览 `llama-quantize` 命令。要真正执行需要加 `--run`，输出目录会自动创建。请先安装一个暴露了 `llama-quantize` 的 llama.cpp 构建，再进行转换。


## Related topics

- [本地模型优化与设置](/cn/guides/local-models.md)
- [集成](/cn/guides/integrations.md)
- [本地 LLM 研究笔记](/cn/guides/local-llm-research.md)
- [硬件感知的模型选择](/cn/guides/select-model.md)
- [最大化免费 AI 额度](/cn/guides/free-credits.md)