C✳CODEZ.WIN
🌐 English

Localized reading guide

huggingface-local-modelsPurpose, usage and source

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

Source retrieved:

Source repository
huggingface/skills
SKILL.md
skills/huggingface-local-models/SKILL.md
Repository stars
11,241
Repository updated
2026-10-30
Categories
Other
Last collected

License: Apache-2.0

Source SKILL.md

Workflow excerpts are reading aids, not executable instructions from Codez. No third-party Skill was run to produce this page.

The purpose and workflow passages below are upstream material, organized and translated for reading. They are distinct from the separately labeled Codez editorial analysis.

What this Skill does

Use to select models to run locally with llama.cpp and GGUF on CPU, Mac Metal, CUDA, or ROCm. Covers finding GGUFs, quant selection, running servers, exact GGUF file lookup, conversion, and OpenAI-compatible local serving.

How the upstream workflow works

Default Workflow

Search the Hub with apps=llama.cpp. Prefer the exact HF local-app snippet and quant recommendation when it is visible. Confirm exact .gguf filenames with https://huggingface.co/api/models//tree/main?recursive=true. Launch with llama-cli -hf : or llama-server -hf :.

Upstream passage · L10 ↗

Hugging Face Local Models

Search the Hugging Face Hub for llama.cpp-compatible GGUF repos, choose the right quant, and launch the model with llama-cli or llama-server.

Upstream passage · L6 ↗

Quant Choice

Prefer the exact quant that HF marks as compatible on the ?local-app=llama.cpp page. Keep repo-native labels such as UD-Q4_K_M instead of normalizing them.

Upstream passage · L92 ↗
Upstream passage · bash ↗
brew install llama.cpp
winget install llama.cpp

Requirements and setup

No short requirements passage was selected from this file. This does not mean the Skill has no dependencies. Check the repository setup instructions and referenced files.

Limits and quality checks

No separate limits passage was selected from this file. This does not mean the Skill is safe for every input or environment. Review the complete source and validate your own result.

Start with a safe trial

  1. Check the supported host and the repository installation instructions. Keep the Skill directory and its referenced scripts, assets and documentation together; SKILL.md alone may omit dependencies.
  2. Give the agent your real input, desired output and acceptance criteria. Invocation syntax and available tools depend on the host; this site does not assume a universal install command.
  3. Try the source workflow in a disposable project or on a copy. Review operations that change files, remote services or billable resources before allowing them.
  4. Validate the output against the source quality checks and your own requirements. A successful trigger or a high repository Star count does not establish a correct result.

Skill format and directory specification ↗

Read further in the source

Translation and scope

This reading guide selects passages from the pinned upstream SKILL.md. Translation is assisted. It is not a complete manual or a claim of tested compatibility. Read the original and its referenced files before use.

This introduction refers to the pinned version below; current repository activity and collection time are shown separately.

Source retrieved
Source commit
fabc634a893f62ad5c2039830397efa35fa62715
Source SHA-256
814640db1d5f2f274aec09d66b3589ed5a0fdcfaf536afd508b1d757dcae1534
Back to the full Skill catalog