Every model on this page runs entirely on your hardware — no API keys, no usage logs, no data leaving your machine. Browse the detailed cards below, or visit the full model catalog for 80+ families with per-family deployment guidance.
Not sure where to start? These are the strongest choices for each common scenario. Full details and alternatives are in the comparison table below.
| Model | Creator | MT-Bench | Context | Min RAM | Licence | Best for | Guide |
|---|---|---|---|---|---|---|---|
|
Alpaca 7B
Stanford · March 2023
|
Stanford CRFM | N/A* | 4K | 4–5 GB | Non-commercial | HistoryEducation | Read → |
|
Dolphin 2.x
Eric Hartford · 2023–24
|
Eric Hartford | ~7.8 | 32K | 5–6 GB | Apache 2.0 | UncensoredCustom agents | Read → |
|
GPT-2
OpenAI · Feb 2019
|
OpenAI | N/A† | 1K | 1 GB | MIT | ResearchEducation | Read → |
|
Neural Chat 7B
Intel · Nov 2023
|
Intel Labs | 7.98 | 8K | 5–6 GB | Apache 2.0 | Intel HWGeneral | Read → |
|
Nous Hermes 2
Nous Research · 2023–24
|
Nous Research | ~8.5 | 32K | ~50 GB | Apache 2.0 | CommercialReasoning | Read → |
|
OpenChat 3.5
Tsinghua · Oct 2023
|
Tsinghua THUNLP | 7.81 | 8K | 5–6 GB | Apache 2.0 | Best overall 7BChat | Read → |
|
Orca 1
Microsoft · June 2023
|
Microsoft Research | ~7.0 | 4K | 5–6 GB | Non-commercial | ReasoningResearch | Read → |
|
Orca 2
Microsoft · Nov 2023
|
Microsoft Research | ~7.2 | 4K | 5–6 GB | Non-commercial | ReasoningStrategy | Read → |
|
Starling 7B β
UC Berkeley · Nov 2023
|
UC Berkeley | 8.09 | 8K | 5–6 GB | Apache 2.0 | Best 7B chatRLAIF | Read → |
|
Vicuna 1.5
LMSYS · July 2023
|
LMSYS Org | 7.92 | 4K | 5–6 GB | Non-commercial | ShareGPT styleResearch | Read → |
|
Whisper large-v3-turbo
OpenAI · Sept 2022 / Oct 2024
|
OpenAI | STT only | 30s audio | 6 GB | MIT | Transcription99+ langs | Read → |
|
WizardLM-2 7B
Microsoft · April 2024
|
Microsoft Research | 8.01 | 32K | 5–6 GB | Mixed by variant | Complex tasksCoding | Read → |
|
Zephyr 7B β
HuggingFace · Oct 2023
|
HuggingFace | 7.34 | 8K | 5–6 GB | MIT | MIT licenceAlignment study | Read → |
* Alpaca predates MT-Bench; contemporary evaluations show it performing below Llama 2-era models. † GPT-2 is a completion model, not a chat assistant — MT-Bench is not applicable. MT-Bench scores from LMSYS Chatbot Arena public leaderboard. RAM figures for Q4_K_M INT4 quantisation via Ollama. Nous Hermes 2 shown as Mixtral 8x7B (47B) variant; a 7B/13B variant exists requiring 5–6 GB RAM.
Each card links to the full guide page. The score shown is MT-Bench unless marked otherwise.
The model cards above cover the original 13 comparison families in depth. These additional families are covered on their own pages in the NoCloudGPT catalog. Each links to a full page with hardware requirements, licensing, and deployment guidance.
All models on this page can be running locally in under five minutes using Ollama. The quickstart covers installation on macOS, Linux, and Windows, with hardware recommendations matched to each model.
# Install Ollama: https://ollama.com # Then pick any model from this page: ollama run openchat # Best overall 7B — Apache 2.0 ollama run starling # Best 7B conversation — Apache 2.0 ollama run zephyr # Most permissive licence — MIT ollama run wizardlm2 # Complex instructions — Apache 2.0 ollama run dolphin # Uncensored custom agents ollama run whisper # Speech-to-text — MIT
After the initial download, all inference is local. No prompts are sent to external servers. No usage data is collected. Your conversations stay on your machine. This guide exists because that privacy guarantee matters — and because the quality of open-source models now makes it practical.