LocalClaw/LLM/Dolphin Mixtral (8x7B)
Open-weight local LLM

Dolphin Mixtral (8x7B)

Uncensored Mixtral fine-tune. No content filters. Popular for unrestricted chat. 708K downloads.

32 GB power user 32 GB RAM Q4_K_M Coding assistant
Run with LocalClaw Compare all models
Parameters
8x7B (46.7B)
Minimum RAM
32 GB
Model size
26 GB
Quantization
Q4_K_M

Can Dolphin Mixtral (8x7B) run locally?

Dolphin Mixtral (8x7B) belongs on 32 GB machines when you want stronger quality without jumping to server hardware.

Search for dolphin-2.9.2-mixtral-8x7b in LM Studio or another GGUF-compatible runtime.

TheBloke/dolphin-2.9.2-mixtral-8x7b-GGUF
chatcodepowergeneral

Install path

01
Check RAM fitMinimum 32 GB RAM. Start with the Q4_K_M quant.
02
Load the modelSearch dolphin-2.9.2-mixtral-8x7b in LM Studio.
03
Control locallyUse LocalClaw to manage models, agents, chat, channels and scheduled OpenClaw work.

Strengths

  • Uncensored Mixtral fine-tune. No content filters. Popular for unrestricted chat. 708K downloads.

Limitations

  • Performance depends on quantization, RAM bandwidth and runtime support.

Best use cases

  • chat
  • code
  • power
  • general

Capability profile

speed
4
quality
8
coding
7
reasoning
7

Technical notes

Developer
dolphin
License
See model repository
Context window
Unknown tokens
Architecture
See model card

This model fits these next steps

Hardware fit is based on LocalClaw's RAM tier, model size and quantization metadata. Always leave memory headroom for your OS and runtime.

Comfortable headroomMac mini M4 Pro 48GBMobile workstationMacBook Pro M4 Max 36GBPower-user picks32GB RAM guide

Where to go next