Model × hardware
Can Mac Studio (2025) M4 Max (32-core GPU) 36GB run Qwen2.5-1.5B-Instruct?
Qwen2.5-1.5B-Instruct at Q4_K_M fits the estimated Mac Studio (2025) M4 Max (32-core GPU) 36GB memory budget at 4,096 tokens: 2.15 GiB required versus 27.00 GiB usable. 146.8–293.6 estimated tokens/s.
Compare the recorded formats.
| Quant | Weight files | Estimated KV | Estimated total | Fit | Estimated generation |
|---|---|---|---|---|---|
| Q4_K_M | 1.04 GiB | 0.11 GiB | 2.15 GiB | fits | 146.8–293.6 estimated tokens/s |
| Q5_K_M | 1.20 GiB | 0.11 GiB | 2.31 GiB | fits | 127.6–255.2 estimated tokens/s |
| Q8_0 | 1.76 GiB | 0.11 GiB | 2.87 GiB | fits | 86.6–173.1 estimated tokens/s |
| FP16 | 3.32 GiB | 0.11 GiB | 4.43 GiB | fits | 46.1–92.1 estimated tokens/s |
What changes with a longer context?
| Context tokens | Estimated KV | Estimated total | Fit |
|---|---|---|---|
| 2,048 | 0.05 GiB | 2.10 GiB | fits |
| 4,096 | 0.11 GiB | 2.15 GiB | fits |
| 8,192 | 0.22 GiB | 2.26 GiB | fits |
| 16,384 | 0.44 GiB | 2.48 GiB | fits |
| 32,768 | 0.88 GiB | 2.92 GiB | fits |
The formula for this estimate.
Weights GiB = exact recorded file bytes / 2^30. KV GiB = 2 × layers × KV heads × head dimension × context × KV bytes / 2^30. Required GiB = weights + KV + runtime overhead. Usable GiB = device GiB × usable fraction. Estimated decode tokens/s = bandwidth GB/s × 10^9 / (active parameters B × 10^9 × effective bytes per weight) × efficiency. Effective bytes per weight = file bytes / (total parameters B × 10^9). Selected efficiency = 0.6; sensitivity uses 0.4–0.8.
Assumptions and limitations
- Memory values labeled GB in the data contract are GiB (2^30 bytes); bandwidth uses decimal GB/s (10^9 bytes/s).
- The memory budget reserves 25.0% of device memory. Runtime overhead is an assumed 1 GiB.
- KV cache assumes 2 bytes per element, independently of weight quantization. Runtime cache layout and allocation can add memory.
- Memory fit does not establish runtime, driver, operating-system, architecture, or quantization support.
- All speed values are estimated single-stream decode proxies, not benchmarks. Prefill, batching, latency, and concurrent sessions are not predicted.
- Estimated speed sensitivity is not a confidence interval; actual speed can fall outside the range because of compute, cache traffic, kernels, thermal limits, and other workloads.
- Effective bytes per weight is the exact file-size / total-parameter proxy. Metadata, tensors with different precision, padding, and duplicated tensors make it different from nominal quantization bits.
Source records
Official model metadata · Exact weight files · Maker hardware specifications
Model verified 2026-10-22; hardware verified 2026-10-22. This is an estimated memory and bandwidth calculation, not a hands-on benchmark.