Model field guide

DeepSeek-R1-Distill-Qwen-1.5B

42 of 44 hardware configurations have a supported memory fit at one or more recorded quantizations. Runtime compatibility still needs verification.

Total parameters1.78B
Active parameters1.78B
Recorded context limit131,072
Architecturedense
Customize the estimate ↗Official model record

Verified 2026-10-22 · license metadata: mit · commercial use: yes (review the terms).

Actual files, not a size shortcut.

Recorded complete GGUF file sets
QuantizationTotal file sizeSource
Q4_K_M1.041 GiB1,117,321,312 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22
Q5_K_M1.197 GiB1,285,494,880 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22
Q8_01.764 GiB1,894,532,416 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22

The hardware picture.

Q4_K_M: hardware comparison
DeepSeek-R1-Distill-Qwen-1.5B · Q4_K_M · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB2.15 GiBfits54.8–109.5 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB2.15 GiBfits60.9–121.7 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB2.15 GiBfits60.9–121.7 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB2.15 GiBfits109.9–219.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB2.15 GiBfits109.9–219.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB2.15 GiBfits109.9–219.8 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB2.15 GiBfits164.7–329.4 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB2.15 GiBfits219.8–439.6 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB2.15 GiBfits219.8–439.6 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB2.15 GiBfits429.6–859.2 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB2.15 GiBfits429.6–859.2 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB2.15 GiBfits429.6–859.2 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB2.15 GiBfits54.8–109.5 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB2.15 GiBfits109.9–219.8 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB2.15 GiBfits219.8–439.6 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB2.15 GiBfits43.0–85.9 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB2.15 GiBfits43.0–85.9 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB2.15 GiBfits43.0–85.9 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB2.15 GiBfits97.7–195.5 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB2.15 GiBfits97.7–195.5 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB2.15 GiBfits97.7–195.5 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB2.15 GiBfits146.8–293.6 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB2.15 GiBfits195.5–390.9 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB2.15 GiBfits195.5–390.9 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB2.15 GiBfits293.2–586.4 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB2.15 GiBfits293.2–586.4 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB2.15 GiBfits128.9–257.8 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB2.15 GiBfits335.1–670.2 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB2.15 GiBfits103.1–206.2 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB2.15 GiBfits180.4–360.9 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB2.15 GiBfits256.6–513.2 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB2.15 GiBfits360.9–721.7 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB2.15 GiBfits160.4–320.8 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB2.15 GiBfits240.6–481.2 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB2.15 GiBfits320.8–641.5 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB2.15 GiBfits343.7–687.4 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB2.15 GiBfits641.5–1283.1 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB2.15 GiBfits641.5–1283.1 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB2.15 GiBfits343.7–687.4 estimated tokens/s
Intel Arc B580 12GB10.8 GiB2.15 GiBfits163.2–326.5 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB2.15 GiBfits91.6–183.3 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB2.15 GiBfits97.7–195.5 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB2.15 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB2.15 GiBNeeds verificationEstimated speed unavailable
Q5_K_M: hardware comparison
DeepSeek-R1-Distill-Qwen-1.5B · Q5_K_M · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB2.31 GiBfits47.6–95.2 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB2.31 GiBfits52.9–105.8 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB2.31 GiBfits52.9–105.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB2.31 GiBfits95.5–191.1 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB2.31 GiBfits95.5–191.1 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB2.31 GiBfits95.5–191.1 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB2.31 GiBfits143.1–286.3 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB2.31 GiBfits191.1–382.1 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB2.31 GiBfits191.1–382.1 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB2.31 GiBfits373.4–746.8 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB2.31 GiBfits373.4–746.8 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB2.31 GiBfits373.4–746.8 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB2.31 GiBfits47.6–95.2 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB2.31 GiBfits95.5–191.1 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB2.31 GiBfits191.1–382.1 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB2.31 GiBfits37.3–74.7 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB2.31 GiBfits37.3–74.7 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB2.31 GiBfits37.3–74.7 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB2.31 GiBfits84.9–169.9 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB2.31 GiBfits84.9–169.9 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB2.31 GiBfits84.9–169.9 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB2.31 GiBfits127.6–255.2 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB2.31 GiBfits169.9–339.8 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB2.31 GiBfits169.9–339.8 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB2.31 GiBfits254.8–509.7 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB2.31 GiBfits254.8–509.7 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB2.31 GiBfits112.0–224.0 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB2.31 GiBfits291.2–582.5 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB2.31 GiBfits89.6–179.2 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB2.31 GiBfits156.8–313.7 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB2.31 GiBfits223.0–446.1 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB2.31 GiBfits313.7–627.3 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB2.31 GiBfits139.4–278.8 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB2.31 GiBfits209.1–418.2 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB2.31 GiBfits278.8–557.6 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB2.31 GiBfits298.7–597.4 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB2.31 GiBfits557.6–1115.2 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB2.31 GiBfits557.6–1115.2 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB2.31 GiBfits298.7–597.4 estimated tokens/s
Intel Arc B580 12GB10.8 GiB2.31 GiBfits141.9–283.8 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB2.31 GiBfits79.7–159.3 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB2.31 GiBfits84.9–169.9 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB2.31 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB2.31 GiBNeeds verificationEstimated speed unavailable
Q8_0: hardware comparison
DeepSeek-R1-Distill-Qwen-1.5B · Q8_0 · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB2.87 GiBfits32.3–64.6 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB2.87 GiBfits35.9–71.8 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB2.87 GiBfits35.9–71.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB2.87 GiBfits64.8–129.6 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB2.87 GiBfits64.8–129.6 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB2.87 GiBfits64.8–129.6 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB2.87 GiBfits97.1–194.2 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB2.87 GiBfits129.6–259.3 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB2.87 GiBfits129.6–259.3 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB2.87 GiBfits253.4–506.7 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB2.87 GiBfits253.4–506.7 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB2.87 GiBfits253.4–506.7 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB2.87 GiBfits32.3–64.6 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB2.87 GiBfits64.8–129.6 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB2.87 GiBfits129.6–259.3 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB2.87 GiBfits25.3–50.7 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB2.87 GiBfits25.3–50.7 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB2.87 GiBfits25.3–50.7 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB2.87 GiBfits57.6–115.3 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB2.87 GiBfits57.6–115.3 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB2.87 GiBfits57.6–115.3 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB2.87 GiBfits86.6–173.1 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB2.87 GiBfits115.3–230.6 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB2.87 GiBfits115.3–230.6 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB2.87 GiBfits172.9–345.8 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB2.87 GiBfits172.9–345.8 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB2.87 GiBfits76.0–152.0 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB2.87 GiBfits197.6–395.2 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB2.87 GiBfits60.8–121.6 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB2.87 GiBfits106.4–212.8 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB2.87 GiBfits151.3–302.7 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB2.87 GiBfits212.8–425.6 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB2.87 GiBfits94.6–189.2 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB2.87 GiBfits141.9–283.8 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB2.87 GiBfits189.2–378.4 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB2.87 GiBfits202.7–405.4 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB2.87 GiBfits378.4–756.7 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB2.87 GiBfits378.4–756.7 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB2.87 GiBfits202.7–405.4 estimated tokens/s
Intel Arc B580 12GB10.8 GiB2.87 GiBfits96.3–192.6 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB2.87 GiBfits54.1–108.1 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB2.87 GiBfits57.6–115.3 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB2.87 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB2.87 GiBNeeds verificationEstimated speed unavailable
A “fits” result checks estimated memory only. “Needs verification” preserves missing cache, vision, or placement information. All speed figures are estimated from the published bandwidth formula.
Field-level sources and verification dates