Model field guide

Qwen3-0.6B

42 of 44 hardware configurations have a supported memory fit at one or more recorded quantizations. Runtime compatibility still needs verification.

Total parameters0.75B
Active parameters0.75B
Recorded context limit40,960
Architecturedense
Customize the estimate ↗Official model record

Verified 2026-10-22 · license metadata: apache-2.0 · commercial use: yes (review the terms).

Actual files, not a size shortcut.

Recorded complete GGUF file sets
QuantizationTotal file sizeSource
Q8_00.596 GiB639,446,688 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22
Q4_K_M0.369 GiB396,705,472 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22
Q5_K_M0.414 GiB444,415,680 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22

The hardware picture.

Q8_0: hardware comparison
Qwen3-0.6B · Q8_0 · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB2.03 GiBfits95.7–191.4 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB2.03 GiBfits106.3–212.7 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB2.03 GiBfits106.3–212.7 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB2.03 GiBfits192.0–384.1 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB2.03 GiBfits192.0–384.1 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB2.03 GiBfits192.0–384.1 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB2.03 GiBfits287.7–575.5 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB2.03 GiBfits384.1–768.2 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB2.03 GiBfits384.1–768.2 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB2.03 GiBfits750.6–1501.3 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB2.03 GiBfits750.6–1501.3 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB2.03 GiBfits750.6–1501.3 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB2.03 GiBfits95.7–191.4 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB2.03 GiBfits192.0–384.1 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB2.03 GiBfits384.1–768.2 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB2.03 GiBfits75.1–150.1 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB2.03 GiBfits75.1–150.1 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB2.03 GiBfits75.1–150.1 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB2.03 GiBfits170.8–341.5 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB2.03 GiBfits170.8–341.5 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB2.03 GiBfits170.8–341.5 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB2.03 GiBfits256.5–512.9 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB2.03 GiBfits341.5–683.1 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB2.03 GiBfits341.5–683.1 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB2.03 GiBfits512.3–1024.6 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB2.03 GiBfits512.3–1024.6 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB2.03 GiBfits225.2–450.4 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB2.03 GiBfits585.5–1171.0 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB2.03 GiBfits180.2–360.3 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB2.03 GiBfits315.3–630.5 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB2.03 GiBfits448.4–896.8 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB2.03 GiBfits630.5–1261.1 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB2.03 GiBfits280.2–560.5 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB2.03 GiBfits420.4–840.7 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB2.03 GiBfits560.5–1121.0 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB2.03 GiBfits600.5–1201.0 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB2.03 GiBfits1121.0–2241.9 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB2.03 GiBfits1121.0–2241.9 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB2.03 GiBfits600.5–1201.0 estimated tokens/s
Intel Arc B580 12GB10.8 GiB2.03 GiBfits285.2–570.5 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB2.03 GiBfits160.1–320.3 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB2.03 GiBfits170.8–341.5 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB2.03 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB2.03 GiBNeeds verificationEstimated speed unavailable
Q4_K_M: hardware comparison
Qwen3-0.6B · Q4_K_M · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB1.81 GiBfits154.3–308.5 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB1.81 GiBfits171.4–342.8 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB1.81 GiBfits171.4–342.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB1.81 GiBfits309.5–619.1 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB1.81 GiBfits309.5–619.1 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB1.81 GiBfits309.5–619.1 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB1.81 GiBfits463.8–927.6 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB1.81 GiBfits619.1–1238.2 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB1.81 GiBfits619.1–1238.2 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB1.81 GiBfits1210.0–2419.9 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB1.81 GiBfits1210.0–2419.9 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB1.81 GiBfits1210.0–2419.9 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB1.81 GiBfits154.3–308.5 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB1.81 GiBfits309.5–619.1 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB1.81 GiBfits619.1–1238.2 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB1.81 GiBfits121.0–242.0 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB1.81 GiBfits121.0–242.0 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB1.81 GiBfits121.0–242.0 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB1.81 GiBfits275.3–550.5 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB1.81 GiBfits275.3–550.5 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB1.81 GiBfits275.3–550.5 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB1.81 GiBfits413.4–826.8 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB1.81 GiBfits550.5–1101.1 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB1.81 GiBfits550.5–1101.1 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB1.81 GiBfits825.8–1651.6 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB1.81 GiBfits825.8–1651.6 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB1.81 GiBfits363.0–726.0 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB1.81 GiBfits943.8–1887.5 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB1.81 GiBfits290.4–580.8 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB1.81 GiBfits508.2–1016.4 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB1.81 GiBfits722.8–1445.5 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB1.81 GiBfits1016.4–2032.7 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB1.81 GiBfits451.7–903.4 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB1.81 GiBfits677.6–1355.2 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB1.81 GiBfits903.4–1806.9 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB1.81 GiBfits968.0–1935.9 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB1.81 GiBfits1806.9–3613.8 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB1.81 GiBfits1806.9–3613.8 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB1.81 GiBfits968.0–1935.9 estimated tokens/s
Intel Arc B580 12GB10.8 GiB1.81 GiBfits459.8–919.6 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB1.81 GiBfits258.1–516.3 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB1.81 GiBfits275.3–550.5 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB1.81 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB1.81 GiBNeeds verificationEstimated speed unavailable
Q5_K_M: hardware comparison
Qwen3-0.6B · Q5_K_M · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB1.85 GiBfits137.7–275.4 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB1.85 GiBfits153.0–306.0 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB1.85 GiBfits153.0–306.0 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB1.85 GiBfits276.3–552.6 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB1.85 GiBfits276.3–552.6 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB1.85 GiBfits276.3–552.6 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB1.85 GiBfits414.0–828.1 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB1.85 GiBfits552.6–1105.3 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB1.85 GiBfits552.6–1105.3 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB1.85 GiBfits1080.1–2160.1 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB1.85 GiBfits1080.1–2160.1 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB1.85 GiBfits1080.1–2160.1 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB1.85 GiBfits137.7–275.4 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB1.85 GiBfits276.3–552.6 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB1.85 GiBfits552.6–1105.3 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB1.85 GiBfits108.0–216.0 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB1.85 GiBfits108.0–216.0 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB1.85 GiBfits108.0–216.0 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB1.85 GiBfits245.7–491.4 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB1.85 GiBfits245.7–491.4 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB1.85 GiBfits245.7–491.4 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB1.85 GiBfits369.0–738.0 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB1.85 GiBfits491.4–982.9 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB1.85 GiBfits491.4–982.9 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB1.85 GiBfits737.1–1474.3 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB1.85 GiBfits737.1–1474.3 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB1.85 GiBfits324.0–648.0 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB1.85 GiBfits842.5–1684.9 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB1.85 GiBfits259.2–518.4 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB1.85 GiBfits453.6–907.3 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB1.85 GiBfits645.2–1290.3 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB1.85 GiBfits907.3–1814.5 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB1.85 GiBfits403.2–806.5 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB1.85 GiBfits604.8–1209.7 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB1.85 GiBfits806.5–1612.9 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB1.85 GiBfits864.1–1728.1 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB1.85 GiBfits1612.9–3225.8 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB1.85 GiBfits1612.9–3225.8 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB1.85 GiBfits864.1–1728.1 estimated tokens/s
Intel Arc B580 12GB10.8 GiB1.85 GiBfits410.4–820.9 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB1.85 GiBfits230.4–460.8 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB1.85 GiBfits245.7–491.4 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB1.85 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB1.85 GiBNeeds verificationEstimated speed unavailable
A “fits” result checks estimated memory only. “Needs verification” preserves missing cache, vision, or placement information. All speed figures are estimated from the published bandwidth formula.
Field-level sources and verification dates