Model field guide

Qwen3-8B

42 of 44 hardware configurations have a supported memory fit at one or more recorded quantizations. Runtime compatibility still needs verification.

Total parameters8.19B
Active parameters8.19B
Recorded context limit40,960
Architecturedense
Customize the estimate ↗Official model record

Verified 2026-10-22 · license metadata: apache-2.0 · commercial use: yes (review the terms).

Actual files, not a size shortcut.

Recorded complete GGUF file sets
QuantizationTotal file sizeSource
Q4_K_M4.682 GiB5,027,783,488 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22
Q5_K_M5.449 GiB5,851,112,224 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22
Q8_08.111 GiB8,709,518,112 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight.Pinned file recordVerified 2026-10-22

The hardware picture.

Q4_K_M: hardware comparison
Qwen3-8B · Q4_K_M · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB6.24 GiBfits12.2–24.3 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB6.24 GiBfits13.5–27.0 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB6.24 GiBfits13.5–27.0 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB6.24 GiBfits24.4–48.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB6.24 GiBfits24.4–48.8 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB6.24 GiBfits24.4–48.8 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB6.24 GiBfits36.6–73.2 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB6.24 GiBfits48.8–97.7 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB6.24 GiBfits48.8–97.7 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB6.24 GiBfits95.5–190.9 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB6.24 GiBfits95.5–190.9 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB6.24 GiBfits95.5–190.9 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB6.24 GiBfits12.2–24.3 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB6.24 GiBfits24.4–48.8 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB6.24 GiBfits48.8–97.7 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB6.24 GiBfits9.5–19.1 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB6.24 GiBfits9.5–19.1 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB6.24 GiBfits9.5–19.1 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB6.24 GiBfits21.7–43.4 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB6.24 GiBfits21.7–43.4 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB6.24 GiBfits21.7–43.4 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB6.24 GiBfits32.6–65.2 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB6.24 GiBfits43.4–86.9 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB6.24 GiBfits43.4–86.9 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB6.24 GiBfits65.2–130.3 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB6.24 GiBfits65.2–130.3 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB6.24 GiBfits28.6–57.3 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB6.24 GiBfits74.5–148.9 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB6.24 GiBfits22.9–45.8 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB6.24 GiBfits40.1–80.2 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB6.24 GiBfits57.0–114.1 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB6.24 GiBfits80.2–160.4 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB6.24 GiBfits35.6–71.3 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB6.24 GiBfits53.5–106.9 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB6.24 GiBfits71.3–142.6 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB6.24 GiBfits76.4–152.8 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB6.24 GiBfits142.6–285.1 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB6.24 GiBfits142.6–285.1 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB6.24 GiBfits76.4–152.8 estimated tokens/s
Intel Arc B580 12GB10.8 GiB6.24 GiBfits36.3–72.6 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB6.24 GiBfits20.4–40.7 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB6.24 GiBfits21.7–43.4 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB6.24 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB6.24 GiBNeeds verificationEstimated speed unavailable
Q5_K_M: hardware comparison
Qwen3-8B · Q5_K_M · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB7.01 GiBfits10.5–20.9 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB7.01 GiBfits11.6–23.2 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB7.01 GiBfits11.6–23.2 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB7.01 GiBfits21.0–42.0 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB7.01 GiBfits21.0–42.0 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB7.01 GiBfits21.0–42.0 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB7.01 GiBfits31.4–62.9 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB7.01 GiBfits42.0–83.9 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB7.01 GiBfits42.0–83.9 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB7.01 GiBfits82.0–164.1 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB7.01 GiBfits82.0–164.1 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB7.01 GiBfits82.0–164.1 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB7.01 GiBfits10.5–20.9 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB7.01 GiBfits21.0–42.0 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB7.01 GiBfits42.0–83.9 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB7.01 GiBfits8.2–16.4 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB7.01 GiBfits8.2–16.4 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB7.01 GiBfits8.2–16.4 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB7.01 GiBfits18.7–37.3 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB7.01 GiBfits18.7–37.3 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB7.01 GiBfits18.7–37.3 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB7.01 GiBfits28.0–56.1 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB7.01 GiBfits37.3–74.7 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB7.01 GiBfits37.3–74.7 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB7.01 GiBfits56.0–112.0 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB7.01 GiBfits56.0–112.0 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB7.01 GiBfits24.6–49.2 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB7.01 GiBfits64.0–128.0 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB7.01 GiBfits19.7–39.4 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB7.01 GiBfits34.5–68.9 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB7.01 GiBfits49.0–98.0 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB7.01 GiBfits68.9–137.8 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB7.01 GiBfits30.6–61.3 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB7.01 GiBfits45.9–91.9 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB7.01 GiBfits61.3–122.5 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB7.01 GiBfits65.6–131.3 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB7.01 GiBfits122.5–245.0 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB7.01 GiBfits122.5–245.0 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB7.01 GiBfits65.6–131.3 estimated tokens/s
Intel Arc B580 12GB10.8 GiB7.01 GiBfits31.2–62.3 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB7.01 GiBfits17.5–35.0 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB7.01 GiBfits18.7–37.3 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB7.01 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB7.01 GiBNeeds verificationEstimated speed unavailable
Q8_0: hardware comparison
Qwen3-8B · Q8_0 · default context up to 4,096 tokens · estimated fit and speed
HardwareUsable memoryRequired memoryFit estimateEstimated generation
Mac mini M6 (12-core GPU) 16GB12.0 GiB9.67 GiBfits7.0–14.1 estimated tokens/s
Mac mini M6 (12-core GPU) 24GB18.0 GiB9.67 GiBfits7.8–15.6 estimated tokens/s
Mac mini M6 (12-core GPU) 32GB24.0 GiB9.67 GiBfits7.8–15.6 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB18.0 GiB9.67 GiBfits14.1–28.2 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB36.0 GiB9.67 GiBfits14.1–28.2 estimated tokens/s
Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB48.0 GiB9.67 GiBfits14.1–28.2 estimated tokens/s
Mac Studio M5 Max (32-core GPU) 36GB27.0 GiB9.67 GiBfits21.1–42.3 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 64GB48.0 GiB9.67 GiBfits28.2–56.4 estimated tokens/s
Mac Studio M5 Max (40-core GPU) 128GB96.0 GiB9.67 GiBfits28.2–56.4 estimated tokens/s
Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB72.0 GiB9.67 GiBfits55.1–110.2 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB192.0 GiB9.67 GiBfits55.1–110.2 estimated tokens/s
Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB384.0 GiB9.67 GiBfits55.1–110.2 estimated tokens/s
MacBook Pro 14-inch M5 (10-core GPU) 24GB18.0 GiB9.67 GiBfits7.0–14.1 estimated tokens/s
MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB36.0 GiB9.67 GiBfits14.1–28.2 estimated tokens/s
MacBook Pro 16-inch M5 Max (40-core GPU) 128GB96.0 GiB9.67 GiBfits28.2–56.4 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 16GB12.0 GiB9.67 GiBfits5.5–11.0 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 24GB18.0 GiB9.67 GiBfits5.5–11.0 estimated tokens/s
Mac mini (2024) M4 (10-core GPU) 32GB24.0 GiB9.67 GiBfits5.5–11.0 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 24GB18.0 GiB9.67 GiBfits12.5–25.1 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 48GB36.0 GiB9.67 GiBfits12.5–25.1 estimated tokens/s
Mac mini (2024) M4 Pro (16-core GPU) 64GB48.0 GiB9.67 GiBfits12.5–25.1 estimated tokens/s
Mac Studio (2025) M4 Max (32-core GPU) 36GB27.0 GiB9.67 GiBfits18.8–37.7 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 64GB48.0 GiB9.67 GiBfits25.1–50.2 estimated tokens/s
Mac Studio (2025) M4 Max (40-core GPU) 128GB96.0 GiB9.67 GiBfits25.1–50.2 estimated tokens/s
Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB72.0 GiB9.67 GiBfits37.6–75.2 estimated tokens/s
Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB192.0 GiB9.67 GiBfits37.6–75.2 estimated tokens/s
NVIDIA GeForce RTX 3060 12GB10.8 GiB9.67 GiBfits16.5–33.1 estimated tokens/s
NVIDIA GeForce RTX 3090 24GB21.6 GiB9.67 GiBfits43.0–86.0 estimated tokens/s
NVIDIA GeForce RTX 4060 Ti 16GB14.4 GiB9.67 GiBfits13.2–26.5 estimated tokens/s
NVIDIA GeForce RTX 4070 12GB GDDR6X10.8 GiB9.67 GiBfits23.1–46.3 estimated tokens/s
NVIDIA GeForce RTX 4080 16GB14.4 GiB9.67 GiBfits32.9–65.8 estimated tokens/s
NVIDIA GeForce RTX 4090 24GB21.6 GiB9.67 GiBfits46.3–92.6 estimated tokens/s
NVIDIA GeForce RTX 5060 Ti 16GB14.4 GiB9.67 GiBfits20.6–41.2 estimated tokens/s
NVIDIA GeForce RTX 5070 12GB10.8 GiB9.67 GiBfits30.9–61.7 estimated tokens/s
NVIDIA GeForce RTX 5070 Ti 16GB14.4 GiB9.67 GiBfits41.2–82.3 estimated tokens/s
NVIDIA GeForce RTX 5080 16GB14.4 GiB9.67 GiBfits44.1–88.2 estimated tokens/s
NVIDIA GeForce RTX 5090 32GB28.8 GiB9.67 GiBfits82.3–164.6 estimated tokens/s
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB86.4 GiB9.67 GiBfits82.3–164.6 estimated tokens/s
NVIDIA RTX 6000 Ada Generation 48GB43.2 GiB9.67 GiBfits44.1–88.2 estimated tokens/s
Intel Arc B580 12GB10.8 GiB9.67 GiBfits20.9–41.9 estimated tokens/s
AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB89.6 GiB9.67 GiBfits11.8–23.5 estimated tokens/s
NVIDIA DGX Spark 128GB / 4TB96.0 GiB9.67 GiBfits12.5–25.1 estimated tokens/s
2 × GeForce RTX 3090 24GB (conditional 48GB aggregate)40.8 GiB9.67 GiBNeeds verificationEstimated speed unavailable
2 × GeForce RTX 5090 32GB (conditional 64GB aggregate)54.4 GiB9.67 GiBNeeds verificationEstimated speed unavailable
A “fits” result checks estimated memory only. “Needs verification” preserves missing cache, vision, or placement information. All speed figures are estimated from the published bandwidth formula.
Field-level sources and verification dates