Skip to content
modelread
Ask
Browse
Devices
Connect
Docs
Methodology
Search
⌘K
My hardware
All
Loading devices…
System RAM / unified memory override
GB
Remembered on this device. Multi-GPU: search “2x”, “8x”, “node”.
Ask
Browse
Devices
Connect
Docs
Methodology
On your hardware
Search models, devices and pages
Type a model or device name.
Pages
Ask
what should I run?
Browse
best models per device
Devices
all hardware
Connect your agent
MCP · API
How the numbers work
calibration
Models
/
ornith-ai
ornith-ai/Ornith-1.5-35B-A3B-FP8
Hugging Face
36B params · MoE 256 experts, top-8
Qwen3_5MoeForConditionalGeneration
text-generation
mit
256K trained context
36.7 GiB repo
RTX 3060 12GB
✕
Won't fit
COMPRESSED-TENSORS
RTX 4060 Ti 16GB
⇅
Offload
COMPRESSED-TENSORS
26.6 tok/s
RTX 4090 24GB
⇅
Offload
COMPRESSED-TENSORS
48.3 tok/s
RTX 5090 32GB
⇅
Offload
COMPRESSED-TENSORS
86.2 tok/s
2x RTX 3090 (48GB)
✓
Fits
COMPRESSED-TENSORS
117 tok/s
Radeon RX 7900 XTX 24GB
⇅
Offload
COMPRESSED-TENSORS
38.2 tok/s
Apple M4 32GB
✕
Won't fit
COMPRESSED-TENSORS
Apple M4 Pro 48GB
◐
Tight fit
COMPRESSED-TENSORS
34.6 tok/s
Apple M4 Max 128GB
✓
Fits
COMPRESSED-TENSORS
59.9 tok/s
Apple M3 Ultra 512GB
✓
Fits
COMPRESSED-TENSORS
79.9 tok/s
NVIDIA DGX Spark (GB10) 128GB
✓
Fits
COMPRESSED-TENSORS
44.4 tok/s
AMD Ryzen AI Max+ 395 128GB
✓
Fits
COMPRESSED-TENSORS
26.7 tok/s
H100 80GB SXM
✓
Fits
COMPRESSED-TENSORS
246 tok/s
NVIDIA DGX/HGX H100 8x80GB (640GB)
✓
Fits
COMPRESSED-TENSORS
246 tok/s
Apple iPhone 17 Pro / Pro Max (A19 Pro) 12GB
✕
Won't fit
COMPRESSED-TENSORS
Samsung Galaxy S25 Ultra (Snapdragon 8 Elite) 12GB
✕
Won't fit
COMPRESSED-TENSORS
Raspberry Pi 5 16GB
✕
Won't fit
COMPRESSED-TENSORS
NVIDIA Jetson AGX Thor 128GB
✓
Fits
COMPRESSED-TENSORS
22.1 tok/s
My hardware
All
Loading devices…
System RAM / unified memory override
GB
Remembered on this device. Multi-GPU: search “2x”, “8x”, “node”.
Context
4K
8K
16K
32K
64K
128K
256K
1M
KV cache
f16
q8_0
q4_0